CN102970286B - Automatic speech and multimedia information communication middleware system - Google Patents
Automatic speech and multimedia information communication middleware system Download PDFInfo
- Publication number
- CN102970286B CN102970286B CN201210442633.9A CN201210442633A CN102970286B CN 102970286 B CN102970286 B CN 102970286B CN 201210442633 A CN201210442633 A CN 201210442633A CN 102970286 B CN102970286 B CN 102970286B
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- communication
- interface
- middleware
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention relates to a kind of automatic speech and multimedia information communication middleware system.The server of system includes hardware structure and software architecture.Described server and each operation system of customer side carry out data interaction by interface protocol, constitute the system architecture of loose coupling.The module of all layers in software architecture realizes high Aggregation computation by height encapsulation loose coupling in allowing dynamic load and unloading, layer.The mode that this middleware system processes with telecommunications computer automation instead of old manual type, solve the current domestic medium-sized and small enterprises unicity at the working forms of the aspects such as externally notice, customer information inquiry, notice scheduling, improve the artificial flow process of current poor efficiency, it is to avoid the high fault under artificial treatment environment.
Description
Technical field
The present invention relates to a kind of multimedia messages being automatically controlled by a computer notice interactive system, particularly relate to
And a kind of automatic speech and multimedia information communication middleware system.
Background technology
Along with the rise of ecommerce in recent years, and the Internet, communication terminal is universal, increasingly
Many people select to carry out e-commerce initiative on the internet, and the logistics transportation that huge trading volume makes etc. is correlated with
The production load of supporting traditional industries is increasing, is especially embodied in this one side of customer service,
Along with portfolio explosive growth, the service such as corresponding customer notification, business consultation, inquiry
Activity also first mate increases, and this bears pressure far beyond the customer service of existing most logistics company.Old
The information communication AC mode that some poor efficiencys are single the most increasingly can not meet the hugest service system
Demand, the mode of communication be also badly in need of from original one to one, the mode of word or audio frequency is upgraded to current one
To many, multi-to-multi, the multimedia messages mixed model such as word, image, audio frequency, video.Increasingly
Many enterprises need with mode convenient, rapid, timely, efficient come process for producing, service, the stream such as management
The information communication of journey is mutual.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of automatic speech and multimedia information communication middleware
System, can for enterprise provide verbal announcement, Interactive Voice Response, audio/video conference, short message up-downgoing,
Multimedia messages shares a series of functions such as broadcast, and the mode of separate server is at Intranet environment
Middle operation, this system can be the inquiring about external information notice issue, customer self-service of enterprise, and internal training is linked up
Exchange provides abundant polymorphic mode and approach.It has extension expansion flexibly, can be with corporate client
Operation system slitless connection, by the configuration feature of this platform, corporate client can be the most reasonably to various
Information carries out flexible dispatching use so that it is be the support work of the Information application performance maximum of corporate client jointly
With.This system can also integrate client's existing telecom hardware line resource, by configuration path, intelligence
The execution passage of selection information, makes the existing line resource of client not waste, does not loses, it is to avoid overlapping investment,
Reach the maximization effect that resource distribution utilizes.
For solving above-mentioned technical problem, the present invention provides a kind of automatic speech and multimedia information communication middleware
System, be placed in Intranet including one run independent, inside fire wall, pass through ether
Network and each operation system of enterprise carry out outside data interaction, fire wall then by the Internet or Leased line with
Each operator basis line resource or intermediary service gateway carry out the hardware server of data communication.Described service
Device includes main by data collection, data encoding Transpression, data transmission, hardware driving, Control on Communication
The configuration of protocol realization, service logic, the hardware structure of data memory module composition and mainly by hardware driving,
Communication protocol control, business logic processing, data converting transmission, data acquisition feedback, charging process, answer
By development interface, the software architecture of system operation monitoring layer composition.Described server and customer side each business system
System carries out data interaction by interface protocol, constitutes the system architecture of loose coupling.Institute in software architecture
The module having layer realizes height by height encapsulation loose coupling in allowing dynamic load and unloading, layer and assembles meter
Calculate, and retrain respective category of behavior by set interface；Top layer system is according to every business configuration model
Combine the functional interface called between each level one by one, form automatic workflow.
Every hardware driving system is carried out unified classification encapsulation by the Hardware drive module of described hardware structure,
To there is the hardware cell of same behavior attribute character, carry out more higher leveled encapsulation and integrate, generate a set of system
The hardware device drivers that can be attached the every hardware device resources in system flexibly driving of one is adjusted
Use framework.
The communications protocol gateway of described software architecture includes encapsulating note and the short message of multimedia message communication protocol
Gateway, it is achieved SS1, SS7, ISDN, the calling of pri signaling, there is media handling function, communication function
PSTN gateway, and be responsible for the system that realizes and Internet user and the data communication of 3G network users, realization
The Session Initiation Protocol gateway of the two-way communication of PSTN Yu INTERNET.Described Session Initiation Protocol gateway includes that RTP assists
View, H.323 agreement and the realization of S IP agreement.
The business logic processing layer of described software architecture includes involved by system by user configured rule
Each hierarchy module carry out concatenated call, service logic is run through be blended in each hierarchy module formation work
Make flow process and support that forward, reverse and two-way combination persistence are run user side logic realization and support number
According to collection, service billing, the system side logic realization of system snapshot.
The data transfer layer of described software architecture is responsible for being converted into initial data each business model needs
Standard, it is achieved data feedback layer collect the self-defining encapsulation format of client.Described data transfer layer
It is implemented in combination with the various document format datas required for various signaling with described base communications protocol gateway module
Conversion and process, compressed by the transformation of ownership, initial data be converted into the data form that each agreement specifies, enter
Row communication transfer；And the interim big quantity file data produced in user interaction process is carried out segmentation cutting,
Strange land preserves.
The data acquisition feedback layer of described software architecture devises different mould according to the behavior property of every business
The data acquisition webpage of formula, has the submission of information, controls, manages and the checking of result, leading of form
Go out, and interface issues function.The Web system of described data acquisition feedback layer additionally provides configurable power
Limit management, Web system authority be not by level limited irregularly shaped, be based entirely on actual demand from
Definition, all personalizable configuration managements of all functions.Issue function by described interface, can realize client
The support of the self-defining data bag form of side, custom system is capable of the data interaction with middleware system,
Middleware system can issue produced by custom system each constantly when the data link of data-pushing interface
Plant status information with object information to client-side system.
The system operation monitoring layer of described software architecture realizes physical memory monitoring, CPU usage monitoring, magnetic
The monitoring of disk space utilization rate, task averagely send duration monitoring, network condition monitoring and database monitoring.Institute
State system operation monitoring layer the ruuning situation of each operational module is monitored and operating state information acquisition,
By analytical data, forming curves figure.When the moving body collected is detectd beyond preset range, or produce event
During barrier, system operation monitoring layer can control middleware system and alert by different way.
The moving body that system operation monitoring layer is collected detects referred to system at each operational module of run duration
Desired value during operation, the operating index value of modules can be along with the load of operating system and process portfolio
Or the change of the load of handling capacity and be continually changing, and the long-time superelevation of operating index value is system malfunctions
Front sign.System operation monitoring layer monitors the desired value that total system is run constantly, when desired value value exceedes
During the alarming value arranged, system operation monitoring layer can trigger alarm module, report to the police.
The hardware server of middleware system is independent and other server；Hardware server is placed on enterprise
Internal network runs, inside fire wall, carries out data friendship by Ethernet and each operation system of enterprise
Mutually, then by the Internet or Leased line and each operator basis line resource or intermediary service outside fire wall
Gateway carries out data communication.Owing to using the framework of independent operating, so middleware system and each industry of customer side
Business system is to carry out data interaction by interface protocol, it is ensured that the independence of both sides' system and stability,
Constitute the system architecture of good loose coupling.
The hardware structure of middleware system mainly by data collection, data encoding Transpression, data transmission,
Hardware driving, communication control processor realize, service logic configures, data store this 7 unit modules compositions.
Being combined by the Connection between Processes of these 7 modules, various different business configuration can be become independent by middleware system
Work flow model carry out automatic streamline execution.
The software architecture of middleware system uses multi-layer framework mode development, including hardware driving, communication protocol
Control, business logic processing, data converting transmission, data acquisition feedback, charging process, application and development connect
Mouthful.All layers allow dynamic load and unloading, can realize Dynamic expansion and the switching at runtime of system easily；This
Middleware system reliability of operation, availability will be improved greatly with maintainable.Every in software architecture
Layer is all responsible for realizing respective logic affairs, realizes height by height encapsulation loose coupling and assemble meter in layer
Calculate, and retrain respective category of behavior by set interface.Top layer according to every business configuration model come by
The functional interface between each level is called in one combination, forms automatic workflow, thus reaches set purpose.
Be layered independent loose coupling structure system ensure that arbitrary level of system or the inefficacy of functional module all without
Cause the inefficacy of other functional modules.Random time increases/starts/stop arbitrary module, all it is not result in
Whole system or the exception of other modules.The dynamic renewal that each workflow is carried out by user, all without shadow
Ring the operation of other operation flow, also without interrupting service.
Every hardware cell equipment in middleware system, such as voice plate card, fax board, conference card,
The driving module of the unit such as video frequency collection card, VOIP data conversion card, by the numerous and diverse numerous driving body of each product man
System has carried out unified classification encapsulation.Hardware drive module will have the hardware list of same behavior attribute character
Unit, carries out more higher leveled encapsulation and integrates, thus generate a set of unified hardware device drivers invocation framenort,
Utilize this framework can be attached the every hardware device resources in system flexibly driving, adjust during operation
Whole, thus the most more flexible driving equipment is operated.
Communications protocol gateway includes short messaging gateway, PSTN gateway and S IP protocol gateway, possesses many nets, many
Ability, handling capacity that business processes simultaneously are big, disposal ability is strong, be the core of middleware system, tool
There is the function of all bottoms and operator's communication, as follows:
1. short messaging gateway encapsulates the CMPP communications protocol of movement, the SMGP communications protocol of UNICOM and telecommunications
SMGP communications protocol, MM7 multimedia message communication protocol, it is achieved the SMS/MMS of three big operators is accessed.
2.PSTN gateway achieves the SS1 of current main flow, SS7, ISDN, the calling of pri signaling, and relates to exhaling
Cry, data transmission, each flow process such as exchange/media handling, by the complicated signaling protocol envelope by height
Dress, make calls the simplest of change, only need to call one group of simple AP I function, just can complete each
Plant function.By the SOCKET packet interface of standard, other module of system arbitrarily can exchange with it data,
The information such as control command, event, PSTN gateway is responsible for realizing following functions:
1) media handling function: include all function (languages that Voice media processing is provided that in prior art
Sound recording playback, echo cancelltion, GTD/GTG, DTMF/FSK transmitting-receiving, Large Copacity meeting, sound specially good effect, FAX etc.).
2) communication function: include the support (SS1/DSS1/SS7/ISDN/PRI) of various signaling, it is provided that various
The support (Digital Access E1, analog junction/analog subscriber/high resistant/VoIP access etc.) of telecommunication interface.
3.VOI P SGW is responsible for the data communication of the system that realizes and Internet user with 3G network users, will
Traditional circuit switching is converted into IP exchange, and decoding PSTN voice signal is also converted into SIP bag, thus real
The two-way communication of existing PSTN Yu INTERNET.VOIP SGW includes the realization of three below sub-protocol:
1) realization of Real-time Transport Protocol:
(1) RTP/RTCP standard agreement (RFC3551/3552) is met；
(2) voice encoding and decoding format: G.711/A rule, G.723.1(5.3/6.3kbps self adaptation),
G.729A/B/AB；
(3) coding and decoding video form: H.263, H.263+, H.264, MPEG-4/V;
(4) movable voice detection/silence compression (G.723/G.729);
(5) comfort noise;
(6) facsimile mode: T.38/udptl fax and T.30 transparent transmission (G.711);
(7) voice packet sampling length/frame number is configurable (10-60 millisecond);
(8) RTP dynamic DTMF load (RFC2833/4733);
(9) jitter buffer: simultaneously support static buffering mode and dynamic self-adapting mode；
(10) network environment analysis, packet loss statistics；
(11) support the detection of NAT/ fire wall and penetrate.
2) realization of H.323 agreement
(1) ITU-T H.323v2 standard (H.225v2/H.245v3) is met；
(2) support that quickly starting (Fa s t S tar t), H.245 tunnel (H.245Tunne ling) etc. exhales
It is parameter；
(3) calling transfer；
(4) gatekeeper finds that H.323 (Ga tekeeper Auto Di s covery) and login (are supported simultaneously automatically
UI D and E164 number registration mode)；
(5) H.245 user inputs word and dtmf signal message (Us er I nput I ndi ca t i on)；
(6) endpoint registration management.
2) realization of S IP agreement
(1) IETF SIPv2 standard (RFC3261) is met；
(2) UDP/TCP transmission means；
(3) MD5(digest) authentication；
(4) REFER calling transfer (RFC3515)；
(5) S IP message subscribing/notifying (RFC3265SUBSCRIBE/NOTIFY)；
(6) proxy server registration, authenticated client；
(7) SIP INFO (RFC2976)；
(8) registrar (Registrar), support service end authentication
(9) NAT/ firewall penetrating is supported.
Business logic processing layer is divided into user side logic realization and system side logic realization two part.User patrols side
Collect and be responsible for realizing user configured service logic, by user configured rule by each layer involved by system
Level module carries out concatenated call, service logic is run through and is blended in each hierarchy module, forms workflow,
Supporting, forward, reverse and two-way combination persistence are run.Wherein,
1) forward part:
(1) voice group busy, facsimile cluster sending
(2) short message, multimedia message group sending
(3) S IP message multicasts
(4) IM information multicasts
2) the most partly:
(1) short message uplink receiving
(2) speech data receives
(4) the up inquiry of voice
(5) SIP, IM message sink
3) mutual part:
(1) voice, video conference
(2) short message up-downgoing business
(3) voice automatic-answering back device is mutual (IVR)
(4) PSTN+VOIP data communication
System side logic realization following functions:
1) data acquisition: include web data collection, interface data collection, data validity judges, DB
Mode data orientation acquisition etc..
2) service billing: the charging constantly of miscellaneous service, as short message presses bar charging, multimedia message byte charging,
Voice duration based accounting, IM service traffics charging.
3) system snapshot: the trip information of each module of dynamic collection system, by analyzing, formulates optimum
Implement plan, according to collect runtime system each unit load condition do dynamic adjustable strategies: in system
Relatively busy, uses amount of calculation less but has the strategy of enough accuracy to ensure the response speed of system；It is being
Unite not busy, use the higher implementation strategy of precision, ensure the execution result efficiency of system:
(1) every 1 hour, the running status snapshot of unit modules the most at different levels is generated, for O&M analysis.
(2) runtime data and historical data divide example to run, and creation data one has run, at once from life
Product table is transferred to history lists, so can ensure the high efficiency of production table, it is ensured that not to production system during big quantity
Cause accumulation, affect production system execution efficiency.Independent query case and running environment also ensure that to be entered
During row extensive historical data report statistics, the overall performance of production system is not lost.
(3) dynamic registration debugging when supporting to run, it is provided that command line interface, carries out order control for operation maintenance personnel
System output, the run time behaviour output of system following several respects of support:
A. the packet during protocol prints
B. the unexpected message in gateway running prints
C. the dynamic state of parameters in gateway running adjusts
D. database session process tracking output (output of Oracle 10046 event)
E. database session statement execution plan output
Data transfer layer receives the data that data acquisition module produces, and initial data is converted into each business
The standard that model needs, calls for modules in workflow.It is responsible for realizing data feedback module to receive simultaneously
Collection the self-defining encapsulation format of client, for data feedback module carry out result web present, report output with
Interface pushes.
Data transfer layer is combined with base communications protocol gateway module to be responsible for realizing required for various signaling
Data form, data packet format, audio frequency and video form, fax paper form conversion with process, pass through the transformation of ownership
Compression, changes initial data the data form that each agreement specifies, carries out communication transfer, by mutual for user mistake
The interim big quantity file data produced in journey, such as: leave a message file, session recording file of user is carried out point
Section cutting, strange land preserves.
1) data conversion:
(1) audio coding decoding: sample rate: 6K/8KHZ coded system: A rule/μ rule PCM, AMI-ADPCM,
G729, G723.1 etc..
(2) coding and decoding video: support MPEG4, H.263/H.264 etc.
(3) media file format: support 3GP, AVI, MPEG4, WAVE, PCM, ADPCM, VOX, MP3
Deng
2) big data quantity transmission: large data files carries out height ratio and integrates compression, uses external advanced pressure
Compression algorithm, improves to figure under traditional mode, and the situation that the compression factor such as voice document is low, new algorithm can
In the case of ensureing compression quality, compression ratio is promoted to 30%-40% by 10%-20%.Segment transmissions,
It is the most complete, with traditional wall scroll serial transmission phase that the application of the technology such as breakpoint transmission ensure that in terms of transmission
Ratio, new architecture mode can promote the transfer rate of more than 5 times, the monofile transmission capacity of more than 3 times.
(1) data height ratio compression
(2) segment transmissions
(3) breakpoint transmission
(4) service end forwards, broadcasts
(5) point-to-point direct sending
User can carry out the input of data by the web interface that the data acquisition feedback layer of middleware system provides
Output, the data acquisition feedback layer of middleware system, according to the behavior property of every business, devises different mould
The data acquisition webpage of formula, user can realize the submission of information, control by logging in the platform of middleware system
Checking of system, management and result, the derivation of form etc. operates.Data acquisition feedback layer additionally provides can join
The rights management put: all functions all personalizable configuration managements, System Privileges is by traditional inverted pyramid knot
Structure upgrade to not by level limited irregularly shaped, be based entirely on actual demand come self-defined.
The platform of middleware system provides the application and development interface of all functions, it is provided that SMS, CTI, ACD,
Voice/Faxmail IVR, IM etc. is powerful, be easy to the DLL of exploitation, has good opening
Property.Language aspect supports the mainstream speeches such as VC++, C#, Java, VB, Powerbuilder, Delphi,
Access module aspect supports the multiple connection modes such as Http, webService, Socket, Com+.
In terms of data feedback, the web interface that data acquisition feedback layer provide not only in terms of tradition is checked,
Form export function, additionally provides interface and issues function, and custom system is by realizing data-pushing interface protocol
Data interaction is carried out, the platform of the middleware system number by data-pushing interface with the platform of middleware system
Various status informations produced by custom system are issued constantly with object information to client-side system according to link.Number
Support the self-defining data bag form of customer side according to propelling movement interface, facilitate the docking of user's side system.
System operation monitoring layer is responsible for the ruuning situation of each operational module in platform is monitored and is transported
Row status information capture, by analytical data, forming curves figure, can time at that time of viewing system intuitively
With the ruuning situation of time in the past, and running trend trend.
The running status of each unit module of system is entered by system operation monitoring layer in the system normal operation period
Row gathers, and when the high load capacity operation of system continuous long period, monitor supervision platform can be according to the state ginseng collected
Number adjusts system background parameter, submits threshold values parallel to such as short message channel, and the ring back tone shortening relaying passage surpasses
Shi Shichang, called end exception number of retries promotes the execution efficiency of system, reduces load.
When systematic collection to moving body detect beyond preset range or produce fault time, system operation monitoring layer meeting
Alerting by different way, operation maintenance personnel can be according to graphic interface instruments such as field data figure or trend graph
Search the time period of unusual fluctuations, the time point of quick positioning question, describe in conjunction with daily record and investigate.
Abnormality alarming information can pass through pc client bullet screen, and note issues, PC plays buzzer and Email
Send etc. form.
The monitoring range of system operation monitoring layer is as follows:
1) physical memory monitoring: by the situation of the physical content that system uses, the operation of monitor operating system
Situation, and at internal memory less than time a certain amount of, report to the police.
2) CPU usage monitoring: the service condition of the CPU of monitoring system, when in system, if had
There is situation in service or process, occupy a large amount of cpu time, reaching certain value when, send
Report to the police, handle it in advance, prevent the generation of fault.
3) disk space utilization rate monitoring: the disk service condition of monitoring system main frame, will at disk space
The when of not enough, report to the police, remind user to need increase disk or some files are backed up and shifted,
Prevent from, because disk is not enough, causing the paralysis of system.
4) task averagely sends duration monitoring: be monitored, the average duration that sends of task when average duration
Suddenly the when of increasing, system can be reported to the police, to get rid of fault in advance.
5) network condition monitoring: the situation of network is monitored, when special circumstances occur when, notice
System, if will route task, improves promptness and the accuracy of task.
6) database monitoring: the ruuning situation of monitoring data base, there are abnormal conditions in some values data base,
As too high in connected number, when Database lock substantial increase, report to the police, in advance to system and data base
Process, prevent the appearance of database corruption situation, strengthen the continual and steady service ability of system.
The mode that this middleware system processes with telecommunications computer automation instead of old manual type, carries
Rise the productivity, it is to avoid the material impact that customer service industry is brought by the trend that human cost improves year by year, solved
Determine the current domestic medium-sized and small enterprises work shape at aspects such as externally notice, customer information inquiry, notice scheduling
The unicity of formula, improve the artificial flow process of current poor efficiency, it is to avoid the high fault under artificial treatment environment,
Also corresponding work position labour force is liberated reducing while production cost first mate promotes work efficiency.Middle
The mode that the information of part system presents also from original one to one, the mode of word or audio frequency is upgraded to current
One-to-many, multi-to-multi, the multimedia messages mixed model such as word, image, audio frequency, video, enrich
Information present form.Text conversion voice, voice messaging are grouied busy, automatic voice responding is inquired about, many phonetic aspects of a dialect
The suites of measure of the multiple technologies such as video conference, multimedia messages multicast enriches between customer service department and client
Exchange approach, improve customer service satisfaction.
Accompanying drawing explanation
Below in conjunction with the accompanying drawings the detailed description of the invention of the present invention is described in further detail.
Fig. 1 is the automatic speech hardware structure with multimedia information communication middleware system of the present invention；
Fig. 2 is the automatic speech software architecture with multimedia information communication middleware system of the present invention；
Fig. 3 is the automatic speech loose coupling framework body with multimedia information communication middleware system of the present invention
System；
Fig. 4 is that the automatic speech of the public network mode access present invention that client passes through internet is believed with multimedia
The schematic diagram of breath communication middleware system；
Fig. 5 is that the automatic speech that enterprises user accesses the present invention by built-in enterprise network is believed with multimedia
The schematic diagram of breath communication middleware system.
Fig. 6 is the automatic speech base communications protocol net with multimedia information communication middleware system of the present invention
Close the frame diagram of module；
Fig. 7 is the automatic speech Work flow model figure with multimedia information communication middleware system of the present invention.
Fig. 8 is the automatic speech data transfer layer with multimedia information communication middleware system of the present invention
Compressing file fate map；
Fig. 9 is the automatic speech data acquisition feedback layer with multimedia information communication middleware system of the present invention
The functional structure chart at the web-based management interface provided.
Figure 10 be automatic speech and the multimedia information communication middleware system of the present invention support running environment,
Secondary development language, host-host protocol and database platform list figure.
Figure 11 is the automatic speech system operation monitoring with multimedia information communication middleware system of the present invention
Display waveform figure during the CPU usage that layer monitors.
Figure 12 is the automatic speech system operation monitoring with multimedia information communication middleware system of the present invention
The disk space utilization rate block diagram of layer monitoring.
Figure 13 is the automatic speech system operation monitoring with multimedia information communication middleware system of the present invention
The network packet loss rate oscillogram of layer monitoring.
Figure 14 is the automatic speech signaling status code mark with multimedia information communication middleware system of the present invention
Quasi-classification chart.
Detailed description of the invention
Embodiment 1
Middleware system supports that public network accesses, two kind subordinate patterns built-in with enterprise.The use of public network access style
Family can carry out data inputting submission by corresponding domain name by the Internet logon operation network address, or by adjusting
With platform opening webService service, it is achieved corresponding function.
Enterprise's built-in manner is middleware system to be arranged on the hardware server of a platform independent and is positioned over enterprise
In industry internal network.External communication is carried out by Leased line or public network in ICP/IP protocol mode.Data
Bag uses RSA asymmetric encryption strategy, client and service end to own the encryption key of a group 1024 together
With PKI, PKI is for sending the encryption of packet, and private key is used for being decrypted the packet received,
Improve the safety of transmission the most to the full extent.Internal communication is connected by Ethernet mode.Basis number
According to carrying out in the way of intermediate database alternately, this ensure that independence and the safety of both sides' system.Enterprise
Task is committed to intermediate database by web interface or data-interface by each operation system of industry, is patrolled by business
Collect and process and after data conversion, send concurrent to each operator ground line channel platform by each functional protocol gateway
Deliver to the mobile terminal that receives, otherwise when middleware platform receives the information feedback of user from business system
After, information can be formatted encapsulation, and push to letter with the form of web interface form or data-interface
Breath receiving terminal.
Middleware system provides the API second development interface of consolidation form, is used for realizing involved by each business function
And data collection, data perform and result feedback issue.Should with concrete business by numerous and diverse communication protocol
With separating.Called side only need to be according to the form of definition, the interface method that process invocation by definition is set,
Corresponding workflow can be realized.
Automatic speech is mutual with multimedia information communication middleware system be collect voice, note, fax, meeting,
IVR, instant messaging etc. serve the standardized integrated communication platform of one, have powerful communications,
Speech processes, fax conversion, recording synthesis, phone tandem, multimedia interactive, multichannel short message process energy
Power, platform is connected by the SDK assembly of standard, WAP assembly and the CRM of user, OA, ERP system, real
The lowest input, high efficiency, Full Featured enterprise-level concentrate communication service, and this middleware system has following merit
Can:
1) the intelligent text Voice Conversion Techniques of high accuracy: the high accuracy intelligence literary composition that middleware system has
This analysis and preconditioning technique, effective guarantee phonetic synthesis is accurate, smooth, natural, at the special language of magnanimity
Sound storehouse, plus passing through constantly training on the basis of powerful autonomic learning function, optimizing, makes TTS switch technology
In the difficult point in the face of processing for linguistic analysis, as polyphone, polysemant, special symbol, prosodic phrase,
Unregistered word (such as place name, name, address) etc., also can ensure that obtain pin-point accuracy automatically processes knot
Really.
2) graph image conversion compression process technology: in terms of graph and image processing, middleware system exists
Having carried out extending on the basis of MFC-GUI graph and image processing class libraries, final encapsulation defines Vcom fax
Graph image Transpression engine.
The current various mainstream electronic documents of this engine support, image format conversion become Tiff facsimile format, electricity
Subdocument aspect supports Word Yu xls document and Pdf electronic document.Support at present in terms of image file
Common Jpeg, Jpg, Gif, Bmp file.The ccitt3 of the most compatible main flow at present in terms of compression of images
With ccitt4 algorithm.
3) audio frequency conversion treatment technology: in terms of audio frequency conversion process, middleware system is at DirectShow
Having carried out secondary research and development extension on the basis of the kit that Streaming Media processes, final encapsulation defines the audio frequency of uniqueness
Conversion process engine.The audio types of various forms changed by this engine, compress, edit provide strong
Support.Support that it supports turning mutually between various medium type widely widely, including Asf, Avi,
Mp3, Wave, Wma etc..Support turning such as Pcm, Adpcm, Ccitt, Ccitt-A mutually between various compressed format
Law, Ccitt-U Law, Mpeg, Mpeg-Layer3 etc..
4) pstn signaling net Development Framework: middleware system achieve PSTN net involved by circuit switching,
The aspect Integrated Developments such as the distribution of speech processes, resource, traffic signaling, support multiple signaling to develop simultaneously, bag
Include cno.1, numeral one, I SDN or Signaling System Number 7.By automatic to PC-PBX (driving is called), ACD(
Traffic distribution), IVR(interactive voice response), numerous business function functions such as CTI service converge integrated,
Use NameSpace formula multi-zone supervision.Group can be called according to practical situation flexible configuration during the secondary development made
Close, greatly improve the development efficiency of program.
5) unified signaling status code standard: middleware system by various signaling protocols (voice, short multimedia message,
VOIP, IM) conditional code carried out arranging unified, by rich for complexity in conditional code in there is joint act belong to
Property part carried out layering and sorted out, abnormal ownership is carried out classification.By environment classification and the customer group bodily form
Become result to present, system investigates two big codes and standards.Run through data submission, data process, result feedback three
Big process.
Obviously, the above embodiment of the present invention is only for clearly demonstrating example of the present invention, and
It it is not the restriction to embodiments of the present invention.For those of ordinary skill in the field, upper
State bright on the basis of can also make other changes in different forms.Here cannot be to all of reality
The mode of executing gives exhaustive.Every belong to obvious change that technical scheme extended out or become
The dynamic row still in protection scope of the present invention.
Claims (7)
1. automatic speech and multimedia information communication middleware system, be placed in enterprise including one
Portion's network runs independent, inside fire wall by Ethernet and each industry of enterprise
Business system carries out then passing through the Internet or Leased line outside data interaction, fire wall with each
Operator's basis line resource or intermediary service gateway carry out the hardware service of data communication
Device, it is characterised in that: described server includes mainly being turned by data collection, data encoding
Change compression, data transmission, hardware driving, communication control processor realizes, service logic is joined
Put, the hardware structure of data memory module composition and main by hardware driving, communications protocol
Gateway, business logic processing, data converting transmission, data acquisition feedback, charging process,
The software architecture of application and development interface layer, system operation monitoring layer composition；Described server
Operation system each with customer side carries out data interaction by interface protocol, constitutes pine coupling
The system architecture closed；The module of all layers in software architecture allows dynamic load and unloading,
High Aggregation computation is realized by height encapsulation loose coupling in layer, and by set interface
Retrain respective category of behavior；Top layer system is come one by one according to every business configuration model
The functional interface between each level is called in combination, forms automatic workflow；
The business logic processing layer of described software architecture includes system by user configured rule
Each involved hierarchy module carry out concatenated call, service logic is run through be blended in each
Individual hierarchy module is formed workflow and supports that forward, reverse and two-way combination are held
Longization is run user side logic realization and supports data acquisition, service billing, system snapshot
System side logic realization；
The system operation monitoring layer of described software architecture realizes physical memory monitoring, CPU usage
Monitoring, the monitoring of disk space utilization rate, task averagely send duration monitoring, network condition
Monitoring and database monitoring.
2. middleware system as claimed in claim 1, it is characterised in that: described hardware structure
Every hardware driving system is carried out unified classification encapsulation by Hardware drive module, will have
The hardware cell of same behavior attribute character, carries out more higher leveled encapsulation and integrates, generate
A set of unification can flexibly the every hardware device resources in system be attached drive
Hardware device drivers invocation framenort.
3. middleware system as claimed in claim 1, it is characterised in that: described software architecture
Communications protocol gateway includes encapsulating note and the short messaging gateway of multimedia message communication protocol, real
Existing SS1, SS7, ISDN, the calling of pri signaling, there is media handling function, communication
The PSTN gateway of function, and it is responsible for the system that realizes and Internet user and 3G network users
Data communication, realize the Session Initiation Protocol gateway of the two-way communication of PSTN Yu INTERNET；
Described Session Initiation Protocol gateway includes the realization of Real-time Transport Protocol, H.323 agreement and Session Initiation Protocol.
4. middleware system as claimed in claim 2, it is characterised in that: described software architecture
Communications protocol gateway includes encapsulating note and the short messaging gateway of multimedia message communication protocol, real
Existing SS1, SS7, ISDN, the calling of pri signaling, there is media handling function, communication
The PSTN gateway of function, and it is responsible for the system that realizes and Internet user and 3G network users
Data communication, realize the Session Initiation Protocol gateway of the two-way communication of PSTN Yu INTERNET；
Described Session Initiation Protocol gateway includes the realization of Real-time Transport Protocol, H.323 agreement and Session Initiation Protocol.
5. the middleware system as described in arbitrary in claim 1-4, it is characterised in that: described soft
The data transfer layer of part framework is responsible for being converted into initial data each business model needs
Standard, it is achieved data feedback layer collect the self-defining encapsulation format of client；Described number
It is implemented in combination with various signaling institute with described base communications protocol gateway module according to transmission conversion layer
The conversion of the various document format datas needed and process, compressed by the transformation of ownership, by original
Data are converted into the data form that each agreement specifies, carry out communication transfer；And user is handed over
The interim big quantity file data produced during Hu carries out segmentation cutting, and strange land preserves.
6. the middleware system as described in arbitrary in claim 1-4, it is characterised in that: described soft
The data acquisition feedback layer of part framework devises different mould according to the behavior property of every business
The data acquisition webpage of formula, has the submission of information, controls, manages and the looking into of result
See, the derivation of form, and interface issues function；The Web of described data acquisition feedback layer
System additionally provides configurable rights management, and Web system authority is not for be limited by level
Irregularly shaped, be based entirely on actual demand come self-defined, all functions all can individual character
Change configuration management；Issuing function by described interface, can realize customer side is self-defined
The support of data packet format, custom system is capable of the data interaction with middleware system,
Middleware system can issue custom system constantly when the data link of data-pushing interface
Produced various status informations and object information are to client-side system.
7. middleware system as claimed in claim 5, it is characterised in that: described software architecture
Data acquisition feedback layer devises the data of different mode according to the behavior property of every business
Gather webpage, there is the submission of information, control, manage and the checking of result, form
Derivation, and interface issues function；The Web system of described data acquisition feedback layer is also
Providing configurable rights management, Web system authority is not advised by what level limited
Then shape, is based entirely on actual demand and comes self-defined, and all functions all personalizables configure
Management；Issue function by described interface, the self-defining data bag to customer side can be realized
The support of form, custom system is capable of the data interaction with middleware system, middle
Part system can issue custom system constantly when the data link of data-pushing interface and be produced
Raw various status informations and object information are to client-side system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442633.9A CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442633.9A CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102970286A CN102970286A (en) | 2013-03-13 |
| CN102970286B true CN102970286B (en) | 2016-12-07 |
Family
ID=47800172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210442633.9A Active CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102970286B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716190B (en) * | 2013-12-25 | 2017-12-22 | 南威软件股份有限公司 | The method of E-government Intranet service application safety supervision |
| CN105392149A (en) * | 2014-09-05 | 2016-03-09 | 中兴通讯股份有限公司 | Strategy adjusting trigger and strategy adjusting method and device, and strategy adjusting system |
| CN105959972A (en) * | 2016-04-18 | 2016-09-21 | 重庆金美通信有限责任公司 | Improved method for full duplex conference |
| CN105898505B (en) * | 2016-04-27 | 2019-02-19 | 北京小米移动软件有限公司 | The method, apparatus and system of audio-visual synchronization are tested in video instant communication |
| CN108521523A (en) * | 2018-04-08 | 2018-09-11 | 成都万维图新信息技术有限公司 | A kind of communication service multimedia middleware cut-in method |
| CN111338927B (en) * | 2018-12-19 | 2023-12-12 | 国家电投集团科学技术研究院有限公司 | Nuclear power software efficient coupling analysis system |
| CN109639722B (en) * | 2019-01-07 | 2021-09-07 | 烽火通信科技股份有限公司 | Method and system for realizing ISDN service access on SIP gateway |
| CN110768870B (en) * | 2019-10-28 | 2021-05-28 | 中国联合网络通信集团有限公司 | Quality monitoring method and device for intelligent special line |
| CN112669586A (en) * | 2020-12-16 | 2021-04-16 | 宁夏隆基宁光仪表股份有限公司 | Intelligent instrument remote monitoring system and method based on Android system |
| CN113316101B (en) * | 2021-02-19 | 2022-08-09 | 深圳力维智联技术有限公司 | Short message sending method, short message sending device, short message sending equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1403991A (en) * | 2002-10-25 | 2003-03-19 | 北京炎黄新星网络科技有限公司 | Efficient link-up management system |
| CN101208951A (en) * | 2005-06-28 | 2008-06-25 | 微软公司 | Creating standardized playlists and maintaining coherency |
| CN101706738A (en) * | 2009-10-29 | 2010-05-12 | 中国联合网络通信集团有限公司 | Flow application system |
-
2012
- 2012-11-08 CN CN201210442633.9A patent/CN102970286B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1403991A (en) * | 2002-10-25 | 2003-03-19 | 北京炎黄新星网络科技有限公司 | Efficient link-up management system |
| CN101208951A (en) * | 2005-06-28 | 2008-06-25 | 微软公司 | Creating standardized playlists and maintaining coherency |
| CN101706738A (en) * | 2009-10-29 | 2010-05-12 | 中国联合网络通信集团有限公司 | Flow application system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102970286A (en) | 2013-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102970286B (en) | Automatic speech and multimedia information communication middleware system | |
| CN101335869B (en) | Video conference system based on Soft-MCU | |
| CN101826987B (en) | System and method for supporting mixed service based on integrated open network | |
| US20050254481A1 (en) | Knowledge management, capture and modeling tool for multi-modal communications | |
| US20080088428A1 (en) | Dynamic Emergency Notification and Intelligence System | |
| EP2247030A2 (en) | Intelligent conference call information agents | |
| CN101471803B (en) | Conference service system and method | |
| CN101958817A (en) | Intelligent home information management system | |
| CN102238573A (en) | Machine-to-machine/machine-to-man/man-to-machine (M2M) service structure and M2M service realization method | |
| CN105429958A (en) | Enterprise application platform system based on Android development | |
| CN204204022U (en) | A kind of live supervisory system based on operation of power networks state | |
| CN108446774A (en) | A kind of device intelligence management system | |
| CN114386938A (en) | Operation management system of 5G message platform | |
| CN104113938A (en) | Scheduling method, device and system | |
| CN102917000A (en) | Intelligent cloud voice application service technology platform | |
| CN110401811A (en) | A kind of video conferencing system towards hierarchical organization | |
| CN108416721A (en) | A kind of emergency management system | |
| CN108810669A (en) | A kind of voice inter-speaking system and method for multistage architecture | |
| CN102739783A (en) | Method for automatically combining meeting information | |
| CN208188895U (en) | emergency management system | |
| CN102752373A (en) | Method for calling a plurality of control terminals through one centralized control server in cloud network | |
| CN100446510C (en) | System and method for implementing business integrating between interprises | |
| CN1169078C (en) | Efficient link-up management system | |
| CN108833725A (en) | A kind of goods and materials are honoured an agreement voice management system | |
| CN201163787Y (en) | Intelligent call centre control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160907 Address after: Copper Road Software Avenue Gulou District of Fuzhou city in Fujian province 350000 No. 89 Fuzhou Software Park B District No. 23 building 301 room Applicant after: Chi Tong (Fujian) Mdt InfoTech Ltd Address before: Copper Road Software Avenue Gulou District of Fuzhou city in Fujian province 350000 No. 89 Fuzhou Software Park B District 23-301 Applicant before: Shanghai Foochow branch company of Ji Shi open network Science and Technology Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |