CN101877706B - Multi-terminal multimedia conference control system and implementation method - Google Patents
Multi-terminal multimedia conference control system and implementation method Download PDFInfo
- Publication number
- CN101877706B CN101877706B CN 201010208459 CN201010208459A CN101877706B CN 101877706 B CN101877706 B CN 101877706B CN 201010208459 CN201010208459 CN 201010208459 CN 201010208459 A CN201010208459 A CN 201010208459A CN 101877706 B CN101877706 B CN 101877706B
- Authority
- CN
- China
- Prior art keywords
- speech
- terminal
- message
- conference
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a multi-terminal multimedia conference control system and an implementation method. The conference control system comprises a conference capability component subsystem and a conference flow control subsystem, wherein the conference flow control subsystem comprises a dual tone multiple frequency (DTMF) normality monitoring module, a request message routing module, a conference speech policy control module, a terminal speech making module, a speech stopping module and a terminal switching module. The multimedia conference control system realizes the functions of applied message acquiring of mobile phones, phones and web client ends, message routing, terminal switching, conference speech policy controlling, terminal speech making and speech stopping through all the functional modules of the conference flow control subsystem so as to achieve the purposes of controlling a multimedia conference and carrying out conference switching between participated communication terminals. By adopting the multimedia conference control system, the cost for using the conference control system of publics can be reduced so as to be helpful to popularize the multimedia conference service.
Description
Technical field
The present invention relates to the application technology of multimedia communication, relate in particular to a kind of multimedia conference control system and implementation method of multiple terminals.
Background technology
Development along with computing technique and the communication technology, for providing the multimedia conference system of interchange, discussion, collaborative work, the people that are in the strange land show huge development prospect, it can be widely used in remote reporting, summary, report, discussion, teaching, product issue etc., can greatly reduce expenses and increase work efficiency.At present, some multimedia conferencing products have been arranged, but most function concentrates on the Web end of PC, for example:
MSN multi-person speech system, it supports multi-person speech based on public network, but does not support the multi-person speech of mobile phone and fixed phone terminal.
Tencent QQ multi-person speech system, it is similar to MSN, supports the multi-person speech chat, but does not support the multi-person speech of mobile phone and fixed phone terminal.
In emerging video conferencing system (ZTE Corporation's multimedia integration business platform), it is the complete compatible business platform take the intelligent Videoconferencing server of full compatibility as core, can access comprehensively the heterogeneous networks such as special line, ISDN, IP, different agreement video terminal (as, DDN, ISDN, IP etc.), can carry the different conference contents such as high definition meeting, ordinary video meeting, individual face-to-face communication are provided by the meeting quality requirement, support real-time communication and non real-time communication, two-way exchange and one-way communication (as, multicast) etc.
But above product or multimedia conference system provide Audio and Video communication all to satisfy to a certain extent people's remote communication demand, yet, these products overwhelming majority can only support take computer as main Web client, and lacks the attend a meeting support of function of mobile phone and fixed phone terminal; Perhaps, the function although the support mobile phone that has or fixed phone terminal are attended a meeting, mobile phone and fixed phone terminal only are the receiving terminals as information, thereby lack the support that sends the functions such as request and then conference participation control to conference system.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of multimedia conference control system and implementation method of multiple terminals, it is based on public network generic media server, to realize that mobile phone, fixed phone terminal or Web end subscriber carry out session control function, thereby reduce the expense that the public uses multimedia conference system, to help to promote multimedia conference service.
For achieving the above object, technical scheme of the present invention is achieved in that
A kind of multimedia conference control system of multiple terminals mainly comprises conference capability component subsystems and conference flow control subsystem; Wherein,
The conference capability component subsystems be used for to realize the business function of meeting bottom with media server the application programming interface API of described media server occuring directly to call alternately, and encapsulates its basic function interface and call for other functional modules; The business function of described meeting bottom comprises and realizes dual tone multi-frequency dtmf normality monitor function, voice document broadcast atomic function and the media state atomic function is set;
The conference flow control subsystem, be used for to realize meeting coarsegrain flow process control function, comprise and realize that mobile phone, fixed phone terminal and web client solicitation message obtain (core is DTMF normality monitor function), message routing functionality, terminal switch function, conference speech policy control functions, terminal speech function and stop the function of making a speech; Described conference flow control subsystem further comprises: the DTMF normality is monitored module, is used to mobile phone, fixed phone terminal participation multimedia conferencing that DTMF real-time listening function is provided; The request message routing module is used for the unified external message that receives, and routes messages to associated component according to different message contents, with the route connection that realizes the speech application, message is switched in the application that stops to make a speech, terminal; The conference speech strategic control module is used for collecting the request speech message that mobile phone, fixed phone terminal and web client are sent, and adopts certain strategy to carry out ruling, then the ruling result is sent to the terminal speaker module; The terminal speaker module is used for the function that realization mobile phone, fixed phone terminal and web client are made a speech at multimedia conferencing, after the terminal speaking request goes through, makes a speech in multimedia conferencing by this terminal speaker module; Stop speaker module, be used for closing session member's floor status; The terminal handover module is used for being implemented in and carries out the meeting switching between mobile phone, fixed line, the web client.
Wherein, this multimedia conference control system further comprises the terminal display subsystem, is used for realizing that the page status of web end shows; The page status demonstration of described terminal display subsystem comprises that floor status shows and terminal type shows.
Described conference capability component subsystems comprises logic entity layer, meeting sub-services layer, Session initiation protocol SIP messaging layer and sip message adaptation layer.
The external message that described request message routing module receives comprises through the DTMF normality and monitors mobile phone that module receives or the request message in the fixed phone terminal dtmf signal, and from the request message of web client.
A kind of implementation method of multimedia conference control system of multiple terminals, the method comprises:
A, unlatching media server DTMF monitor function, receive user's application of mobile phone or fixed phone terminal, and therefrom extract press key contents, relevant information according to telephone number is inquired about this user from the multimedia conferencing database forms request message with described press key contents and sends to the message routing module;
B, message routing module receive the request message of mobile phone or fixed phone terminal or web client, judge according to message content, and route messages to associated component according to judged result; If described message content then sends a message to the conference speech strategic control module for request speech message, and execution in step C; Switch relevant solicitation message if described message content is terminal, then send a message to the terminal handover module, and execution in step D; If described message content is to stop the relevant message of making a speech, then send a message to and stop speaker module, and execution in step E;
C, conference speech strategic control module adopt certain strategy to carry out ruling according to different mode of operations, and the ruling result are sent to the terminal speaker module according to request speech message, carry out conference speech by the participant by the terminal speaker module;
D, terminal handover module adopt soft handoff according to terminal handover request message, carry out meeting and switch between mobile phone, fixed phone terminal and web client;
E, stop speaker module according to the difference of the end of message reason that stops to make a speech, closing session member's floor status.
Wherein, the described conference speech strategic control module of step C comprises three kinds of mode of operations: speech mode, enquirement pattern and discussion pattern; Described speech mode is applicable to the personal presentation stage in the meeting; The enquirement pattern is applicable to the enquirement stage in the meeting, to select the spokesman from numerous quizmasters; The discussion pattern is applicable to a plurality of participant members and makes a speech simultaneously.
Described employing soft handoff is carried out meeting and is switched between mobile phone, fixed phone terminal and web client, specifically comprise mobile phone to fixed line, mobile phone to the web end, fixed line holds to web end, mobile phone to web, web holds mobile phone and web to hold six kinds of meetings of fixed line to control switching.
Described basis stop to make a speech different closing session members' the floor status of end of message reason is divided into two kinds of situations and triggers; One stops speaking request and is sent by chairman end, stops speaker module and receives that this stops to change after the speaking request message spokesman's media state, ends this user's speech; Its two, stop speaking request and sent by the spokesman, when the spokesman make a speech finish after, the spokesman abandons right to speak, receives that by stopping speaker module this stops to change after the speaking request this spokesman's floor status, stops its speech.
The multimedia conference control system of multiple terminals provided by the present invention and implementation method have the following advantages:
This multimedia conference control system adopts and comprises DTMF normality monitoring module, the request message routing module, the conference speech strategic control module, the terminal speaker module, stop the conference flow control subsystem of speaker module and terminal handover module, by continuing to monitor dtmf signal, can the application of real-time listening user key-press, in time extract press key contents, thereby can intercept and capture in real time the request message that user terminal sends, so that send to the message routing module, and according to different message contents described message is routed to the associated component application of making a speech by the message routing module, the function that terminal is switched and stopped to make a speech.
This multimedia conference control system adopts the conference speech strategic control module, can realize multiple-working mode, and cooperate certain strategy to carry out ruling, can make the user of this system obtain maximum satisfaction.
This multimedia conference control system, adopt the terminal handover module, can realize that soft handoff carries out meeting and switch between mobile phone, fixed phone terminal and web client, flexibility and the portability of system have been improved, simultaneously, also have handoff failure and still can return the advantage that former terminal continues to attend a meeting, improved the reliability of multimedia conference system.
Description of drawings
Fig. 1 is the multimedia conference control system illustrative view of functional configuration of multiple terminals of the present invention;
Fig. 1 a is conference capability component subsystems configuration diagram illustrated in Figure 1;
Fig. 2 is the functional schematic that uses multiple terminal to attend a meeting in the conference flow control subsystem illustrated in Figure 1;
Fig. 2 a is DTMF monitor function schematic diagram shown in Figure 2;
Fig. 2 b is that the speaker module that stops shown in Figure 2 finishing speech control procedure schematic diagram;
Fig. 3 be the web client-the switching flow schematic diagram of mobile phone;
Fig. 4 be web-the switching flow schematic diagram of fixed phone terminal;
Fig. 5 be mobile phone-the switching flow schematic diagram of web end;
Fig. 6 be fixed phone terminal-the switching flow schematic diagram of web end;
Fig. 7 be fixed phone terminal-the switching flow schematic diagram of mobile phone terminal;
Fig. 8 be mobile phone-the switching flow schematic diagram of fixed phone terminal;
Fig. 9 is the interacting message schematic diagram in the conference capability component subsystems DTMF normality monitor function implementation procedure of the present invention;
Figure 10 is the interacting message schematic diagram in conference capability component subsystems terminal switch function of the present invention (connect and the switch) implementation procedure;
Figure 11 is the interacting message schematic diagram in the user media status function implementation procedure of arranging of conference capability component subsystems of the present invention;
Figure 12 is interacting message schematic diagram in the play cuing sound function implementation procedure of conference capability component subsystems of the present invention.
Embodiment
Below in conjunction with accompanying drawing and embodiments of the invention system and method for the present invention is described in further detail.
Fig. 1 is the multimedia conference control system illustrative view of functional configuration of multiple terminals of the present invention, and as shown in Figure 1, this multimedia conference control system mainly comprises: conference capability component subsystems 10, conference flow control subsystem 20 and terminal display subsystem 30; Wherein:
Conference capability component subsystems 10 be used for to realize the business function of meeting bottom with media server the application programming interface (API) of described media server occuring directly to call alternately, and encapsulates its basic function interface and call for other functional modules.Use this conference capability component subsystems 10, can realize DTMF normality monitor function, voice document broadcast atomic function, media state atomic function etc. is set.
Conference flow control subsystem 20, be used for realizing meeting coarsegrain flow process control function, namely use following functional module, as, the DTMF normality is monitored module 201(calling application message and is obtained), request message routing module 202, conference speech strategic control module 203, terminal speaker module 204, stop speaker module 205, terminal handover module 206 is to realize mobile phone, fixed phone terminal and web client solicitation message are obtained (core is DTMF normality monitor function), message routing functionality, terminal switch function, the conference speech policy control functions, terminal speech function, stop the function etc. of making a speech.More than each functional module details as shown in Figure 2.
Terminal display subsystem 30 is mainly used in realizing that the page status of web end shows, comprises floor status demonstration, terminal type demonstration etc.This state is stored in the database, with then reading again.
Fig. 1 a is conference capability component subsystems configuration diagram illustrated in Figure 1, as shown in Figure 1a, this subsystem comprises logic entity layer (claiming again the media logic layer), meeting sub-services layer, conversation initialized protocol (SIP, Session initial Protocal) messaging layer and sip message adaptation layer; Wherein,
1) media logic layer comprises participant (Participant) logic entity, is used for the various atomic function that expression participant entity can participate at this layer.Realize by participant (Participant) service logic unit (SBB, Service Building Block), safeguard that simultaneously the entity state of oneself realizes different service logics with resource and by the subservice logical layer.
2) meeting sub-services layer according to the needed different abilities of multimedia conferencing, defines different meeting sub-services, concentrates the service logic that realizes different meeting sub-services.They receive from the calling of upper layer module by the entity logical layer, and use the function of SIP signaling key-course to finish the service logic of self.
3) sip message processing layer: this layer is used for providing the link resources of SIP to the upper strata, and carrying out for business provides signalling path, and carries out other Message Processing of signaling level.
4) sip message adaptation layer (device): this layer is used for the Session Initiation Protocol stack is fitted to Mobicents inside, mainly carry out reception and the transmission of message, the conversion of message format and message are in the distribution (be assigned to Activity, each Activity is corresponding to a plurality of dialog) of each SBB entity (Entity).Here, described Mobicents is that first also is a unique networking telephone (VoIP that increases income that is authenticated by the JSLEE1.0 standard at present, Voice over Internet Protocol) platform, Mobicents uses for telecommunications strong component model and execution environment is provided, and promotes voice, video and the fusion of data service in intelligent use of future generation by supporting J2EE.
5) other instruments have:
Database interface: the interface that the SBB accessing database is provided;
Media server control language (MSML, Media Server Markup Language): generation and the parsing of MSML language are provided;
Dialogue and back-to-back user agent (B2BUA) state machine: the state machine that SIP dialog and B2BUA are provided.
For participant (Participant), mainly provide following 10 kinds of functions: invite member and member application to withdraw from meeting (webpage), application adding meeting (phone) and application and withdraw from meeting (phone), playback, obtain the current media type, obtain the support media type, medium type is set, obtains information about firms and calling application service.Wherein, obtain the current media type, obtain the support media type and obtain information about firms etc. without the function of flow process, and directly in participant SBB, realize with the correlation function of SIP connection resource.Other function with flow process will realize in sub-SBB mode as the child of participant SBB, is created by father SBB when needed.The primary event of participant SBB entity is for inviting the web end subscriber to add meeting (InvitePaticipant) or inviting the telephony side user to add meeting (ApplyJoin), and being created as conference member in primary event provides the SIP of service to connect.Then, carry out again the service logic of member's adition process.When receiving that disconnecting meeting link (DisconnectPaticipant) or application withdraws from meeting (ApplyQuit), the member withdraws from that meeting adjourned.Participant SBB entity is at first carried out and is withdrawed from corresponding service logic, then discharges SIP and connects.
Fig. 2 is the functional schematic that uses multiple terminal to attend a meeting in the conference flow control subsystem illustrated in Figure 1, as shown in Figure 2, by the continuous monitoring to the Dual Tone Multifrequency signal of mobile phone, fixed phone terminal, the multiple terminals of the realizing multimedia conference system function of attending a meeting.
This conference flow control subsystem 20 mainly comprises DTMF normality monitoring module 201, request message routing module 202, conference speech strategic control module 203, terminal speaker module 204, the speaker module 205 that stops, terminal handover module 206; Wherein, the normality of DTMF under the existing network environment monitored module 201, conference speech strategic control module 203, terminal handover module 206 and each module and cooperated to realize multimedia conferencing control function, is innovative point of the present invention.
It is a relatively ripe technology that dtmf signal described here is monitored, and each media server can both provide this function.But multimedia conference system has the characteristics of himself, its conference member interactivity is carried throughout, be in the whole conference process, mobile phone or fixed line conference member will with mobile phone or fixed line receive information (as, answer conference content), also will suitable scene issue carry information (as, make a speech, ask to carry out terminal switching etc. with mobile phone or fixed line), this just requires multimedia conference system to send message to mobile phone or fixed phone terminal, also requirement can receive the message that mobile phone or fixed line end send in real time, and carries out corresponding function conversion.And existing media server can only be accepted signal one time after DTMF monitors startup, after signal receives, if there is not new triggering flow process, just can't open again new monitor function, in other words, existing media server can only receive user's once request, can't satisfy the requirement that the user can both send to this multimedia conference system request at any time.Therefore, existing multimedia conference system is all more weak to mobile phone or the fixed line function of attending a meeting, a support information receiving function or send the request signal of predetermined number of times at the time point of appointment.The present invention has provided a kind of based on the normality DTMF monitoring technique on the existing DTMF monitoring technique basis, namely can listen in any time of meeting the request message of the arbitrary number of times that the user sends.
1) the DTMF normality is monitored module 201, is used to mobile phone, fixed phone terminal participation multimedia conferencing that DTMF real-time listening function is provided; The core that its DTMF normality is monitored is the continuation of monitoring, and namely in a single day opens, and then whole process is all at the monitoring users button, and being embodied on the flow process is the continuous startup of DTMF monitor function, and shown in Fig. 2 a, its implementation procedure is as follows:
Step 2011, unlatching media server carry out DTMF and monitor;
Step 2012, the application of wait user key-press;
Step 2013, judge and to receive press key contents, if what receive is that the user applies for, then goes to step 2014, otherwise return step 2012;
Step 2014, extraction press key contents, the relevant information according to telephone number is inquired about this user from the multimedia conferencing database forms request message with press key contents and sends to the message routing module;
Step 2015, be back to step 2011.
2) the solicited message routing module 202, are used for the unified external message that receives, and route messages to associated component according to different message contents, with the route connection that realizes the speech application, message is switched in the application that stops to make a speech, terminal.Its request message route implementing process is as follows:
Step 2021, receipt message requestMessage;
The message that if step 2022 requestMessage is request floor to be correlated with (as, mobile phone/fixed line request floor, web holds request floor), send a message to " conference speech strategic control module ";
If step 2023 requestMessage stops to make a speech relevant message (stop speech such as, mobile phone/fixed line, the web end stops speech etc.), send a message to " stopping speaker module ";
The solicitation message that if step 2024 requestMessage is the terminal switching to be correlated with (as, mobile phone-〉 fixed line, mobile phone-the web end, fixed line-〉 mobile phone, fixed line-the web end, the web end-mobile phone, the web end-〉 fixed line), then send a message to the terminal handover module.
3) the conference speech strategic control module 203, be used for to collect each terminal (as, mobile phone, fixed phone terminal and web client) the request speech message sent, adopt certain strategy to carry out ruling, then the ruling result is sent to terminal speaker module 204.Here, this conference speech strategic control module 203, it comprises various modes and implementation strategy, and is designed with weighted-fair-queuing, can further promote the whole fairness of native system when reply speech application.
This module core is spokesman's ruling problem, and namely the How to choose spokesman makes a speech.This multimedia conference control system has provided three kinds of different patterns according to the characteristics of multimedia conferencing: speech mode, enquirement pattern and discussion pattern, these three kinds of patterns adopt at the different three phases of meeting, every kind of speech pattern is corresponding different speech strategy all, and its concrete pattern is as follows:
(1) speech mode: this pattern is applicable to the personal presentation stage in the meeting, when chairman determines to use speech mode to select the spokesman, alternative participant member tabulation will occur, serve as chair and choose certain participant member, this member obtains the floor, and can make a speech;
(2) enquirement pattern: this pattern is applicable to the enquirement stage in the meeting, need to select the spokesman from numerous quizmasters, and overall goal is to make the native system user obtain maximum satisfaction.Three kinds of ruling strategies are arranged:
A, minimum speech frequency strategy: system log (SYSLOG) enters the speech number of times of each member after the enquirement pattern, selects the member of speech least number of times to obtain the floor during decision-making.This strategy makes the whole speech of meeting be tending towards balanced.
B, largest request frequency strategy: system log (SYSLOG) enters the speaking request number of times of each member after the enquirement pattern, and adds up each member to send speaking request and the number of times f that do not obtain the floor, selects the right to speak of giving of f maximum during decision-making.This strategy can obtain the floor so that conference member needs only application enough actively
C, weighted fair queuing: weighted fair queuing is actually a kind of Fuzzy strategy, and it combines the parameter of multiple pure strategy, and balance is totally adjudicated.Speaker module is collected the information of request floor, and application information is directly sent to the Weighted Fair Queuing substrategy.The content that the application information here comprises no longer only is simple user ID, but has comprised the participant member tabulation of labyrinth.These labyrinths comprise that time, speech number of times, the user of user in this meeting of user ID, user's request floor ask the number of times of speech etc. in this meeting.This strategy is assigning weight of each Rational Parameters according to above-mentioned parameter, comprehensively draws a result after the weighting, is the right to speak winner.Specifically see following algorithm:
Algorithm: weighted-fair-queuing
If the decision-making time is c, the request floor time is t, and request times is r, the speech number of times is s, and the weight of distributing for the application time is weight1, and the weight of distributing for the speech number of times is weight2, the weight of distributing for request times is weight3, and user's speech weighted value is designated as result.Algorithmic formula can be described below:
Result=(r-s) * weight3-s*weight2-(t-c) * weight1 (formula one)
Weighted-fair-queuing is described below:
Step 1:result=0;
Step 2: adopt formula one to calculate request floor person's weighted value, be designated as temp;
Step 3: if temp greater than result, then with the temp assignment to result; Turn step 5
Step 4: if temp equals result, then compare the user ID user ID corresponding with temp corresponding to result, the smaller is new result;
Step 5: circulation step 2-4, until each member's weighted value draws;
Step 6: selecting user corresponding to result value the maximum is the spokesman, finishes.
Weighted fair queuing is analyzed: this tactful core is the weighted value computing formula, and namely formula one, can get formula two to its modification; Can find out that from formula two weighted value result is that namely request times is more about the monotonic increasing function of request times r, the result value is larger; Be the monotone decreasing function about speech number of times s, the principle of universality that this has embodied conference speech makes the speech chance can spread all over quizmaster as much as possible; Be the monotone decreasing function of speech application time t, i.e. application is putd question in encouragement as far as possible sending of morning, embodies the principle of serving first first.
Result=r*weight3-s* (weight2+weight3)-t*weight1+c*weight1 (formula two)
After the chairman selects to enter the enquirement pattern, system in the certain hour section (as, 1 minute) collect the speech application that each user sends, carry out ruling by the strategy of this pattern, select the spokesman.
(3) discussion pattern: the discussion pattern need not chairman and controls after opening, and opens all participants' speech medium stream information, and a plurality of participant members can make a speech simultaneously.
In sum, the native system design has realized weighted-fair-queuing, this strategy has been considered request times principle (multiple go out application then obtain the speech chance large), first first Service Principle (it is large that the chance that obtains the floor is early sent in application) and speech principle of universality (chance that obtains the floor when obtaining the floor the applicant request floor few is large), and distribute rational weight for every kind of influencing factor, finally calculate a rational weighted value.
4) the terminal speaker module 204, be used for the function that realization mobile phone, fixed phone terminal and web client are made a speech at multimedia conferencing, be after the terminal speaking request goes through, make a speech in multimedia conferencing by this terminal speaker module 204, other members that attend a meeting can hear this member's speech content in real time.Consider mobile phone or fixed phone terminal participant member's particularity, after the speech application goes through, will be at first at mobile phone or fixed phone terminal play cuing voice, such as promptings such as " please make a speech "; Its speech content will be sent to media server, be transmitted by the member of media server unification to each conference participation again.
Because this module is in close relations with concrete media server, for ease of disposing in different media servers, only provides the realization flow of functional plane herein.Because playing voice document and reception/forwarding media stream all is the basic function of media server, only need during specific implementation to get final product with reference to the specification setting of media server.
5) stop speaker module 205, be used for closing session member's floor status.Difference according to finishing reason is triggered, i.e. " by ending " and " normally stopping " in two kinds of situation.
" by ending " speaking request is sent by chairman's end, when conference member is not suitable for continuing speech (as, the allotted time etc. has been arrived in the conference member speech), the chairman can send the request message of ending this user's speech, stop to understand the media state that changes the spokesman after speaker module 205 is received this request message, end its speech, and give corresponding prompting according to the difference of terminal type.
" normally stop " speaking request and sent by the spokesman, when the spokesman make a speech finish after, can send the speaking request of " normally stopping " and abandon right to speak, stop speaker module and receive that the floor status that can change this spokesman after this solicited message stops its speech.Its implementation process is shown in Fig. 2 b, and this module has been used voice document broadcast and Media Stream control, and is therefore in close relations with concrete media server, only provides the flow process introduction herein.
6) the terminal handover module 206, are used for being implemented in carrying out the meeting switching between mobile phone, fixed line, the web client.Carrying out in the process of meeting, because user's mobility, the user needs meeting to switch between different terminal equipments sometimes.For example: the user is using computer web client conference participation, and busy needs are gone out midway, and he does not think so withdraw from meeting, at this moment meeting can be switched on the mobile phone, guarantees that user's sustainable participation is among the meeting at his place.
The multimedia conference control system of multiple terminals of the present invention can realize " mobile phone-〉 fixed line, mobile phone-web end, fixed line-web end, mobile phone-web end, web end-mobile phone and web end-fixed line " six kinds of meetings controls switch.The terminal handover module 206 of this system adopts soft handoff, can be implemented in the mutual switching between above-mentioned three kinds of terminals, improved flexibility and the portability of system, switching mode is at first judged after receiving handover request by this system, then new terminal is connected to multimedia conference system.After the terminal of newly attending a meeting is successfully logined meeting, can select to disconnect original terminal and withdraw from meeting; If the terminal login failure of newly attending a meeting also can return original user terminal and continue meeting.As mentioned above, by in multimedia conference system, introducing soft handoff idea, adopt terminal handover module 206 of the present invention, can improve the reliability of multimedia conference system.
Fig. 3 be web-the switching flow schematic diagram of mobile phone, Fig. 4 be web-the switching flow schematic diagram of fixed phone terminal, Fig. 5 be mobile phone-the switching flow schematic diagram of web end, Fig. 6 be fixed phone terminal-the switching flow schematic diagram of web end, Fig. 7 be fixed phone terminal-the switching flow schematic diagram of mobile phone terminal, Fig. 8 be mobile phone-the switching flow schematic diagram of fixed phone terminal.Here, take fixed phone terminal shown in Figure 7-handoff procedure of mobile phone terminal describes as example, this handoff procedure comprises:
Step 701, fixed phone terminal send handover request by the request message routing module to mobile phone terminal;
Step 702, media server stop to send Media Stream to fixed phone terminal;
Step 703, then play the IVR prompt tone at fixed phone terminal; As, " switch, please wait a moment ";
Step 704, mobile phone is added multimedia conferencing;
Step 705, judge that mobile phone terminal adds whether success, if add unsuccessfully, then execution in step 706; Otherwise, execution in step 708;
Step 706, play IVR prompting handoff failure to fixed phone terminal, then execution in step 707;
Step 707, continuation send Media Stream to fixed phone terminal, continue to use the fixed phone terminal conference participation, and then execution in step 711;
Step 708, set up SIP with mobile phone terminal and be connected; Then execution in step 709;
Step 709, send the media stream data carry multimedia conferencing by media server to mobile phone, at this moment, mobile phone adds the multimedia conferencing success, and then execution in step 710;
Step 710, disconnection multimedia conferencing are connected with fixed phone terminal user's data, and then execution in step 711;
Step 711, finish fixed phone terminal to the switching flow of mobile phone terminal.
In like manner, mobile phone shown in Figure 8-process switched of fixed phone terminal similarly, repeat no more here.
Below in conjunction with Fig. 1 and Fig. 1 a, atomic function and the interacting message implementation of conference capability component subsystems 10 of the present invention are carried out brief description.
Fig. 9 is that the DTMF normality of conference capability component subsystems 10 of the present invention is monitored the interacting message schematic diagram in the atomic function implementation procedure., this process comprises:
1) service message bus (Service Message Bus) is received and is started DTMF normality monitoring service message, by inside story notice Participant SBB;
2) Participant SBB creates ContinueDTMF SBB provides ContinueDTMF professional;
3) ContinueDTMF SBB uses MSML Parser to create MSML;
4) MSML Parser returns the MSML for ContinueDTMF;
5) ContinueDTMF SBB sends sip message by the Session Initiation Protocol key-course, and the notice media server prepares to accept DTMF;
6) media server successful execution DTMF, and by SIP Control Layer notice ContinueDTMF SBB;
7) ContinueDTMF SBB returns the DTMF normality to Participant SBB and monitors the startup result;
8) Participant SBB returns the DTMF normality to Service Message Bus and monitors the startup result;
9) dialled number as the user, media server by SIP Control Layer notice DTMF SBB user broadcast number;
10) ContinueDTMF SBB reports Service Message Bus to dial the number;
11) ContinueDTMF SBB uses MSML Parser to create MSML;
12) MSML Parser returns the MSML for ContinueDTMF;
13) ContinueDTMF SBB sends sip message by the Session Initiation Protocol key-course, and the notice media server prepares to accept DTMF;
14) media server successful execution DTMF, and by SIP Control Layer notice ContinueDTMF SBB;
15) dialled number as the user, media server by SIP Control Layer notice DTMF SBB user broadcast number;
16) ContinueDTMF SBB reports Service Message Bus to dial the number.
Figure 10 is that the terminal of conference capability component subsystems of the present invention is switched the interacting message schematic diagram in atomic function (connect and the switch) implementation procedure, connecting and switch (ChangeConnection)---this atomic function is realized the mutual switching of bottom media links, is that the core of terminal handover module realizes part; Comprised and set up new terminal SIP connection, connected the new terminal Media Stream, disconnect the process that old terminal SIP connects, as shown in figure 10., this process comprises:
1) Service Message Bus receives that the backward Participant SBB of terminal switching message sends triggering message;
2) Participant SBB uses SIP Control Layer to create the SIP connection of new terminal;
3) SIP Control Layer returns the establishment result;
4) Participant SBB creates SetMedia SBB the business that user media is set is provided;
5) SetMedia SBB uses MSML Parser to create the MSML script;
6) MSML Parser returns the MSML script for SetMedia;
7) SetMedia SBB sends sip message by SIP Control Layer, wherein carries the msml script that creates meeting;
8) media server arranges the result by SIP Control Layer notice SetMedia SBB media;
9) SetMedia SBB is reported to Participant SBB with the result of media setting;
10) if invite successfully, Participant SBB is with the information write into Databasce of new terminal;
11) database returns and writes the result;
12) Participant SBB connects by the SIP that SIP Control Layer discharges old terminal;
13) SIP Control Layer returns the release result;
14) if discharge successfully, Participant SBB upgrades the old end message in the database;
15) database returns the renewal result;
16) Participant SBB is by Service Message Bus reporting terminal switching result.
Figure 11 is the user media state that the arranges atomic function implementation procedure schematic diagram of conference capability component subsystems of the present invention, the described user media state that arranges, namely this atomic function is implemented in the media state that the media server end arranges the user, as, floor status, the floor status etc. that stops.As shown in figure 11., this process comprises:
1) Service Message Bus receives participant's media information is set, by inside story notice Participant SBB;
2) Participant SBB creates SetMedia SBB the business that user media is set is provided;
3) SetMedia SBB uses MSML Parser to create the MSML script;
4) MSML Parser returns the MSML script for SetMedia;
5) SetMedia SBB sends sip message by SIP Control Layer, wherein carries the msml script that creates meeting;
6) media server arranges the result by SIP Control Layer notice SetMedia SBB media;
7) SetMedia SBB is reported to Participant SBB with the result of media setting;
8) Participant SBB reports the result that participant's media are set by Service Message Bus.
Figure 12 is the playing alert tones atomic function implementation procedure schematic diagram of conference capability component subsystems of the present invention, and this playing alert tones (PalyInform) atomic function is used for being implemented in mobile phone, fixed line end broadcast appointment prompt tone function.As shown in figure 12, this process comprises:
1) Service Message Bus receives the playing alert tones service message, by inside story notice Participant SBB;
2) Participant SBB creates Play SBB provides PLAY professional;
3) PLAY SBB uses MSML Parser to create MSML;
4) MSML Parser returns the MSML for PLAY;
5) PLAY SBB sends sip message by the Session Initiation Protocol key-course, and the notice media server prepares to accept PLAY;
6) media server successful execution PLAY, and by SIP Control Layer notice PLAY SBB;
7) Play SBB reports Participant SBB sign-off information;
8) Participant SBB reports the result of playing alert tones by Service Message Bus.
Introduce conference flow control subsystem 20 of the present invention below in conjunction with Fig. 1, Fig. 1 a and Fig. 2 and call the process that the atomic function of described conference capability component subsystems 10 is realized the multimedia control technology of multiple terminals, as described in Figure 1, the message on the messaging bus mainly contains dtmf signal, request message, terminal handover request message, finishes speech message, speech solicitation message and ruling results messages etc.
Wherein, dtmf signal is the character string that is made of " button # "; Request message, terminal handover request message, the message that finishes to make a speech, speech solicitation message all adopt the RequestMessage structure, as shown in Table 1; The ruling results messages adopts the JudgeResult structure, as shown in Table 2:
Table one request message structure
Table two ruling result
Monitor the request message of mobile phone and fixed phone terminal according to DTMF, intercept and capture and user-dependent information, and this information is sent to the request message routing module judge, and then this message of route is to conference speech strategic control module, terminal handover module or stop speaker module and carry out next step action, with the function that realizes selecting spokesman, terminal to switch and make a speech/stop etc.
The above is preferred embodiment of the present invention only, is not for limiting protection scope of the present invention.
Claims (9)
1. the multimedia conference control system of a multiple terminals is characterized in that, mainly comprises conference capability component subsystems and conference flow control subsystem; Wherein,
The conference capability component subsystems be used for to realize the business function of meeting bottom with media server the application programming interface API of described media server occuring directly to call alternately, and encapsulates its basic function interface and call for other functional modules; The business function of described meeting bottom comprises and realizes dual tone multi-frequency dtmf normality monitor function, voice document broadcast atomic function and the media state atomic function is set;
The conference flow control subsystem, be used for to realize meeting coarsegrain flow process control function, comprise and realize mobile phone, fixed phone terminal and web client solicitation message is obtained, message routing functionality, terminal switch function, conference speech policy control functions, terminal speech function and stop the function of making a speech; Described conference flow control subsystem further comprises: the DTMF normality is monitored module, is used to mobile phone, fixed phone terminal participation multimedia conferencing that DTMF real-time listening function is provided; The request message routing module is used for the unified external message that receives, and routes messages to associated component according to different message contents, with the route connection that realizes the speech application, message is switched in the application that stops to make a speech, terminal; The conference speech strategic control module is used for collecting the request speech message that mobile phone, fixed phone terminal and web client are sent, and adopts certain strategy to carry out ruling, then the ruling result is sent to the terminal speaker module; The terminal speaker module is used for the function that realization mobile phone, fixed phone terminal and web client are made a speech at multimedia conferencing, after the terminal speaking request goes through, makes a speech in multimedia conferencing by this terminal speaker module; Stop speaker module, be used for closing session member's floor status; The terminal handover module is used for being implemented in and carries out the meeting switching between mobile phone, fixed line, the web client.
2. the multimedia conference control system of multiple terminals according to claim 1 is characterized in that, this multimedia conference control system further comprises the terminal display subsystem, is used for realizing that the page status of web end shows; The page status demonstration of described terminal display subsystem comprises that floor status shows and terminal type shows.
3. the multimedia conference control system of multiple terminals according to claim 1 is characterized in that, described conference capability component subsystems comprises logic entity layer, meeting sub-services layer, Session initiation protocol SIP messaging layer and sip message adaptation layer.
4. the multimedia conference control system of multiple terminals according to claim 1, it is characterized in that, the external message that described request message routing module receives, comprise through the DTMF normality and monitor mobile phone that module receives or the request message in the fixed phone terminal dtmf signal, and from the request message of web client.
5. the implementation method of the multimedia conference control system of a multiple terminals is characterized in that, the method comprises:
A, unlatching media server DTMF monitor function, receive user's application of mobile phone or fixed phone terminal, and therefrom extract press key contents, relevant information according to telephone number is inquired about this user from the multimedia conferencing database forms request message with described press key contents and sends to the message routing module;
B, message routing module receive the request message of mobile phone or fixed phone terminal or web client, judge according to message content, and route messages to associated component according to judged result; If described message content then sends a message to the conference speech strategic control module for request speech message, and execution in step C; Switch relevant solicitation message if described message content is terminal, then send a message to the terminal handover module, and execution in step D; If described message content is to stop the relevant message of making a speech, then send a message to and stop speaker module, and execution in step E;
C, conference speech strategic control module adopt certain strategy to carry out ruling according to different mode of operations, and the ruling result are sent to the terminal speaker module according to request speech message, carry out conference speech by the participant by the terminal speaker module;
D, terminal handover module adopt soft handoff according to terminal handover request message, carry out meeting and switch between mobile phone, fixed phone terminal and web client;
E, stop speaker module according to the difference of the end of message reason that stops to make a speech, closing session member's floor status.
6. the implementation method of the multimedia conference control system of multiple terminals according to claim 5 is characterized in that, the described conference speech strategic control module of step C comprises three kinds of mode of operations: speech mode, enquirement pattern and discussion pattern; Described speech mode is applicable to the personal presentation stage in the meeting; The enquirement pattern is applicable to the enquirement stage in the meeting, to select the spokesman from numerous quizmasters; The discussion pattern is applicable to a plurality of participant members and makes a speech simultaneously.
7. according to claim 5 or the implementation method of the multimedia conference control system of 6 described multiple terminalss, it is characterized in that the ruling strategy that adopts according to the difference of mode of operation comprises: minimum speech frequency strategy, largest request frequency strategy and weighted fair queuing.
8. the implementation method of the multimedia conference control system of multiple terminals according to claim 5, it is characterized in that, described employing soft handoff is carried out meeting and is switched between mobile phone, fixed phone terminal and web client, specifically comprise mobile phone to fixed line, mobile phone to the web end, fixed line holds to web end, mobile phone to web, web holds mobile phone and web to hold six kinds of meetings of fixed line to control switching.
9. the implementation method of the multimedia conference control system of multiple terminals according to claim 5 is characterized in that, described basis stop to make a speech different closing session members' the floor status of end of message reason is divided into two kinds of situations and triggers; One stops speaking request and is sent by chairman end, stops speaker module and receives that this stops to change after the speaking request message spokesman's media state, ends this user's speech; Its two, stop speaking request and sent by the spokesman, when the spokesman make a speech finish after, the spokesman abandons right to speak, receives that by stopping speaker module this stops to change after the speaking request this spokesman's floor status, stops its speech.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010208459 CN101877706B (en) | 2010-06-24 | 2010-06-24 | Multi-terminal multimedia conference control system and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010208459 CN101877706B (en) | 2010-06-24 | 2010-06-24 | Multi-terminal multimedia conference control system and implementation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101877706A CN101877706A (en) | 2010-11-03 |
| CN101877706B true CN101877706B (en) | 2013-04-17 |
Family
ID=43020167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010208459 Expired - Fee Related CN101877706B (en) | 2010-06-24 | 2010-06-24 | Multi-terminal multimedia conference control system and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101877706B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102547211B (en) * | 2010-12-31 | 2014-04-16 | 苏州科达科技股份有限公司 | Video conference terminal controller on basis of serial port and control system thereof |
| CN102170362A (en) * | 2011-04-27 | 2011-08-31 | 苏州阔地网络科技有限公司 | Multi-speaker identity switching method and system for webpage-based network conference |
| CN103078749B (en) * | 2012-12-28 | 2016-01-27 | 中国科学院计算技术研究所 | A kind of for removable intelligent terminal provide raise one's voice service apparatus and method for |
| CN103473963B (en) * | 2013-09-26 | 2015-07-15 | 苏州阔地网络科技有限公司 | Synchronous classroom processing method and system |
| CN109412822A (en) * | 2014-03-05 | 2019-03-01 | 华为技术有限公司 | A kind of discussion group's right management method, apparatus and system |
| CN105049221B (en) * | 2015-06-30 | 2018-01-12 | 苏州科达科技股份有限公司 | Pass through routing device and realize that terminal installation receives the method and system that information is shared in meeting |
| CN106448294A (en) * | 2015-08-04 | 2017-02-22 | 中兴通讯股份有限公司 | Speech processing method and device, teaching terminal, and learning terminal |
| CN105656641A (en) * | 2016-02-22 | 2016-06-08 | 杨跃龙 | Intelligent party host assistance and information exchange system based on mobile Internet technology |
| CN105812717A (en) * | 2016-04-21 | 2016-07-27 | 邦彦技术股份有限公司 | Multimedia conference control method and server |
| CN106330932A (en) * | 2016-08-31 | 2017-01-11 | 苏州阳明诚商业管理有限公司 | Conference flow intelligent management system |
| CN112866976A (en) | 2017-02-07 | 2021-05-28 | 华为技术有限公司 | Data transmission method, terminal and access network element |
| CN107294839A (en) * | 2017-06-09 | 2017-10-24 | 南京跃豚智能科技有限公司 | The method and mobile terminal of session are quickly set up in mobile terminal |
| CN109089226A (en) * | 2017-06-13 | 2018-12-25 | 中兴通讯股份有限公司 | A kind of method, computer equipment and readable storage medium storing program for executing that right of speech is distributed, applied |
| CN110198430A (en) * | 2019-04-19 | 2019-09-03 | 视联动力信息技术股份有限公司 | A kind of method and device switching conference speech people |
| CN110493554B (en) * | 2019-07-17 | 2021-09-28 | 视联动力信息技术股份有限公司 | Method and system for switching speaking terminal |
| CN112261348B (en) * | 2020-10-20 | 2023-04-11 | 安徽师范大学 | Intelligent conference system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003055188A1 (en) * | 2001-12-19 | 2003-07-03 | Bellsouth Intellectual Property Corporation | Establishing a conference call from a call-log |
| WO2003055187A1 (en) * | 2001-12-19 | 2003-07-03 | Bellsouth Intellectual Property Corporation | Conference call setup automation |
| CN1607495A (en) * | 2002-03-29 | 2005-04-20 | 孙智峰 | Setting method and device for intelligent voice information bridge |
| CN1705336A (en) * | 2004-05-27 | 2005-12-07 | 华为技术有限公司 | Method for implementing telephone conference |
| CN1845501A (en) * | 2006-04-26 | 2006-10-11 | 朱志祥 | Method for remote controlling multi-point audio/video communication equipment using telephone terminal |
| CN101090476A (en) * | 2007-07-23 | 2007-12-19 | 杭州华三通信技术有限公司 | Switchover method for video terminal and multi-point control unit |
-
2010
- 2010-06-24 CN CN 201010208459 patent/CN101877706B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003055188A1 (en) * | 2001-12-19 | 2003-07-03 | Bellsouth Intellectual Property Corporation | Establishing a conference call from a call-log |
| WO2003055187A1 (en) * | 2001-12-19 | 2003-07-03 | Bellsouth Intellectual Property Corporation | Conference call setup automation |
| CN1607495A (en) * | 2002-03-29 | 2005-04-20 | 孙智峰 | Setting method and device for intelligent voice information bridge |
| CN1705336A (en) * | 2004-05-27 | 2005-12-07 | 华为技术有限公司 | Method for implementing telephone conference |
| CN1845501A (en) * | 2006-04-26 | 2006-10-11 | 朱志祥 | Method for remote controlling multi-point audio/video communication equipment using telephone terminal |
| CN101090476A (en) * | 2007-07-23 | 2007-12-19 | 杭州华三通信技术有限公司 | Switchover method for video terminal and multi-point control unit |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101877706A (en) | 2010-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101877706B (en) | Multi-terminal multimedia conference control system and implementation method | |
| CN105306757B (en) | A kind of multiside calling method and system of synchronisation | |
| US7283154B2 (en) | Systems and methods for videoconference and/or data collaboration initiation | |
| CN101465919B (en) | Method and system for implementing video conference | |
| CN103475499B (en) | A kind of speech talkback method and system based on network telephone conference | |
| CN100464514C (en) | Control method for holding the mixed telephone conference with the instant communication device | |
| CN102082884A (en) | Audio/video cooperation method and system based on 3G | |
| CN102550008A (en) | Controlling multi-party communications | |
| CN101291373B (en) | Method and system realizing multi-party communication | |
| CN101453524B (en) | Multimedia service implementing method | |
| CN108347337A (en) | Conference communication method and apparatus | |
| CN109802913A (en) | Merge meeting implementation method and device, electronic equipment, readable storage medium storing program for executing | |
| CN112040073B (en) | Intelligent directory assistance server, directory assistance system and directory assistance method | |
| CN102281367B (en) | The method and system of Three-Way Calling are realized in a kind of Click To Dial | |
| CN101902455B (en) | Open multimedia conference service system and implementing method thereof | |
| US20080037446A1 (en) | Facilitating connection to a conference call | |
| CN102387154B (en) | Method for realizing multi-party multimedia communication | |
| CN103595704B (en) | A kind of enterprise communication towards VOIP applies a key method of calling | |
| CN102316228B (en) | The methods, devices and systems of attendant intrusion call are realized in central office service | |
| CN101815138A (en) | Method and device for leaving meeting message | |
| CN106341410A (en) | IP phone with integration of third-party application and method | |
| EP2736212B1 (en) | Method and system for implementing broadcast group call in click to dial service | |
| CN105741050A (en) | Power grid dispatching method and device | |
| US20140294171A1 (en) | Multi-node predictive dialing for scalability | |
| CN103067189A (en) | Master-slave mode teleconference system based on converged communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130417 Termination date: 20150624 |
|
| EXPY | Termination of patent right or utility model |