CN104980683A - Implement method and device for video telephone conference - Google Patents
Implement method and device for video telephone conference Download PDFInfo
- Publication number
- CN104980683A CN104980683A CN201410137468.5A CN201410137468A CN104980683A CN 104980683 A CN104980683 A CN 104980683A CN 201410137468 A CN201410137468 A CN 201410137468A CN 104980683 A CN104980683 A CN 104980683A
- Authority
- CN
- China
- Prior art keywords
- video
- phone
- participant
- participant side
- side phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides an implement method for a video telephone conference. The implement method mainly comprises the following operation steps: step a, a host telephone judges whether a current video decoding module simultaneously supports decoding of videos transmitted by newly added participant telephones or not; step b, a needed video polling mechanism is selected according to the operation of a user, and the host telephone further determines the working state of each participant telephone, i.e. determines the working state as a visible state or an invisible state, wherein the step a further comprises the steps as follows: the host telephone determines that the access number for supporting the decoding of video streams is L, determines that the total number of the participant telephones is H after the new participant telephones are added, and compares whether H is more than L. The above video polling mechanism comprises a fixed display mode, a random display mode, a timing display mode and a volume determining mode. According to the technical solution of the invention, the implement method of the invention enlarges the range of the participant telephones available for video display without increasing the hardware cost so as to further improve the reality sense of the video conference.
Description
Technical field
The invention belongs to communication technique field, especially based on multi-party video videoconference implementation method and the device of embedded communication apparatus.
Background technology
Under current global businesses environment, voice are important media that commercial affairs exchange, and phone is then the major interfaces of terminal use.Because every day all can hold a large amount of videoconferences, conference telephone becomes the important component part of all enterprise institutions end product combination.Therefore, the videoconference of integrated senior IP application program and high resolution audio and video technology can improve Consumer's Experience, and finally brings active influence to business exchange and workflow management.The video conference that VoIP phone on existing market provides, in view of the restriction of hardware decode chip performance, usually can under hosting side be arranged, other two side participants are invited to participate in, thus only branchedly hold 3 side video conference, when its other party thinks that request video connects, hosting side directly refuses.
The present invention wishes to support on the hardware foundation of 3 side video conference existing, improves with the participant increasing video conference further, improves the flexible expansion of existing VoIP phone.
Summary of the invention
The object of the present invention is to provide a kind of implementation method of video conference call, under the support of lower hardware cost, realizing the video conference that the above participant of tripartite holds can carry out video interactive each other.
In order to realize foregoing invention object, technical scheme of the present invention is as follows:
An implementation method for video conference call, comprises following operation: step a, the side's of hosting phone judge whether current video decoder module supports the decoding of described newly-increased participant side phone transmission of video simultaneously; Step b, select required video polling mechanism according to the operation of user, the operating state of all participant sides phone determined further by the side's of hosting phone, is defined as visible state or invisible mode.
Preferably, step a comprises further: the side's of hosting phone judges that the number of passages supporting video code flow decoding is L; After judgement newly-increased participant side phone, the quantity of all participant sides phone is H; Relatively whether H is beyond L.
Preferably, step a comprises further: the side's of hosting phone and newly-increased participant side phone carry out voice and be connected and be connected with video communication.
Preferably, step b comprises further: if H>L, then determine that participant side's phone of described visible state can arrange L, and shows described video polling mechanism menu for user operation.
Preferably, described invisible mode shows that the video communication of participant side's phone connects, and can receive and show from the video of hosting side's phone through aliasing process, but the video of participant side's phone does not send to hosting side's phone to carry out decoding display; Visible state shows that participant side's phone can receive and shows from the video of hosting side's phone through aliasing process, and the side's of hosting phone selects the video code flow of participant side's phone decode and show simultaneously.
Preferably, video polling mechanism can be fixing display mode, random display pattern, time display pattern, volume deterministic model.
Preferably, when the side's of hosting phone enters volume deterministic model, calculate the speech energy of each road call voice data by arranging energy calculation unit, and speech energy numerical value great Ji described in alternative connects on road the video code flow decoding channels of corresponding participant side phone to realize video poll.
In order to realize the object of the invention, the present invention program also comprises a kind of device realizing the videoconference of video polling type, be provided with video communication module, signaling negotiation module, OSD display module, video channel management, Video decoding module, Video Composition, Video coding, video display, and camera, it is characterized in that, described video channel management comprises: the video connection request judging to identify whether to have newly-increased participant side phone; Carry out video communication connection; Judge whether current video decoder module supports the decoding of described newly-increased participant side phone transmission of video simultaneously; The operating state of participant side's phone is switched according to video polling mechanism.
Preferably, described video channel management comprises: judge that the number of passages supporting video code flow decoding is L; After judgement newly-increased participant side phone, the quantity of all participant sides phone is H; Relatively whether H is beyond L, if H>L, then determines that participant side's phone of described visible state can arrange L.
Preferably, above-mentioned participant side phone switches between invisible mode and visible state, wherein said invisible mode shows that the video communication of described participant side phone connects, can receive and show through the video of aliasing process from described hosting side phone, but the video of described participant side phone does not send to described hosting side phone to carry out decoding display; Described visible state shows that described participant side phone can receive and shows through the video of aliasing process from described hosting side phone, and described hosting side phone selects the video code flow of described participant side phone decode and show simultaneously.
Preferably, under volume deterministic model, said apparatus also comprises energy calculation unit and routing unit, this energy calculation unit is for calculating the short-time energy of the speech data of each participant side phone, two participant side's id informations that routing unit selects volume maximum according to short-time energy, and sent to by id information described video management passage to connect the video code flow decoding channels of corresponding participant side phone.
The invention discloses a kind of technical scheme of carrying out multipart video-meeting expansion on existing video conference function basis, come by adopting video polling mechanism decode to the video code flow of different participant sides phone transmission and show in turn, thus the display of multiple participant sides image can be increased under the limited condition of decoding capability, improve the outdoor scene communication effectiveness of video conference.
Accompanying drawing explanation
Fig. 1 is prior art 3 side video conference operation principle schematic diagram;
Fig. 2 is the operation principle schematic diagram of polling type video conference mode in the embodiment of the present invention;
When Fig. 3 is traditional 3 side video conference, the side of hosting phone M looks closely and frequently shows schematic diagram;
Fig. 4 is the operation chart that the pattern of participant side's phone in polling type video conference of the present invention switches;
Fig. 5 is the display schematic diagram of polling type video conference of the present invention;
Fig. 6 is the operational flowchart of 3 side video conference expansion in the specific embodiment of the invention;
Fig. 7 is the flow chart of fixed video poll pattern in the specific embodiment of the invention;
Fig. 8 is the functional schematic of volume deterministic model in the specific embodiment of the invention;
Fig. 9 is that the state of volume deterministic model in the specific embodiment of the invention switches schematic diagram;
Figure 10 is the functional block diagram of video poll display in the specific embodiment of the invention.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, clear, complete description is carried out to the technical scheme in the embodiment of the present invention.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.Based on the embodiment in the present invention, the every other embodiment that those skilled in the art obtains all belongs to the scope of protection of the invention.
The meeting presiding side VoIP phone mentioned in the specific embodiment of the invention, support to carry out five tunnel calls, five talk lines arbitrarily switch, and provide traditional 3 side video conference simultaneously.Fig. 1 is prior art 3 side video conference operation principle schematic diagram.As shown in the drawing, the side of hosting phone M supports at most the decoding of two-path video bit stream data, one road video data encoding, therefore this traditional 3 side video conference function, can show participant side A, participant side B at hosting side phone M end, and the picture of self camera shooting, if now except above-mentioned participant side, when also having participant side phone C, participant side phone D to want request video to connect, phone M will directly refuse, and can only carry out voice with them and be connected.
Fig. 2 is the operation principle schematic diagram of polling type video conference mode in the embodiment of the present invention.As shown in the drawing, carry out in 3 side video conference process at hosting side M, participant side A, participant side B, if when phone C asks video to connect, the side of hosting M agrees to connect and the video codeword data stream after superposition is sent to phone C.So now, phone C also can see the video of part participant side.And according to the actual requirements, phone C can be designed to the video seeing other all meeting participants, or can only see the video of hosting side.Further improve as the present invention, after hosting side phone M holds agreement phone C to connect, also can receive the video code flow of phone C.Now, phone M can the video codeword data stream that sends of any two participant side's phones of selective decompression, and not as the video of decode all the time during traditional 3 side video conference phone A and phone B.
Therefore, following two kinds of video operating states are existed to the phone C asking later to add: (a) visible state: represent that video channel connects, video conference can be carried out, and the video data of this participant side will send to hosting side's phone to decode, other and square phone will be sent to show simultaneously; (b) invisible mode: represent that video channel connects, video conference can be carried out, but the video of this participant side does not send to hosting side's phone to decode, the video of other participant sides and hosting side can only be seen by this participant side, and the video data of this participant side can not be seen by other participant sides.
We just carry out video meeting implementing method explanation of the present invention based on above-mentioned VoIP phone below.Under common voice conferencing pattern, the voice data of each participant side is transmitted by voice channel, this voice channel is a passage transmitting voice data, original voice data is encoded through audio coder, then the other end participant side that RTP bag is sent to network is packaged into, coded data is passed to audio decoder to reduce voice data after receiving these RTP bag by this participant side's phone.After establishment completes videoconference, if video calling is selected by interface menu by hosting side, then on above-mentioned voice conferencing basis by the collect and transmit to respective participant side video image after create video conference further by the work of coding and decoding video.Therefore, participant side needs to send to hosting side after encoded for the image gathering its camera, receive the video data after video superimpose transmitted from hosting side simultaneously, thus realizing the image that this participant side's phone end shows other participant sides and hosting side, the side's of hosting phone end then can show the image of this participant side.
The polling type video conference mode that the present invention mentions carries out based on existing 3 side video conference the multipart video-meeting expanded.Phone M as this 3 side video conference supports at most the decoding of two-path video bit stream data, one road video data encoding, therefore can receive from the video data with phone A and phone B two-way, show on phone M after carrying out follow-up video code flow decoding separately. simultaneouslyAnd for Video coding aspect, the encoder that phone M holds is by from the camera image of dialect machine, phone A video data, the superposition of phone B coding video data, follow-up being sent to phone A and phone B is decoded and shows.When Fig. 3 is traditional 3 side video conference, the side of hosting phone M looks closely and frequently shows schematic diagram.As shown in the drawing, during 3 side video conference, the image of the image that phone M can show respectively local camera collection, the participant side A received and participant side B.
In order to more clearly demonstrate technical scheme of the present invention, set forth together with coming with state handover operation below in conjunction with the operating state of participant side's phone.Fig. 4 is the operation chart that the state of participant side's phone in polling type video conference of the present invention switches.As shown in the drawing, in video conference, each participant side phone has following three kinds of video operating states usually:
State one: audio frequency connection status, namely only audio frequency connect and video does not connect, represent that phone does not connect video channel, phone can only carry out audio conferencing, this state is in traditional 3 side video conference process, when adding new participant side's phone, this participant side's phone end can not show the video of any participant side, can only carry out voice interface with other participant sides;
State two: invisible mode, namely the video not opening decoding connects, represent that video channel connects, video conference can be carried out, but the video of this participant side does not send to hosting side's phone to decode, the video of other participant sides and hosting side can only be seen by this participant side, and the video data of this participant side can not be seen by other participant sides;
State three: visible state, namely the video having opened decoding connects, and represents that video channel connects, can carry out video conference, and the video data of this participant side will send to hosting side's phone to decode, other participant side's phones will be sent to show simultaneously.And send to other participant side's phones to show after carrying out video superimpose process by hosting side.
In video polling type of the present invention meeting, the number of, lines of video decode can be carried out according to hosting side phone M simultaneously, the participant side's phone arranging respective numbers is visible state, and the switching between the visible state of participant side's phone and invisible mode can adopt following four kinds of video polling mechanisms to carry out:
(1) fixing display mode: determined to select wherein two-way participant side phone by hosting side M, carry out video reception and process of decoding;
(2) random display pattern: receive any two-way participant side phone by Stochastic choice and decode;
(3) time display pattern: two-path video is wherein decoded;
(4) volume deterministic model: determine that video corresponding to maximum two-way volume is decoded by participant's volume.
Adopt video polling type conferencing technology scheme of the present invention, user can switch participant side's phone according to practical application request between above-mentioned three kinds of video operating states.For convenience of description, in the specific embodiment of the invention, we disclose description with the situation switched between state two, state three.
Continue as shown in Figure 4, the video switch operation between participant side's phone different operating state is described as follows:
Operation 1: connect video communication, and open the decoding channels of institute's receiver, video stream, in common 3 side video conference process of establishing, first participant side's phone carries out audio frequency connection, rear extended meeting is connected to hosting side's phone end because selecting video conference request, thus its mode of operation is switched to state three from state one;
Operation 2: disconnect video communication, if propose after above-mentioned participant side complete operation 1 to disconnect video request, then participant side's phone will return to state one video and not connect;
Operation 3: only connect video communication, do not open the decoding channels of institute's receiver, video stream, in polling type video conference of the present invention, other participant side's phones are connected to hosting side's phone end through request, then this participant side's phone gets the hang of two, namely this participant side enters the invisible mode in video polling mechanism of the present invention, and namely this participant side can only receive and see the video of other participant sides and hosting side, and the video data of this participant side can not be seen by other participant sides;
Operation 4: the video communication disconnecting video conference, if propose after above-mentioned participant side complete operation 3 to disconnect video request, then this participant side's phone will return to state one;
Operation 5: the decoding channels of closing institute's receiver, video code stream, in polling type video conference of the present invention, as the participant side's phone in original 3 side video conference, may be switched to state two because of adding of other participant sides after complete operation 1, the video mode being also about to 3 side video conference is before switched to the invisible mode of polling type video conference;
Operation 6: the decoding channels opening institute's receiver, video code stream, after other participants Fang Jing operation 3 enters the invisible mode in video polling mechanism, also may enter the visible state of polling type video conference through the selection operation of the side's of hosting phone.
Fig. 5 is the display schematic diagram of polling type video conference in the embodiment of the present invention.When after newly-increased participant side phone C, because the side of hosting phone M can only support the decoding of two-path video bit stream data, to take into account at hosting side phone M end the image showing all participant sides, the display in turn of video selection must be carried out between above-mentioned participant side.In the polling type video conference of the specific embodiment of the invention, phone M needs in phone A, phone B and phone C, select two-way to carry out video decode display, then other unchecked participant side phones just can only carry out audio data transmission in a meeting, and can only receive the image of other meetings of display personnel, and the image of this participant side can not be seen by other participants.If hold the fixing video decode display selecting phone A and phone C at phone M, namely belong to the visible state of above-mentioned state three.The image of host M, participant side A, participant side C now then can be shown at each participant phone end.
Fig. 6 is the operational flowchart of 3 side video conference expansion in the specific embodiment of the invention.In the figure, be at first on phone M, carry out 3 side video conference by phone M, phone A, phone B, then, the request due to other phones C enters polling type in many ways of the present invention video conference.As seen from the figure, this operating procedure mainly includes:
Step S610: phone C sends video conference request holds to the side of hosting phone M.
Step S620: phone M judges whether above-mentioned request is video conference request, if video conference request just goes to step S630, otherwise terminates.
Step S630: phone M judges whether current video decoder module supports the decoding of newly-increased video frequency channel simultaneously, if supported, goes to step S640 and enters ordinary video conference model, otherwise go to step S650.This operating procedure is mainly used for judging after video connects newly-increased participant side phone, the video code flow of suitable quantity is selected according to the decoding capability of phone M, phone M holds the need of unlatching polling type video conference mode, it comprises further: phone M judges the number of passages supporting video code flow decoding, is set to L; Judge all participant sides the Number of Telephone Sets after newly-increased participant side phone, be set to H; Relatively whether H is beyond L.In the specific embodiment of the invention, phone M supports that video code flow decoding path is 2, and after newly-increased phone C, the quantity of all participant sides phone is 3, and now obvious participant side the Number of Telephone Sets is beyond the ability of video decode.
Step S640: enter ordinary video conference model, namely phone M and phone C connects speech data, connects video communication, and opens the decoding video stream passage of received phone C.
Step S650: phone M agrees to that video connects phone C, first connects the speech data of this phone C, is arranged to preparation and enters polling type video conference mode of the present invention.
Step S660: the video code flow selecting suitable quantity according to the decoding capability of phone, display video polling mechanism menu is selected for user.If H>L, then determine that participant side's phone of described visible state can arrange L, and show described video polling mechanism menu for user operation.In the specific embodiment of the invention, two-path video code stream can only be selected to decode, namely two participant side's phone setups can only be become visible state, other participant side's phone is just arranged to invisible mode.And video polling mechanism i.e. above-mentioned four kinds: fixing display mode, random display pattern, time display pattern and volume deterministic model.
Step S670: according to host the video polling mode selected carry out between different video state to all participant sides phone handover operation, open or close the video decode passage of selected participant side's phone, in order to receive the video data that it sends over, and carry out video decode process.In the specific embodiment of the invention, if host selects the video poll of phone A and phone C with fixing display mode, then now phone M will be set to invisible mode phone B, and phone C is set to visible state.
Step S680: phone M carries out video mix superposition, to mix with the video data of local camera by decoded participant side phone video and superposes, and follow-uply the video code flow that this mixing superposes is sent to each participant side phone end.
Fig. 7 is the flow chart of fixed video poll pattern in the specific embodiment of the invention.As seen from the figure, in above-mentioned embodiment, 3 side video conference is carried out at hosting side phone M, phone A, phone B, the request of follow-up because phone C and in above-mentioned steps S660, the selected fixing display mode of meeting presider, and selected phone A and phone C is fixed display further, the show state of dialogue machine B and phone C is namely now needed to carry out switching adjustment.Then in step S670, specifically include following operation:
Step S710: fix display mode according to selected phone A and phone C, phone M carries out the switching of video decode passage, namely open the video decode passage of phone C thus the video decode passage of closedown phone B, send work state information by control channel to each participant side phone simultaneously.
Step S720: phone A receives above-mentioned work state information, and be judged as state three, then continue to keep sending speech data and video data to phone M, and receive the speech data after superposing from phone M and the video data after superposition.
Step S730: phone B receives above-mentioned work state information, and be judged as state two, then continue to keep sending speech data to phone M, but no longer send the video data from oneself camera to phone M, and continue to receive the speech data after superposing from phone M and the video data after superposition.
Step S740: phone C receives above-mentioned work state information, and be judged as state three, then send speech data to phone M, also send the video data from oneself camera to phone M simultaneously, and continue to receive the speech data after superposing from phone M and the video data after superposition.
The phone A that above-mentioned fixing display mode is chosen and phone C, they can by its local camera collection to video data be sent on hosting side phone M, phone M re-send to after carrying out video mix overlap-add procedure participant side phone A, phone B and phone C end show.
In time display pattern, set by the decode time of timer poll to received video data, this time size can be determined according to user's user demand.
In addition, also support the display poll of volume deterministic model in technical scheme disclosed in this invention, namely carry out poll according to audio volume size.Now, the side of hosting phone M judges according to the audio volume size of each participant side phone, the rule that current speaker preferentially shows.Audio processing modules will analyze the decibel of the voice data of each participant side, thus reach certain value by the lasting decibel value of participant side, judge which side is spoken, and then by video switch to this participant side, replace the video of non-spokesman at most.
Fig. 8 is the functional schematic of volume deterministic model in the specific embodiment of the invention.Two the participant sides arranging volume maximum are visible.This pattern needs audio processing modules associated treatment.For realizing the present invention, first the phone of meeting presiding side calculates the size of volume after the call voice data decode of other participant sides, afterwards, play in this locality after on the one hand other participant side's voice being made stereo process, two the participant side ID reporting speech volume maximum on the other hand.As shown in Figure 8, the side of hosting phone M calculates the short-time energy of each road call voice data by arranging energy calculation unit, namely calculate the speech energy of one section of set time length in real time, general set time length span is 10ms-16ms, to keep accuracy.Now have two kinds of modes can be used for calculating short-time energy, its effect is identical: a kind of is be added by the absolute value of speech data each in set time length, and another kind is added by the square value of speech data each in set time length.After routing unit obtains the speech energy of each participant side, process of simply sorting, two participant side ID that volume can be found maximum.The audio mixing of above process and voice is separate, can not make an amendment to speech data, thus also can not affect the subsequent voice process of meeting.As shown in table 1 for adopting the absolute value of speech data to be added the example judging call voice energy, wherein each time period length is identical, is 10ms.In table, the call voice of each numeric representation participant side A, B, C is at the energy of each time period, can select two participant sides that each time period should show, namely as shown in table 1 routing result bar according to comparing energy size.
Fig. 9 is that the state of volume deterministic model in the specific embodiment of the invention switches schematic diagram.The speech energy change of each participant side's phone end of table 1 different time sections.Because the speech energy value of T3-T4 period interphone B and phone C is the highest, therefore the T4 moment dispatches choosing phone B and phone C as needing the participant side of display, and be now connected with the video of hosting side phone M can shown in reference diagram 9 for participant side's phone.In phone M end main operational steps be:
(1) stop the video display of phone A, namely close the video decode passage of phone A, phone A is switched to invisible mode from visible state;
(2) open the video display of phone B, namely open the video decode passage of phone B, phone B is switched to visible state from invisible mode.
Table 1:
Figure 10 shows that the functional block diagram of video poll display in the specific embodiment of the invention.As seen from the figure, following functional module is comprised: video communication module, signaling negotiation module, OSD display module, video channel administration module, Video decoding module a, Video decoding module b, Video Composition, Video coding, video show, and camera at hosting side phone M end.Wherein, Video decoding module a and Video decoding module b comprises further: RTP buffer, video encoder, unit for scaling.
Video channel manages, be mainly used in the video state judging to identify each participant side's phone current, and the operation signaling of the host received according to OSD display module determines whether the video communication connecting the other side's phone, and when judging that participant side's phone video state changes, notice signaling negotiation module carries out notice alternately.Wherein, above-mentioned judgement identification comprises: 1) judge whether the video access request from the phone outside 3 side video conference; 2) select the video code flow of suitable quantity according to the decoding capability of phone M, phone M holds the need of unlatching polling type video conference mode, and it comprises further: phone M judges the number of passages supporting video code flow decoding, is set to L; Judge all participant sides the Number of Telephone Sets after newly-increased participant side phone, be set to H; Relatively whether H is beyond L.If H>L, then determine that participant side's phone of described visible state can arrange at most L, and show described video polling mechanism menu for user operation.In the specific embodiment of the invention, phone M supports that video code flow decoding path is 2, and after newly-increased phone C, the quantity of all participant sides phone is 3, and now obvious participant side the Number of Telephone Sets is beyond the ability of video decode.
In invention specific embodiment in polling type video conference, participant side's phone can comprise the switching of following three kinds of video states:
State one: audio frequency connection status, represents that phone only connects audio frequency and do not connect video channel, thus can only carry out audio conferencing;
State two: invisible mode, namely the video not opening decoding connects, represent that video channel connects, video conference can be carried out, but the video of this participant side does not send to hosting side's phone to decode, the video of other participant sides and hosting side can only be seen by this participant side, and the video data of this participant side can not be seen by other participant sides;
State three: visible state, namely the video having opened decoding connects, and represents that video channel connects, can carry out video conference, and the video data of this participant side will send to hosting side's phone to decode, other participant side's phones will be sent to show simultaneously.And send to other participant side's phones to show after carrying out video superimpose process by hosting side.
For convenience of description, the polling type video conference of our citing is based on newly-increased participant side phone situation on traditional 3 side video conference, so time participant side's phone only switch at visible state and invisible mode.And in the specific embodiment of the invention, adopt following video polling mechanism to carry out the setting poll of visible state and invisible mode: fixing display mode, random display pattern, time display pattern and volume deterministic model.In time display pattern, need to comprise timer to set the decode time to received video data.
Video communication module, sets up video code flow communication with each participant side phone and is connected, and for receiving the video code flow from participant side's phone, and sends the video code flow of hosting side phone M after aliasing.
Signaling negotiation module, be used for carrying out the mutual of control signal with each participant side phone, in the specific embodiment of the invention, when participant side's phone video state changes, this signaling negotiation module can send to participant side's phone according to the signaling data provided of video channel management.
OSD display module, is used for display four kinds of fixing display modes, random display pattern, time display pattern and volume deterministic model menu option for host's operation, and operating result is transferred to video channel management.
RTP buffer: receive RTP message from network, temporarily leaves in this buffer.
Video Decoder: the RTP load contents obtained from RTP buffer, then carries out corresponding decoding effort according to certain video decode algorithm, produces the original video data that can be used to encode or superpose or play.
Video encoder: original video data is encoded, for participant, these data are from camera image collection; For hosting side, these data from self camera collection, the video superimpose of meeting path management module.
Unit for scaling: decoded video size is reduced.
Video Composition: by the superposition of multiple original video data, shows to video display module image for the image transmitting generating final display.
In another specific embodiment of the present invention, if when carrying out video poll in employing volume deterministic model, above-mentioned video channel administration module further comprises energy calculation unit as shown in Figure 8 and routing unit, two participant side's id informations that routing Unit selection volume is maximum, and sent to by this circuit id information above-mentioned video management channel module to connect the video code flow decoding channels of corresponding participant side phone.
After above-mentioned video channel module receives routing requirement, whether the video that the side of hosting phone M can follow participant side's phone to consult this participant side continues to be received for display of decoding.The result finally provided according to routing selects the video data of reception two participants then to carry out aliasing together with the video data of local camera collection for decoding.Then output video data, for the interface display of local phone M, and are sent to each participant phone.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.
Claims (13)
1. an implementation method for video conference call, for it is characterized in that, described method comprises following operation:
Step a, described hosting side phone judge whether current video decoder module supports the decoding of described newly-increased participant side phone transmission of video simultaneously;
Step b, select required video polling mechanism according to the operation of user, the operating state of all participant sides phone determined further by described hosting side phone, is defined as visible state or invisible mode.
2. the implementation method of video conference call according to claim 1, is characterized in that, described step a comprises further: described hosting side phone judges that the number of passages supporting video code flow decoding is L; After judgement newly-increased participant side phone, the quantity of all participant sides phone is H; Relatively whether H is beyond L.
3. the implementation method of video conference call according to claim 2, is characterized in that, described step a can also comprise: described hosting side phone carries out audio frequency connection with newly-increased participant side phone, video communication is connected.
4. the implementation method of video conference call according to claim 3, it is characterized in that, described step b comprises further: if H>L, then determine that participant side's phone of described visible state can arrange L, and shows described video polling mechanism menu for user operation.
5. the implementation method of video conference call according to claim 4, it is characterized in that, described invisible mode shows that described participant side phone can receive and shows through the video of aliasing process from described hosting side phone, but the video of described participant side phone does not send to described hosting side phone to carry out decoding display; Described visible state shows that described participant side phone can receive and shows through the video of aliasing process from described hosting side phone, and described hosting side phone selects the video code flow of described participant side phone decode and show simultaneously.
6. the implementation method of video conference call according to claim 5, is characterized in that, described video polling mechanism can be fixing display mode, random display pattern, time display pattern, volume deterministic model.
7. the implementation method of video conference call according to claim 6, it is characterized in that, when described hosting side phone enters volume deterministic model, calculate the call voice energy of each road speech data by arranging energy calculation unit, and speech energy numerical value great Ji described in alternative connects on road the video code flow decoding channels of corresponding participant side phone to realize video poll.
8. the implementation method of video conference call according to claim 7, is characterized in that, described step b also comprises: described hosting side phone receives the video code flow of participant side's phone of described visible state, and opens the decoding channels of described receiver, video code stream.
9. the implement device of a video conference call, comprise video communication module, signaling negotiation module, OSD display module, video channel management, Video decoding module, Video Composition, Video coding, video display, and camera, it is characterized in that, described video channel management comprises: the video connection request judging to identify whether to have newly-increased participant side phone; Carry out video communication connection; Judge whether current video decoder module supports the decoding of described newly-increased participant side phone transmission of video simultaneously; The operating state of participant side's phone is switched according to video polling mechanism.
10. video conference call implement device according to claim 9, is characterized in that, described video channel management comprises: judge that the number of passages supporting video code flow decoding is L; After judgement newly-increased participant side phone, the quantity of all participant sides phone is H; Relatively whether H is beyond L, if H>L, then determines that participant side's phone of described visible state can arrange L.
11. video conference call implement devices according to claim 10, it is characterized in that, described participant side phone switches between invisible mode and visible state, wherein said invisible mode shows that the video communication of described participant side phone connects, can receive and show through the video of aliasing process from described hosting side phone, but the video of described participant side phone does not send to described hosting side phone to carry out decoding display; Described visible state shows that described participant side phone can receive and shows through the video of aliasing process from described hosting side phone, and described hosting side phone selects the video code flow of described participant side phone decode and show simultaneously.
12. video conference call implement devices according to claim 11, is characterized in that, described video polling mechanism can be fixing display mode, random display pattern, time display pattern, volume deterministic model.
13. video conference call implement devices according to claim 12, it is characterized in that, under described volume deterministic model, described device also comprises energy calculation unit and routing unit, described energy calculation unit is for calculating the short-time energy of the speech data of each participant side phone, two participant side's id informations that described routing unit selects volume maximum according to described short-time energy, and sent to by described id information described video management passage to connect the video code flow decoding channels of corresponding participant side phone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410137468.5A CN104980683A (en) | 2014-04-08 | 2014-04-08 | Implement method and device for video telephone conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410137468.5A CN104980683A (en) | 2014-04-08 | 2014-04-08 | Implement method and device for video telephone conference |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104980683A true CN104980683A (en) | 2015-10-14 |
Family
ID=54276728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410137468.5A Pending CN104980683A (en) | 2014-04-08 | 2014-04-08 | Implement method and device for video telephone conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104980683A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454200A (en) * | 2016-08-10 | 2017-02-22 | 惠州紫旭科技有限公司 | Video interaction method and video interaction system based on scene switching |
| CN107580191A (en) * | 2017-09-06 | 2018-01-12 | 合肥庆响网络科技有限公司 | Tele-conferencing system |
| CN108206817A (en) * | 2016-12-20 | 2018-06-26 | 中移（杭州）信息技术有限公司 | A kind of meeting route selecting method and device |
| CN108632562A (en) * | 2017-03-20 | 2018-10-09 | 展讯通信（上海）有限公司 | The method, apparatus of initiating conference phone, mostly logical terminal and network side equipment |
| CN109874179A (en) * | 2019-03-29 | 2019-06-11 | 深圳市昊一源科技有限公司 | Phone system, master controller, wireless processing unit and retransmission method |
| CN109889699A (en) * | 2019-02-15 | 2019-06-14 | 深圳市昊一源科技有限公司 | Wireless communication host, wireless communication tally system and retransmission method |
| CN109963107A (en) * | 2019-02-20 | 2019-07-02 | 视联动力信息技术股份有限公司 | A kind of display methods and system of audio, video data |
| CN110149492A (en) * | 2019-04-03 | 2019-08-20 | 视联动力信息技术股份有限公司 | A kind of resource allocation methods and device |
| CN111601064A (en) * | 2020-05-18 | 2020-08-28 | 维沃移动通信有限公司 | Information interaction method and information interaction device |
| CN112650464A (en) * | 2021-01-05 | 2021-04-13 | 深圳市捷视飞通科技股份有限公司 | Video picture display method, video picture display device, computer equipment and storage medium |
| CN113345281A (en) * | 2021-05-28 | 2021-09-03 | 上海易教科技股份有限公司 | Intelligent teaching system |
| CN113596349A (en) * | 2021-07-26 | 2021-11-02 | 世邦通信股份有限公司 | Conference method, system, device and storage medium for automatic linkage of speech position and video |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146208A (en) * | 2007-10-17 | 2008-03-19 | 中兴通讯股份有限公司 | Terminal with built-in multiple-point control unit and its communication method |
| CN101291417A (en) * | 2008-06-06 | 2008-10-22 | 中兴通讯股份有限公司 | Polling method and system for videoconference system |
| CN101483749A (en) * | 2009-01-20 | 2009-07-15 | 中兴通讯股份有限公司 | Video meeting implementing method and system based on media server |
| CN102244765A (en) * | 2011-07-05 | 2011-11-16 | 华平信息技术股份有限公司 | Multi-protocol-supported conference terminal interaction system and method |
| US20110279634A1 (en) * | 2010-05-12 | 2011-11-17 | Alagu Periyannan | Systems and methods for real-time multimedia communications across multiple standards and proprietary devices |
-
2014
- 2014-04-08 CN CN201410137468.5A patent/CN104980683A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146208A (en) * | 2007-10-17 | 2008-03-19 | 中兴通讯股份有限公司 | Terminal with built-in multiple-point control unit and its communication method |
| CN101291417A (en) * | 2008-06-06 | 2008-10-22 | 中兴通讯股份有限公司 | Polling method and system for videoconference system |
| CN101483749A (en) * | 2009-01-20 | 2009-07-15 | 中兴通讯股份有限公司 | Video meeting implementing method and system based on media server |
| US20110279634A1 (en) * | 2010-05-12 | 2011-11-17 | Alagu Periyannan | Systems and methods for real-time multimedia communications across multiple standards and proprietary devices |
| CN102244765A (en) * | 2011-07-05 | 2011-11-16 | 华平信息技术股份有限公司 | Multi-protocol-supported conference terminal interaction system and method |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454200A (en) * | 2016-08-10 | 2017-02-22 | 惠州紫旭科技有限公司 | Video interaction method and video interaction system based on scene switching |
| CN108206817B (en) * | 2016-12-20 | 2020-12-22 | 中移（杭州）信息技术有限公司 | Conference routing method and device |
| CN108206817A (en) * | 2016-12-20 | 2018-06-26 | 中移（杭州）信息技术有限公司 | A kind of meeting route selecting method and device |
| CN108632562A (en) * | 2017-03-20 | 2018-10-09 | 展讯通信（上海）有限公司 | The method, apparatus of initiating conference phone, mostly logical terminal and network side equipment |
| CN107580191A (en) * | 2017-09-06 | 2018-01-12 | 合肥庆响网络科技有限公司 | Tele-conferencing system |
| CN109889699A (en) * | 2019-02-15 | 2019-06-14 | 深圳市昊一源科技有限公司 | Wireless communication host, wireless communication tally system and retransmission method |
| CN109889699B (en) * | 2019-02-15 | 2023-11-28 | 深圳市昊一源科技有限公司 | Wireless call host, wireless call tally system and forwarding method |
| CN109963107A (en) * | 2019-02-20 | 2019-07-02 | 视联动力信息技术股份有限公司 | A kind of display methods and system of audio, video data |
| CN109963107B (en) * | 2019-02-20 | 2021-10-08 | 视联动力信息技术股份有限公司 | Audio and video data display method and system |
| CN109874179A (en) * | 2019-03-29 | 2019-06-11 | 深圳市昊一源科技有限公司 | Phone system, master controller, wireless processing unit and retransmission method |
| CN109874179B (en) * | 2019-03-29 | 2024-03-05 | 深圳市昊一源科技有限公司 | Communication system, main controller, wireless processing unit and forwarding method |
| CN110149492A (en) * | 2019-04-03 | 2019-08-20 | 视联动力信息技术股份有限公司 | A kind of resource allocation methods and device |
| CN111601064A (en) * | 2020-05-18 | 2020-08-28 | 维沃移动通信有限公司 | Information interaction method and information interaction device |
| CN111601064B (en) * | 2020-05-18 | 2022-02-22 | 维沃移动通信有限公司 | Information interaction method and information interaction device |
| CN112650464A (en) * | 2021-01-05 | 2021-04-13 | 深圳市捷视飞通科技股份有限公司 | Video picture display method, video picture display device, computer equipment and storage medium |
| CN112650464B (en) * | 2021-01-05 | 2024-02-06 | 深圳市捷视飞通科技股份有限公司 | Video picture display method, apparatus, computer device and storage medium |
| CN113345281A (en) * | 2021-05-28 | 2021-09-03 | 上海易教科技股份有限公司 | Intelligent teaching system |
| CN113596349A (en) * | 2021-07-26 | 2021-11-02 | 世邦通信股份有限公司 | Conference method, system, device and storage medium for automatic linkage of speech position and video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104980683A (en) | Implement method and device for video telephone conference | |
| CN1849824B (en) | System and method for performing distributed video conferencing | |
| US8289369B2 (en) | Distributed real-time media composer | |
| KR100880150B1 (en) | Multi-point video conference system and media processing method thereof | |
| CN100583985C (en) | Method, apparatus and system for switching pictures in video service | |
| CN101370114B (en) | Video and audio processing method, multi-point control unit and video conference system | |
| EP2119107B1 (en) | Multipoint conference video switching | |
| CN100562094C (en) | Camera with multiple frames at far end remote control thereof in a kind of TV conference system | |
| CN101478642A (en) | Multi-picture mixing method and apparatus for video meeting system | |
| JP6179834B1 (en) | Video conferencing equipment | |
| CN101198008A (en) | Method and system for implementing multi-screen and multi-picture | |
| CN102404547B (en) | Method and terminal for realizing video conference cascade | |
| EP1994743A2 (en) | System and method for displaying participants in a videoconference between locations | |
| CN101778181A (en) | Method and system for mobile terminal to achieve three-part call of videophone | |
| CN102868880A (en) | Media transmission method and system based on remote display | |
| CN101931783A (en) | Double-flow transmitting system and method for video session | |
| CN102025972A (en) | Mute indication method and device applied for video conference | |
| CN105472306A (en) | Video conference data sharing method and related device | |
| CN102348097B (en) | Session method and multi-point control unit for video conference | |
| CN101217634B (en) | A wireless video and audio communication device and system | |
| CN101656864A (en) | Method for realizing selection and watching of video and video session system | |
| US20190089754A1 (en) | System and method for providing audio conference between heterogenious networks | |
| CN101888377A (en) | Communication method, media server and communication system | |
| GB2511822A (en) | A telecommunication network | |
| CN101662643A (en) | Method for introducing real-time monitoring images/videos into video conference |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20151014 |