Video switching processing method and multipoint control unit
Technical field
The present invention relates to the communications field, particularly, relate to a kind of video switching processing method and multipoint control unit.
Background technology
Multipoint control unit (Multi-point Control Unit, abbreviate MCU as) be a kind of equipment based on the multimedia application system of communicating by letter, can carry out the multiple spot service to a plurality of video conference terminals by MCU, multimedia services such as the voice that participate in, image are provided in many ways.
MCU is the control core of multi-spot video conference system, and its effect can be equivalent to a switch.MCU can be with after the audiovisual information stream process separated in synchronization from each meeting field point, extract information and signalings such as audio frequency, video, data, again with the information and the signaling of each meeting field point, send into a kind of processing module, unified corresponding audio mix or the processing procedures such as switching, video mix or switching, data broadcasting and Route Selection, timing and meeting control finished, at last that each meeting field point is required various information reconfigure, and are sent to each relevant terminal system equipment.
Usually, video data frame can be divided into a plurality of packets, sends to receiving terminal then on network, and receiving terminal is reduced into frame of video with each packet combination and decodes to Video Decoder after receiving complete data packet.Fig. 1 a shows the frame format according to the video Data Transmission of correlation technique, wherein can comprise 1, bag 2 ... bag n.
I frame (I-frame) is called inner picture (intra picture) again, and the I frame is first frame of image encoding normally, through moderately compression, as the reference point of random access, also can treat as image.The I frame is the same with video data, is divided into a plurality of packets when transmission, sends to receiving terminal then on network.
Receiving terminal may propose the request of video switch in the process of reception and display video data, in the process of this request, because packet switch self can cause switching the back usually and following problem occur:
1, receives the process of former frame of video in the former terminal before switching, produce the packet loss phenomenon, cause the received packet of receiving terminal imperfect, can't form correct frame of video, thereby cause to be correctly decoded (for example, shown in Fig. 1 b);
2, receive the process of former frame of video at the new terminal after switching, produce the packet loss phenomenon, cause the received packet of receiving terminal imperfect, can't form correct frame of video, thereby cause and to be correctly decoded;
3, the frame of video that receiving terminal received is not the I frame, be through just receiving the I frame after a plurality of frame of video, cause video switch after image show slowly.
Fig. 1 b shows according to the frame format that produces in the video Data Transmission of correlation technique when wrong.That is, occur from switching the incomplete problem of packet that preceding former terminal receives.
At the problems referred to above, corresponding countermeasure has been proposed at present, Fig. 2 a shows the handling process of this method, and Fig. 2 b shows the signaling process of this processing procedure on the network architecture.
In Fig. 2, suppose that the video switch that terminal A is gone up current shown terminal B becomes the video of terminal C, shown in Fig. 2 a and 2b, the hand-off process in the correlation technique may further comprise the steps:
202, receiving terminal (that is terminal A) sends the request (also can be switched by the autonomous decision of MCU) of video switch to MCU;
204, MCU sends freeze frame order (VideoCommand Freeze abbreviates VCF as) for receiving terminal (terminal A), and the decoding end that requires receiving terminal (terminal A) is avoided the output error image with the freeze frame of current shown terminal B;
206, MCU finishes video switch in inside;
208, MCU sends video update command (VideoCommand Update abbreviates VCU as) to new video source (that is, terminal C), requires the coding side in new video source (terminal C) to send the I frame as early as possible.
But there is the problem of not supporting VCF in present some video conference terminals, like this, just can't guarantee image after this Terminal Type can correctly show switching fast by above-mentioned video switch strategy.
Show wrong problem after the switching of not supporting VCF and being caused at video conference terminal, do not propose effective solution at present as yet.
Summary of the invention
Consider and show wrong problem after the switching that video conference terminal does not support VCF to cause in the correlation technique and make the present invention, for this reason, main purpose of the present invention is to provide a kind of video switching processing method and multipoint control unit, in order to solve the problems referred to above in the correlation technique.
According to an aspect of the present invention, provide a kind of video switching processing method.
Video switching processing method according to the present invention comprises: need switch under the situation of the 3rd terminal from second terminal from the second terminal receiver, video frame and first terminal in first terminal, multipoint control unit will be sent to first terminal from the current video frame of second terminal; After current video frame was sent completely, multipoint control unit sent the video update command with predetermined period to the 3rd terminal and obtains the I frame with request, and after obtaining the I frame I frame that obtains is sent to first terminal.
Wherein, after the 3rd terminal received video update command from multipoint control unit, further comprise: the 3rd terminal was sent to multipoint control unit with the I frame.
Wherein, after current video frame is sent completely, further comprise: multipoint control unit stops to send frame of video from second terminal to first terminal.
Wherein, after multipoint control unit is sent to first terminal with the I frame, further comprise: multipoint control unit will be sent to first terminal from the frame of video of the 3rd terminal.
According to a further aspect in the invention, provide a kind of multipoint control unit, this multipoint control unit is used for finishing switching first terminal need switch to the situation of the 3rd terminal from second terminal from the second terminal receiver, video frame and first terminal under.
Multipoint control unit according to the present invention comprises:
First sending module is used for the current video frame from second terminal is sent to first terminal;
Second sending module is used for sending the video update command with predetermined period to the 3rd terminal and obtains the I frame with request, receives the I frame until receiver module;
Control unit is used to control second sending module and sends the video update command to the 3rd terminal after first sending module sends current video frame;
Receiver module is used for receiving the I frame that request obtains from the 3rd terminal;
The 3rd sending module is used for the I frame that receiver module obtains is sent to first terminal.
Wherein, after first sending module sent current video frame, control unit notified first sending module to stop to send time-frequency frame from second terminal to first terminal.
Wherein, first sending module is further used for the frame of video from the 3rd terminal is sent to first terminal.
By in the technique scheme one of at least, by MCU the I frame that the 3rd terminal is sent is received detection, can determine whether the 3rd terminal begins to send frame of video, and when MCU receives the I frame, the frame of video that the 3rd terminal is sent is forwarded to first terminal, thereby on first terminal, can fast, correctly show the vision signal of the 3rd terminal, realized video switch accurately, avoid owing to show wrong problem after the switching that terminal is not supported VCF and caused.
Other features and advantages of the present invention will be set forth in the following description, and, partly from specification, become apparent, perhaps understand by implementing the present invention.Purpose of the present invention and other advantages can realize and obtain by specifically noted structure in the specification of being write, claims and accompanying drawing.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 a is the schematic diagram according to the frame format of the video Data Transmission of correlation technique;
Fig. 1 b is the schematic diagram that produces the frame format when wrong according to the switching rear video transfer of data of correlation technique;
Fig. 2 a is the process chart according to the video switching method of correlation technique;
Fig. 2 b is the signaling process schematic diagram according to the video switching method of correlation technique;
Fig. 3 is the structured flowchart according to the multipoint control unit of apparatus of the present invention embodiment;
Fig. 4 is the process chart according to the video switching processing method of the inventive method embodiment;
Fig. 5 a is the process chart of video switching processing method according to the preferred embodiment of the invention;
Fig. 5 b is the signalling diagram of video switching processing method on the network architecture according to the preferred embodiment of the invention.
Embodiment
Functional overview
At in the correlation technique owing to show wrong problem after the switching that terminal is not supported VCF and caused, the present invention proposes a kind of video switching processing method and multipoint control unit (MCU), wherein, in the method, by MCU the I frame that the 3rd terminal is sent is received detection, can determine whether the 3rd terminal begins to send frame of video, and when MCU receives the I frame, the frame of video that the 3rd terminal is sent is forwarded to first terminal, thereby can correctly show the vision signal of the 3rd terminal on first terminal fast.
Describe embodiments of the invention in detail below in conjunction with accompanying drawing.
Device embodiment
In the present embodiment, proposed a kind of MCU, this MCU is used for finishing switching first terminal need switch to the situation of the 3rd terminal from second terminal from the second terminal receiver, video frame and first terminal under.
Fig. 3 shows the MCU according to apparatus of the present invention embodiment, as shown in Figure 3, comprises according to the MCU of apparatus of the present invention embodiment: first sending module 32, second sending module 34, control unit 36, receiver module 38 and the 3rd sending module 40.
Below above-mentioned module and processing procedure are therebetween described.
First sending module 32 is used for the current video frame from second terminal is sent to first terminal, and this module is connected to control unit 36; Further, after first sending module 32 sent current video frame, control unit 36 notified first sending module 32 to stop to send time-frequency frame from second terminal to first terminal; And first sending module 32 is further used for the frame of video (that is the video data after the I frame) from the 3rd terminal is sent to first terminal.
Second sending module 34 is used for sending VCU with predetermined period to the 3rd terminal and obtains the I frame with request, receives the I frame until receiver module, and this module is connected to control unit 36.
Control unit 36 is used to control second sending module and sends VCU to the 3rd terminal after first sending module sends current video frame;
Receiver module 38 is used for receiving the I frame that request obtains from the 3rd terminal, and this module is connected to control unit 36;
The 3rd sending module 40 is used for the I frame that receiver module 38 obtains is sent to first terminal, and this module is connected to control unit 36, and is connected to receiver module 38;
By technique scheme, the video switching processing method that provides among the following method embodiment can be provided, that is,, can reach in the purpose that fast, correctly shows the image that the 3rd terminal after switching sends on first terminal by above-mentioned MCU.
Method embodiment
In the present embodiment, provide a kind of video switching processing method.
Fig. 4 shows the flow process according to the video switching processing method of the inventive method embodiment, as shown in Figure 4, comprises step S402 and step S404 according to the flow process of the video switching processing method of the inventive method embodiment.
Describe above-mentioned steps below in detail.
At first, execution in step S402 need switch under the situation of the 3rd terminal from second terminal from the second terminal receiver, video frame and first terminal in first terminal, and MCU will be sent to first terminal from the current video frame of second terminal;
And after the current video frame that second terminal sends to first terminal was sent completely, this method further comprised: MCU stops to send frame of video from second terminal to first terminal;
Secondly, execution in step S404, after current video frame was sent completely, MCU sent VCU with predetermined period to the 3rd terminal and obtains the I frame with request, and after obtaining the I frame I frame that obtains is sent to first terminal.
In step S404, after the 3rd terminal received VCU from MCU, the 3rd terminal was sent to MCU with the I frame.
And behind execution of step S404, that is, after MCU will be sent to first terminal from the I frame of the 3rd terminal, this method further comprised: MCU will be sent to first terminal from the frame of video of the 3rd terminal.
More specifically, can carry out according to video switching processing method of the present invention with following optimal way.
Fig. 5 a shows the handling process of the video switching processing method of effective embodiment according to the present invention, and Fig. 5 b shows the signalling diagram of above-mentioned handling process on the network architecture.
In Fig. 5 a, suppose that the video switch that terminal A is gone up current shown terminal B becomes the video of terminal C, shown in Fig. 5 a, the handling process of the video switching processing method of effective embodiment comprises the steps: according to the present invention
502, terminal A (the first above-mentioned terminal) or MCU send the video switch request;
504, the video code flow that MCU continues to send terminal B (the second above-mentioned terminal) finishes up to the current video frame transmission to A;
506, MCU finishes video switch;
508, MCU sends out VCU to terminal C (the 3rd above-mentioned terminal), requires terminal C to send the I frame as early as possible;
510, in the MCU sense terminals C transmitted stream whether the I frame is arranged, under the situation of receiving the I frame, execution in step 512 denys the person, execution in step 514;
512, MCU detects the I frame, and the I frame is sent to terminal A, and execution in step 516;
514, MCU does not detect the I frame, and at this moment, the data with terminal B do not send to A, and timed sending VCU gives terminal C, requires terminal C to send the I frame, and execution in step 516;
516, the video data of MCU terminal C after terminal A sends the I frame.
By technique scheme, can on first terminal, can correctly show the vision signal of the 3rd terminal fast.
In sum, by technical scheme of the present invention, by MCU the I frame that the 3rd terminal is sent is received detection, can determine whether the 3rd terminal begins to send frame of video, and when MCU receives the I frame, the frame of video that the 3rd terminal is sent is forwarded to first terminal, thereby the vision signal that on first terminal, can fast, correctly show the 3rd terminal, realized video switch accurately, avoided can't normal display data after not supporting VCF to cause switching owing to terminal equipment problem.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.