WO2012062153A1 - Method, system and mcu for achieving multipicture in cascade conference - Google Patents

Method, system and mcu for achieving multipicture in cascade conference Download PDF

Info

Publication number
WO2012062153A1
WO2012062153A1 PCT/CN2011/079892 CN2011079892W WO2012062153A1 WO 2012062153 A1 WO2012062153 A1 WO 2012062153A1 CN 2011079892 W CN2011079892 W CN 2011079892W WO 2012062153 A1 WO2012062153 A1 WO 2012062153A1
Authority
WO
WIPO (PCT)
Prior art keywords
mcu
video
video channel
transmitted
channel
Prior art date
Application number
PCT/CN2011/079892
Other languages
French (fr)
Chinese (zh)
Inventor
马铮
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012062153A1 publication Critical patent/WO2012062153A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Definitions

  • the present invention relates to the field of multimedia communications, and in particular, to a method, a system, and an MCU (Multipoint Control Unit) for implementing multiple pictures in a cascade conference.
  • MCU Multipoint Control Unit
  • the multi-picture synthesis is usually performed by the main MCU in the cascade conference, and the other secondary MCUs or lower-level MCUs are only responsible for the video stream of the terminal site. Passed to the main MCU. Since there is usually only one media channel between the primary MCU and the secondary MCU for one channel of video, that is, only one video channel of the terminal can be transmitted at the same time between the MCUs. Therefore, it is impossible to see multiple terminals on any MCU other than the non-master MCU in multiple pictures.
  • a method in the prior art is to perform a specific position on a multi-picture in a secondary MCU, that is, each sub-MCU only synthesizes a multi-picture sub-picture in which the own terminal is located, and then this is The incomplete multi-picture is sent to the main MCU, and finally the main MCU finally synthesizes the incomplete multi-picture received from each sub-MCU into a complete multi-picture.
  • Still another method is to use the main MCU to control each terminal MCU to display the terminal image under the multi-picture, and re-encode according to a certain strategy, for example, reduce the video format or encode the video. The rate is reduced, etc., so that the code rate is reduced, so that multiple video streams can be transmitted to the main MCU, and then the main MCU synthesizes multiple pictures.
  • the main object of the present invention is to provide a method, system and MCU for implementing multi-picture in a cascade conference, which aims to realize multi-channel video simultaneous transmission between two-level MCUs by using network broadband resources.
  • a method for implementing multiple pictures in a cascade conference including:
  • the second multipoint control unit MCU sends a video channel request to the first MCU
  • the first MCU allocates a video channel to the second MCU according to the preset allocation policy; the second MCU transmits the required video code stream to the first MCU by the first MCU for its assigned video channel.
  • the preset allocation policy includes:
  • the allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
  • the process of transmitting the video code stream by the second MCU includes:
  • the second MCU determines whether the video capability and the bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted;
  • the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU; if not, the required video code stream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU.
  • the method further includes:
  • the second MCU sends a video channel release request to the first MCU, and the first MCU releases the video channel.
  • the method further includes:
  • a call connection is established between the first MCU and the second MCU, and at least one video channel is established.
  • a system for implementing multi-picture in a cascade conference comprising a first MCU and a second MCU; wherein
  • the first MCU is configured to allocate a video channel to the second MCU according to the preset allocation policy after receiving the video channel application sent by the second MCU;
  • the second MCU is configured to send a video channel request to the first MCU, and transmit the required video code stream to the first MCU for the video channel allocated by the first MCU.
  • the preset allocation policy includes:
  • the allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
  • the second MCU is configured to: when transmitting the video code stream:
  • the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU; if not, the required video code stream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU.
  • the second MCU is further configured to: send a video channel release request to the first MCU; the first MCU is further configured to: release the corresponding view according to the received video channel release request Frequency channel.
  • the first MCU and the second MCU are further configured to establish a call connection with each other and establish at least one video channel.
  • a controller MCU that implements multi-picture in a cascade conference including:
  • a video channel application module configured to send a video channel request to another MCU, and transmit the required video code stream to the other MCU for the video channel allocated by the another MCU; the video channel allocation module, And after receiving the video channel application sent by the another MCU, assigning a video channel to the another MCU according to a preset allocation policy.
  • the video channel application module includes:
  • a determining unit configured to determine whether the video capability and bandwidth corresponding to the allocated video channel are the same as the video stream capacity to be transmitted; when the capability and bandwidth are the same as the video stream capacity to be transmitted, the required The video code stream is directly transmitted by the video channel allocated by the another MCU to the another MCU; when the video capability and bandwidth are different from the video stream capacity to be transmitted, the required video bitstream is performed. After the transcoding process, it is transmitted to the other MCU through the transmission unit.
  • the video channel application module is further configured to send a video channel release request to the another MCU.
  • the video channel allocation module is further configured to receive a video channel release request sent by the video channel application module, and release the corresponding video channel.
  • the invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-picture conferences are held, and the network bandwidth resources are fully utilized, and multiple channels can be transmitted in the same multi-picture cascade conference.
  • the video stream allows the multi-channel video stream to be transmitted with high quality and quality, without the limitation of video bandwidth, which causes image quality loss in multiple pictures.
  • FIG. 2 is a schematic diagram of a process for a second MCU to transmit a video code stream to a first MCU according to an embodiment of the present invention
  • FIG. 3 is a schematic flow chart of another embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a system according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a system according to another embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of an MCU according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an MCU according to an embodiment of the present invention as a first MCU and a second MCU;
  • FIG. 9 is a schematic structural diagram of a video channel application module in an MCU according to an embodiment of the present invention. detailed description
  • FIG. 1 is a schematic flow chart of an embodiment of the present invention.
  • Step S10 The second MCU sends a video channel application to the first MCU.
  • a video channel can be proposed by one of the two cascaded MCUs (Multipoint Control Units) transmitting the video.
  • the application includes the video capabilities to be transmitted, as well as the specific location of the video in the multi-picture.
  • the second MCU is the next-level MCU
  • the first MCU is the upper-level MCU.
  • the second MCU is the upper-level MCU
  • the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
  • Step S11 The first MCU allocates a video channel to the second MCU according to the preset allocation policy.
  • the first MCU allocates a video channel to the second MCU according to the preset allocation policy.
  • the preset allocation policy may include:
  • the video channel of the appropriate bandwidth is allocated according to the video capability (ie, the video stream format) to be transmitted in the video channel application.
  • the transmitted video stream format is less than or equal to CIF, and can be allocated a low bandwidth (for example, 384k) video channel;
  • the transmitted video stream format is greater than CIF less than or equal to 4CIF, and can be allocated a medium bandwidth ( For example, a 1M video channel; if the transmitted video stream format is greater than 4CIF, it can be assigned a high bandwidth (eg 2M or above) video channel.
  • the video channel of the appropriate bandwidth is allocated according to the specificity of the video stream to be transmitted in the video channel application in the multi-picture. For example: For a video stream of a small picture located in a multi-picture, a low-bandwidth (for example, 384k) video channel is allocated to it; for a large picture video stream located in a multi-picture, a medium bandwidth is allocated (for example) 1M) or high bandwidth (eg 2M) video channel.
  • a low-bandwidth for example, 384k
  • a medium bandwidth is allocated (for example) 1M) or high bandwidth (eg 2M) video channel.
  • the video channel will be allocated according to the second policy. For example, if the transmitted video stream is 720p in high definition, and the video stream is only displayed in a small picture of a multi-picture (for example, in a sub-picture of 16 pictures), a low-bandwidth video channel can be allocated thereto. .
  • Step S12 The second MCU transmits the required video code stream to the first MCU by the video channel allocated by the first MCU.
  • step S12 specifically includes:
  • Step S121 the second MCU determines whether the video capability and bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted; if yes, step S123 is performed; if not, step S122 is performed; Step S122, the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU;
  • Step S123 After transcoding the required video code stream, the video channel allocated by the first MCU is transmitted to the first MCU.
  • a multi-screen method is implemented in a cascade conference, which solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and the network bandwidth resources are fully utilized.
  • Multi-channel video streams can be transmitted in the same multi-view cascade conference, so that the multi-channel video stream can be transmitted with high quality and quantity, without the limitation of video bandwidth, resulting in image quality in multiple pictures. loss.
  • the method further includes:
  • Step S13 The second MCU sends a video channel release request to the first MCU, and the first MCU follows the video channel release request to release the corresponding video channel.
  • the second MCU proposes a video channel release request to the first MCU.
  • the first MCU receives the video channel release, the video channel resource is reclaimed.
  • the second MCU is the next-level MCU, and the first MCU is the upper-level MCU.
  • the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
  • This embodiment enables all multi-view cascading conferences between two MCUs to share video channels between two MCUs to maximize the sharing of bandwidth resources between the two MCUs.
  • the method further includes:
  • Step S14 The first MCU establishes a call connection with the second MCU, and establishes at least one video channel.
  • a call connection can be established between the first MCU and the second MCU by using a protocol based on H.320, H.323, SIP, or the like.
  • the specific video pass The number of channels, the capability and bandwidth of each video channel, establish a video channel through negotiation between the first MCU and the second MCU.
  • the first MCU and the second MCU can also use a customized message to interact, thereby negotiating the number of specific video channels, the capability and bandwidth of each video channel, and establishing a video channel.
  • the total bandwidth occupied by the above video channels should be less than or equal to the available bandwidth between the two MCUs.
  • the bandwidth occupied by each video channel can be allocated according to a fixed bandwidth; it can also be assigned in accordance with the video stream format.
  • Video channels can be classified into three types. For video streams smaller than CIF format, a fixed bandwidth of 384k is used. For video streams larger than CIF format smaller than 4CIF format, 1M fixed bandwidth is used. For videos larger than 4CIF format. The code stream uses a fixed bandwidth of 2M. The number of these three types of video channels can also be assigned in a ratio of 2: 2: 6.
  • FIG. 5 is a schematic structural diagram of a system according to an embodiment of the present invention.
  • a multi-view system is implemented in a cascade conference, including a first MCU 100 and a second MCU 200:
  • the first MCU 100 is configured to: after receiving the video channel application sent by the second MCU 200, allocate a video channel to the second MCU 200 according to the preset allocation policy;
  • the second MCU 200 is configured to send a video channel request to the first MCU 100, and transmit the required video code stream to the first MCU 100 for the video channel allocated by the first MCU 100.
  • the second MCU is the next-level MCU
  • the first MCU is the upper-level MCU
  • the second MCU is the upper-level MCU
  • the principle thereof is consistent with this embodiment.
  • the preset allocation policy includes: Assigned according to the video stream format to be transmitted; and/or
  • the allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
  • specific allocation method refer to the preset allocation strategy described in the above method.
  • the second MCU 200 is specifically configured to:
  • a multi-screen method is implemented in a cascade conference, which solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and the network bandwidth resources are fully utilized.
  • Multi-channel video streams can be transmitted in the same multi-view cascade conference, so that the multi-channel video stream can be transmitted with high quality and quantity, without the limitation of video bandwidth, resulting in image quality in multiple pictures. loss.
  • the second MCU 200 is further configured to: send a video channel release request to the first MCU 100; the first MCU 100 is further configured to: release the corresponding video channel according to the video channel release request.
  • the second MCU proposes a video channel release request to the first MCU.
  • the first MCU receives the video channel release, the video channel resource is reclaimed.
  • the second MCU is the next-level MCU, and the first MCU is the upper-level MCU.
  • the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
  • This embodiment enables all multi-view cascading conferences between two MCUs to share video channels between two MCUs to maximize the sharing of bandwidth resources between the two MCUs.
  • First MCU 100 and second MCU 200 Call connections can be established between protocols based on H.320, H.323, SIP, and the like.
  • the number of specific video channels, the capability and bandwidth of each video channel, and the video channel are established through negotiation between the first MCU 100 and the second MCU 200.
  • the first MCU 100 and the second MCU 200 can also use a customized message to interact, thereby negotiating the number of specific video channels, the capability and bandwidth of each video channel, to establish a video channel.
  • the first MCU in the multi-view system is a higher-level MCU
  • the second MCU is a lower-level MCU
  • the second MCU may be multiple.
  • the first MCU can be a primary MCU1
  • the second MCU can be a secondary MCU2 and a secondary MCU3.
  • the video transmission between the primary MCU1 and the secondary MCU2 and the secondary MCU3 is performed simultaneously, and the secondary MCU2 and the secondary MCU3 respectively transmit the video code stream of the required terminal to the video channel allocated by the primary MCU1.
  • Level MCU1, and thus the first stage MCU1 performs synthesis.
  • FIG. 7 is a schematic structural diagram of an MCU according to an embodiment of the present invention.
  • a multi-screen control MCU is implemented in a cascade conference, including:
  • the video channel application module 10 is configured to send a video channel request to another MCU, and transmit the required video code stream to another MCU for the video channel allocated by another MCU;
  • the video channel allocation module 20 is configured to allocate a video channel to another MCU according to a preset allocation policy after receiving a video channel application sent by another MCU.
  • the MCU may be the first MCU 100 or the second MCU 200 in a system that implements multiple pictures in a cascade conference. That is, when the video channel application module 201 in the second MCU 200 sends a video channel request to the first MCU 100, the video channel allocation module 102 of the first MCU 100 allocates a video channel to the second MCU 200 according to the preset allocation policy, thereby making the second MCU 200 The video channel application module 201 transmits the required video code stream to the first MCU 100 for the video channel allocated by the first MCU 100.
  • the video channel application module 10 specifically includes:
  • the determining unit 11 is configured to determine whether the video capability and bandwidth corresponding to the video channel allocated thereto are the same as the video stream capacity to be transmitted;
  • the transmitting unit 12 is configured to: when the video capability and bandwidth corresponding to the video channel allocated thereto are the same as the video stream capacity to be transmitted, transmit the required video code stream directly to the video channel allocated by another MCU. To another MCU;
  • the video transcoding unit 13 is configured to determine that the video capability and bandwidth corresponding to the video channel allocated by the video channel are different from the video stream capacity to be transmitted, and then transcode the required video code stream, and then transmit the video stream.
  • the unit is transferred to another MCU.
  • the video channel application module 10 is further configured to send a video channel release request to another MCU.
  • the video channel allocation module 20 is further configured to receive a video channel release request sent by the video channel application module, and release the corresponding video channel.
  • the method for implementing multi-picture in the cascade conference can send a video channel application to the first MCU by using the method in the cascading conference; the first MCU is configured according to the preset allocation policy.
  • the second MCU allocates a video channel; the second MCU transmits the required video code stream to the first MCU by the first MCU for its assigned video channel. Therefore, the present invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-picture conferences are held, and full use of network bandwidth resources can be transmitted in the same multi-view cascade conference.
  • the multi-channel video stream enables the multi-channel video stream to be transmitted in a quality-for-money manner without causing image quality loss in multiple pictures due to video bandwidth limitations.
  • the present invention provides a method, system and MCU for implementing multi-picture in a cascade conference. Transmitting, by the second MCU, a video channel request to the first MCU; the first MCU allocates a video channel to the second MCU according to the preset allocation policy; and the second MCU transmits the required video code stream to the video allocated by the first MCU The channel is transmitted to the first MCU. Therefore, the present invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and full use of network bandwidth resources can be transmitted in the same multi-view cascade conference.
  • the multi-channel video stream enables the multi-channel video stream to be transmitted in a quality-for-money manner without causing image quality loss in multiple pictures due to video bandwidth limitations.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention provides a method, a system and an MCU for achieving a multipicture in a cascade conference. A second MCU sends a video channel request to a first MCU; the first MCU allocates a video channel for the second MCU according to a preset allocation policy; the second MCU transmits a required video code stream to the first MCU through the video channel allocated by the first MCU to the second MCU. In the present invention, the problem that between two MCUs, only one path of video can be added to a multipicture when a cascade multipicture conference is held is solved, network bandwidth resources are fully utilized, and multiple paths of video code streams may be transferred in the same multipicture cascade conference, so that the multiple paths of video code streams may all be transmitted with quality and quantity guaranteed without picture quality deterioration in the multipicture due to limitation of video bandwidth.

Description

在级联会议中实现多画面的方法、 ***及 MCU 技术领域  Method, system and MCU technical field for implementing multi-picture in cascade conference
本发明涉及多媒体通讯领域， 尤其涉及一种在级联会议中实现多画面 的方法、 ***及 MCU ( Multipoint Control Unit, 多点控制单元；)。 背景技术  The present invention relates to the field of multimedia communications, and in particular, to a method, a system, and an MCU (Multipoint Control Unit) for implementing multiple pictures in a cascade conference. Background technique
随着网络和各种视音频设备的快速发展， 视频会议技术在本世纪有了 飞速的发展。 运营商、 政府部门、 军队、 企业等部门， 都在不断的新建或 扩容已有的视频会议***。 而且， 随着视讯技术的提升以及用户对***容 量的扩大， MCU之间的级联会议在现网环境中应用更加广泛。 通过多个 MCU级联召集会议的方式， 可以解决分层组网、 提高会议容量等问题。  With the rapid development of networks and various video and audio equipment, video conferencing technology has developed rapidly in this century. Operators, government departments, the military, enterprises and other departments are constantly building or expanding existing video conferencing systems. Moreover, with the improvement of video technology and the expansion of user capacity, the cascaded conferences between MCUs are more widely used in the existing network environment. Through multiple MCU cascading conferences, you can solve hierarchical networking and increase conference capacity.
在现有的多画面级联会议中， 多画面的合成通常是由级联会议中的主 MCU完成的， 而其他的次 MCU或是更低一级的 MCU只负责将终端会场 的视频码流传递到主 MCU。 由于主 MCU和次 MCU之间对于一路视频来 讲通常只有一个媒体通道，也就是说 MCU之间同一时刻只能传输一路终端 的视频码流。因此，如果想在多画面中看到多个非主 MCU外的任一次 MCU 上的多个终端， 是不可能的。  In the existing multi-view cascade conference, the multi-picture synthesis is usually performed by the main MCU in the cascade conference, and the other secondary MCUs or lower-level MCUs are only responsible for the video stream of the terminal site. Passed to the main MCU. Since there is usually only one media channel between the primary MCU and the secondary MCU for one channel of video, that is, only one video channel of the terminal can be transmitted at the same time between the MCUs. Therefore, it is impossible to see multiple terminals on any MCU other than the non-master MCU in multiple pictures.
为了解决上述问题，现有技术中有一种方法是采用在次 MCU上也进行 成在多画面的某个具***置，即每个次 MCU只合成自己终端所在的多画面 的子画面， 然后将这个不完整的多画面发送到主 MCU, 最后主 MCU将从 各个次 MCU上收到的不完整的多画面最终合成为一个完整的多画面。还有 另一种方法是采用主 MCU控制各个次 MCU将其下的需要显示在多画面中 的终端图像， 按照某个策略重新编码， 例如将视频格式降低或将视频编码 速率降低等， 使其码率降低， 从而可以传递多路视频码流到主 MCU, 再由 主 MCU合成多画面。 In order to solve the above problem, a method in the prior art is to perform a specific position on a multi-picture in a secondary MCU, that is, each sub-MCU only synthesizes a multi-picture sub-picture in which the own terminal is located, and then this is The incomplete multi-picture is sent to the main MCU, and finally the main MCU finally synthesizes the incomplete multi-picture received from each sub-MCU into a complete multi-picture. Still another method is to use the main MCU to control each terminal MCU to display the terminal image under the multi-picture, and re-encode according to a certain strategy, for example, reduce the video format or encode the video. The rate is reduced, etc., so that the code rate is reduced, so that multiple video streams can be transmitted to the main MCU, and then the main MCU synthesizes multiple pictures.
上述两种方法都是在主 MCU和次 MCU之间的媒体带宽不变的条件下 解决的。 但是， 随着网络传输技术的飞速发展， 网络带宽已经不再是资源 瓶颈。 因此， 可以充分利用网络带宽来更好地实现会议电视中级联会议的 多画面显示。 发明内容  Both of the above methods are solved under the condition that the media bandwidth between the primary MCU and the secondary MCU is constant. However, with the rapid development of network transmission technology, network bandwidth is no longer a resource bottleneck. Therefore, network bandwidth can be fully utilized to better realize multi-screen display of cascaded conferences in conference television. Summary of the invention
本发明的主要目的是提供一种在级联会议中实现多画面的方法、 *** 及 MCU, 旨在利用网络宽带资源， 实现两级 MCU之间的多路视频同时传 输。  The main object of the present invention is to provide a method, system and MCU for implementing multi-picture in a cascade conference, which aims to realize multi-channel video simultaneous transmission between two-level MCUs by using network broadband resources.
为了达到上述目的， 本发明的技术方案是这样实现的：  In order to achieve the above object, the technical solution of the present invention is achieved as follows:
一种在级联会议中实现多画面的方法， 包括：  A method for implementing multiple pictures in a cascade conference, including:
第二多点控制单元 MCU向第一 MCU发送视频通道申请；  The second multipoint control unit MCU sends a video channel request to the first MCU;
第一 MCU根据预置分配策略， 为第二 MCU分配视频通道； 第二 MCU将所需的视频码流由第一 MCU为其分配的视频通道传输至 第一 MCU。  The first MCU allocates a video channel to the second MCU according to the preset allocation policy; the second MCU transmits the required video code stream to the first MCU by the first MCU for its assigned video channel.
其中， 所述预置分配策略包括：  The preset allocation policy includes:
根据所要传输的视频码流格式来分配； 和 /或  Assigned according to the video stream format to be transmitted; and/or
根据所要传输的视频码流在多画面中的具***置来分配。  The allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
其中， 所述第二 MCU传输所述视频码流的过程包括：  The process of transmitting the video code stream by the second MCU includes:
第二 MCU判断第一 MCU为其分配的视频通道所对应的视频能力和带 宽与所要传输的视频码流能力是否相同；  The second MCU determines whether the video capability and the bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted;
若是，则将所需的视频码流直接由第一 MCU为其分配的视频通道传输 至第一 MCU; 若否，则将所需的视频码流进行转码处理后，再由第一 MCU 为其分配的视频通道传输至第一 MCU。 其中， 所述第二 MCU将所需的视频码流由第一 MCU为其分配的视频 通道传输至第一 MCU之后， 该方法还包括： If yes, the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU; if not, the required video code stream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU. After the second MCU transmits the required video code stream to the first MCU by the video channel allocated by the first MCU, the method further includes:
第二 MCU向第一 MCU发送视频通道释放请求 , 由第一 MCU释放视 频通道。  The second MCU sends a video channel release request to the first MCU, and the first MCU releases the video channel.
其中， 所述第二 MCU向第一 MCU发送视频通道申请之前， 该方法还 包括：  Before the second MCU sends a video channel request to the first MCU, the method further includes:
第一 MCU与第二 MCU之间互相建立呼叫连接， 并建立至少一条视频 通道。  A call connection is established between the first MCU and the second MCU, and at least one video channel is established.
一种在级联会议中实现多画面的***， 包括第一 MCU及第二 MCU; 其中，  A system for implementing multi-picture in a cascade conference, comprising a first MCU and a second MCU; wherein
所述第一 MCU, 用于在收到第二 MCU发送的视频通道申请后， 根据 预置分配策略， 为第二 MCU分配视频通道；  The first MCU is configured to allocate a video channel to the second MCU according to the preset allocation policy after receiving the video channel application sent by the second MCU;
所述第二 MCU, 用于向第一 MCU发送视频通道申请， 并将所需的视 频码流由第一 MCU为其分配的视频通道传输至第一 MCU。  The second MCU is configured to send a video channel request to the first MCU, and transmit the required video code stream to the first MCU for the video channel allocated by the first MCU.
其中， 所述预置分配策略包括：  The preset allocation policy includes:
根据所要传输的视频码流格式来分配； 和 /或  Assigned according to the video stream format to be transmitted; and/or
根据所要传输的视频码流在多画面中的具***置来分配。  The allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
其中， 所述第二 MCU传输所述视频码流时， 用于：  The second MCU is configured to: when transmitting the video code stream:
判断第一 MCU 为其分配的视频通道所对应的视频能力和带宽与所要 传输的视频码流能力是否相同；  Determining whether the video capability and bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted;
若是，则将所需的视频码流直接由第一 MCU为其分配的视频通道传输 至第一 MCU; 若否，则将所需的视频码流进行转码处理后，再由第一 MCU 为其分配的视频通道传输至第一 MCU。  If yes, the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU; if not, the required video code stream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU.
其中， 所述第二 MCU还用于： 向第一 MCU发送视频通道释放请求； 所述第一 MCU还用于： 根据收到的视频通道释放请求，释放相应的视 频通道。 The second MCU is further configured to: send a video channel release request to the first MCU; the first MCU is further configured to: release the corresponding view according to the received video channel release request Frequency channel.
其中， 所述第一 MCU与第二 MCU还用于在彼此之间互相建立呼叫连 接， 并建立至少一条视频通道。  The first MCU and the second MCU are further configured to establish a call connection with each other and establish at least one video channel.
一种在级联会议中实现多画面的控制器 MCU, 包括：  A controller MCU that implements multi-picture in a cascade conference, including:
视频通道申请模块， 用于向另一 MCU发送视频通道申请， 并将所需的 视频码流由所述另一 MCU为其分配的视频通道传输至所述另一 MCU; 视频通道分配模块， 用于在收到所述另一 MCU发送的视频通道申请 后， 根据预置分配策略， 为所述另一 MCU分配视频通道。  a video channel application module, configured to send a video channel request to another MCU, and transmit the required video code stream to the other MCU for the video channel allocated by the another MCU; the video channel allocation module, And after receiving the video channel application sent by the another MCU, assigning a video channel to the another MCU according to a preset allocation policy.
其中， 所述视频通道申请模块包括：  The video channel application module includes:
判断单元， 用于判断分配的所述视频通道所对应的视频能力和带宽与 所要传输的视频码流能力是否相同； 能力和带宽与所要传输的视频码流能力相同时， 将所需的所述视频码流直 接由所述另一 MCU分配的所述视频通道传输至所述另一 MCU; 视频能力和带宽与所要传输的视频码流能力不相同时， 将所需的所述视频 码流进行转码处理后， 再通过传输单元传输至所述另一 MCU。  a determining unit, configured to determine whether the video capability and bandwidth corresponding to the allocated video channel are the same as the video stream capacity to be transmitted; when the capability and bandwidth are the same as the video stream capacity to be transmitted, the required The video code stream is directly transmitted by the video channel allocated by the another MCU to the another MCU; when the video capability and bandwidth are different from the video stream capacity to be transmitted, the required video bitstream is performed. After the transcoding process, it is transmitted to the other MCU through the transmission unit.
其中，所述视频通道申请模块还用于向所述另一 MCU发送视频通道释 放请求；  The video channel application module is further configured to send a video channel release request to the another MCU.
所述视频通道分配模块还用于接收视频通道申请模块发送的视频通道 释放请求， 释放相应的视频通道。  The video channel allocation module is further configured to receive a video channel release request sent by the video channel application module, and release the corresponding video channel.
本发明解决了在召开级联多画面会议时，两个 MCU之间只能有一路视 频加入到多画面中的问题， 充分利用网络带宽资源， 在同一多画面级联会 议中可以传递多路视频码流， 使得这多路的视频码流都可以保质保量的进 行传输， 不会因视频带宽的限制而导致其在多画面中出现画质损耗。 附图说明 The invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-picture conferences are held, and the network bandwidth resources are fully utilized, and multiple channels can be transmitted in the same multi-picture cascade conference. The video stream allows the multi-channel video stream to be transmitted with high quality and quality, without the limitation of video bandwidth, which causes image quality loss in multiple pictures. DRAWINGS
图 1是本发明实施例的流程示意图；  1 is a schematic flow chart of an embodiment of the present invention;
图 2是本发明实施例中第二 MCU将视频码流传输至第一 MCU的流程 示意图；  2 is a schematic diagram of a process for a second MCU to transmit a video code stream to a first MCU according to an embodiment of the present invention;
图 3是本发明另一实施例的流程示意图；  3 is a schematic flow chart of another embodiment of the present invention;
图 4是本发明再一实施例的流程示意图；  4 is a schematic flow chart of still another embodiment of the present invention;
图 5是本发明实施例的***结构示意图；  FIG. 5 is a schematic structural diagram of a system according to an embodiment of the present invention; FIG.
图 6是本发明另一实施例的***结构示意图；  6 is a schematic structural diagram of a system according to another embodiment of the present invention;
图 7是本发明实施例的 MCU结构示意图；  7 is a schematic structural diagram of an MCU according to an embodiment of the present invention;
图 8是本发明实施例的 MCU作为第一 MCU及第二 MCU的结构示意 图；  8 is a schematic structural diagram of an MCU according to an embodiment of the present invention as a first MCU and a second MCU;
图 9是本发明实施例的 MCU中视频通道申请模块的结构示意图。 具体实施方式  FIG. 9 is a schematic structural diagram of a video channel application module in an MCU according to an embodiment of the present invention. detailed description
以下结合说明书附图及具体实施例进一步说明本发明的技术方案。 应当理解， 此处所描述的具体实施例仅仅用以解释本发明， 并不用于 限定本发明。  The technical solutions of the present invention are further described below in conjunction with the drawings and specific embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
图 1是本发明实施例的流程示意图。  FIG. 1 is a schematic flow chart of an embodiment of the present invention.
本实施例在级联会议中实现多画面的方法， 包括以下步驟：  The method for implementing multi-picture in a cascade conference in this embodiment includes the following steps:
步驟 S10、 第二 MCU向第一 MCU发送视频通道申请；  Step S10: The second MCU sends a video channel application to the first MCU.
当多画面级联会议需要使用特殊的视频通道来传递视频时， 则可以由 传输这路视频的两个级联 MCU ( Multipoint Control Unit, 多点控制单元 ) 中的其中一方向另一方提出视频通道申请。 该申请包括要传输的视频能力， 以及该路视频在多画面中的具***置。 本实施例中， 第二 MCU 为下一级 MCU, 第一 MCU为上一级 MCU。 当然， 第二 MCU为上一级 MCU, 第一 MCU为下一级 MCU, 其原理与本实施例一致。 步驟 Sll、第一 MCU根据预置分配策略， 为第二 MCU分配视频通道； 当第一 MCU收到第二 MCU发送的视频通道申请时，根据预置分配策 略， 为第二 MCU分配视频通道。 该预置分配策略可以包括： When a multi-picture cascade conference needs to use a special video channel to deliver video, a video channel can be proposed by one of the two cascaded MCUs (Multipoint Control Units) transmitting the video. Application. The application includes the video capabilities to be transmitted, as well as the specific location of the video in the multi-picture. In this embodiment, the second MCU is the next-level MCU, and the first MCU is the upper-level MCU. Of course, the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment. Step S11: The first MCU allocates a video channel to the second MCU according to the preset allocation policy. When the first MCU receives the video channel application sent by the second MCU, the first MCU allocates a video channel to the second MCU according to the preset allocation policy. The preset allocation policy may include:
( 1 )根据所要传输的视频码流格式来分配； 和 /或  (1) assigned according to the video stream format to be transmitted; and/or
根据视频通道申请中所要传输的视频能力 （即视频码流格式） 来分配 合适带宽的视频通道。 例如， 所传输的视频码流格式为小于或等于 CIF, 可 以为其分配低带宽 （例如 384k ) 的视频通道； 所传输的视频码流格式大于 CIF小于或等于 4CIF, 可以为其分配中带宽（例如 1M )的视频通道； 若所 传输的视频码流格式大于 4CIF, 可以为其分配高带宽 （例如 2M或以上 ) 的视频通道。  The video channel of the appropriate bandwidth is allocated according to the video capability (ie, the video stream format) to be transmitted in the video channel application. For example, the transmitted video stream format is less than or equal to CIF, and can be allocated a low bandwidth (for example, 384k) video channel; the transmitted video stream format is greater than CIF less than or equal to 4CIF, and can be allocated a medium bandwidth ( For example, a 1M video channel; if the transmitted video stream format is greater than 4CIF, it can be assigned a high bandwidth (eg 2M or above) video channel.
( 2 )根据所要传输的视频在多画面中的具***置来分配。  (2) Assign according to the specific location of the video to be transmitted in the multi-picture.
根据视频通道申请中所要传输的视频码流在多画面中的具体来分配合 适带宽的视频通道。 例如： 对于位于多画面中的小画面的视频码流， 则为 其分配低带宽 （例如 384k ) 的视频通道； 对于位于多画面中的大画面的视 频码流， 则为其分配中带宽（例如 1M )或高带宽（例如 2M )的视频通道。  The video channel of the appropriate bandwidth is allocated according to the specificity of the video stream to be transmitted in the video channel application in the multi-picture. For example: For a video stream of a small picture located in a multi-picture, a low-bandwidth (for example, 384k) video channel is allocated to it; for a large picture video stream located in a multi-picture, a medium bandwidth is allocated (for example) 1M) or high bandwidth (eg 2M) video channel.
在这里需要说明的是， 当上述两个策略产生沖突时， 将以第二策略为 准来分配视频通道。 例如： 所传输的视频码流为高清的 720p, 而该视频路 码流仅显示在多画面的小画面中 （例如 16画面中的某个子画面中）， 则可 以为其分配低带宽的视频通道。  It should be noted here that when the above two policies conflict, the video channel will be allocated according to the second policy. For example, if the transmitted video stream is 720p in high definition, and the video stream is only displayed in a small picture of a multi-picture (for example, in a sub-picture of 16 pictures), a low-bandwidth video channel can be allocated thereto. .
步驟 S12、 第二 MCU将所需的视频码流由第一 MCU为其分配的视频 通道传输至第一 MCU。  Step S12: The second MCU transmits the required video code stream to the first MCU by the video channel allocated by the first MCU.
参照图 2, 上述步驟 S12具体包括：  Referring to FIG. 2, the foregoing step S12 specifically includes:
步驟 S121、第二 MCU判断第一 MCU为其分配的视频通道所对应的视 频能力和带宽与所要传输的视频码流能力是否相同； 若是， 则执行步驟 S123; 若否， 则执行步驟 S122; 步驟 S122、 将所需的视频码流直接由第一 MCU为其分配的视频通道 传输至第一 MCU; Step S121, the second MCU determines whether the video capability and bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted; if yes, step S123 is performed; if not, step S122 is performed; Step S122, the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU;
步驟 S123、 将所需的视频码流进行转码处理后， 再由第一 MCU为其 分配的视频通道传输至第一 MCU。  Step S123: After transcoding the required video code stream, the video channel allocated by the first MCU is transmitted to the first MCU.
本实施例在级联会议中实现多画面的方法， 解决了在召开级联多画面 会议时， 两个 MCU之间只能有一路视频加入到多画面中的问题， 充分利用 网络带宽资源， 在同一多画面级联会议中可以传递多路视频码流， 使得这 多路的视频码流都可以保质保量的进行传输， 不会因视频带宽的限制而导 致其在多画面中出现画质损耗。  In this embodiment, a multi-screen method is implemented in a cascade conference, which solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and the network bandwidth resources are fully utilized. Multi-channel video streams can be transmitted in the same multi-view cascade conference, so that the multi-channel video stream can be transmitted with high quality and quantity, without the limitation of video bandwidth, resulting in image quality in multiple pictures. loss.
参照图 3 , 上述实施例中步驟 S12之后还包括：  Referring to FIG. 3, after step S12 in the foregoing embodiment, the method further includes:
步驟 S13、 第二 MCU向第一 MCU发送视频通道释放请求， 且由第一 MCU跟进视频通道释放请求 , 释放相应的视频通道。  Step S13: The second MCU sends a video channel release request to the first MCU, and the first MCU follows the video channel release request to release the corresponding video channel.
当级联会议不再需要视频通道进行视频传输时， 由第二 MCU 向第一 MCU提出视频通道释放请求。 第一 MCU收到视频通道释放时 , 则回收该 视频通道资源。 本实施例中， 第二 MCU为下一级 MCU, 第一 MCU为上 一级 MCU。 当然， 第二 MCU为上一级 MCU, 第一 MCU为下一级 MCU, 其原理与本实施例一致。  When the cascading conference no longer needs the video channel for video transmission, the second MCU proposes a video channel release request to the first MCU. When the first MCU receives the video channel release, the video channel resource is reclaimed. In this embodiment, the second MCU is the next-level MCU, and the first MCU is the upper-level MCU. Of course, the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
本实施例使得在两个 MCU之间的所有多画面级联会议可以共享两个 MCU之间的视频通道， 最大限度的共享两个 MCU之间的带宽资源。  This embodiment enables all multi-view cascading conferences between two MCUs to share video channels between two MCUs to maximize the sharing of bandwidth resources between the two MCUs.
参照图 4, 上述实施例步驟 S10之前还包括：  Referring to FIG. 4, before step S10 of the foregoing embodiment, the method further includes:
步驟 S14、 第一 MCU与第二 MCU建立呼叫连接， 并建立至少一条视 频通道。  Step S14: The first MCU establishes a call connection with the second MCU, and establishes at least one video channel.
当两个 MCU之间要召开级联会议时， 在两个 MCU之间除了建立级联 会议的呼叫连接外， 再建立多条视频通道。 第一 MCU与第二 MCU之间可 以通过基于 H.320、 H.323、 SIP等协议来建立呼叫连接。 而且具体的视频通 道的个数、 每条视频通道的能力及带宽， 都通过第一 MCU与第二 MCU之 间的协商而建立视频通道。 第一 MCU与第二 MCU之间还可以使用自定义 的消息进行交互， 从而协商出具体的视频通道的个数、 每条视频通道的能 力及带宽， 以建立视频通道。 When a cascade conference is to be held between two MCUs, in addition to establishing a call connection of the cascade conference between the two MCUs, multiple video channels are established. A call connection can be established between the first MCU and the second MCU by using a protocol based on H.320, H.323, SIP, or the like. And the specific video pass The number of channels, the capability and bandwidth of each video channel, establish a video channel through negotiation between the first MCU and the second MCU. The first MCU and the second MCU can also use a customized message to interact, thereby negotiating the number of specific video channels, the capability and bandwidth of each video channel, and establishing a video channel.
上述视频通道所占用的总带宽应小于或等于两个 MCU之间的可用带 宽。 而且， 每条视频通道所占用的带宽可以按照固定带宽来分配创建； 也 可以按照视频码流格式来分配创建。 例如： 可以将视频通道分为三类， 对 于小于 CIF格式的视频码流， 采用 384k的固定带宽； 对于大于 CIF格式小 于 4CIF格式的视频码流， 采用 1M的固定带宽； 对于大于 4CIF格式的视 频码流， 采用 2M的固定带宽。 该三种类型的视频通道的个数也可以按 2: 2: 6的比例进行分配。  The total bandwidth occupied by the above video channels should be less than or equal to the available bandwidth between the two MCUs. Moreover, the bandwidth occupied by each video channel can be allocated according to a fixed bandwidth; it can also be assigned in accordance with the video stream format. For example: Video channels can be classified into three types. For video streams smaller than CIF format, a fixed bandwidth of 384k is used. For video streams larger than CIF format smaller than 4CIF format, 1M fixed bandwidth is used. For videos larger than 4CIF format. The code stream uses a fixed bandwidth of 2M. The number of these three types of video channels can also be assigned in a ratio of 2: 2: 6.
图 5是本发明实施例的***结构示意图。  FIG. 5 is a schematic structural diagram of a system according to an embodiment of the present invention.
本实施例在级联会议中实现多画面的***， 包括第一 MCU100及第二 MCU200:  In this embodiment, a multi-view system is implemented in a cascade conference, including a first MCU 100 and a second MCU 200:
第一 MCU100, 用于接收第二 MCU200发送的视频通道申请后， 根据 预置分配策略， 为第二 MCU200分配视频通道；  The first MCU 100 is configured to: after receiving the video channel application sent by the second MCU 200, allocate a video channel to the second MCU 200 according to the preset allocation policy;
第二 MCU200, 用于向第一 MCU100发送视频通道申请， 并将所需的 视频码流由第一 MCU100为其分配的视频通道传输至第一 MCU100。  The second MCU 200 is configured to send a video channel request to the first MCU 100, and transmit the required video code stream to the first MCU 100 for the video channel allocated by the first MCU 100.
当多画面级联会议需要使用特殊的视频通道来传递视频时， 则可以由 传输这路视频的两个级联 MCU中的其中一方向另一方提出视频通道申请。 该申请包括要传输的视频能力， 以及该路视频在多画面中的具***置。 本 实施例中， 第二 MCU为下一级 MCU, 第一 MCU为上一级 MCU。 当然， 第二 MCU为上一级 MCU, 第一 MCU为下一级 MCU, 其原理与本实施例 一致。  When a multi-picture cascading conference needs to use a special video channel to deliver video, one of the two cascaded MCUs transmitting the video can make a video channel request from the other party. The application includes the video capabilities to be transmitted, as well as the specific location of the video in the multi-picture. In this embodiment, the second MCU is the next-level MCU, and the first MCU is the upper-level MCU. Of course, the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
上述第一 MCU100中， 预置分配策略包括： 根据所要传输的视频码流格式来分配； 和 /或 In the foregoing first MCU 100, the preset allocation policy includes: Assigned according to the video stream format to be transmitted; and/or
根据所要传输的视频码流在多画面中的具***置来分配。 具体分配方 法， 参照上述方法中所述的预置分配策略。  The allocation is based on the specific location of the video stream to be transmitted in the multi-picture. For the specific allocation method, refer to the preset allocation strategy described in the above method.
上述第二 MCU200具体用于：  The second MCU 200 is specifically configured to:
判断第一 MCU100为其分配的视频通道所对应的视频能力和带宽与所 要传输的视频码流能力是否相同； 若是， 则将所需的视频码流直接由第一 MCU100为其分配的视频通道传输至第一 MCU100; 若否， 则将所需的视 频码流进行转码处理后， 再由第一 MCU100为其分配的视频通道传输至第 一 MCUlOOo  Determining whether the video capability and bandwidth corresponding to the video channel allocated by the first MCU 100 are the same as the video stream capacity to be transmitted; if yes, transmitting the required video code stream directly to the video channel allocated by the first MCU 100 Up to the first MCU 100; if not, transcoding the desired video stream, and then transmitting the video channel allocated by the first MCU 100 to the first MCU 100o
本实施例在级联会议中实现多画面的方法， 解决了在召开级联多画面 会议时， 两个 MCU之间只能有一路视频加入到多画面中的问题， 充分利用 网络带宽资源， 在同一多画面级联会议中可以传递多路视频码流， 使得这 多路的视频码流都可以保质保量的进行传输， 不会因视频带宽的限制而导 致其在多画面中出现画质损耗。  In this embodiment, a multi-screen method is implemented in a cascade conference, which solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and the network bandwidth resources are fully utilized. Multi-channel video streams can be transmitted in the same multi-view cascade conference, so that the multi-channel video stream can be transmitted with high quality and quantity, without the limitation of video bandwidth, resulting in image quality in multiple pictures. loss.
上述第二 MCU200还用于： 向第一 MCU100发送视频通道释放请求； 上述第一 MCU100还用于： 根据视频通道释放请求，释放相应的视频通道。  The second MCU 200 is further configured to: send a video channel release request to the first MCU 100; the first MCU 100 is further configured to: release the corresponding video channel according to the video channel release request.
当级联会议不再需要视频通道进行视频传输时， 由第二 MCU 向第一 MCU提出视频通道释放请求。 第一 MCU收到视频通道释放时 , 则回收该 视频通道资源。 本实施例中， 第二 MCU为下一级 MCU, 第一 MCU为上 一级 MCU。 当然， 第二 MCU为上一级 MCU, 第一 MCU为下一级 MCU, 其原理与本实施例一致。  When the cascading conference no longer needs the video channel for video transmission, the second MCU proposes a video channel release request to the first MCU. When the first MCU receives the video channel release, the video channel resource is reclaimed. In this embodiment, the second MCU is the next-level MCU, and the first MCU is the upper-level MCU. Of course, the second MCU is the upper-level MCU, and the first MCU is the next-level MCU, and the principle thereof is consistent with this embodiment.
本实施例使得在两个 MCU之间的所有多画面级联会议可以共享两个 MCU之间的视频通道， 最大限度的共享两个 MCU之间的带宽资源。  This embodiment enables all multi-view cascading conferences between two MCUs to share video channels between two MCUs to maximize the sharing of bandwidth resources between the two MCUs.
当两个 MCU之间要召开级联会议时， 在两个 MCU之间除了建立级联 会议的呼叫连接外， 再建立多条视频通道。 第一 MCU100与第二 MCU200 之间可以通过基于 H.320、 H.323、 SIP等协议来建立呼叫连接。 而且具体的 视频通道的个数、 每条视频通道的能力及带宽， 都通过第一 MCU100与第 二 MCU200之间的协商而建立视频通道。 第一 MCU100与第二 MCU200 之间还可以使用自定义的消息进行交互， 从而协商出具体的视频通道的个 数、 每条视频通道的能力及带宽， 以建立视频通道。 When a cascade conference is to be held between two MCUs, in addition to establishing a call connection of the cascade conference between the two MCUs, multiple video channels are established. First MCU 100 and second MCU 200 Call connections can be established between protocols based on H.320, H.323, SIP, and the like. Moreover, the number of specific video channels, the capability and bandwidth of each video channel, and the video channel are established through negotiation between the first MCU 100 and the second MCU 200. The first MCU 100 and the second MCU 200 can also use a customized message to interact, thereby negotiating the number of specific video channels, the capability and bandwidth of each video channel, to establish a video channel.
上述实施例在级联会议中实现多画面的***中第一 MCU 为上级 MCU, 第二 MCU为下级 MCU, 而且该第二 MCU可以为多个。 例如图 6 所示， 第一 MCU可以为一级 MCU1 , 第二 MCU则为二级 MCU2及二级 MCU3。且一级 MCU1与二级 MCU2及二级 MCU3之间的视频传输分别同 时进行，二级 MCU2及二级 MCU3分别根据一级 MCU1为其分配的视频通 道将所需终端的视频码流传输至一级 MCU1 , 从而一级 MCU1进行合成处 示。  In the above embodiment, the first MCU in the multi-view system is a higher-level MCU, the second MCU is a lower-level MCU, and the second MCU may be multiple. For example, as shown in Figure 6, the first MCU can be a primary MCU1, and the second MCU can be a secondary MCU2 and a secondary MCU3. The video transmission between the primary MCU1 and the secondary MCU2 and the secondary MCU3 is performed simultaneously, and the secondary MCU2 and the secondary MCU3 respectively transmit the video code stream of the required terminal to the video channel allocated by the primary MCU1. Level MCU1, and thus the first stage MCU1 performs synthesis.
图 7是本发明实施例的 MCU结构示意图。  FIG. 7 is a schematic structural diagram of an MCU according to an embodiment of the present invention.
本实施例在级联会议中实现多画面的控制 MCU, 包括：  In this embodiment, a multi-screen control MCU is implemented in a cascade conference, including:
视频通道申请模块 10, 用于向另一 MCU发送视频通道申请， 并将所 需的视频码流由另一 MCU为其分配的视频通道传输至另一 MCU;  The video channel application module 10 is configured to send a video channel request to another MCU, and transmit the required video code stream to another MCU for the video channel allocated by another MCU;
视频通道分配模块 20, 用于接收另一 MCU发送的视频通道申请后， 根据预置分配策略， 为另一 MCU分配视频通道。  The video channel allocation module 20 is configured to allocate a video channel to another MCU according to a preset allocation policy after receiving a video channel application sent by another MCU.
参照图 8, 上述 MCU可以为在级联会议中实现多画面的***中的第一 MCU100, 也可以为第二 MCU200。 即当第二 MCU200中视频通道申请模 块 201向第一 MCU100发送视频通道申请， 第一 MCU100的视频通道分配 模块 102再根据预置分配策略， 为第二 MCU200分配视频通道， 从而使得 第二 MCU200的视频通道申请模块 201将所需的视频码流由第一 MCU100 为其分配的视频通道传输至第一 MCU100。 参照图 9, 上述视频通道申请模块 10具体包括： Referring to FIG. 8, the MCU may be the first MCU 100 or the second MCU 200 in a system that implements multiple pictures in a cascade conference. That is, when the video channel application module 201 in the second MCU 200 sends a video channel request to the first MCU 100, the video channel allocation module 102 of the first MCU 100 allocates a video channel to the second MCU 200 according to the preset allocation policy, thereby making the second MCU 200 The video channel application module 201 transmits the required video code stream to the first MCU 100 for the video channel allocated by the first MCU 100. Referring to FIG. 9, the video channel application module 10 specifically includes:
判断单元 11 , 用于判断为其分配的视频通道所对应的视频能力和带宽 与所要传输的视频码流能力是否相同；  The determining unit 11 is configured to determine whether the video capability and bandwidth corresponding to the video channel allocated thereto are the same as the video stream capacity to be transmitted;
传输单元 12, 用于判断为其分配的视频通道所对应的视频能力和带宽 与所要传输的视频码流能力相同时，将所需的视频码流直接由另一 MCU为 其分配的视频通道传输至另一 MCU;  The transmitting unit 12 is configured to: when the video capability and bandwidth corresponding to the video channel allocated thereto are the same as the video stream capacity to be transmitted, transmit the required video code stream directly to the video channel allocated by another MCU. To another MCU;
视频转码单元 13 , 用于判断为其分配的视频通道所对应的视频能力和 带宽与所要传输的视频码流能力不相同时， 将所需的视频码流进行转码处 理后， 再通过传输单元传输至另一 MCU。  The video transcoding unit 13 is configured to determine that the video capability and bandwidth corresponding to the video channel allocated by the video channel are different from the video stream capacity to be transmitted, and then transcode the required video code stream, and then transmit the video stream. The unit is transferred to another MCU.
上述视频通道申请模块 10还用于向另一 MCU发送视频通道释放请求。 视频通道分配模块 20还用于接收视频通道申请模块发送的视频通道释放请 求， 释放相应的视频通道。  The video channel application module 10 is further configured to send a video channel release request to another MCU. The video channel allocation module 20 is further configured to receive a video channel release request sent by the video channel application module, and release the corresponding video channel.
综上所述可见， 无论是方法、 ***还是 MCU, 本发明在级联会议中实 现多画面的技术可以由第二 MCU向第一 MCU发送视频通道申请； 第一 MCU根据预置分配策略， 为第二 MCU分配视频通道； 第二 MCU将所需 的视频码流由第一 MCU为其分配的视频通道传输至第一 MCU。 因此， 本 发明解决了在召开级联多画面会议时，两个 MCU之间只能有一路视频加入 到多画面中的问题， 充分利用网络带宽资源， 在同一多画面级联会议中可 以传递多路视频码流， 使得这多路的视频码流都可以保质保量的进行传输， 不会因视频带宽的限制而导致其在多画面中出现画质损耗。  In summary, the method for implementing multi-picture in the cascade conference can send a video channel application to the first MCU by using the method in the cascading conference; the first MCU is configured according to the preset allocation policy. The second MCU allocates a video channel; the second MCU transmits the required video code stream to the first MCU by the first MCU for its assigned video channel. Therefore, the present invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-picture conferences are held, and full use of network bandwidth resources can be transmitted in the same multi-view cascade conference. The multi-channel video stream enables the multi-channel video stream to be transmitted in a quality-for-money manner without causing image quality loss in multiple pictures due to video bandwidth limitations.
以上所述仅为本发明的优选实施例， 并非因此限制其专利范围， 凡是 利用本发明说明书及附图内容所作的等效结构或等效流程变换， 直接或间 接运用在其他相关的技术领域， 均同理包括在本发明的专利保护范围内。 工业实用性  The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the patents. The equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention. Industrial applicability
本发明提供了一种在级联会议中实现多画面的方法、 ***和 MCU, 可 以由第二 MCU向第一 MCU发送视频通道申请； 第一 MCU根据预置分配 策略， 为第二 MCU分配视频通道； 第二 MCU将所需的视频码流由第一 MCU为其分配的视频通道传输至第一 MCU。 因此， 本发明解决了在召开 级联多画面会议时， 两个 MCU之间只能有一路视频加入到多画面中的问 题， 充分利用网络带宽资源， 在同一多画面级联会议中可以传递多路视频 码流， 使得这多路的视频码流都可以保质保量的进行传输， 不会因视频带 宽的限制而导致其在多画面中出现画质损耗。 The present invention provides a method, system and MCU for implementing multi-picture in a cascade conference. Transmitting, by the second MCU, a video channel request to the first MCU; the first MCU allocates a video channel to the second MCU according to the preset allocation policy; and the second MCU transmits the required video code stream to the video allocated by the first MCU The channel is transmitted to the first MCU. Therefore, the present invention solves the problem that only one video between two MCUs can be added to multiple pictures when cascading multi-view conferences are held, and full use of network bandwidth resources can be transmitted in the same multi-view cascade conference. The multi-channel video stream enables the multi-channel video stream to be transmitted in a quality-for-money manner without causing image quality loss in multiple pictures due to video bandwidth limitations.

Claims

权利要求书 Claim
1、 一种在级联会议中实现多画面的方法， 包括：  1. A method for implementing multi-picture in a cascade conference, comprising:
第二多点控制单元 MCU向第一 MCU发送视频通道申请；  The second multipoint control unit MCU sends a video channel request to the first MCU;
第一 MCU根据预置分配策略， 为第二 MCU分配视频通道； 第二 MCU将所需的视频码流由第一 MCU为其分配的视频通道传输至 第一 MCU。  The first MCU allocates a video channel to the second MCU according to the preset allocation policy; the second MCU transmits the required video code stream to the first MCU by the first MCU for its assigned video channel.
2、 根据权利要求 1所述的方法， 其中， 所述预置分配策略包括： 根据所要传输的视频码流格式来分配； 和 /或  2. The method according to claim 1, wherein the preset allocation policy comprises: allocating according to a video stream format to be transmitted; and/or
根据所要传输的视频码流在多画面中的具***置来分配。  The allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
3、 根据权利要求 1所述的方法， 其中， 所述第二 MCU传输所述视频 码流的过程包括：  3. The method according to claim 1, wherein the process of transmitting the video code stream by the second MCU comprises:
第二 MCU判断第一 MCU为其分配的视频通道所对应的视频能力和带 宽与所要传输的视频码流能力是否相同；  The second MCU determines whether the video capability and the bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted;
若是，则将所需的视频码流直接由第一 MCU为其分配的视频通道传输 至第一 MCU; 若否， 则将所需的视频码流进行转码处理后，再由第一 MCU 为其分配的视频通道传输至第一 MCU。  If yes, the required video bitstream is directly transmitted to the first MCU by the first MCU for its assigned video channel; if not, the required video bitstream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU.
4、 根据权利要求 1至 3中任一项所述的方法， 其中， 所述第二 MCU 将所需的视频码流由第一 MCU为其分配的视频通道传输至第一 MCU之 后， 该方法还包括：  The method according to any one of claims 1 to 3, wherein the second MCU transmits a required video code stream to a video channel allocated by the first MCU to the first MCU, the method Also includes:
第二 MCU向第一 MCU发送视频通道释放请求 , 由第一 MCU释放视 频通道。  The second MCU sends a video channel release request to the first MCU, and the first MCU releases the video channel.
5、 根据权利要求 1至 3中任一项所述的方法， 其中， 所述第二 MCU 向第一 MCU发送视频通道申请之前， 该方法还包括：  The method according to any one of claims 1 to 3, wherein before the second MCU sends a video channel request to the first MCU, the method further includes:
第一 MCU与第二 MCU之间互相建立呼叫连接， 并建立至少一条视频 通道。 A call connection is established between the first MCU and the second MCU, and at least one video channel is established.
6、一种在级联会议中实现多画面的***，包括第一 MCU及第二 MCU; 其中， 6. A system for implementing a multi-picture in a cascade conference, comprising a first MCU and a second MCU; wherein
所述第一 MCU, 用于在收到第二 MCU发送的视频通道申请后， 根据 预置分配策略， 为第二 MCU分配视频通道；  The first MCU is configured to allocate a video channel to the second MCU according to the preset allocation policy after receiving the video channel application sent by the second MCU;
所述第二 MCU, 用于向第一 MCU发送视频通道申请， 并将所需的视 频码流由第一 MCU为其分配的视频通道传输至第一 MCU。  The second MCU is configured to send a video channel request to the first MCU, and transmit the required video code stream to the first MCU for the video channel allocated by the first MCU.
7、 根据权利要求 6所述的***， 其中， 所述预置分配策略包括： 根据所要传输的视频码流格式来分配； 和 /或  7. The system according to claim 6, wherein the preset allocation policy comprises: allocating according to a video stream format to be transmitted; and/or
根据所要传输的视频码流在多画面中的具***置来分配。  The allocation is based on the specific location of the video stream to be transmitted in the multi-picture.
8、 根据权利要求 6所述的***， 其中， 所述第二 MCU传输所述视频 码流时， 用于：  8. The system according to claim 6, wherein, when the second MCU transmits the video code stream, it is used to:
判断第一 MCU 为其分配的视频通道所对应的视频能力和带宽与所要 传输的视频码流能力是否相同；  Determining whether the video capability and bandwidth corresponding to the video channel allocated by the first MCU are the same as the video stream capacity to be transmitted;
若是，则将所需的视频码流直接由第一 MCU为其分配的视频通道传输 至第一 MCU; 若否，则将所需的视频码流进行转码处理后，再由第一 MCU 为其分配的视频通道传输至第一 MCU。  If yes, the required video code stream is directly transmitted to the first MCU by the video channel allocated by the first MCU; if not, the required video code stream is transcoded, and then the first MCU is Its assigned video channel is transmitted to the first MCU.
9、 根据权利要求 6至 8中任一项所述的***， 其中，  9. The system according to any one of claims 6 to 8, wherein
所述第二 MCU还用于： 向第一 MCU发送视频通道释放请求； 所述第一 MCU还用于： 根据收到的视频通道释放请求，释放相应的视 频通道。  The second MCU is further configured to: send a video channel release request to the first MCU; the first MCU is further configured to: release the corresponding video channel according to the received video channel release request.
10、 根据权利要求 6至 8中任一项所述的***， 其中， 所述第一 MCU 与第二 MCU还用于在彼此之间互相建立呼叫连接，并建立至少一条视频通 道。  The system according to any one of claims 6 to 8, wherein the first MCU and the second MCU are further configured to establish a call connection with each other and establish at least one video channel.
11、 一种在级联会议中实现多画面的控制器 MCU, 包括：  11. A controller MCU that implements multi-picture in a cascade conference, including:
视频通道申请模块， 用于向另一 MCU发送视频通道申请， 并将所需的 视频码流由所述另一 MCU为其分配的视频通道传输至所述另一 MCU; 视频通道分配模块， 用于在收到所述另一 MCU发送的视频通道申请 后， 根据预置分配策略， 为所述另一 MCU分配视频通道。 Video channel application module, used to send a video channel request to another MCU, and will be required The video code stream is transmitted to the other MCU by the video channel allocated by the another MCU; the video channel allocation module is configured to, according to the preset allocation policy, after receiving the video channel application sent by the another MCU , allocating a video channel to the other MCU.
12、 根据权利要求 11所述的 MCU, 其中， 所述视频通道申请模块包 括：  The MCU of claim 11, wherein the video channel application module comprises:
判断单元， 用于判断分配的所述视频通道所对应的视频能力和带宽与 所要传输的视频码流能力是否相同； 能力和带宽与所要传输的视频码流能力相同时， 将所需的所述视频码流直 接由所述另一 MCU分配的所述视频通道传输至所述另一 MCU; 视频能力和带宽与所要传输的视频码流能力不相同时， 将所需的所述视频 码流进行转码处理后， 再通过传输单元传输至所述另一 MCU。  a determining unit, configured to determine whether the video capability and bandwidth corresponding to the allocated video channel are the same as the video stream capacity to be transmitted; when the capability and bandwidth are the same as the video stream capacity to be transmitted, the required The video code stream is directly transmitted by the video channel allocated by the another MCU to the another MCU; when the video capability and bandwidth are different from the video stream capacity to be transmitted, the required video bitstream is performed. After the transcoding process, it is transmitted to the other MCU through the transmission unit.
13、 根据权利要求 11或 12所述的 MCU, 其中，  13. The MCU according to claim 11 or 12, wherein
所述视频通道申请模块还用于向所述另一 MCU发送视频通道释放请 求；  The video channel application module is further configured to send a video channel release request to the another MCU;
所述视频通道分配模块还用于接收视频通道申请模块发送的视频通道 释放请求， 释放相应的视频通道。  The video channel allocation module is further configured to receive a video channel release request sent by the video channel application module, and release the corresponding video channel.
PCT/CN2011/079892 2010-11-08 2011-09-20 Method, system and mcu for achieving multipicture in cascade conference WO2012062153A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010549145.9 2010-11-08
CN2010105491459A CN102006451A (en) 2010-11-18 2010-11-18 Method, system and MCU (Micro Control Unit) for realizing multipicture in cascade meeting

Publications (1)

Publication Number Publication Date
WO2012062153A1 true WO2012062153A1 (en) 2012-05-18

Family

ID=43813471

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/079892 WO2012062153A1 (en) 2010-11-08 2011-09-20 Method, system and mcu for achieving multipicture in cascade conference

Country Status (2)

Country Link
CN (1) CN102006451A (en)
WO (1) WO2012062153A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102006451A (en) * 2010-11-18 2011-04-06 中兴通讯股份有限公司 Method, system and MCU (Micro Control Unit) for realizing multipicture in cascade meeting
CN102611562B (en) 2012-02-06 2015-06-03 华为技术有限公司 Method and device for establishing multi-cascade channel
CN105704424A (en) * 2014-11-27 2016-06-22 中兴通讯股份有限公司 Multi-image processing method, multi-point control unit, and video system
CN105827633B (en) * 2016-05-06 2021-02-02 浙江大华技术股份有限公司 Video transmission method and device
CN113301292B (en) * 2021-05-13 2023-08-18 广州市迪士普音响科技有限公司 Audio/video conference MCU cascading method, system, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1968119A (en) * 2006-09-07 2007-05-23 华为技术有限公司 Method for resource sharing among MCUs in videoconference system
CN101110939A (en) * 2006-07-17 2008-01-23 中兴通讯股份有限公司 Method for multi-picture control in cascade connection conference television system
CN101262587A (en) * 2008-03-31 2008-09-10 杭州华三通信技术有限公司 A method and multi-point control units for realizing multi-image video conference
CN101345844A (en) * 2008-08-28 2009-01-14 杭州华三通信技术有限公司 Multimedia code stream transmission method and multi-point control cell
CN102006451A (en) * 2010-11-18 2011-04-06 中兴通讯股份有限公司 Method, system and MCU (Micro Control Unit) for realizing multipicture in cascade meeting

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100454820C (en) * 2006-07-04 2009-01-21 华为技术有限公司 MCU cascade system and establishing and communication method for the same
CN101562587B (en) * 2008-04-14 2014-11-05 展讯通信（上海）有限公司 Wireless transmission method based on subcarrier and device thereof
CN101656864A (en) * 2009-08-26 2010-02-24 中兴通讯股份有限公司 Method for realizing selection and watching of video and video session system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110939A (en) * 2006-07-17 2008-01-23 中兴通讯股份有限公司 Method for multi-picture control in cascade connection conference television system
CN1968119A (en) * 2006-09-07 2007-05-23 华为技术有限公司 Method for resource sharing among MCUs in videoconference system
CN101262587A (en) * 2008-03-31 2008-09-10 杭州华三通信技术有限公司 A method and multi-point control units for realizing multi-image video conference
CN101345844A (en) * 2008-08-28 2009-01-14 杭州华三通信技术有限公司 Multimedia code stream transmission method and multi-point control cell
CN102006451A (en) * 2010-11-18 2011-04-06 中兴通讯股份有限公司 Method, system and MCU (Micro Control Unit) for realizing multipicture in cascade meeting

Also Published As

Publication number Publication date
CN102006451A (en) 2011-04-06

Similar Documents

Publication Publication Date Title
CN100454820C (en) MCU cascade system and establishing and communication method for the same
KR100880150B1 (en) Multi-point video conference system and media processing method thereof
US7373379B2 (en) Media role management in a video conferencing network
US8830294B2 (en) Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
EP3203682B1 (en) System and method for providing phone related services to devices using upnp on a home network
US20070299983A1 (en) Apparatus for synchronizing multicast audio and video
US20070297454A1 (en) Systems and methods for multicasting audio
CN110062191B (en) Multi-party group meeting method and server based on video network
WO2011088656A1 (en) Method and system for implementing three-party call of videophone by mobile terminals
EP2130346B1 (en) Media stream setup in a group communication system
CN103581610A (en) Method and system for conducting video conferences of diverse participating devices
WO2012041117A1 (en) Method, system and related device for centralized monitoring of video conference terminal
CN101262587A (en) A method and multi-point control units for realizing multi-image video conference
CN101656864A (en) Method for realizing selection and watching of video and video session system
WO2012062153A1 (en) Method, system and mcu for achieving multipicture in cascade conference
WO2015127799A1 (en) Method and device for negotiating on media capability
CN100454821C (en) Method for resource sharing among MCUs in videoconference system
WO2012068940A1 (en) Method for monitoring terminal through ip network and mcu
CN111478884B (en) Method, device and storage medium for data transmission among different video networks
WO2014177082A1 (en) Video conference video processing method and terminal
CN110830750A (en) Data transmission method and device based on video network
US9013537B2 (en) Method, device, and network systems for controlling multiple auxiliary streams
TWI495345B (en) Video conference system and method using the same
CN100366080C (en) Method of implementing switching of single picture and multi-pictures in conference television system
CN101998105B (en) Media control server cascade system as well as method and device for controlling multimedia code streams

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11839968

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11839968

Country of ref document: EP

Kind code of ref document: A1