WO2008131644A1 - A method, device and system for realizing picture switching in the video service - Google Patents

A method, device and system for realizing picture switching in the video service Download PDF

Info

Publication number
WO2008131644A1
WO2008131644A1 PCT/CN2008/000848 CN2008000848W WO2008131644A1 WO 2008131644 A1 WO2008131644 A1 WO 2008131644A1 CN 2008000848 W CN2008000848 W CN 2008000848W WO 2008131644 A1 WO2008131644 A1 WO 2008131644A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
screen
mixer
image information
information
Prior art date
Application number
PCT/CN2008/000848
Other languages
French (fr)
Chinese (zh)
Inventor
Xiangwen Zhu
Zongwu Wu
Xufeng Zhou
Yan Mo
Xin Qu
Jiafeng Liu
Yuan Li
Original Assignee
Huawei Technologies Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co., Ltd. filed Critical Huawei Technologies Co., Ltd.
Publication of WO2008131644A1 publication Critical patent/WO2008131644A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • the present invention relates to video technologies, and in particular, to a method, device and system for implementing picture switching in a video service. Background technique
  • the video conferencing system allows conference participants to interact with voice, video, and data in real time, greatly facilitating communication and communication between conference participants.
  • a multipoint control unit MCU
  • the conference sites of the conference; the user terminal equipment mainly realizes the input and output of voice, image and data, as well as the functions of communication connection and data transmission and reception; more than two user terminal equipments and MCUs construct a multi-point, real-time conference communication environment.
  • the user views images of other users through the terminal device and listens to the sounds of other users.
  • the main processing flow of a multi-screen display implementation method is as follows:
  • the site image terminal data from each conference terminal is processed by the H.221 frame processing module to form a plurality of source high-speed serial image data code streams that meet the H.221 standard;
  • the plurality of source high-speed serial image data streams are exchanged through the source high-speed serial data channel and exchanged to one or more target high-speed serial data channels to form one or more of the video wall target monitoring terminals.
  • the CIF standard digital image is sent to the picture combining module to be combined into a "combined mode of the fixed mode, and the combined picture is encoded and then framed to form a multi-picture image data code stream, through exchange mesh switching and H.221 frames.
  • the processing module processes and sends it to each terminal, thereby implementing multi-screen display of each terminal.
  • the technical solution is mainly for a specific conference television system, and the conference video wall needs to be set up on the MCU side, and the application has a large limitation; in addition, the user can only view the same multi-picture image and the multi-screen display function is single.
  • the embodiment of the invention provides a method, a device and a system for implementing a screen switching in a video service, and a user for participating in a video service can independently select a screen display mode to view an image according to requirements.
  • a method for implementing a screen display in a video service comprising the steps of:
  • the multipoint control unit MCU receives a handover request message including a screen display mode for indicating the number of sub-pictures displayed on the screen.
  • the MCU determines a required picture mixer based on the picture display mode, and outputs a picture image corresponding to the requested picture display mode to the user terminal that transmits the switching request message.
  • a screen display device implemented in a video service comprising:
  • control module configured to manage multi-picture control information, and dynamically determine a picture mixer according to a picture display mode
  • a decoding module configured to decode a video source image data stream of each user terminal to obtain a plurality of screen image information
  • a picture combining module configured to perform multi-screen combination by one or more picture mixers according to the multi-picture control information, to obtain combined multi-picture image information
  • the encoding module is configured to encode the combined multi-picture image information accordingly.
  • a video service system comprising: a multipoint control unit MCU, wherein the MCU is configured to connect to a plurality of user terminals through a network, and receive a handover request message including a screen display mode sent by the user terminal, and according to the screen
  • the display mode determines a required screen mixer, and outputs a screen image corresponding to the requested screen display mode to the user terminal transmitting the switching request message; the screen display mode is for indicating the number of sub-screens displayed on the screen.
  • the multi-point control unit MCU outputs a screen image corresponding to the screen display mode to the terminal where the user is located according to the screen display mode selected by the user, and the user participating in the video service can view the image in the same screen display mode, or can be independent according to needs. Selecting the screen display mode to view the image realizes flexible switching between the multi-screen display mode, the multi-screen display mode and the single-screen display mode, and satisfies the user's demand for differently viewing the conference image.
  • FIG. 1 is a schematic structural diagram of a conference video system in the prior art
  • FIG. 2 is a schematic structural diagram of a multipoint control unit according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a screen combination module according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a multi-screen display mode according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram showing an implementation principle of displaying a conference image by a plurality of user terminals in a four-screen display mode according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of displaying, by a plurality of user terminals, a conference image in a four-screen display mode according to an embodiment of the present invention
  • FIG. 7 is a flowchart of an implementation of displaying a conference image by user A selecting a six-screen display mode according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of a user A, B, and C. D terminal displaying a conference image when user A selects a six-screen display mode according to an embodiment of the present invention
  • FIG. 9 is a flowchart of an implementation of displaying a conference image by a user C selecting a single screen display mode according to an embodiment of the present invention.
  • D terminal 10 is a user A, B, and C when user C selects a single-screen display mode according to an embodiment of the present invention.
  • D terminal displays a schematic diagram of the conference image
  • FIG. 11 is a flowchart of implementing a frame identifier sub-picture according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram showing the display of a frame identifier sub-screen according to an embodiment of the present invention.
  • the video conference system in this embodiment includes a multi-point control unit MCU and a plurality of user terminals connected to the MCU through a network.
  • the MCU structure of the multi-point control unit is as shown in FIG. 2, and the MCU includes control.
  • the control module 20 is configured to manage multi-screen control information, which is obtained by negotiating with a user terminal participating in the video conference, and playing video menu prompt information to the user terminal participating in the video conference, and dynamically allocating the screen according to the screen display mode selected by the user.
  • the multi-picture control information includes input video source information, picture mixture information, and multi-picture output information; the input video source information includes identification information of each decoder and pixel precision of each input video source image; The number of picture mixers to be supported, the multi-picture image pixel precision, and the attribute information of each picture mixer.
  • the multi-picture image pixel accuracy is usually determined as the maximum image pixel accuracy in each participant terminal, and may also be based on system requirements.
  • the attribute information of the screen mixer includes a mode of multi-screen display, a position of each sub-screen in the multi-screen display mode, and identification information of an encoder corresponding to each sub-screen;
  • the multi-screen output information includes identifier information of each encoder, Correct The mixer identifier and output image pixel accuracy should be the same.
  • the control module 20 specifies a default picture mixer when the video conference is initialized, and the attribute of the picture mixer can be dynamically changed according to the number of user terminals participating in the video conference during the conference, but cannot be deleted; In the process, according to the screen selected by the user The mode determines the corresponding picture mixer, and the corresponding picture mixing mixer can be added, or these picture mixers can be deleted dynamically.
  • the decoding module 21 is composed of a plurality of decoders, and is configured to decode the video source image code stream of the user terminal participating in the video conference, and transmit the decoded video source image information to the screen combining module 22 through the data bus;
  • Each of the output image streams is assigned a decoder, and each decoder decodes the input image stream using a decoding algorithm (such as H.263, MPEG-4, etc.) that matches the input image stream encoding algorithm.
  • the image information is restored; each decoder supports multiple decoding algorithms, and an initialization matching algorithm is performed when assigned to the input image code stream.
  • the picture combining module 22 is configured to perform multi-screen combination on the plurality of video source image information output by the decoder by using one or more picture blenders according to the multi-picture control information, and transmit the combined multi-picture image information to the data bus through the data bus.
  • Encoding module 23 as shown in FIG.
  • the picture combining module 22 further includes: an image data input unit 220, configured to receive video source image information output by the decoding module 21; and a plurality of first samplers 221 for Comparing the pixel precision of the corresponding video source image in the image data input unit 220 with the image pixel precision of the corresponding position of the video source image in the multi-picture, and when the two are inconsistent, sampling the video source image information, and sampling The subsequent video source image information is output to the picture mixer 222; otherwise, the video source image information is directly output to the picture mixer 222; the sampling includes upsampling and downsampling, such as dropping the image with a pixel precision of 704 X 576 (4CIF) Sampling an image of 352 x 288 (CIF) or upsampling an image with a pixel accuracy of 176 ⁇ 144 (QCIF) An image with a pixel precision of 352 x 288 (CIF); a picture blender 222, configured to perform multi-screen combination on each video source image information outputted in the first
  • the picture mixer 222 in the picture combining module 22 may be one or more, the first picture
  • the mixer is specified or set as the default screen mixer when the conference is initialized.
  • the first screen mixer properties can be changed during the conference, but cannot be deleted.
  • other screen mixers can be added, or they can be dynamic.
  • the screen mixer is deleted to meet the user's differentiated viewing requirements; the control module 20 refreshes the input video source information, the screen mixing information, and the multi-picture output information in the multi-picture control information according to the operation information of the user, first The sampler 221, the picture mixer 222, and the second sampler 223 perform corresponding processing in accordance with the new multi-picture control information.
  • the encoding module 23 is composed of a plurality of encoders, and is configured to encode the multi-picture image information output by the picture combining module 22, and form a multi-picture image compressed code stream matched with the decoding algorithm of the participating terminal, and output the same to each At the participating terminal, the participating terminal decodes the received multi-picture image compressed code stream and displays the multi-picture image locally; each encoder supports multiple encoding algorithms, and performs initial matching when assigned to the output image code stream, The encoder may correspond to one or more participating terminals; the schematic diagram of the multi-screen display of the participating terminal is as shown in FIG. 4, and the multi-screen display mode supported by each screen mixer may be any one of them, but is not limited to a few Kind of situation.
  • the MCU when the video service is initialized, the MCU specifies a default picture blender and selects a picture display mode according to the business needs, and further performs multi-picture display by using the default picture mixer to realize multi-picture display, thereby reducing the picture blender. The number of uses, thus saving resources.
  • Example 1 Users A, B, C, and D terminals are connected to a video conference.
  • the video attributes of users A, B, C, and D are as follows:
  • the D MPEG-4 QCIF ( 176x 144 ) control module initializes the user A, B, C, and D terminals to view the multi-screen display mode of the conference.
  • the multi-screen display mode of the first screen mixer is set to the four-screen display mode, that is, the user A,
  • the images of the B, C, and D terminals each occupy 1/4 of the picture, and the pixel precision of the multi-picture image is selected as CIF (352 x 288); as shown in Figure 5, the implementation principle of the four-picture display is as follows:
  • the control module allocates a decoder corresponding to each user and initializes a decoding algorithm.
  • Each decoder restores the video source image stream input by each user to a corresponding video source image information, and outputs the same;
  • the decoding algorithm used by the decoder 1 corresponding to the decoder 1 and the user C terminal is initialized to H.263, and the decoding algorithm used by the decoder 2 corresponding to the user B terminal and the decoder 4 corresponding to the user D terminal is initialized to MPEG-4;
  • the decoders 1, 2, 3, and 4 respectively decode the image code streams of the users A, B, C, and D terminals, and output the restored video source image information to the image data input units in the screen combination module.
  • the first sampler 1 and 2 determine that the decoded image information corresponding to the user A and the B terminal needs to be downsampled according to the pixel precision of the video source image input by the user and the B terminal and the multi-picture image pixel precision, so the first sampler 1 and 2
  • the decoded image information corresponding to the user A and the B terminal is downsampled, and the image obtained with the image pixel precision of QCIF (176 ⁇ 144 ) is output to the picture mixer; the decoded image corresponding to the user (and the D terminal) Since the pixel precision is QCIF (176 X 144 ), the first sampler 3, 4 determines that the image information does not need to be sampled, and directly outputs the decoded image information to the picture mixer.
  • the screen mixer combines the video source image information corresponding to the user A, B, and C. D terminals output by the first sampler 1, 2, 3, 4 into a four-screen image information according to the multi-screen display mode in the screen mixing information. And output it to the second sampler.
  • the second sampler 1 and 2 determine that the four-picture image information does not need to be sampled for the user A and the B terminal according to the output image pixel precision of each user terminal, and output the same to the corresponding encoder 1 and 2 through the image data output unit.
  • the second sampler 3, 4 determines that the four-picture image information is down-sampled for the user (:, D terminal, therefore, the second sampler 3, 4 downsamples the four-picture image information,
  • the images obtained by sampling and having the pixel precision of QCIF (176 X 144 ) are respectively output to the corresponding encoders 3 and 4 through the image data output unit.
  • the encoders 1, 2, 3, and 4 respectively encode the four-picture image information output by the picture combining module, and output an image compressed code stream matching the user A, B, C, and D terminal decoding algorithms to the corresponding user terminal.
  • the user A, B, C, and D terminals decode the received image compressed code stream and display the four-picture images locally.
  • the schematic diagram of the display is shown in FIG. 6.
  • the user A, B, C, and D terminals view the conference image in the same four-screen display mode.
  • the user can select other multi-screen display modes to view the conference image through the terminal operation, and freely switch the screen display.
  • the mode does not affect the viewing of other participants, as shown in Figure 7, the specific implementation process of the user switching the multi-screen display mode is as follows:
  • Step 600 The MCU periodically plays a video menu prompt message during the conference, prompting the user to perform related operations.
  • Step 601 The user selects a corresponding multi-screen display mode by using a terminal operation when the conference image is required to be viewed in other multi-screen display mode according to the prompt information, and the terminal where the user is located sends a handover request to the MCU.
  • Step 602 The MCU updates the multi-picture control information according to the handover request, and determines a required picture mixer.
  • Step 603 The MCU performs multi-screen combination by the determined picture blender according to the updated multi-screen control information, and outputs a multi-screen image that satisfies the multi-screen display mode selected by the user and outputs to the other user terminal to the user terminal that sends the switching request. Corresponding multi-screen image.
  • Example 2 During the conference of the first instance, the user A selects the six-screen display mode to view the conference image through the terminal operation, and the user A terminal sends a request for switching the screen display mode to the MCU, and the MCU updates the screen mixing information according to the request. And determining that the second picture mixer needs to be added, and the attributes thereof include a six-picture display mode, a position of each sub-picture in the six-picture display mode, and encoder identification information corresponding to each sub-picture.
  • the first sampler selects the users A, B, C according to the input video source information and the screen mixing information and the attribute information of the first screen mixer and the second screen mixer.
  • the first picture mixer and the second picture mixer respectively perform four picture combination and six picture combination on each video source image information; the second sampler will The four-picture image information combined by the first picture mixer is output to the encoder 2 corresponding to the user B terminal through the image data output unit, and the combined four-picture image information is downsampled, and the sampled four-picture image information is passed.
  • the image data output unit outputs to the encoders 3 and 4 corresponding to the C and D terminals of the user, and outputs the six-picture image information combined by the second picture mixer to the encoder 1 corresponding to the user A terminal through the image data output unit; 1, 2, 3, 4 encode the multi-picture image information corresponding to the output of the picture combination module and output it to the corresponding user terminal; the user A, B, C, D terminal decodes the received image compressed code stream and then localizes Display corresponding multi-screen images, that is, user A views the six-screen image of the conference on the terminal, and users B, C, and D are at their respective terminals.
  • the four-screen image of the conference is viewed, and the schematic diagram of the multi-screen display of each user terminal is as shown in FIG. 8.
  • the user selects the multi-screen display mode to view the conference image through the terminal operation, and can also select the single-screen display mode to view the conference image according to the need, and the specific implementation process of the user selecting the single-screen display mode to view the conference image is as follows:
  • Step 700 The MCU periodically plays a video menu prompt message during the conference, prompting the user to perform related operations.
  • Step 701 The user selects a corresponding single-screen display mode by using a terminal operation when the conference image is required to view the conference image according to the prompt information, and the user terminal sends a handover request to the MCU.
  • Step 702 The MCU updates the multi-screen control information according to the handover request.
  • Step 703 The MCU directly outputs the corresponding single-screen image to the user terminal that sends the handover request, and performs multi-screen combination by the original screen mixing according to the multi-screen control information, and outputs the corresponding multi-screen image to other user terminals.
  • Example 3 During the conference of the second instance, after the user C selects to view the single-screen image of the user A through the terminal operation, the user C terminal sends a request for switching the screen mode to the MCU, and the MCU updates the screen mixing information according to the request, and Make sure only the first picture mixer and the second picture are needed a mixer, the corresponding attribute information remains unchanged; the first sampler selects the user A, B, C, D according to the input video source information and the screen mixing information and the attribute information of the first picture mixer and the second picture mixer Decoding picture information corresponding to the terminal and performing corresponding sampling processing; the first picture mixer and the second picture mixer respectively perform four picture combination and six picture combination; and the second sampler combines the four picture picture information after combining the first picture mixer Outputting to the encoder 2 corresponding to the user B terminal by the image data output unit, down-sampling the combined four-picture image information, and outputting the four-picture image information obtained after sampling to the user D terminal through the image data output unit
  • the encoder 4 outputs
  • Encoder 3 Encoder 1, 2, 3, 4 encodes the picture image information corresponding to the picture combination module and outputs it to the corresponding user terminal; the user A, B, C, D terminal compresses the received image After the code stream is decoded, the corresponding picture image is displayed locally, that is, user C views the image information of user A on the terminal, and user A views the image information of the six-picture mode on the terminal, and user B and user D respectively watch on the terminal.
  • Four-screen image information A schematic diagram of multi-screen display of each user terminal is shown in FIG.
  • a frame identifier of a certain sub-screen in the multi-screen is highlighted to highlight the image of the screen, for example, a frame of the sub-picture of the currently speaking D is frame-marked to highlight the image, as shown in FIG.
  • the specific process of highlighting the border logo is as follows:
  • Step 800 The MCU determines the sub-picture information corresponding to the user terminal that needs the frame identifier.
  • Step 801 The MCU updates the multi-screen control information.
  • Step 802 The MCU records the sub-picture information into a picture mixer.
  • Step 803 After the screen mixer completes the multi-screen combination, the frame image is identified by the frame.
  • the process of decoding, multi-picture combining and encoding of the image information in the process is the same as the implementation process in the above embodiment, and will not be described again; the schematic diagram of the multi-screen display of the user A, B, C, D terminal is as shown in FIG. .
  • the participant terminal views the conference image in the same multi-screen display mode at the initial stage of the conference, and during the conference, the user can select the multi-screen display mode for viewing the conference image according to the need.
  • the single-screen display mode satisfies the requirement of the user to separately view the conference image; in this embodiment, the user can switch between the multi-screen display mode and the single-screen display mode through the terminal operation, and the implementation method is simple and flexible; In this embodiment, the sub-pictures in the multi-picture are highlighted by the frame, which satisfies the needs of business diversification.
  • the video conference is taken as an example to describe the implementation process of the technical solution of the embodiment of the present invention.
  • the technical solution of the embodiment of the present invention is not limited to video conference, and is also applicable to other video services, such as an interactive voice response (IVR).
  • IVR interactive voice response
  • the service, the multi-participating video communication service, etc. when the above method is implemented in other video service systems, the functional requirements on the processor (such as the MCU) are similar to or the same as the MCU function in the embodiment, and the screen display and the screen are realized.
  • the process of the handover is the same as the implementation process in this embodiment, and details are not described herein again.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method, device and system for realizing a picture switching in the video service, for solving the problem of the prior art that a user participating in the video service can not select a picture display mode to watch the picture image according to his needs. The method of the invention includes: receiving a switching request message by a multipoint control unit, wherein the request message includes the picture display mode for indicating the amount of the sub-picture displayed on the picture; determining the required picture mixers according to the picture display mode by the multipoint control unit, and outputting the picture image corresponding to the requested picture display mode to the user terminals which have sent the switching request messages. With the method according to the invention, a user can choose the picture display mode according to his needs, at the same time, can also perform the switching between the multi-picture display mode and the single- picture display mode, therefore the demand of different users are satisfied.

Description

一种在视频业务中实现画面显示的方法、 装置及*** 技术领域  Method, device and system for realizing picture display in video service
本发明涉及视频技术， 特别涉及一种在视频业务中实现画面切换的方法、 装置及***。 背景技术  The present invention relates to video technologies, and in particular, to a method, device and system for implementing picture switching in a video service. Background technique
视频会议***允许会议参与者实时地交互语音、 视频和数据， 极大地方 便了会议参与者之间的沟通与交流。 如图 1所示的视频会议***网絡结构中， 多点控制单元（ MCU, Multipoint Control Unit )连接参加会议的各会场， 用于 接收会场信号、 处理会场信号以及将处理后的会场信号下发到与会的各个会 场； 用户终端设备主要实现语音、 图像和数据的输入和输出， 以及进行通信 连接和数据收发等功能； 两个以上的用户终端设备和 MCU构建了一个多点、 实时的会议通信环境， 用户通过终端设备观看其他用户的图像并收听其他用 户的声音。  The video conferencing system allows conference participants to interact with voice, video, and data in real time, greatly facilitating communication and communication between conference participants. In the network structure of the video conference system shown in FIG. 1 , a multipoint control unit (MCU) is connected to each site participating in the conference, and is configured to receive the site signal, process the site signal, and deliver the processed site signal to the site. The conference sites of the conference; the user terminal equipment mainly realizes the input and output of voice, image and data, as well as the functions of communication connection and data transmission and reception; more than two user terminal equipments and MCUs construct a multi-point, real-time conference communication environment. The user views images of other users through the terminal device and listens to the sounds of other users.
为满足视频会议中的与会者在同一时间能够同时了解所有或部分其他与 会者的图像信息的需求， 现有技术提供了可以在视频会议中实现多画面显示 的方式：  In order to meet the need for participants in a video conference to simultaneously understand the image information of all or part of other participants at the same time, the prior art provides a way to realize multi-screen display in a video conference:
一种多画面显示的实现方法的主要处理流程如下：  The main processing flow of a multi-screen display implementation method is as follows:
1、 将来自各会议终端的会场图像终端数据通过 H.221帧处理模块处理， 形成满足 H.221标准的多个源高速串行图像数据码流；  1. The site image terminal data from each conference terminal is processed by the H.221 frame processing module to form a plurality of source high-speed serial image data code streams that meet the H.221 standard;
2、 所述多个源高速串行图像数据码流通过源高速串行数据通道， 经交换 网片交换到一个或多个目标高速串行数据通道， 形成电视墙目标监控终端的 一个或多个目标高速串行图像数据码流；  2. The plurality of source high-speed serial image data streams are exchanged through the source high-speed serial data channel and exchanged to one or more target high-speed serial data channels to form one or more of the video wall target monitoring terminals. Target high speed serial image data stream;
3、 将目标图像数据码流发送至图像解码模块， 经过解帧形成 H.261格式 或 H.263格式的图像码流后进行数字图像解码， 获得 CCIR601格式标准数字 图像和通用中间格式 CIF标准数字图像； 4、将 CCIR601格式标准数字图像进行模拟图像编码，转换为模拟视频信 号后发送至电视墙目标监控终端显示； 3. Sending the target image data stream to the image decoding module, de-framing to form an image stream of H.261 format or H.263 format, and then performing digital image decoding to obtain a CCIR601 format standard digital image and a common intermediate format CIF standard number. image; 4. The CCIR601 format standard digital image is encoded by the analog image, converted into an analog video signal and sent to the video wall target monitoring terminal for display;
5、将所述 CIF标准数字图像发送至画面组合模块组合成" -定模式的组合 画面， 将组合画面编码后进行组帧形成多画面图像数据码流， 通过交换网片 交换和 H.221 帧处理模块处理后发送给各个终端， 从而实现各个终端多画面 显示。  5. The CIF standard digital image is sent to the picture combining module to be combined into a "combined mode of the fixed mode, and the combined picture is encoded and then framed to form a multi-picture image data code stream, through exchange mesh switching and H.221 frames. The processing module processes and sends it to each terminal, thereby implementing multi-screen display of each terminal.
该技术方案主要针对某种具体的会议电视***，需要在 MCU侧架设会议 电视墙， 应用局限性较大； 另外该方法中各个与用户只能观看相同的多画面 图像， 多画面显示功能单一。 发明内容  The technical solution is mainly for a specific conference television system, and the conference video wall needs to be set up on the MCU side, and the application has a large limitation; in addition, the user can only view the same multi-picture image and the multi-screen display function is single. Summary of the invention
本发明实施例提供一种在视频业务中实现画面切换的方法、 装置及***， 用于实现参与视频业务的用户可以根据需要自主选择画面显示模式以观看图 像。  The embodiment of the invention provides a method, a device and a system for implementing a screen switching in a video service, and a user for participating in a video service can independently select a screen display mode to view an image according to requirements.
一种在视频业务中实现画面显示方法， 包括步骤：  A method for implementing a screen display in a video service, comprising the steps of:
多点控制单元 MCU接收切换请求消息，所述请求消息包括用于表明画面 显示的子画面数量的画面显示模式。  The multipoint control unit MCU receives a handover request message including a screen display mode for indicating the number of sub-pictures displayed on the screen.
所述 MCU根据所述画面显示模式确定需要的画面混合器，并向发送切换 请求消息的用户终端输出与请求的画面显示模式对应的画面图像。  The MCU determines a required picture mixer based on the picture display mode, and outputs a picture image corresponding to the requested picture display mode to the user terminal that transmits the switching request message.
一种在视频业务中实现画面显示装置， 包括：  A screen display device implemented in a video service, comprising:
控制模块， 用于管理多画面控制信息， 以及根据画面显示模式动态确定 画面混合器；  a control module, configured to manage multi-picture control information, and dynamically determine a picture mixer according to a picture display mode;
解码模块， 用于对各用户终端的视频源图像数据码流进行解码， 获得多 个画面图像信息；  a decoding module, configured to decode a video source image data stream of each user terminal to obtain a plurality of screen image information;
画面组合模块， 用于根据所述多画面控制信息通过一个或多个画面混合 器进行多画面组合， 获得组合的多画面图像信息；  a picture combining module, configured to perform multi-screen combination by one or more picture mixers according to the multi-picture control information, to obtain combined multi-picture image information;
编码模块， 用于对组合后的多画面图像信息进行相应编码。 一种视频业务***， 包括多点控制单元 MCU， 所述 MCU用于通过网络 与多个用户终端相连， 并接收用户终端发送的包含画面显示模式的送切换请 求消息， 以及才艮据所述画面显示模式确定需要的画面混合器， 并向发送切换 请求消息的用户终端输出与请求的画面显示模式对应的画面图像； 所述画面 显示模式用于表明画面显示的子画面数量。 The encoding module is configured to encode the combined multi-picture image information accordingly. A video service system, comprising: a multipoint control unit MCU, wherein the MCU is configured to connect to a plurality of user terminals through a network, and receive a handover request message including a screen display mode sent by the user terminal, and according to the screen The display mode determines a required screen mixer, and outputs a screen image corresponding to the requested screen display mode to the user terminal transmitting the switching request message; the screen display mode is for indicating the number of sub-screens displayed on the screen.
上述多点控制单元 MCU根据用户选择的画面显示模式向该用户所在的 终端输出与该画面显示模式对应的画面图像， 参与视频业务的用户可以以相 同的画面显示模式观看图像， 也可以根据需要自主选择画面显示模式观看图 像， 实现了用户在多画面显示模式之间、 多画面显示模式与单画面显示模式 之间的灵活切换， 满足了用户差异化观看会议图像的需求。 附图说明  The multi-point control unit MCU outputs a screen image corresponding to the screen display mode to the terminal where the user is located according to the screen display mode selected by the user, and the user participating in the video service can view the image in the same screen display mode, or can be independent according to needs. Selecting the screen display mode to view the image realizes flexible switching between the multi-screen display mode, the multi-screen display mode and the single-screen display mode, and satisfies the user's demand for differently viewing the conference image. DRAWINGS
图 1为现有技术中会议视频***结构示意图；  1 is a schematic structural diagram of a conference video system in the prior art;
图 2为本发明实施例中多点控制单元结构示意图；  2 is a schematic structural diagram of a multipoint control unit according to an embodiment of the present invention;
图 3为本发明实施例中画面组合模块结构示意图；  3 is a schematic structural diagram of a screen combination module according to an embodiment of the present invention;
图 4为本发明实施例中多画面显示模式示意图；  4 is a schematic diagram of a multi-screen display mode according to an embodiment of the present invention;
图 5 为本发明实施例中多个用户终端以四画面显示模式显示会议图像的 实现原理图；  FIG. 5 is a schematic diagram showing an implementation principle of displaying a conference image by a plurality of user terminals in a four-screen display mode according to an embodiment of the present invention; FIG.
图 6为本发明实施例中多个用户终端以四画面显示模式显示会议图像的 示意图；  6 is a schematic diagram of displaying, by a plurality of user terminals, a conference image in a four-screen display mode according to an embodiment of the present invention;
图 7为本发明实施例中用户 A选择六画面显示模式显示会议图像的实现 流程图；  FIG. 7 is a flowchart of an implementation of displaying a conference image by user A selecting a six-screen display mode according to an embodiment of the present invention; FIG.
图 8为本发明实施例中用户 A选择六画面显示模式时， 用户 A、 B、 C. D终端显示会议图像的示意图；  8 is a schematic diagram of a user A, B, and C. D terminal displaying a conference image when user A selects a six-screen display mode according to an embodiment of the present invention;
图 9为本发明实施例中用户 C选择单画面显示模式显示会议图像的实现 流程图；  FIG. 9 is a flowchart of an implementation of displaying a conference image by a user C selecting a single screen display mode according to an embodiment of the present invention;
图 10为本发明实施例中用户 C选择单画面显示模式时， 用户 A、 B、 C, D终端显示会议图像的示意图； 10 is a user A, B, and C when user C selects a single-screen display mode according to an embodiment of the present invention. D terminal displays a schematic diagram of the conference image;
图 11为本发明实施例中边框标识子画面的实现流程图；  FIG. 11 is a flowchart of implementing a frame identifier sub-picture according to an embodiment of the present invention;
图 12为本发明实施例中边框标识子画面的显示示意图。  FIG. 12 is a schematic diagram showing the display of a frame identifier sub-screen according to an embodiment of the present invention.
具体实施方式 detailed description
为解决现有技术中多画面显示功能单一以及用户不能在多画面和单画面 显示模式之间进行转换的问题， 本实施例以视频会议***为例对本发明实施 例技术方案进行详细说明。  In order to solve the problem that the multi-screen display function is single and the user cannot convert between the multi-screen and single-screen display modes in the prior art, the technical solution of the embodiment of the present invention is described in detail by taking a video conference system as an example.
本实施例中的视频会议***如图 1所示， 包括多点控制单元 MCU、 通过 网络与 MCU连接的多个用户终端， 其中， 多点控制单元 MCU结构如图 2所 示， 该 MCU包括控制模块 20、 解码模块 21、 画面组合模块 22和编码模块 23; 其中：  As shown in FIG. 1 , the video conference system in this embodiment includes a multi-point control unit MCU and a plurality of user terminals connected to the MCU through a network. The MCU structure of the multi-point control unit is as shown in FIG. 2, and the MCU includes control. Module 20, decoding module 21, picture combining module 22, and encoding module 23;
控制模块 20, 用于管理多画面控制信息， 该信息通过和参与视频会议的 用户终端协商获取， 并向参与视频会议的用户终端播放视频菜单提示信息， 以及根据用户选择的画面显示模式动态分配画面混合器； 所述多画面控制信 息包括输入视频源信息、 画面混合信息和多画面输出信息； 输入视频源信息 包括各解码器的标识信息和各输入视频源图像像素精度等； 画面混合信息包 括本会场所有需要支持的画面混合器的数目、 多画面图像像素精度和各画面 混合器的属性信息， 其中， 多画面图像像素精度通常确定为各与会终端中的 最大图像像素精度， 也可以根据***需要进行设置， 画面混合器的属性信息 包括多画面显示的模式、 该多画面显示模式中各子画面的位置以及各子画面 对应编码器的标识信息等； 多画面输出信息包括各编码器标识信息、 对应的 混合器标识和输出图像像素精度等。  The control module 20 is configured to manage multi-screen control information, which is obtained by negotiating with a user terminal participating in the video conference, and playing video menu prompt information to the user terminal participating in the video conference, and dynamically allocating the screen according to the screen display mode selected by the user. The multi-picture control information includes input video source information, picture mixture information, and multi-picture output information; the input video source information includes identification information of each decoder and pixel precision of each input video source image; The number of picture mixers to be supported, the multi-picture image pixel precision, and the attribute information of each picture mixer. The multi-picture image pixel accuracy is usually determined as the maximum image pixel accuracy in each participant terminal, and may also be based on system requirements. Setting, the attribute information of the screen mixer includes a mode of multi-screen display, a position of each sub-screen in the multi-screen display mode, and identification information of an encoder corresponding to each sub-screen; the multi-screen output information includes identifier information of each encoder, Correct The mixer identifier and output image pixel accuracy should be the same.
所述控制模块 20在视频会议初始化时， 指定一个默认的画面混合器， 该 画面混合器的属性可以在会议进行过程中根据参与视频会议的用户终端数量 动态改变， 但是不能删除； 在视频会议进行过程中， 根据用户选择的画面显 示模式确定相应的画面混合器， 可以增加相应的画面混混合器， 也可以动态 删除这些画面混合器。 The control module 20 specifies a default picture mixer when the video conference is initialized, and the attribute of the picture mixer can be dynamically changed according to the number of user terminals participating in the video conference during the conference, but cannot be deleted; In the process, according to the screen selected by the user The mode determines the corresponding picture mixer, and the corresponding picture mixing mixer can be added, or these picture mixers can be deleted dynamically.
解码模块 21， 由多个解码器组成， 用于对参与视频会议的用户终端的视 频源图像码流进行解码， 并将解码得到的视频源图像信息通过数据总线传送 给画面组合模块 22; 用户终端输出的每个图像码流对应分配一个解码器， 每 个解码器使用与输入的图像码流编码算法相匹配的解码算法 （如 H.263、 MPEG-4等）对输入图像码流进行解码， 还原出图像信息； 每个解码器均支持 多种解码算法， 在分配给输入图像码流时进行初始化匹配算法。  The decoding module 21 is composed of a plurality of decoders, and is configured to decode the video source image code stream of the user terminal participating in the video conference, and transmit the decoded video source image information to the screen combining module 22 through the data bus; Each of the output image streams is assigned a decoder, and each decoder decodes the input image stream using a decoding algorithm (such as H.263, MPEG-4, etc.) that matches the input image stream encoding algorithm. The image information is restored; each decoder supports multiple decoding algorithms, and an initialization matching algorithm is performed when assigned to the input image code stream.
画面组合模块 22， 用于根据多画面控制信息通过一个或多个画面混和器 对解码器输出的多个视频源图像信息进行多画面组合， 并将组合后的多画面 图像信息通过数据总线传送给编码模块 23; 如图 3所示， 所述画面组合模块 22进一步包括： 图像数据输入单元 220, 用于接收所述解码模块 21输出的视 频源图像信息； 多个第一采样器 221 , 用于将图像数据输入单元 220中的对应 视频源图像的像素精度与该视频源图像在多画面中对应位置的图像像素精度 进行比较， 当两者不一致时， 对视频源图像信息进行采样, 并将采样后的视 频源图像信息输出到画面混合器 222; 否则， 将视频源图像信息直接输出到画 面混合器 222; 采样包括升采样和降采样， 如将像素精度为 704 X 576 ( 4CIF ) 的图像降采样为 352 x 288( CIF )的图像，或者将像素精度为 176^ 144( QCIF ) 的图像升采样为像素精度为 352 x 288 ( CIF )的图像； 画面混合器 222, 用于 对第一采样器 221 中输出的各视频源图像信息进行多画面组合， 并将组合后 的多画面图像信息输出到第二采样器 223; 多个第二采样器 223， 用于将画面 混合器 222输出的多画面图像的像素精度和多画面输出信息中的输出图像像 素精度进行比较， 当两者不一致时将多画面图像信息进行相应采样并将采样 后得到的多画面图像信息通过数据总线传送给图像数据输出单元 224; 否则， 将多画面图像信息直接输出到图像数据输出单元 224;图像数据输出单元 224 , 用于将图像信息输出给编码模块 23。  The picture combining module 22 is configured to perform multi-screen combination on the plurality of video source image information output by the decoder by using one or more picture blenders according to the multi-picture control information, and transmit the combined multi-picture image information to the data bus through the data bus. Encoding module 23; as shown in FIG. 3, the picture combining module 22 further includes: an image data input unit 220, configured to receive video source image information output by the decoding module 21; and a plurality of first samplers 221 for Comparing the pixel precision of the corresponding video source image in the image data input unit 220 with the image pixel precision of the corresponding position of the video source image in the multi-picture, and when the two are inconsistent, sampling the video source image information, and sampling The subsequent video source image information is output to the picture mixer 222; otherwise, the video source image information is directly output to the picture mixer 222; the sampling includes upsampling and downsampling, such as dropping the image with a pixel precision of 704 X 576 (4CIF) Sampling an image of 352 x 288 (CIF) or upsampling an image with a pixel accuracy of 176^144 (QCIF) An image with a pixel precision of 352 x 288 (CIF); a picture blender 222, configured to perform multi-screen combination on each video source image information outputted in the first sampler 221, and output the combined multi-picture image information to a second sampler 223; the plurality of second samplers 223 are configured to compare the pixel precision of the multi-picture image output by the picture mixer 222 with the output image pixel precision in the multi-picture output information, and when the two are inconsistent, The screen image information is correspondingly sampled and the multi-picture image information obtained after sampling is transmitted to the image data output unit 224 through the data bus; otherwise, the multi-picture image information is directly output to the image data output unit 224; the image data output unit 224 The image information is output to the encoding module 23.
所述画面组合模块 22中的画面混合器 222可以是一个或多个， 第一画面 混合器在会议初始化时被指定或设置为默认画面混合器， 第一画面混合器属 性可以在会议进行过程中改变， 但不能被删除； 在会议进行中， 可以增加其 他画面混合器， 也可以动态删除该画面混合器， 以满足用户差异化的观看需 求； 控制模块 20才 据用户的操作信息， 对多画面控制信息中的输入视频源信 息、 画面混合信息和多画面输出信息进行刷新， 第一采样器 221、 画面混合器 222和第二采样器 223根据新的多画面控制信息进行相应的处理。 The picture mixer 222 in the picture combining module 22 may be one or more, the first picture The mixer is specified or set as the default screen mixer when the conference is initialized. The first screen mixer properties can be changed during the conference, but cannot be deleted. During the conference, other screen mixers can be added, or they can be dynamic. The screen mixer is deleted to meet the user's differentiated viewing requirements; the control module 20 refreshes the input video source information, the screen mixing information, and the multi-picture output information in the multi-picture control information according to the operation information of the user, first The sampler 221, the picture mixer 222, and the second sampler 223 perform corresponding processing in accordance with the new multi-picture control information.
编码模块 23， 由多个编码器组成， 用于对画面组合模块 22输出的多画面 图像信息进行编码， 形成和与会终端解码算法相匹配的多画面图像压缩码流， 并将其分别输出到各与会终端， 与会终端对接收到的多画面图像压缩码流进 行相应解码后在本地显示多画面图像； 每个编码器均支持多种编码算法， 在 分配给输出图像码流时进行初始化匹配， 一个编码器可以对应一个或多个与 会终端； 与会终端多画面显示的示意图如图 4所示， 每个画面混合器支持的 多画面显示模式可以是其中的任一种， 但并不局限图示几种情况。  The encoding module 23 is composed of a plurality of encoders, and is configured to encode the multi-picture image information output by the picture combining module 22, and form a multi-picture image compressed code stream matched with the decoding algorithm of the participating terminal, and output the same to each At the participating terminal, the participating terminal decodes the received multi-picture image compressed code stream and displays the multi-picture image locally; each encoder supports multiple encoding algorithms, and performs initial matching when assigned to the output image code stream, The encoder may correspond to one or more participating terminals; the schematic diagram of the multi-screen display of the participating terminal is as shown in FIG. 4, and the multi-screen display mode supported by each screen mixer may be any one of them, but is not limited to a few Kind of situation.
在本实施例中 ,视频业务初始化时 MCU指定一个默认的画面混和器并根 据业务需要选择画面显示模式， 进一步通过该默认画面混合器进行多画面组 合从而实现多画面显示， 这样能够减少画面混和器的使用数量， 从而节省资 源。  In this embodiment, when the video service is initialized, the MCU specifies a default picture blender and selects a picture display mode according to the business needs, and further performs multi-picture display by using the default picture mixer to realize multi-picture display, thereby reducing the picture blender. The number of uses, thus saving resources.
为了更清楚地说明本实施例中多画面显示的实现过程， 下面通过具体的 实例进行说明。  In order to more clearly explain the implementation process of the multi-screen display in this embodiment, a specific example will be described below.
实例一： 用户 A、 B、 C和 D终端连接到视频会议中, 其中， 用户 A、 B、 C和 D终端的视频属性如下表所示：  Example 1: Users A, B, C, and D terminals are connected to a video conference. The video attributes of users A, B, C, and D are as follows:
用户终端 图像压缩算法 图像像素精度 User terminal image compression algorithm image pixel precision
A H.263 CIF ( 352x288 )  A H.263 CIF ( 352x288 )
B MPEG-4 CIF ( 352x288 )  B MPEG-4 CIF ( 352x288 )
C H.263 QCIF ( 176x144 ) D MPEG-4 QCIF ( 176x 144 ) 控制模块初始化用户 A、 B、 C, D终端观看会议的多画面显示模式， 第 一画面混合器的多画面显示模式设置为四画面显示模式， 即用户 A、 B、 C、 D终端的图像各占画面的 1/4， 多画面图像像素精度选择为 CIF ( 352 x 288 ); 如图 5所示， 四画面显示的实现原理如下： C H.263 QCIF ( 176x144 ) The D MPEG-4 QCIF ( 176x 144 ) control module initializes the user A, B, C, and D terminals to view the multi-screen display mode of the conference. The multi-screen display mode of the first screen mixer is set to the four-screen display mode, that is, the user A, The images of the B, C, and D terminals each occupy 1/4 of the picture, and the pixel precision of the multi-picture image is selected as CIF (352 x 288); as shown in Figure 5, the implementation principle of the four-picture display is as follows:
用户接入会场后， 控制模块分配给每个用户对应的解码器并初始化解码 算法， 各解码器将各用户输入的视频源图像码流还原成对应的视频源图像信 息后输出； 用户 A终端对应的解码器 1和用户 C终端对应的解码器 3使用的 解码算法初始化为 H.263, 用户 B终端对应的解码器 2和用户 D终端对应的 解码器 4使用的解码算法初始化为 MPEG-4; 解码器 1、 2、 3、 4分别对用户 A、 B、 C, D终端的图像码流进行解码， 并将还原得到的视频源图像信息分 别输出到画面组合模块中的图像数据输入单元。  After the user accesses the site, the control module allocates a decoder corresponding to each user and initializes a decoding algorithm. Each decoder restores the video source image stream input by each user to a corresponding video source image information, and outputs the same; The decoding algorithm used by the decoder 1 corresponding to the decoder 1 and the user C terminal is initialized to H.263, and the decoding algorithm used by the decoder 2 corresponding to the user B terminal and the decoder 4 corresponding to the user D terminal is initialized to MPEG-4; The decoders 1, 2, 3, and 4 respectively decode the image code streams of the users A, B, C, and D terminals, and output the restored video source image information to the image data input units in the screen combination module.
第一采样器 1、 2根据用户八、 B终端输入的视频源图像的像素精度和多 画面图像像素精度判定用户 A、 B终端对应的解码图像信息需要降采样， 因此 第一采样器 1、 2分别对用户 A、 B终端对应的解码图像信息进行降采样， 并 将采样后得到的图像像素精度为 QCIF( 176 χ 144 )的图像输出到画面混合器； 由于用户 （、 D终端对应的解码图像像素精度为 QCIF ( 176 X 144 ), 因此第 一采样器 3、 4判定其图像信息不需要进行采样， 直接将解码图像信息输出到 画面混合器。  The first sampler 1 and 2 determine that the decoded image information corresponding to the user A and the B terminal needs to be downsampled according to the pixel precision of the video source image input by the user and the B terminal and the multi-picture image pixel precision, so the first sampler 1 and 2 The decoded image information corresponding to the user A and the B terminal is downsampled, and the image obtained with the image pixel precision of QCIF (176 χ 144 ) is output to the picture mixer; the decoded image corresponding to the user (and the D terminal) Since the pixel precision is QCIF (176 X 144 ), the first sampler 3, 4 determines that the image information does not need to be sampled, and directly outputs the decoded image information to the picture mixer.
画面混合器根据画面混合信息中的多画面显示模式将第一采样器 1、 2、 3、 4输出的用户 A、 B、 C. D终端对应的视频源图像信息组合成一个四画面图 像信息， 并将其输出给第二采样器。  The screen mixer combines the video source image information corresponding to the user A, B, and C. D terminals output by the first sampler 1, 2, 3, 4 into a four-screen image information according to the multi-screen display mode in the screen mixing information. And output it to the second sampler.
第二采样器 1、 2根据各用户终端的输出图像像素精度判定该四画面图像 信息针对用户 A、 B终端不需要进行采样，通过图像数据输出单元将其分别输 出给对应的编码器 1、 2; 第二采样器 3、 4判定该四画面图像信息针对用户（：、 D终端需要进行降采样， 因此， 第二采样器 3、 4对四画面图像信息降采样， 并将采样后得到的图像像素精度为 QCIF ( 176 X 144 )的图像通过图像数据输 出单元分别输出给对应的编码器 3、 4。 The second sampler 1 and 2 determine that the four-picture image information does not need to be sampled for the user A and the B terminal according to the output image pixel precision of each user terminal, and output the same to the corresponding encoder 1 and 2 through the image data output unit. The second sampler 3, 4 determines that the four-picture image information is down-sampled for the user (:, D terminal, therefore, the second sampler 3, 4 downsamples the four-picture image information, The images obtained by sampling and having the pixel precision of QCIF (176 X 144 ) are respectively output to the corresponding encoders 3 and 4 through the image data output unit.
编码器 1、 2、 3、 4对画面组合模块输出的四画面图像信息分别进行编码， 并输出与用户 A、 B、 C、 D终端解码算法相匹配的图像压缩码流给对应的用 户终端。  The encoders 1, 2, 3, and 4 respectively encode the four-picture image information output by the picture combining module, and output an image compressed code stream matching the user A, B, C, and D terminal decoding algorithms to the corresponding user terminal.
用户 A、 B、 C、 D终端对接收到的图像压缩码流进行解码后在本地分别 显示四画面图像， 其显示的示意图如图 6所示。  The user A, B, C, and D terminals decode the received image compressed code stream and display the four-picture images locally. The schematic diagram of the display is shown in FIG. 6.
上述实例中用户 A、 B、 C、 D终端以相同的四画面显示模式观看会议图 像， 本实施例在会议进行中用户可以通过终端操作选择其他多画面显示模式 观看会议图像， 并自由切换画面显示模式而不影响其他与会方的观看，如图 7 所示， 用户切换多画面显示模式的具体实现过程如下：  In the above example, the user A, B, C, and D terminals view the conference image in the same four-screen display mode. In this embodiment, the user can select other multi-screen display modes to view the conference image through the terminal operation, and freely switch the screen display. The mode does not affect the viewing of other participants, as shown in Figure 7, the specific implementation process of the user switching the multi-screen display mode is as follows:
步骤 600、 MCU在会议进行过程中定时播放视频菜单提示信息， 提示用 户如何进行相关操作。  Step 600: The MCU periodically plays a video menu prompt message during the conference, prompting the user to perform related operations.
步骤 601、用户根据提示信息，在需要其他多画面显示模式观看会议图像 时通过终端操作选择相应的多画面显示模式，由用户所在终端向 MCU发送切 换请求。  Step 601: The user selects a corresponding multi-screen display mode by using a terminal operation when the conference image is required to be viewed in other multi-screen display mode according to the prompt information, and the terminal where the user is located sends a handover request to the MCU.
步骤 602、 MCU根据切换请求更新多画面控制信息， 确定需要的画面混 和器。  Step 602: The MCU updates the multi-picture control information according to the handover request, and determines a required picture mixer.
步骤 603、 MCU根据更新后的多画面控制信息通过确定的画面混和器进 行多画面组合， 并向发送切换请求的用户终端输出满足用户选择的多画面显 示模式的多画面图像和向其他用户终端输出对应的多画面图像。  Step 603: The MCU performs multi-screen combination by the determined picture blender according to the updated multi-screen control information, and outputs a multi-screen image that satisfies the multi-screen display mode selected by the user and outputs to the other user terminal to the user terminal that sends the switching request. Corresponding multi-screen image.
实例二： 在实例一的会议进行中， 用户 A通过终端操作选择六画面显示 模式观看会议图像， 由用户 A终端向 MCU发送切换画面显示模式的请求， MCU根据该请求将画面混合信息进行更新，并确定需要增加第二画面混合器， 其属性包括六画面显示模式、 该六画面显示模式中各子画面的位置以及各子 画面对应的编码器标识信息等。 第一采样器根据输入视频源信息和画面混合 信息以及第一画面混合器和第二画面混合器的属性信息， 选择用户 A、 B、 C、 D终端对应的解码视频源图像信息并对其进行相应采样处理； 第一画面混合 器和第二画面混合器分别对各视频源图像信息进行四画面组合和六画面组 合； 第二釆样器将第一画面混合器组合后的四画面图像信息通过图像数据输 出单元输出给用户 B终端对应的编码器 2, 将组合后的四画面图像信息进行 降采样， 并将采样后的四画面图像信息通过图像数据输出单元输出给用户 C、 D终端对应的编码器 3、 4, 将第二画面混合器组合后的六画面图像信息通过 图像数据输出单元输出给用户 A终端对应的编码器 1; 编码器 1、 2、 3、 4对 画面组合模块对应输出的多画面图像信息进行编码后输出给对应的用户终 端； 用户 A、 B、 C、 D终端对接收到的图像压缩码流进行解码后在本地分别 显示对应的多画面图像， 即用户 A在终端上观看会议的六画面图像， 用户 B、 C、 D在各自的终端上观看会议的四画面图像， 各用户终端多画面显示的示意 图如图 8所示。 Example 2: During the conference of the first instance, the user A selects the six-screen display mode to view the conference image through the terminal operation, and the user A terminal sends a request for switching the screen display mode to the MCU, and the MCU updates the screen mixing information according to the request. And determining that the second picture mixer needs to be added, and the attributes thereof include a six-picture display mode, a position of each sub-picture in the six-picture display mode, and encoder identification information corresponding to each sub-picture. The first sampler selects the users A, B, C according to the input video source information and the screen mixing information and the attribute information of the first screen mixer and the second screen mixer. Decoding the video source image information corresponding to the D terminal and performing corresponding sampling processing thereon; the first picture mixer and the second picture mixer respectively perform four picture combination and six picture combination on each video source image information; the second sampler will The four-picture image information combined by the first picture mixer is output to the encoder 2 corresponding to the user B terminal through the image data output unit, and the combined four-picture image information is downsampled, and the sampled four-picture image information is passed. The image data output unit outputs to the encoders 3 and 4 corresponding to the C and D terminals of the user, and outputs the six-picture image information combined by the second picture mixer to the encoder 1 corresponding to the user A terminal through the image data output unit; 1, 2, 3, 4 encode the multi-picture image information corresponding to the output of the picture combination module and output it to the corresponding user terminal; the user A, B, C, D terminal decodes the received image compressed code stream and then localizes Display corresponding multi-screen images, that is, user A views the six-screen image of the conference on the terminal, and users B, C, and D are at their respective terminals. The four-screen image of the conference is viewed, and the schematic diagram of the multi-screen display of each user terminal is as shown in FIG. 8.
用户通过终端操作选择多画面显示模式观看会议图像， 同时也可以根据 需要选择单画面显示模式观看会议图像， 9所示， 用户选择单画面显示模式观 看会议图像的具体实现过程如下：  The user selects the multi-screen display mode to view the conference image through the terminal operation, and can also select the single-screen display mode to view the conference image according to the need, and the specific implementation process of the user selecting the single-screen display mode to view the conference image is as follows:
步骤 700、 MCU在会议进行过程中定时播放视频菜单提示信息， 提示用 户如何进行相关操作。  Step 700: The MCU periodically plays a video menu prompt message during the conference, prompting the user to perform related operations.
步骤 701、用户根据提示信息，在需要单画面显示模式观看会议图像时通 过终端操作选择相应的单画面显示模式，由用户所在终端向 MCU发送切换请 求。  Step 701: The user selects a corresponding single-screen display mode by using a terminal operation when the conference image is required to view the conference image according to the prompt information, and the user terminal sends a handover request to the MCU.
步骤 702、 MCU根据切换请求更新多画面控制信息。  Step 702: The MCU updates the multi-screen control information according to the handover request.
步骤 703、 MCU向发送切换请求的用户终端直接输出对应的单画面图像， 并根据多画面控制信息通过原来画面混合进行多画面组合， 向其他用户终端 输出对应的多画面图像。  Step 703: The MCU directly outputs the corresponding single-screen image to the user terminal that sends the handover request, and performs multi-screen combination by the original screen mixing according to the multi-screen control information, and outputs the corresponding multi-screen image to other user terminals.
实例三： 在实例二的会议进行中， 用户 C通过终端操作选择观看用户 A 的单画面图像后， 用户 C终端向 MCU发送切换画面模式的请求， MCU根据 该请求将画面混合信息进行更新， 并确定只需要第一画面混合器和第二画面 混合器， 其对应的属性信息保持不变； 第一采样器根据输入视频源信息和画 面混合信息以及第一画面混合器和第二画面混合器的属性信息， 选择用户 A、 B、 C、 D终端对应的解码图像信息并进行相应采样处理； 第一画面混合器和 第二画面混合器分别进行四画面组合和六画面组合； 第二采样器将第一画面 混合器组合后的四画面图像信息通过图像数据输出单元输出给用户 B终端对 应的编码器 2,将组合后的四画面图像信息进行降采样， 并将采样后得到的四 画面图像信息通过图像数据输出单元输出给用户 D终端对应的编码器 4， 将 第二画面混合器组合后的六画面图像信息通过图像数据输出单元输出给用户 A终端对应的编码器 1; 第一采样器将用户 A终端对应的解码图像像素信息 降采样成 QCIF ( 176 X 144 )后将釆样后的图像信息通过图像数据输出单元输 出到用户 C终端对应的编码器 3; 编码器 1、 2、 3、 4对画面组合模块对应输 出的画面图像信息进行编码后输出给对应的用户终端； 用户 A、 B、 C、 D终 端对接收到的图像压缩码流进行解码后在本地分别显示对应的画面图像， 即 用户 C在终端上观看用户 A的图像信息，用户 A在终端上观看六画面模式的 图像信息， 用户 B和用户 D分别在终端上观看四画面的图像信息； 各用户终 端多画面显示的示意图如 10所示。 Example 3: During the conference of the second instance, after the user C selects to view the single-screen image of the user A through the terminal operation, the user C terminal sends a request for switching the screen mode to the MCU, and the MCU updates the screen mixing information according to the request, and Make sure only the first picture mixer and the second picture are needed a mixer, the corresponding attribute information remains unchanged; the first sampler selects the user A, B, C, D according to the input video source information and the screen mixing information and the attribute information of the first picture mixer and the second picture mixer Decoding picture information corresponding to the terminal and performing corresponding sampling processing; the first picture mixer and the second picture mixer respectively perform four picture combination and six picture combination; and the second sampler combines the four picture picture information after combining the first picture mixer Outputting to the encoder 2 corresponding to the user B terminal by the image data output unit, down-sampling the combined four-picture image information, and outputting the four-picture image information obtained after sampling to the user D terminal through the image data output unit The encoder 4 outputs the six-picture image information combined by the second picture mixer to the encoder 1 corresponding to the user A terminal through the image data output unit; the first sampler downsamples the decoded image pixel information corresponding to the user A terminal into After QCIF ( 176 X 144 ), the image information after sampling is output to the user C terminal through the image data output unit. Encoder 3; Encoder 1, 2, 3, 4 encodes the picture image information corresponding to the picture combination module and outputs it to the corresponding user terminal; the user A, B, C, D terminal compresses the received image After the code stream is decoded, the corresponding picture image is displayed locally, that is, user C views the image information of user A on the terminal, and user A views the image information of the six-picture mode on the terminal, and user B and user D respectively watch on the terminal. Four-screen image information; A schematic diagram of multi-screen display of each user terminal is shown in FIG.
另外， 本实施例中对多画面中某个子画面进行边框标识以突出显示该画 面图像， 例如对当前发言的与会方 D的子画面进行边框标识以突出显示其图 像， 如图 11所示， 实现边框标识突出显示的具体过程如下：  In addition, in this embodiment, a frame identifier of a certain sub-screen in the multi-screen is highlighted to highlight the image of the screen, for example, a frame of the sub-picture of the currently speaking D is frame-marked to highlight the image, as shown in FIG. The specific process of highlighting the border logo is as follows:
步骤 800、 MCU确定需要边框标识的用户终端对应的子画面信息。  Step 800: The MCU determines the sub-picture information corresponding to the user terminal that needs the frame identifier.
步骤 801、 MCU更新多画面控制信息。  Step 801: The MCU updates the multi-screen control information.
步驟 802、 MCU将该子画面信息记录到画面混合器中。  Step 802: The MCU records the sub-picture information into a picture mixer.
步骤 803、 画面混合器完成多画面组合后对该子画面图像进行边框标识。 步骤 804、 MCU向用户终端输出具有边框标识的画面图像。  Step 803: After the screen mixer completes the multi-screen combination, the frame image is identified by the frame. Step 804: The MCU outputs a screen image with a frame identifier to the user terminal.
该过程中图像信息的解码、 多画面组合以及编码的过程与上述实施例中 的实现过程同理， 不再赘述； 用户 A、 B、 C, D终端的多画面显示的示意图 如图 12所示。 本实施例中提供的多画面显示的实现方法中， 与会终端在会议初始时以 相同的多画面显示模式观看会议图像， 在会议的进行中， 用户可以根据需要 选择观看会议图像的多画面显示模式或者单画面显示模式， 满足了用户差异 化观看会议图像的需求； 本实施例中与会用户可以通过终端操作在多画面显 示模式和单画面显示模式之间进行切换， 其实现方法简单灵活； 另外， 本实 施例中将多画面中的子画面进行边框标识突出显示画面， 满足了业务多样化 的需要。 The process of decoding, multi-picture combining and encoding of the image information in the process is the same as the implementation process in the above embodiment, and will not be described again; the schematic diagram of the multi-screen display of the user A, B, C, D terminal is as shown in FIG. . In the implementation method of the multi-screen display provided in the embodiment, the participant terminal views the conference image in the same multi-screen display mode at the initial stage of the conference, and during the conference, the user can select the multi-screen display mode for viewing the conference image according to the need. Or the single-screen display mode satisfies the requirement of the user to separately view the conference image; in this embodiment, the user can switch between the multi-screen display mode and the single-screen display mode through the terminal operation, and the implementation method is simple and flexible; In this embodiment, the sub-pictures in the multi-picture are highlighted by the frame, which satisfies the needs of business diversification.
上述以视频会议为实例对本发明实施例技术方案的实现过程进行说明， 但本发明实施例技术方案不局限于视频会议， 还适应于其他视频业务， 如视 频交互式语音应答（IVR， Interactive Voice Response )业务、 多方参与的视频 通讯业务等， 在其他视频业务***中实现上述方法时对处理器（如 MCU )在 功能上的要求与本实施例中 MCU功能相似或相同，其实现画面显示和画面切 换的过程与本实施例中的实现过程同理， 不再赘述。 发明的精神和范围。 这样， 倘若对本发明的这些修改和变型属于本发明权利 要求及其等同技术的范围之内， 则本发明也意图包含这些改动和变型在内。  The video conference is taken as an example to describe the implementation process of the technical solution of the embodiment of the present invention. However, the technical solution of the embodiment of the present invention is not limited to video conference, and is also applicable to other video services, such as an interactive voice response (IVR). The service, the multi-participating video communication service, etc., when the above method is implemented in other video service systems, the functional requirements on the processor (such as the MCU) are similar to or the same as the MCU function in the embodiment, and the screen display and the screen are realized. The process of the handover is the same as the implementation process in this embodiment, and details are not described herein again. The spirit and scope of the invention. Therefore, it is intended that the present invention cover the modifications and variations of the invention as claimed.

Claims

权 利 要 求 Rights request
1、 一种在视频业务中实现画面显示方法， 其特征在于， 包括步骤： 多点控制单元 MCU接收切换请求消息，所述请求消息包括用于表明画面 显示的子画面数量的画面显示模式； A method for displaying a screen in a video service, comprising the steps of: a multipoint control unit MCU receiving a handover request message, the request message comprising a screen display mode for indicating the number of sub-screens displayed by the screen;
所述 MCU根据所述画面显示模式确定需要的画面混合器，并向发送切换 请求消息的用户终端输出与请求的画面显示模式对应的画面图像。  The MCU determines a required picture mixer based on the picture display mode, and outputs a picture image corresponding to the requested picture display mode to the user terminal that transmits the switching request message.
2、 如权利要求 1所述的方法， 其特征在于， 所述画面显示模式为单画面 显示模式时， 向发送该切换请求消息的用户终端直接输出对应的单画面图像； 所述画面显示模式为多画面显示模式时， 通过确定的画面混合器进行多画面 组合后向发送该切换请求消息的用户终端输出对应的多画面图像。  The method according to claim 1, wherein when the screen display mode is the single-screen display mode, the corresponding single-screen image is directly output to the user terminal that sends the switching request message; In the multi-screen display mode, the multi-screen combination is performed by the determined screen mixer, and the corresponding multi-screen image is output to the user terminal that transmits the switching request message.
3、 如权利要求 1或 2所述的方法， 其特征在于， 在视频业务初始化时， 所述 MCU指定一个默认的画面混合器，所述默认画面混合器根据多画面控制 信息对参与视频业务的用户终端对应的视频源图像信息进行多画面组合， 所 述 MCU将组合后的多画面图像输出给各用户终端。  The method according to claim 1 or 2, wherein, when the video service is initialized, the MCU specifies a default picture mixer, and the default picture mixer cooperates with the video service according to the multi-picture control information. The video source image information corresponding to the user terminal is multi-screen combined, and the MCU outputs the combined multi-screen image to each user terminal.
4、 如权利要求 3所述的方法， 其特征在于， 所述 MCU在视频业务进行 中根据参与视频业务的用户终端数量动态修改所述默认画面混合器的属性信  The method according to claim 3, wherein the MCU dynamically modifies the attribute information of the default picture mixer according to the number of user terminals participating in the video service during the video service.
5、 如权利要求 4所述的方法， 其特征在于， 所述属性信息包括多画面显 示模式、 各子画面的显示位置。 The method according to claim 4, wherein the attribute information includes a multi-screen display mode and a display position of each sub-screen.
6、 如权利要求 3所述的方法， 其特征在于， 所述 MCU将需要边框标识 的子画面图像的相关信息记录到画面混合器中， 所述画面混合器完成多画面 组合后对该子画面图像进行边框标识。  The method according to claim 3, wherein the MCU records related information of the sub-picture image that needs the frame identifier to the picture mixer, and the picture mixer completes the multi-picture combination and the sub-picture The image is bordered.
7、 如权利要求 3所述的方法， 其特征在于， 所述画面组合器对视频源图 像信息进行组合时， 包括步骤：  7. The method according to claim 3, wherein when the picture combiner combines the video source image information, the method comprises the steps of:
将视频源图像信息的像素精度与该视频源图像信息在多画面中对应位置 的像素精度进行比较； 当两者不一致时， 对所述视频源图像信息进行采样， 并对采样后的视频 源图像信息进行多画面组合， 否则， 直接对所述视频源图像信息进行多画面 组合。 Comparing the pixel precision of the video source image information with the pixel precision of the corresponding position of the video source image information in the multi-picture; When the two are inconsistent, the video source image information is sampled, and the sampled video source image information is multi-screen combined. Otherwise, the video source image information is directly combined into multiple screens.
8、 如权利要求 7所述的方法， 其特征在于， 对视频图像信息进行多画面 组合后 , 将输出的多画面图像信息的像素精度和多画面输出信息中的输出图 像信息的像素精度进行比较， 当两者不一致时， 将多画面图像信息进行相应 采样并编码， 否则， 直接对所述多画面图像信息进行编码。  8. The method according to claim 7, wherein after the multi-screen combination of the video image information, the pixel precision of the output multi-picture image information and the pixel precision of the output image information in the multi-picture output information are compared. When the two are inconsistent, the multi-picture image information is correspondingly sampled and encoded, otherwise, the multi-picture image information is directly encoded.
9、 一种在视频业务中实现画面显示装置， 其特征在于， 包括： 控制模块， 用于管理多画面控制信息， 以及根据画面显示模式动态确定 画面混合器；  9. A picture display device implemented in a video service, comprising: a control module, configured to manage multi-picture control information, and dynamically determine a picture mixer according to a picture display mode;
解码模块， 用于对各用户终端的视频源图像数据码流进行解码， 获得多 个画面图像信息；  a decoding module, configured to decode a video source image data stream of each user terminal to obtain a plurality of screen image information;
画面组合模块， 用于 居所述多画面控制信息通过一个或多个画面混合 器进行多画面组合， 获得组合的多画面图像信息；  a picture combining module, configured to perform multi-screen combination by using one or more picture mixers to obtain combined multi-picture image information;
编码模块， 用于对组合后的多画面图像信息进行相应编码。  The encoding module is configured to encode the combined multi-picture image information accordingly.
10、 如权利要求 9所述的装置， 其特征在于， 所述控制模块在视频业务 初始化时指定一个默认的画面混合器进行多画面组合； 所述控制模块在视频 业务进行过程中根据用户选择的画面显示模式确定需要的的画面混合器。  The device according to claim 9, wherein the control module specifies a default picture mixer for multi-screen combination when the video service is initialized; the control module selects according to the user during the video service process. The screen display mode determines the desired screen mixer.
11、 如权利要求 10所述的装置， 其特征在于， 所述控制模块在视频业务 进行中根据参与视频业务的用户终端数量动态修改所述默认画面混合器的属 性信息。  The device according to claim 10, wherein the control module dynamically modifies the attribute information of the default picture mixer according to the number of user terminals participating in the video service during the video service.
12、 如权利要求 9-11任一项所述的装置， 其特征在于， 所述控制模块将 需要边框标识的子画面图像的相关信息记录到画面混合器中， 所述画面混合 器完成多画面组合后对该子画面图像进行边框标识。  The device according to any one of claims 9 to 11, wherein the control module records related information of the sub-picture image that needs the frame identification to the picture mixer, and the picture mixer completes the multi-picture. After the combination, the sub-picture image is marked with a border.
13、 如权利要求 12所述的装置， 其特征在于， 所述装置为多点控制单元 MCU。  13. Apparatus according to claim 12, wherein said apparatus is a multipoint control unit MCU.
14、 如权利要求 12所述的装置， 其特征在于， 所述画面组合模块进一步 包括图像数据输入单元， 第一采样器、 画面混合器、 图像数据输出单元和第 二采样器， 其中， 14. The apparatus according to claim 12, wherein said picture combining module further An image data input unit, a first sampler, a picture mixer, an image data output unit, and a second sampler, wherein
图像数据输入单元， 用于接收所述解码模块输出的视频源图像信息； 第一釆样器， 用于将图像数据输入单元中的对应视频源图像信息的像素 精度与该视频源图像在多画面中对应位置的图像像素精度进行比较， 当两者 不一致时， 对视频源图像信息进行釆样， 并将釆样后的视频源图像信息输出 到画面混合器； 否则， 将视频源图像信息直接输出到画面混合器；  An image data input unit, configured to receive video source image information output by the decoding module; a first sampler, configured to input pixel precision of corresponding video source image information in the image data input unit and the video source image in multiple images The image pixel precision of the corresponding position is compared. When the two are inconsistent, the video source image information is sampled, and the sampled video source image information is output to the picture mixer; otherwise, the video source image information is directly output. To the picture mixer;
画面混合器， 用于对第一釆样器中输出的各视频源图像信息进行多画面 组合， 并将组合后的多画面图像信息输出到第二采样器；  a picture mixer, configured to perform multi-screen combination on each video source image information outputted in the first sampler, and output the combined multi-picture image information to the second sampler;
第二采样器， 用于将画面混合器输出的多画面图像信息的像素精度和多 画面输出信息中的输出图像信息的像素精度进行比较， 当两者不一致时将多 画面图像信息进行相应采样并将采样后得到的多画面图像信息通过数据总线 传送给图像数据输出单元； 否则， 将多画面图像信息直接输出到图像数据输 出单元；  a second sampler, configured to compare pixel precision of the multi-picture image information output by the picture mixer with pixel precision of the output picture information in the multi-picture output information, and when the two are inconsistent, the multi-picture image information is correspondingly sampled Transmitting the multi-picture image information obtained by sampling to the image data output unit through the data bus; otherwise, outputting the multi-picture image information directly to the image data output unit;
图像数据输出单元， 用于将图像信息输出给所述编码模块。  And an image data output unit, configured to output image information to the encoding module.
15、 一种视频业务***， 其特征在于， 包括多点控制单元 MCU, 所述 MCU用于通过网络与多个用户终端相连， 并接收用户终端发送的包含画面显 示模式的送切换请求消息， 以及根据所述画面显示模式确定需要的画面混合 器， 并向发送切换请求消息的用户终端输出与请求的画面显示模式对应的画 面图像； 所述画面显示模式用于表明画面显示的子画面数量。  A video service system, comprising: a multipoint control unit MCU, wherein the MCU is configured to connect to a plurality of user terminals through a network, and receive a handover request message including a screen display mode sent by the user terminal, and Determining a required screen mixer according to the screen display mode, and outputting a screen image corresponding to the requested screen display mode to the user terminal transmitting the switching request message; the screen display mode is for indicating the number of sub-screens displayed on the screen.
16、 如权利要求 15所述的***， 其特征在于， 所述 MCU接收所述切换 请求消息之前， 向发送该切换请求消息的用户终端播放视频菜单提示信息。  The system according to claim 15, wherein the MCU plays the video menu prompt information to the user terminal that sends the handover request message before receiving the handover request message.
17、 如权利要求 15所述的***， 其特征在于， 在视频业务初始化时， 所 述 MCU指定一个默认的画面混合器进行多画面组合； 在视频业务进行过程 中， 所述 MCU根据用户选择的画面显示模式确定需要的画面混合器。  The system according to claim 15, wherein, when the video service is initialized, the MCU specifies a default picture mixer for multi-picture combination; during the video service, the MCU is selected according to the user. The screen display mode determines the desired screen mixer.
18、 如权利要求 17所述的***， 其特征在于， 在视频业务进行过程中， 所述 MCU根据参与视频业务的用户终端数量动态修改所述默认画面混合器 的属性信息。 The system according to claim 17, wherein, in the process of performing a video service, the MCU dynamically modifies the default picture mixer according to the number of user terminals participating in the video service. Attribute information.
19、如权利要求 15-18任一项所述的***，其特征在于，所述 MCU包括： 控制模块， 用于管理多画面控制信息， 并向参与视频业务的用户终端播 放视频菜单提示信息， 以及根据用户选择的画面显示模式动态确定画面混合 器；  The system according to any one of claims 15 to 18, wherein the MCU comprises: a control module, configured to manage multi-screen control information, and play video menu prompt information to a user terminal participating in the video service, And dynamically determining the screen mixer according to the screen display mode selected by the user;
解码模块， 用于对各用户终端的视频源图像数据码流进行解码， 获得多 个画面图像信息；  a decoding module, configured to decode a video source image data stream of each user terminal to obtain a plurality of screen image information;
画面组合模块， 用于根据所述多画面控制信息通过一个或多个画面混合 器进行多画面组合， 获得组合的多画面图像信息；  a picture combining module, configured to perform multi-screen combination by one or more picture mixers according to the multi-picture control information, to obtain combined multi-picture image information;
编码模块， 用于对组合后的多画面图像信息进行相应编码。  The encoding module is configured to encode the combined multi-picture image information accordingly.
20、 如权利要求 19所述的***， 其特征在于， 所述控制模块将需要边框 标识的子画面图像的相关信息记录到画面混合器中， 所述画面混合器完成多 画面组合后对该子画面图像进行边^ I标识。  The system according to claim 19, wherein the control module records related information of the sub-picture image that needs the frame identification to the picture mixer, and the picture mixer completes the multi-picture combination and the sub-picture The picture image is marked with the edge ^ I.
PCT/CN2008/000848 2007-04-27 2008-04-25 A method, device and system for realizing picture switching in the video service WO2008131644A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200710097575.X 2007-04-27
CN200710097575A CN100583985C (en) 2007-04-27 2007-04-27 Method, apparatus and system for switching pictures in video service

Publications (1)

Publication Number Publication Date
WO2008131644A1 true WO2008131644A1 (en) 2008-11-06

Family

ID=38716091

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2008/000848 WO2008131644A1 (en) 2007-04-27 2008-04-25 A method, device and system for realizing picture switching in the video service

Country Status (2)

Country Link
CN (1) CN100583985C (en)
WO (1) WO2008131644A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102123268A (en) * 2011-03-15 2011-07-13 深圳市捷视飞通科技有限公司 Video conference terminal and system
CN110709813A (en) * 2018-06-29 2020-01-17 深圳市大疆创新科技有限公司 Image display method, equipment, holder and storage medium
CN111124337A (en) * 2019-12-17 2020-05-08 西安万像电子科技有限公司 Image display method and system

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100583985C (en) * 2007-04-27 2010-01-20 华为技术有限公司 Method, apparatus and system for switching pictures in video service
CN101472090B (en) * 2007-12-27 2011-12-28 新奥特（北京）视频技术有限公司 Method for monitoring beforehand hardware self-adapting multi-channel multi-mode video of video server
CN101262588B (en) * 2008-04-01 2010-06-02 中国联合网络通信集团有限公司 A method and system for mandatory control over auxiliary stream of video network
CN101984659A (en) * 2010-11-16 2011-03-09 中兴通讯股份有限公司 Method, terminal and system for flexibly sending video source in video conference communication
CN102547136B (en) * 2010-12-21 2014-06-04 新奥特（北京）视频技术有限公司 Special effect graph processing method and system for images with multiply pixel ratios
CN102595094A (en) * 2011-01-11 2012-07-18 深圳市锐取软件技术有限公司 Multi-information combined multimedia communication method and system
CN102256099A (en) * 2011-06-20 2011-11-23 中兴通讯股份有限公司 Parameter control method and device
CN102238341B (en) * 2011-06-28 2017-05-10 中兴通讯股份有限公司 Device and method for automatically switching video sub-pictures
CN103248944B (en) * 2012-02-03 2017-08-25 海尔集团公司 A kind of image transfer method and system
CN102625079B (en) * 2012-03-21 2015-01-14 厦门亿联网络技术股份有限公司 Video implementation method for trilateral video conference
CN103686066B (en) * 2012-09-25 2017-05-03 杭州海康威视数字技术股份有限公司 Method and client for adjusting segmentation mode of multi-screen play
CN103905776B (en) 2012-12-26 2018-01-16 华为技术有限公司 Code flow processing method and system, multipoint control unit
CN104253969B (en) * 2013-06-28 2017-12-05 华为技术有限公司 The rendering method and device of more picture compositions
CN103702064B (en) * 2013-12-27 2019-01-18 三亚中兴软件有限责任公司 A kind of video-meeting method, terminal and system
CN103888735A (en) * 2014-03-26 2014-06-25 龙迅半导体科技(合肥)有限公司 Multi-channel video monitoring image data processing method and system
CN105323532B (en) * 2014-06-30 2019-10-15 中兴通讯股份有限公司 A kind of adaptive display method and device of mobile terminal image
CN105472306A (en) * 2014-08-19 2016-04-06 中兴通讯股份有限公司 Video conference data sharing method and related device
CN105704424A (en) * 2014-11-27 2016-06-22 中兴通讯股份有限公司 Multi-image processing method, multi-point control unit, and video system
CN105828151B (en) * 2015-01-07 2019-09-13 ***通信集团公司 A kind of display processing method and device
CN106331576A (en) * 2015-06-25 2017-01-11 中兴通讯股份有限公司 Multimedia service processing method, system and device
JP2017072644A (en) * 2015-10-05 2017-04-13 キヤノン株式会社 Display control device
CN105530131B (en) * 2015-12-18 2020-05-22 航天恒星科技有限公司 Terminal access monitoring management method and system
CN105472309B (en) * 2015-12-31 2020-03-10 杭州华为数字技术有限公司 Data transmission method, device and system
CN106941598A (en) * 2016-01-04 2017-07-11 中兴通讯股份有限公司 Many picture bit stream synthetic methods, many picture bit streams synthesis control method and device
CN108111797A (en) * 2016-11-24 2018-06-01 北京中创视讯科技有限公司 Participant's treating method and apparatus
CN110636242B (en) * 2018-06-22 2023-02-17 中兴通讯股份有限公司 Picture switching method in video conference, terminal and MCU
CN109756695A (en) * 2018-12-25 2019-05-14 视联动力信息技术股份有限公司 A kind of method and apparatus that TV news stream is shown
CN110264543B (en) * 2019-06-21 2022-07-12 苏州科达科技股份有限公司 Frame drawing method and device of spliced picture and storage medium
CN113784080A (en) * 2020-06-10 2021-12-10 中兴通讯股份有限公司 Video conference realization method, device and storage medium
CN111984214A (en) * 2020-08-06 2020-11-24 深圳拔越软件有限公司 Intelligent configuration method for multiple vertical screens and multiple pictures and display system
US11206372B1 (en) * 2021-01-27 2021-12-21 Ampula Inc. Projection-type video conference system
CN112882672B (en) * 2021-02-26 2024-01-23 京东方科技集团股份有限公司 Near-eye display control method and device and near-eye display equipment
CN113727149B (en) * 2021-08-31 2023-06-30 京东方科技集团股份有限公司 Display control method and device, video processing device and display system
CN114449205B (en) * 2022-04-08 2022-07-29 浙江华创视讯科技有限公司 Data processing method, terminal device, electronic device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2407533Y (en) * 2000-01-06 2000-11-22 李保国 Multi-pot interaction multimedia video frequency communication control device
JP2003069563A (en) * 2001-08-22 2003-03-07 Nippon Telegr & Teleph Corp <Ntt> Method and system for multi-location meeting
CN1620133A (en) * 2003-11-21 2005-05-25 华为技术有限公司 Method of implementing switching of single picture and multi-pictures in conference television system
CN101031065A (en) * 2007-04-27 2007-09-05 华为技术有限公司 Method, apparatus and system for switching pictures in video service

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2407533Y (en) * 2000-01-06 2000-11-22 李保国 Multi-pot interaction multimedia video frequency communication control device
JP2003069563A (en) * 2001-08-22 2003-03-07 Nippon Telegr & Teleph Corp <Ntt> Method and system for multi-location meeting
CN1620133A (en) * 2003-11-21 2005-05-25 华为技术有限公司 Method of implementing switching of single picture and multi-pictures in conference television system
CN101031065A (en) * 2007-04-27 2007-09-05 华为技术有限公司 Method, apparatus and system for switching pictures in video service

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102123268A (en) * 2011-03-15 2011-07-13 深圳市捷视飞通科技有限公司 Video conference terminal and system
CN110709813A (en) * 2018-06-29 2020-01-17 深圳市大疆创新科技有限公司 Image display method, equipment, holder and storage medium
CN110709813B (en) * 2018-06-29 2024-05-14 深圳市大疆创新科技有限公司 Image display method, device, cradle head and storage medium
CN111124337A (en) * 2019-12-17 2020-05-08 西安万像电子科技有限公司 Image display method and system

Also Published As

Publication number Publication date
CN100583985C (en) 2010-01-20
CN101031065A (en) 2007-09-05

Similar Documents

Publication Publication Date Title
WO2008131644A1 (en) A method, device and system for realizing picture switching in the video service
EP1683356B1 (en) Distributed real-time media composer
US8319814B2 (en) Video conferencing system which allows endpoints to perform continuous presence layout selection
US8619953B2 (en) Home videoconferencing system
US8139100B2 (en) Virtual multiway scaler compensation
US7884844B2 (en) System for conducting videoconferencing session over television network
WO2011116611A1 (en) Method for playing video of tv meeting
US20070169156A1 (en) Apparatus, Network Device And Method For Video/Audio Data Transmission
US20060192848A1 (en) Video conferencing system
WO2011140812A1 (en) Multi-picture synthesis method and system, and media processing device
US8749611B2 (en) Video conference system
US8743172B2 (en) Image capturing for video conference system
US9961303B2 (en) Video conference virtual endpoints
CN101198008A (en) Method and system for implementing multi-screen and multi-picture
WO2014044059A1 (en) Method, device and system for video conference recording and playing
TW201240465A (en) Video conference system and method using the same
TWI381733B (en) High definition video conference system
KR100949233B1 (en) Apparatus and method for document sharing by using standard video terminal and ip tv
KR20130030066A (en) Video conferencing service system
TW574830B (en) A method and device transmitting and receiving video flow in network
CN116915937A (en) Multipath video input method and system
TW201537990A (en) Method and system for processing video data of meeting
CN115734028A (en) Media stream pushing method and system based on cascade coding
JPH08163529A (en) Image multi-point communication control system
KR20070018561A (en) Method and apparatus providing picture communication service by using broadband convergence network

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08748413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08748413

Country of ref document: EP

Kind code of ref document: A1