CN110636242B - Picture switching method in video conference, terminal and MCU - Google Patents
Picture switching method in video conference, terminal and MCU Download PDFInfo
- Publication number
- CN110636242B CN110636242B CN201810650092.6A CN201810650092A CN110636242B CN 110636242 B CN110636242 B CN 110636242B CN 201810650092 A CN201810650092 A CN 201810650092A CN 110636242 B CN110636242 B CN 110636242B
- Authority
- CN
- China
- Prior art keywords
- picture
- switching
- video conference
- conference terminal
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the invention provides a picture switching method in a video conference, a terminal and an MCU (microprogrammed control unit), wherein the picture switching method comprises the following steps: when the first video conference terminal identifies the switching operation, the first video conference terminal sends a picture switching message to the multipoint control unit MCU, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched; and receiving the switched video code stream sent by the MCU for picture display. Therefore, the pictures of the conference room are dynamically switched at the video conference terminal side, the pictures can be quickly switched, and the user experience is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of video conferences, in particular to a picture switching method in a video conference, a terminal and an MCU.
Background
With the development of video conference technology, the processing capability of an MCU (multipoint Control Unit) becomes more and more powerful, and a Universal Port (UP) technology is developed to realize the function of viewing different pictures at each conference terminal and meet the personalized requirements of different conference sites.
In a video conference, two or more conference places usually exist, and the MCU decodes, encodes and synthesizes pictures of a plurality of conference places according to different video capabilities of the conference places, synthesizes the pictures of the video capabilities supported by a target terminal, and sends the pictures to each conference place. UP is provided for each meeting place to independently decode and encode, so that MCU can be independently provided for different pictures of each meeting place from other meeting places, and the independent picture requirements of each meeting place are met.
However, when the pictures are customized for each meeting place terminal, the pictures viewed at each meeting place are usually set on the MCU, which is a centralized management. In practice, there is a need for multiple meeting places, and it is difficult for the meeting manager to quickly service the needs of all the meeting places.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a method for switching pictures in a video conference, including:
when the first video conference terminal identifies the switching operation, the first video conference terminal sends a picture switching message to the multipoint control unit MCU, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
and receiving the switched video code stream sent by the MCU for picture display.
The embodiment of the invention also provides a picture switching method in the video conference, which comprises the following steps:
the multipoint control unit MCU receives a picture switching message sent by a first video conference terminal, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
and generating a switched video code stream according to the picture switching message, and sending the switched video code stream to the first video conference terminal so as to facilitate the first video conference terminal to display pictures.
An embodiment of the present invention further provides a video conference terminal, where the terminal includes:
the sending unit is used for sending a picture switching message to the multipoint control unit MCU when the switching operation is identified, wherein the picture switching message comprises a switching picture type and a second video conference terminal number to be switched;
and the display unit is used for receiving the switched video code stream sent by the MCU to display the picture.
An embodiment of the present invention further provides a multipoint control unit MCU, where the MCU includes:
the video conference system comprises a receiving unit, a switching unit and a switching unit, wherein the receiving unit is used for receiving a picture switching message sent by a first video conference terminal, and the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
and the switching unit is used for generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal so as to facilitate the first video conference terminal to display pictures.
The embodiment of the invention also provides a video conference terminal, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, the image switching method executed by the video conference terminal is realized.
The embodiment of the invention also provides a multipoint control unit MCU, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the computer program is executed by the processor to realize the image switching method executed by the MCU.
The embodiment of the invention also provides a computer-readable storage medium, wherein an information processing program is stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the steps of any one of the above-mentioned picture switching methods are realized.
Compared with the prior art, the embodiment of the invention provides a picture switching method in a video conference, a terminal and an MCU, wherein the picture switching method comprises the following steps: when the first video conference terminal identifies the switching operation, the first video conference terminal sends a picture switching message to the multipoint control unit MCU, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched; and receiving the switched video code stream sent by the MCU for picture display. Therefore, the pictures of the conference room are dynamically switched at the video conference terminal side, the pictures can be quickly switched, and the user experience is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
Fig. 1 is a schematic diagram illustrating a picture switching process in a conventional video conference;
fig. 2 is a schematic flowchart of a method for switching frames in a video conference according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of a method for switching frames in a video conference according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of a picture switching method in a video conference according to a third embodiment of the present invention;
FIG. 5 is a diagram of a conference terminal list screen;
fig. 6 is a schematic screen view illustrating switching of a terminal a image displayed by a first video conference terminal to a terminal B image when a tag of the terminal B is clicked;
fig. 7 is a screen schematic diagram of switching a terminal a image displayed by a first video conference terminal to a terminal B image when a display screen is clicked and the display screen slides from right to left;
FIG. 8 is a diagram illustrating a touch terminal A displaying a small-screen image;
fig. 9 is a screen diagram illustrating a screen switching according to a fourth embodiment of the present invention;
fig. 10 is a flowchart illustrating a screen switching method according to a fourth embodiment of the present invention;
fig. 11 is a screen diagram illustrating a screen switching according to a fifth embodiment of the present invention;
fig. 12 is a schematic flowchart of a frame switching method according to a fifth embodiment of the present invention;
fig. 13 is a schematic structural diagram of a video conference terminal according to a sixth embodiment of the present invention;
fig. 14 is a schematic structural diagram of an MCU according to a sixth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
At present, when each meeting place terminal is customized with a picture, centralized management is usually performed on the MCU, that is, when each meeting place user wants to modify the picture seen by the user, the meeting manager needs to be informed to modify the picture intensively and uniformly. Fig. 1 is a schematic diagram illustrating a picture switching process in a conventional video conference. In the initial state, the terminal a watches the image of the terminal B, the image data of the terminal B passes through the decoding node of the terminal B, and sends the decoded code stream to the encoding node of the terminal a, and the encoding node of the terminal a encodes the code stream of the terminal B and sends the encoded code stream to the terminal a, as shown in fig. 1-1. When a conference manager or a chairman control terminal A on the terminal switches to watch the image of the terminal C, the media management module commands a decoding node of the terminal B to stop sending the code stream to an encoding node of the terminal A, commands the decoding node of the terminal C to send the code stream to the encoding node of the terminal A, commands the encoding node of the terminal A to receive the code stream decoded by the decoding node of the terminal C, and then sends the encoded video code stream of the terminal C to the terminal A, as shown in the figure 1-2. Therefore, when a plurality of meeting places need to switch local pictures at the same time, a meeting manager can hardly quickly service the requirements of all the meeting places; and the picture switching must be carried out by a conference manager, the operation is complex, and the user experience is poor.
Therefore, the embodiment of the invention provides a new method, terminal and MCU for switching pictures in a video conference, and pictures in a conference room are dynamically switched at a video conference terminal side, so that the pictures can be quickly switched, and the user experience is improved.
Example one
Fig. 2 is a schematic flowchart of a method for switching pictures in a video conference according to an embodiment of the present invention. As shown in fig. 2, the screen switching method includes:
and 202, receiving the switched video code stream sent by the MCU for picture display.
When the switching operation is local picture switching, the switching picture type is switching large pictures;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving the video code stream of the second video conference terminal sent by the MCU, and displaying a local picture as a picture of a conference place where the second video conference terminal is located.
When the switching operation is to display a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of a local picture which is superimposed with a small picture corresponding to the second video conference terminal and is sent by the MCU, and displaying the small picture at the small picture display starting position of the local picture.
When the switching operation is to cancel a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: identifying a display type for canceling display;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of the local picture sent by the MCU, and not displaying the small picture at the small picture display starting position of the local picture.
Wherein the method further comprises:
after the first video conference terminal enters into a conference, receiving a conference terminal list sent by an MCU;
and forming a preset watching terminal list according to the conference terminal list, and displaying or canceling the display of the label of the preset watching terminal list on the display screen of the first video conference terminal when a preset operation is detected.
When the display screen of the first video conference terminal is detected to be clicked, displaying the label of the preset watching terminal list on the display screen, and when the display screen of the first video conference terminal is detected to be away and exceeds the preset time after being clicked, canceling the display of the label of the preset watching terminal list;
when the display screen is detected to be clicked and slides from left to right or from right to left, identifying switching operation for local picture switching; when the video conference terminal slides from left to right, the second video conference terminal to be switched is a video conference terminal of which the video conference terminal corresponding to the local picture is on the left side of the label of the preset watching terminal list; when the second video conference terminal slides from right to left, the second video conference terminal to be switched is a video conference terminal of which the video conference terminal corresponding to the local picture is on the right side of the label of the preset watching terminal list;
when detecting a touch operation on a label of the displayed preset watching terminal list, identifying a switching operation for displaying a small picture, and when detecting that the touch operation on the label disappears, identifying the switching operation for canceling the small picture, wherein the second video conference terminal to be switched is a video conference terminal corresponding to the label;
and when the fact that the label for displaying the small picture is clicked is detected, identifying switching operation for switching the local picture, wherein the second video conference terminal to be switched is a video conference terminal corresponding to the displayed small picture.
Example two
Fig. 3 is a flowchart illustrating a method for switching pictures in a video conference according to an embodiment of the present invention. As shown in fig. 3, the screen switching method includes:
When the switching picture type is a switching large picture, the switching video code stream is generated according to the picture switching message, and the switching video code stream is sent to the first video conference terminal, and the switching video code stream comprises:
and sending the video code stream of the second video conference terminal to the first video conference terminal so that the first video conference terminal can display the local picture as the picture of the conference place where the second video conference terminal is located.
Wherein, when the switching picture type is a switching small picture, the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal includes:
and superposing the small picture of the second video conference terminal to the small picture display starting position of the local picture of the first video conference terminal, and sending the superposed video code stream to the first video conference terminal so that the first video conference terminal can display the small picture at the small picture display starting position of the local picture.
Wherein, when the switching picture type is switching small picture, the picture switching message further includes: identifying a display type for canceling display;
the generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal includes:
and stopping overlaying the small picture of the second video conference terminal to the small picture display starting position of the local picture of the first video conference terminal, and sending the local picture video code stream of the first video conference terminal to the first video conference terminal, so that the first video conference terminal does not display the small picture at the small picture display starting position of the local picture any more.
Wherein the method further comprises:
and after the first video conference terminal enters into a conference, sending a conference terminal list to the first video conference terminal.
The first embodiment and the second embodiment of the invention provide a new picture switching method in a video conference, pictures of a conference room are dynamically switched at a video conference terminal side, the picture switching can be rapidly realized, and the user experience is improved.
The technical solutions provided in the first and second embodiments are explained in detail by two specific embodiments.
EXAMPLE III
Fig. 4 is a schematic flowchart of a picture switching method in a video conference according to a third embodiment of the present invention. As shown in fig. 4, the screen switching method includes:
the video conference is held, and after a plurality of conference terminals enter a conference, the MCU sends a preset video picture to each conference terminal, which is the prior art and is not described herein again. Meanwhile, at the MCU side, the MCU sends a conference terminal list to each conference place terminal; the contents of the conference terminal list may include: a terminal number and/or a terminal name.
and receiving the conference terminal list sent by the MCU at the terminal side of the conference place, and storing the conference terminal list after the conference terminal receives the conference terminal list. And the meeting place user presets a terminal list which the meeting place user wants to see according to the meeting terminal list sent by the MCU to form a preset watching terminal list. As shown in fig. 5, the conference terminal list sent by the MCU includes terminal a, terminal B, terminal C, and terminal D, and the terminal that receives the conference terminal list can select a terminal list that the terminal wants to see from the conference terminal list, that is, a preset viewing terminal list, which includes terminal a, terminal B, and terminal C.
the preset method includes that when it is detected that the display screen of the first video conference terminal is clicked, the tags of the preset watching terminal list are displayed on the display screen, and when it is detected that the display screen of the first video conference terminal is clicked and leaves and exceeds preset time, the tags of the preset watching terminal list are cancelled.
The display screen on the first video conference terminal side can support multi-point touch. The tags of the preset viewing terminal list may be set at various positions displayed on the local screen, for example, may be set below the display screen; when there is no display screen of the first video conference terminal in the point, a preset viewing terminal list label below the screen should be hidden; when a screen is displayed in a point, a preset terminal list is displayed below the screen of the display screen according to one line or a plurality of lines, the display layout on a toolbar is reduced like a computer display screen, the maximum display terminal list labels can be set to be 25, and thus the length of each terminal label can be set to be 1/25 of the length of the screen; if the point-in-screen leaves, the tab of the preset list of viewing terminals below the screen should be hidden after a timeout of 10 s.
in the conference holding process, the first video conference terminal can switch the video source to be watched according to the preset watching terminal list, when the terminal wants to switch the video source, the MCU sends a picture switching message to the MCU, and the MCU sends a designated meeting place video source picture to the terminal according to the content of the picture switching message.
Wherein the switching picture type includes small picture switching and large picture switching. The large picture switching refers to requesting to switch a local picture of the video conference terminal, and the small picture switching refers to requesting to display or canceling to display a small picture. When the switching operation is local picture switching, the switching picture type is switching large pictures; for example, when a displayed tag of a preset viewing terminal list is clicked, it may be set that the switching operation is identified as local picture switching, and the second video conference terminal to be switched is a video conference terminal corresponding to the clicked tag, for example, as shown in fig. 6, an image of a terminal a is displayed by the original first video conference terminal, and when a tag of a terminal B is clicked, an image of a terminal a displayed by the first video conference terminal is switched to an image of a terminal B. The switching operation can be identified as local picture switching when the display screen is clicked and the display screen slides from left to right or from right to left, and the second video conference terminal to be switched is a video conference terminal of a video conference terminal corresponding to the local picture on the left side of the label of the preset watching terminal list when the display screen slides from left to right; when the second video conference terminal slides from right to left, the second video conference terminal to be switched is a video conference terminal of which the video conference terminal corresponding to the local picture is on the right side of the label of the preset watching terminal list; for example, as shown in fig. 7, the terminal a image is displayed on the original first video conference terminal, and when the display screen is clicked and the display screen is slid from right to left, the terminal a image displayed on the first video conference terminal is switched to the terminal B image for display. The switching operation of the local screen switching may be preset in the conference terminal, and the setting is only an example, and various settings may be performed according to needs, for example, the switching operation may also be performed by a remote controller; when the remote controller selects the current picture, the picture images are switched by using front and back direction keys of the remote controller or rolling balls of the remote controller and the like; when the remote controller selects a terminal label below the screen, the small picture image of the terminal can be previewed, and the flow of switching the small picture is triggered.
When the switching operation is to display a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the display type comprises display and cancel display, and the display type respectively represents that a small picture is displayed and the small picture is canceled to be displayed. The small screen display start position information refers to a position corresponding to the touched tab, for example, the maximum value of the terminal list tabs may be set to 25, and the position of each tab is an integral multiple of 1/25 of the length of the bottom edge of the screen, as shown in fig. 8, the tabs of the preset viewing terminal list include: and assuming that the local picture is displayed as the meeting place picture of the terminal A at the moment, when the 1 st terminal label is touched, the small picture display starting position is 3 (1/25) the length of the bottom edge of the screen, the small picture display starting position information can be represented as 1 by a numerical value in the picture switching message, and the number of the second video conference terminal to be switched is the terminal A.
Wherein the switching operation of the small screen switching may be set in advance in the conference terminal. For example, it may be configured that when the screen is clicked and the screen is touched and moved to a tag of a preset viewing terminal list, a switching operation for displaying a small picture is recognized, and at this time, the picture switching message includes a switching picture type identified as small picture switching, a second video conference terminal number to be switched, a display type identified as display, and small picture display start position information; and the second video conference terminal to be switched is a video conference terminal corresponding to the touched label. It may also be arranged that when it is detected that the touch operation on the tab disappears, it is recognized as a switching operation for canceling the small screen. And when the label for displaying the small picture is detected to be clicked, identifying the switching operation for switching the local picture, wherein the second video conference terminal to be switched is a video conference terminal corresponding to the displayed small picture. The above-described setting is merely an example, and various settings may be made as needed.
wherein the screen switching message includes: the method comprises the steps of switching picture types and numbers of second video conference terminals to be switched; when the switching picture type is a switching large picture, the MCU stops sending the original local picture video code stream to the first video conference terminal, and sends the video code stream of the second video conference terminal to the first video conference terminal as the switched video code stream; for example, if it is switching large screen: firstly, informing a decoding node of an original picture terminal to stop sending a code stream to a coding node of a local conference terminal (a first video conference terminal); and informing a decoding node of the second video conference terminal to send a code stream to a coding node of the local conference terminal according to the terminal number (second video conference terminal number) in the message, and simultaneously informing the coding node of the local conference terminal to receive the code stream from the new decoding node.
Wherein, the picture switching message includes not only the switching picture type and the second video conference terminal number to be switched, but also the display type of the display or the cancellation of the display, and when the display type is the display, the method further includes: the small screen displays start position information.
And when the switching picture type is the switching small picture and the display type is displaying, the switching picture type does not switch the local picture but displays the small picture on the local picture. For example, if it is switching small screen, and displaying small screen: firstly, according to the number of a second video conference terminal in a message, informing a decoding node of the second video conference terminal image, and sending a small-picture video code stream to a coding node of a local conference terminal (a first video conference terminal); informing the coding node of the terminal of the conference place to receive the code stream of the decoding node of the original large picture (the local picture displayed by the original first video conference terminal), and simultaneously receiving the decoded code stream sent by the decoding node of the small picture (the decoding node of the second video conference terminal), and simultaneously informing the coding node of the terminal of the conference place, wherein the coding picture information of the code stream of the large picture and the coded picture information of the code stream of the small picture comprise the picture size information and the picture position information; the coding node of the terminal of the local conference place superposes the small picture on the appointed position (small picture display starting position) of the original large picture according to the information, and then the small picture is sent to the terminal of the local conference place (first video conference terminal) through the access node of the MCU.
And when the switching picture type is the switching small picture and the display type is the display cancellation, the switching picture type does not switch the local picture but cancels the display of the small picture on the local picture. For example, if it is switching small pictures and canceling small pictures: firstly, according to the terminal number in the message, informing the decoding node of the terminal image, and stopping sending the decoding code stream to the coding node of the terminal of the local conference; and stopping receiving the code stream of the decoding node through the coding node of the meeting place terminal, and simultaneously canceling the superposition of small pictures.
And 406, the first video conference terminal receives the switched video code stream sent by the MCU to display the picture.
When the switching picture type is switching large pictures, the first video conference terminal receives the video code stream of the second video conference terminal sent by the MCU, and displays a local picture as a picture of a conference place where the second video conference terminal is located.
When the switching picture type is switching small pictures and the small pictures are displayed, the first video conference terminal receives a video code stream which is sent by the MCU and is superposed with local pictures of the small pictures corresponding to the second video conference terminal, and the small pictures are displayed at the small picture display starting position of the local pictures.
When the switching picture type is switching small pictures and the small pictures are not displayed, the first video conference terminal only continues to receive the video code stream of the local pictures sent by the MCU, and the small pictures are not displayed at the small picture display starting position of the local pictures.
The above sequence of steps is merely exemplary and there is no fixed order of the steps.
Example four
Fig. 9 is a schematic view of a screen switching screen according to a fourth embodiment of the present invention, and fig. 10 is a schematic flow chart of a screen switching method according to the fourth embodiment of the present invention.
As shown in fig. 9, terminal a views the image of terminal B, and when clicking the screen of terminal a and sliding from right to left, switches the image of terminal B displayed by terminal a to the image of terminal C; or when the label of the terminal C displayed in the screen of the terminal A is clicked, the image of the terminal B displayed by the terminal A is switched to the image of the terminal C. The specific screen switching process is shown in fig. 10, and includes:
step S1001, on a display screen of a terminal A, a user clicks a terminal C label below the screen or clicks and slides the screen from right to left in a terminal screen touch screen mode, the terminal A is triggered to send a picture switching message to an MCU, and the content of the picture switching message comprises: switching the picture type into a large picture, and setting the number of the video conference terminal to be switched as a terminal C;
before this step, after the conference is held, the terminal a watches the image of the terminal B, and the video code stream flow direction is: and the terminal B sends the video code stream to a decoding node of the MCU terminal B, the decoding node of the terminal B sends the decoded video code stream to a coding node of the terminal A, and the coding node of the terminal A sends the coded video code stream to the terminal A.
Step S1002, after receiving the picture switching message, the media management module on the MCU analyzes that the message content is that a large picture image on the terminal A needs to be switched from the terminal B to the terminal C; the media management module sends a decoding stop message to a decoding node of the terminal B, instructs the decoding node to stop sending the decoding code stream to an encoding node of the terminal A, sends a decoding send message to a decoding node of the terminal C, and instructs the decoding node to send the decoding code stream of the terminal C to the encoding node of the terminal A;
after receiving the message, the decoding node of the terminal B stops sending the decoding code stream to the coding node of the terminal A.
Step S1003, the media management module on the MCU sends a coding receiving message to a coding node of the terminal A and indicates the coding node to receive a code stream from a decoding node of the terminal C;
step 1004, after receiving the message, the coding node of terminal a receives the code stream from the decoding node of terminal C, then codes and sends the coded code stream to terminal a;
after receiving the video code stream, the terminal a switches the image of the terminal B displayed by the terminal a to the image of the terminal C.
The above sequence of steps is merely exemplary and there is no fixed order of the steps.
EXAMPLE five
Fig. 11 is a schematic view of a screen switching screen according to a fifth embodiment of the present invention, and fig. 12 is a schematic flow chart of a screen switching method according to the fifth embodiment of the present invention.
As shown in fig. 11, terminal a views the image of terminal B, and when clicking the terminal a screen and moving to the tab of terminal C at the bottom edge of the screen, a small screen of terminal C is displayed on the tab of terminal C displayed by terminal a. The specific screen switching process is shown in fig. 12, and includes:
step S1201, on the display screen of the terminal A, when the position of the screen in the point moves to the terminal C label at the bottom edge of the screen, the terminal A is triggered to send the picture switching message to the MCU, and the content of the picture switching message comprises: switching the picture type into small picture switching; the display type is display; terminal C is the 3 rd terminal tag, so the small screen display start position information is the tag start position of terminal C: 3. the switched video conference terminal number is terminal C;
before the step, after the conference is held, the terminal A watches the image of the terminal B, and the flow direction of the video code stream is as follows: and the terminal B sends the video code stream of the terminal B to a decoding node of the MCU terminal B, the decoding node of the terminal B sends the decoded video code stream to a coding node of the terminal A, and the coding node of the terminal A sends the coded video code stream to the terminal A.
Step S1202, after receiving the picture switching message, the media management module on the MCU analyzes that the message content is that the small picture image on the terminal A needs to be switched to the terminal C; the media management module sends a message for starting decoding and sending to a decoding node of the terminal C, and indicates the decoding node to send the decoding code stream of the terminal C to an encoding node of the terminal A;
after receiving the message, the decoding node of the terminal C sends a decoding code stream to the coding node of the terminal A.
Step S1203, the media management module sends a coding receiving message to a coding node of the terminal A, instructs the coding node of the terminal A to receive a code stream from a decoding node of the terminal C, and simultaneously instructs the decoding node of the terminal C that the picture type is a small picture; size of coded picture: the picture size is 25 times of the whole large picture; position information in the image: 3;
step S1204, after receiving the message, the coding node of terminal A receives the code stream from the decoding node of terminal C, then according to the picture type in the message, code a small picture, and its position in the picture encodes, send the code stream after encoding to terminal A.
After the terminal A receives the video code stream, the terminal A displays a small picture of the terminal C on a large picture.
The above sequence of steps is merely exemplary and there is no fixed order of the steps.
EXAMPLE six
Fig. 13 is a schematic structural diagram of a video conference terminal according to a sixth embodiment of the present invention. As shown in fig. 13, the video conference terminal includes:
the sending unit is used for sending a picture switching message to the multipoint control unit MCU when the switching operation is identified, wherein the picture switching message comprises a switching picture type and a second video conference terminal number to be switched;
and the display unit is used for receiving the switched video code stream sent by the MCU to display the picture.
When the switching operation is local picture switching, the switching picture type is switching large pictures;
the display unit is specifically configured to receive a video code stream of the second video conference terminal sent by the MCU, and display a local picture as a picture of a conference room where the second video conference terminal is located.
When the switching operation is to display a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the display unit is specifically configured to receive a video code stream of a local picture, which is sent by an MCU and on which a small picture corresponding to the second video conference terminal is superimposed, and display the small picture at the small picture display start position of the local picture.
When the switching operation is to cancel a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: identifying a display type for canceling display;
the display unit is specifically configured to receive a video code stream of a local picture sent by the MCU, and no longer display the small picture at the small picture display start position of the local picture.
Wherein the video conference terminal further comprises:
the receiving unit is used for receiving a conference terminal list sent by the MCU after the first video conference terminal enters a conference;
and the display unit is also used for forming a preset watching terminal list according to the conference terminal list, and displaying or canceling the display of the label of the preset watching terminal list on the display screen of the first video conference terminal when a preset operation is detected.
Fig. 14 is a schematic structural diagram of an MCU according to a sixth embodiment of the present invention. As shown in fig. 14, the MCU includes:
the receiving unit is used for receiving a picture switching message sent by a first video conference terminal, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
and the switching unit is used for generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal so as to facilitate the first video conference terminal to carry out picture switching.
When the switching picture type is a switching large picture, the switching unit is specifically configured to send the video code stream of the second video conference terminal to the first video conference terminal, so that the first video conference terminal displays the local picture as the picture of the conference place where the second video conference terminal is located.
Wherein, when the switching picture type is a switching small picture, the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position; the switching unit is specifically configured to superimpose the small picture of the second video conference terminal onto the small picture display start position of the local picture of the first video conference terminal, and send the superimposed video code stream to the first video conference terminal, so that the first video conference terminal displays the small picture at the small picture display start position of the local picture.
Wherein, when the switching picture type is switching small picture, the picture switching message further includes: identifying a display type for canceling display; the switching unit is specifically configured to stop superimposing the small picture of the second video conference terminal to the small picture display start position of the local picture of the first video conference terminal, and send the local picture video code stream of the first video conference terminal to the first video conference terminal, so that the first video conference terminal does not display the small picture at the small picture display start position of the local picture any more.
The MCU also comprises a sending unit used for sending a conference terminal list to the first video conference terminal after the first video conference terminal enters into a conference.
The functions of the receiving unit and the switching unit may be respectively assumed by a media management module and a coding and decoding module in the MCU, which is specifically referred to in the fourth and fifth embodiments.
The embodiment of the invention also provides a video conference terminal, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, the computer program realizes any one of the picture switching methods executed by the video conference terminal.
The embodiment of the invention also provides a Multipoint Control Unit (MCU), which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, the MCU executes any one of the image switching methods.
An embodiment of the present invention further provides a computer-readable storage medium, where an information processing program is stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the information processing program implements the steps of any one of the above-mentioned image switching methods.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (11)
1. A picture switching method in a video conference comprises the following steps:
when the first video conference terminal identifies the switching operation, the first video conference terminal sends a picture switching message to the multipoint control unit MCU, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
receiving the switched video code stream sent by the MCU for picture display;
the method further comprises the following steps:
after the first video conference terminal enters into a conference, receiving a conference terminal list sent by an MCU;
forming a preset watching terminal list according to the conference terminal list, and displaying or canceling a label of the preset watching terminal list on a display screen of the first video conference terminal when a preset operation is detected;
when the switching operation is to display a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of a local picture which is superimposed with a small picture corresponding to the second video conference terminal and is sent by the MCU, and displaying the small picture at the small picture display starting position of the local picture.
2. The picture switching method according to claim 1,
when the switching operation is local picture switching, the switching picture type is switching large pictures;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of the second video conference terminal sent by the MCU, and displaying a local picture as a picture of a conference place where the second video conference terminal is located.
3. The picture switching method according to claim 1,
when the switching operation is to cancel the small picture, the switching picture type is to switch the small picture; the picture switching message further includes: identifying a display type for canceling display;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of a local picture sent by the MCU, and not displaying the small picture at the small picture display starting position of the local picture any more.
4. A picture switching method in a video conference comprises the following steps:
the multipoint control unit MCU receives a picture switching message sent by a first video conference terminal, wherein the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
generating a switched video code stream according to the picture switching message, and sending the switched video code stream to the first video conference terminal so as to facilitate the first video conference terminal to display pictures;
the method further comprises the following steps:
after the first video conference terminal enters a conference, sending a conference terminal list to the first video conference terminal;
when the switching picture type is a switching small picture, the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal includes:
and superposing the small picture of the second video conference terminal to the small picture display starting position of the local picture of the first video conference terminal, and sending the superposed video code stream to the first video conference terminal so that the first video conference terminal can display the small picture at the small picture display starting position of the local picture.
5. The picture switching method according to claim 4,
when the switching picture type is a switching large picture, generating a switched video code stream according to the picture switching message, and sending the switched video code stream to the first video conference terminal, wherein the switching picture type comprises:
and sending the video code stream of the second video conference terminal to the first video conference terminal so that the first video conference terminal can display the local picture as the picture of the conference place where the second video conference terminal is located.
6. The picture switching method according to claim 4,
when the switching picture type is a switching small picture, the picture switching message further includes: identifying a display type for canceling display;
the generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal includes:
and stopping overlaying the small picture of the second video conference terminal to the small picture display starting position of the local picture of the first video conference terminal, and sending the local picture video code stream of the first video conference terminal to the first video conference terminal, so that the first video conference terminal does not display the small picture at the small picture display starting position of the local picture any more.
7. A video conference terminal, characterized in that the terminal comprises:
the sending unit is used for sending a picture switching message to the multipoint control unit MCU when the switching operation is identified, wherein the picture switching message comprises a switching picture type and a second video conference terminal number to be switched;
the display unit is used for receiving the switched video code stream sent by the MCU and displaying pictures;
the receiving unit is used for receiving a conference terminal list sent by the MCU after the first video conference terminal enters a conference;
the display unit is further used for forming a preset watching terminal list according to the conference terminal list, and displaying or canceling a label of the preset watching terminal list on a display screen of the first video conference terminal when a preset operation is detected;
when the switching operation is to display a small picture, the switching picture type is to switch the small picture; the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the receiving of the switched video code stream sent by the MCU for picture display includes:
and receiving a video code stream of a local picture which is superimposed with a small picture corresponding to the second video conference terminal and is sent by the MCU, and displaying the small picture at the small picture display starting position of the local picture.
8. A multipoint control unit, MCU, characterized in that it comprises:
the video conference system comprises a receiving unit, a switching unit and a switching unit, wherein the receiving unit is used for receiving a picture switching message sent by a first video conference terminal, and the picture switching message comprises a switching picture type and a number of a second video conference terminal to be switched;
the switching unit is used for generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal so as to facilitate the first video conference terminal to display pictures;
the sending unit is used for sending a conference terminal list to the first video conference terminal after the first video conference terminal enters a conference;
when the switching picture type is a switching small picture, the picture switching message further includes: the mark is the display type of the display and the information of the small picture display starting position;
the generating a switched video code stream according to the picture switching message and sending the switched video code stream to the first video conference terminal includes:
and superposing the small picture of the second video conference terminal to the small picture display starting position of the local picture of the first video conference terminal, and sending the superposed video code stream to the first video conference terminal so that the first video conference terminal can display the small picture at the small picture display starting position of the local picture.
9. A video conference terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the picture switching method according to any one of claims 1 to 3.
10. A Multipoint Control Unit (MCU), comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the picture switching method according to any of claims 4 to 6.
11. A computer-readable storage medium, having stored thereon an information processing program which, when executed by a processor, implements the steps of the picture switching method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810650092.6A CN110636242B (en) | 2018-06-22 | 2018-06-22 | Picture switching method in video conference, terminal and MCU |
| PCT/CN2019/092468 WO2019242774A1 (en) | 2018-06-22 | 2019-06-24 | Screen switching method for video conferencing, terminal, and multipoint control unit |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810650092.6A CN110636242B (en) | 2018-06-22 | 2018-06-22 | Picture switching method in video conference, terminal and MCU |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110636242A CN110636242A (en) | 2019-12-31 |
| CN110636242B true CN110636242B (en) | 2023-02-17 |
Family
ID=68967005
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810650092.6A Active CN110636242B (en) | 2018-06-22 | 2018-06-22 | Picture switching method in video conference, terminal and MCU |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110636242B (en) |
| WO (1) | WO2019242774A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112218031A (en) * | 2020-09-17 | 2021-01-12 | 江苏怀业信息技术股份有限公司 | Video conference data transmission method and system |
| CN112380234B (en) * | 2020-11-03 | 2024-05-14 | 广州迈聆信息科技有限公司 | Video conference window searching and displaying method and device and video conference system |
| CN112650464B (en) * | 2021-01-05 | 2024-02-06 | 深圳市捷视飞通科技股份有限公司 | Video picture display method, apparatus, computer device and storage medium |
| CN115474073B (en) * | 2021-06-11 | 2023-12-12 | 上海赛连信息科技有限公司 | Method and device for intelligently switching picture layout |
| CN116886856B (en) * | 2023-09-08 | 2023-12-15 | 湖北华中电力科技开发有限责任公司 | Power emergency consultation method and system based on video communication |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101031065A (en) * | 2007-04-27 | 2007-09-05 | 华为技术有限公司 | Method, apparatus and system for switching pictures in video service |
| CN101350898A (en) * | 2008-08-29 | 2009-01-21 | 深圳华为通信技术有限公司 | Method for selecting combined picture video source and apparatus thereof |
| CN101895718A (en) * | 2010-07-21 | 2010-11-24 | 杭州华三通信技术有限公司 | Video conference system multi-image broadcast method, and device and system thereof |
| CN102082944A (en) * | 2009-11-30 | 2011-06-01 | 华为终端有限公司 | Conference control method, device and system containing tele-presence conference hall |
| CN102750122A (en) * | 2012-06-05 | 2012-10-24 | 华为技术有限公司 | Multiple-picture display control method, multiple-picture display control device and multiple-picture display control system |
| CN103051865A (en) * | 2012-12-28 | 2013-04-17 | 华为技术有限公司 | Method and terminal for controlling picture and video meeting device |
| CN103873813A (en) * | 2012-12-10 | 2014-06-18 | 中兴通讯股份有限公司 | Method and system for conference television multi-screen switching |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6288740B1 (en) * | 1998-06-11 | 2001-09-11 | Ezenia! Inc. | Method and apparatus for continuous presence conferencing with voice-activated quadrant selection |
| JP2006216997A (en) * | 2005-02-01 | 2006-08-17 | Yamaguchi Univ | Communication unit connection apparatus, method, program, and recording medium |
| CN101534411B (en) * | 2009-04-08 | 2012-12-12 | 华为终端有限公司 | Control method for video conference, terminal and system based on image |
| CN101742221B (en) * | 2009-11-09 | 2012-06-13 | 中兴通讯股份有限公司 | Method and device for synthesizing multiple pictures in video conference system |
-
2018
- 2018-06-22 CN CN201810650092.6A patent/CN110636242B/en active Active
-
2019
- 2019-06-24 WO PCT/CN2019/092468 patent/WO2019242774A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101031065A (en) * | 2007-04-27 | 2007-09-05 | 华为技术有限公司 | Method, apparatus and system for switching pictures in video service |
| CN101350898A (en) * | 2008-08-29 | 2009-01-21 | 深圳华为通信技术有限公司 | Method for selecting combined picture video source and apparatus thereof |
| CN102082944A (en) * | 2009-11-30 | 2011-06-01 | 华为终端有限公司 | Conference control method, device and system containing tele-presence conference hall |
| CN101895718A (en) * | 2010-07-21 | 2010-11-24 | 杭州华三通信技术有限公司 | Video conference system multi-image broadcast method, and device and system thereof |
| CN102750122A (en) * | 2012-06-05 | 2012-10-24 | 华为技术有限公司 | Multiple-picture display control method, multiple-picture display control device and multiple-picture display control system |
| CN103873813A (en) * | 2012-12-10 | 2014-06-18 | 中兴通讯股份有限公司 | Method and system for conference television multi-screen switching |
| CN103051865A (en) * | 2012-12-28 | 2013-04-17 | 华为技术有限公司 | Method and terminal for controlling picture and video meeting device |
Non-Patent Citations (1)
| Title |
|---|
| 多类型视频终端在IMS融合会议中的应用;周春丰等;《计算机技术与发展》(第10期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110636242A (en) | 2019-12-31 |
| WO2019242774A1 (en) | 2019-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110636242B (en) | Picture switching method in video conference, terminal and MCU | |
| CN107509052B (en) | Double-current video conference method, device, electronic equipment and system | |
| US9678567B2 (en) | Indication of eye tracking information during real-time communications | |
| RU2595263C1 (en) | Method of media interaction, device and system for multithreaded conference communication | |
| CN109618177A (en) | Method for processing video frequency, device, electronic equipment and computer readable storage medium | |
| CN101959051A (en) | Method and device for choosing screen of remote presentation system | |
| CN106598527B (en) | The method and apparatus of position of display unit in identification display equipment | |
| CN113329240A (en) | Screen projection method and device | |
| CN101742221B (en) | Method and device for synthesizing multiple pictures in video conference system | |
| US20160065625A1 (en) | Notification of Change in Online Conferencing | |
| CN103051865A (en) | Method and terminal for controlling picture and video meeting device | |
| CN112637671B (en) | Screen sharing method and system | |
| CN105554430A (en) | Video call method, system and device | |
| CN110390641B (en) | Image desensitizing method, electronic device and storage medium | |
| CN110928509B (en) | Display control method, display control device, storage medium, and communication terminal | |
| CN115576456A (en) | Session page display method, device, equipment, readable storage medium and product | |
| CN112073798A (en) | Data transmission method and equipment | |
| CN112822472A (en) | Projector control method, system and computer readable storage medium | |
| US8860773B2 (en) | Telepresence for remote collaboration with a gestural interface | |
| CN111818292B (en) | Control method, device, terminal and system | |
| CN110636243B (en) | Conference control method and MCU | |
| US20230367462A1 (en) | Smart interactive board, display method therefor, and readable storage medium | |
| US10397531B2 (en) | Projector, display device, and display method | |
| CN112672089B (en) | Conference control and conference participation method, conference control and conference participation device, server, terminal and storage medium | |
| US10645330B2 (en) | Visual control of a video conference |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |