WO2021012780A1 - Videoconference control method and device - Google Patents

Videoconference control method and device Download PDF

Info

Publication number
WO2021012780A1
WO2021012780A1 PCT/CN2020/092621 CN2020092621W WO2021012780A1 WO 2021012780 A1 WO2021012780 A1 WO 2021012780A1 CN 2020092621 W CN2020092621 W CN 2020092621W WO 2021012780 A1 WO2021012780 A1 WO 2021012780A1
Authority
WO
WIPO (PCT)
Prior art keywords
client
server
conference control
control message
conference
Prior art date
Application number
PCT/CN2020/092621
Other languages
French (fr)
Chinese (zh)
Inventor
王利民
汪鹏
曾伟
刘超
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2021012780A1 publication Critical patent/WO2021012780A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor

Definitions

  • This article relates to the field of communications, in particular to a video conference control method and device.
  • Video conferencing systems mostly use traditional client and server network architecture models. All meeting clients log in to the server through registration.
  • the initiator of the meeting initiates a request to the server to create a meeting, and the server creates a meeting room and invites Conference members join the conference room and conduct video conferences.
  • the server needs to add corresponding control functions synchronously to achieve the goal, so that when the client's conference performs certain conference control, a message will be sent to the server, and the server will perform the conference control operation. To achieve the purpose of controlling the state of the conference and the behavior of members.
  • the client needs to add new conference control control operations, it is severely limited by the support capabilities of the server and cannot flexibly customize the conference control functions required by the client. Moreover, when the number of client terminals that access the server system increases, the network pressure on the server will increase accordingly, reducing the stability of the conference system.
  • this article provides a video conference control method, including: in a multi-party video conference, the server establishes a dedicated connection channel with the client, and the dedicated connection channel is used for transmission A custom conference control message sent by the client; the server receives the custom conference control message without parsing, and forwards the custom conference control message to each client in the multiparty video conference.
  • This article also provides a network device, including: a processor, a memory, and a communication bus; the communication bus is used to realize the connection and communication between the processor and the memory; the processor is used to execute the service processing program stored in the memory to Realize the video conference control method.
  • This document also provides a storage medium that stores one or more programs, and the one or more programs can be executed by one or more processors to implement the video conference control method.
  • Figure 1 is a schematic diagram of this article.
  • FIG. 2 is a flowchart of the implementation of the first embodiment of this document.
  • Fig. 3 is a timing diagram of the implementation of the first embodiment herein.
  • FIG. 4 is a flowchart of the implementation of the second embodiment of this document.
  • Fig. 5 is a timing diagram of the implementation of the second embodiment herein.
  • Figure 6 is a structural diagram of a network device provided in this article.
  • Figure 7 is a structural diagram of a storage medium provided in this article.
  • this method is applied to a smart terminal device, which can be a standalone terminal or a mobile terminal device such as a smart phone.
  • Step S201 The client C1, the client C2, ... the client n, log in to the server S by entering their account and password connection.
  • Step S202 The client 1 initiates a multi-party video conference, and initiates a request for creating a video conference to the server S.
  • the main control interface includes three sub-control interfaces, specifically: the top is the conference control interface, the middle is the member control interface, and the bottom is the voice control interface.
  • Each sub-control interface contains different function buttons.
  • Step S203 The server S receives the request of the client C1, creates a video conference room, and invites other clients C2,...the client Cn to enter the conference room and start a video call.
  • the server when there is an operation of adding a member client, the server adds the designated member client to the system, so that the member client can participate in the meeting.
  • the server adds the member client corresponding to the meeting member to the meeting, and sends a response signal to the member client.
  • the server will add the specified member client to the system so that the member client can participate in the meeting.
  • detecting whether there is a preset member client access method for accessing the server is, if there is no server indicating a member client, the system will also detect whether there is active access from other member clients If there is active access from other member clients, the system will detect the access mode of the member client. Then the system will determine whether the access mode meets the above-mentioned access mode. If the above-mentioned access mode is satisfied, the member client will be added to the server. If the above-mentioned access mode is not met, the member client will be prompted to connect. Entry failed.
  • Step S204 each client client C1, client C2, ... client n establishes a dedicated long connection channel with the server S, and the dedicated connection channel is used to transmit a custom conference control message sent by the client .
  • the customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
  • the client C1 if the client C1 needs to implement a certain custom conference control function, it sends a custom conference control instruction to the server through a dedicated connection channel.
  • the customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
  • the client members can operate in the main control interface of the server to send a custom conference control message to the server.
  • the client's functions included in the conference control interface of the main control interface include: all mute, conference recording, screen sharing, group conversation and other functions.
  • the realization principle of the all-member muting function is: detecting whether there is an operation that triggers muting of all member clients in the conference control interface; if there is a muting operation, all member clients are muted.
  • the realization principle of the conference recording function is: when the operation of opening the conference record in the conference control interface is detected, the conference record is opened, and a recording file is generated, and the recording file is saved.
  • the implementation principle of the screen sharing function is: when the operation of opening screen sharing in the conference control interface is detected, screen sharing is turned on, and the shared document is displayed.
  • the realization principle of the group conversation function is: when the operation of opening the group conversation in the meeting control interface is detected, the group conversation is opened, and all the functions of the IM instant messaging software are directly invoked.
  • the client can operate in the voice control interface.
  • the functions included in the voice control interface of the main control interface include: mute on, hands-free, Exit or end the meeting and other functions, as shown in Figure 3.
  • the implementation principle of the mute function is: when an operation of mute on the member control interface is detected, determine the member client selected in the server to mute, and control the selected member client to mute.
  • the realization principle for turning on the hands-free function is: when the operation of turning on the hands-free in the voice control interface is detected, the speaker function of the server is turned on.
  • the implementation principle for the function of exiting or ending the conference is: when the operation of exiting the conference in the voice control interface is detected, the interface of the server is minimized, the conference is hung up, or the conference is ended.
  • the client can operate in the control interface.
  • the functions included in the member control interface of the main control interface are: turn on video, add members, and turn on mute. , View video, please leave the meeting and other functions.
  • the realization principle for turning on the video function is: when the operation of turning on the video in the member control interface is detected, the local video is turned on, and the collected video is displayed; the realization principle for turning on the mute function is: when the member control is detected When the mute is turned on in the interface, determine the member client to be muted in the server, and control the selected member client to mute.
  • the realization principle of the video viewing function is: when the operation of viewing the video in the member control interface is detected, the video of all member clients is turned on, and the video of all cost clients is displayed.
  • the realization principle of the meeting out of meeting function is: when the operation out of meeting in the member control interface is detected, the member client selected in the member control interface is determined, and the member client is selected to leave the meeting.
  • the realization principle of the function of adding members is: when the operation of adding members in the member control interface is detected, the designated member client is added to the server. Thus, the added member client is displayed in the member control interface.
  • Step S205 After the server S receives the conference control message of the dedicated channel sent by the client C1, it does not parse the message, and directly broadcasts the message to each conference member client C2...client Cn.
  • the server and client functions are decoupled.
  • the client can customize conference control instructions, analyze and execute conference control operations, and does not depend on the server's conference control capabilities.
  • the client's function upgrades are independent of the server's functions upgrade.
  • Step S206 After receiving the broadcast message from the server S, other conference member clients C2...Client Cn parses the message, extracts the controlled number and control instruction of the message, and executes the corresponding conference control operation if needed The above corresponding conference control operations.
  • the processing pressure on the server will increase.
  • the client broadcasts a message, it only needs to broadcast the message to the secondary proxy server, and the secondary proxy server will relay the message to other clients in the local area network.
  • Step S401 After all the members of the conference, including client C1...client Cn and server S are connected to the video conference, the server S according to the network status of each client C1...client Cn The set rules select client C2 to act as the secondary proxy server, which is responsible for broadcasting custom conference control messages to all clients in its area.
  • the rule is that the server S selects the client as the proxy server according to the CPU processing performance of the client C1...the client Cn in the designated local network.
  • the rule is that the server S sends the client with the least number of customized meeting control messages within the same time period within a specified time as the secondary proxy server.
  • Step S402 After the secondary proxy server (client C2) is selected, the server S synchronizes the server information of the secondary proxy server (client C2) to the client C1...client Cn.
  • Step S403 each client C1, client C2, ... client n establishes a dedicated long connection channel with the secondary proxy server (client C2), and the dedicated connection channel is used to transmit the data sent by the client Customize meeting control messages.
  • the customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
  • the client members can perform operations in the main control interface to send a custom conference control message to the secondary proxy server.
  • the client's functions included in the conference control interface of the main control interface include: all mute, conference recording, screen sharing, group conversation and other functions.
  • Step S404 If the client C1 needs to implement a certain custom conference control function, it sends a custom conference control instruction to the secondary proxy server (client C2) in the local area network through the dedicated connection channel.
  • Step S405 The secondary proxy server (client C2) that receives the customized conference control instruction message does not perform analysis, and directly forwards the customized conference control instruction message to the server S.
  • Step S406 The server S broadcasts the conference control instruction message to all the second-level agent servers Cx, Cy...Cz of the local area network.
  • the second-level agent server in this embodiment is the client C2.
  • Step S407 the secondary proxy server Cx...Cz forwards the conference control instruction message to the clients C2...Cn in the local area network.
  • Step S408 After receiving the broadcast message from the second-level proxy server Cx...Cz, the client C3...client Cn of the meeting members in the LAN where the secondary proxy server is located, parses the message and extracts the accused number and Control instructions, if you need to perform corresponding conference control operations yourself, perform the corresponding conference control operations above.
  • an embodiment of the present invention provides a device 110, including a memory 1110 and a processor 1120, the memory 1110 stores a program, and the program is read and executed by the processor 1120 to implement the present invention The described video conference control method.
  • the memory 1110 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 1110 may further include a memory remotely provided with respect to the processor 1120, and these remote memories may be connected to the mobile terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
  • an embodiment of the present invention provides a computer-readable storage medium 120.
  • the computer-readable storage medium 120 stores one or more programs 1210, and the one or more programs 1210 can be used by one or Multiple processors execute to implement the video conference control method described in the content of the present invention.
  • the invention solves the problem that when the number of client terminals accessing the server system in the video conference increases, the network pressure of the server will increase correspondingly, and the stability of the video conference system decreases.
  • Such software may be distributed on a computer-readable medium
  • the computer-readable medium may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium).
  • the term computer storage medium includes volatile and non-volatile memory implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data).
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage device, or Any other medium used to store desired information and that can be accessed by a computer.
  • communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention provides a videoconference control method, comprising: in a multi-party videoconference, a server establishing a dedicated connection channel with a client, said dedicated connection channel being used for transmitting a custom conference control message sent by the client; the server receiving the custom conference control message, not parsing, and forwarding the customized conference control message to each client in the multi-party video conference.

Description

一种视频会议控制方法及装置Video conference control method and device
本文要求享有2019年07月22日提交的名称为“一种视频会议控制方法及装置”的中国专利申请CN201910663124.0的优先权，其全部内容通过引用并入本文中。This article claims the priority of the Chinese patent application CN201910663124.0 entitled "A method and device for video conference control" filed on July 22, 2019, the entire content of which is incorporated herein by reference.
技术领域Technical field
本文涉及通信领域，尤其涉及一种视频会议控制方法及装置。This article relates to the field of communications, in particular to a video conference control method and device.
背景技术Background technique
视频会议***大多采用传统的客户端和服务端网络架构模式，所有的会议客户端通过注册登录到服务端，会议发起者通过向服务端发起创建会议的请求，由服务端创建会议室，并邀请会议成员加入会议室，进行视频会议。当会议发起者或者会议参与者需要功能，需要服务端同步新增相应控制功能才能达到目的，使得客户端的会议进行某些会议控制时，将发送消息到服务端，由服务端进行会控操作，达到控制会议状态和成员行为的目的。Video conferencing systems mostly use traditional client and server network architecture models. All meeting clients log in to the server through registration. The initiator of the meeting initiates a request to the server to create a meeting, and the server creates a meeting room and invites Conference members join the conference room and conduct video conferences. When the conference initiator or conference participant needs functions, the server needs to add corresponding control functions synchronously to achieve the goal, so that when the client's conference performs certain conference control, a message will be sent to the server, and the server will perform the conference control operation. To achieve the purpose of controlling the state of the conference and the behavior of members.
但是，如果客户端需要增加新的会议控制控制操作严重受限于服务端的支持能力，不能灵活定制客户端所需的会控功能。并且，当接入服务端***的客户端终端增多时，服务端的网络压力也将相应增大，降低了会议***的稳定性。However, if the client needs to add new conference control control operations, it is severely limited by the support capabilities of the server and cannot flexibly customize the conference control functions required by the client. Moreover, when the number of client terminals that access the server system increases, the network pressure on the server will increase accordingly, reducing the stability of the conference system.
发明内容Summary of the invention
为解决视频会议控制***严重依赖服务端支持能力的问题，本文提供一种视频会议控制方法，包括：在多方视频会议中，服务端与客户端建立专用连接通道，所述专用连接通道用于传送客户端发送的自定义会议控制消息；所述服务端接收所述自定义会议控制消息，不进行解析，将所述自定义会议控制消息转发至多方视频会议中的各个客户端。In order to solve the problem that the video conference control system relies heavily on the support capability of the server, this article provides a video conference control method, including: in a multi-party video conference, the server establishes a dedicated connection channel with the client, and the dedicated connection channel is used for transmission A custom conference control message sent by the client; the server receives the custom conference control message without parsing, and forwards the custom conference control message to each client in the multiparty video conference.
本文还提供一种网络设备，包括：处理器、存储器及通信总线；所述通信总线用于实现处理器和存储器之间的连接通信；所述处理器用于执行存储器中存储的业务处理程序，以实现所述视频会议控制方法。This article also provides a network device, including: a processor, a memory, and a communication bus; the communication bus is used to realize the connection and communication between the processor and the memory; the processor is used to execute the service processing program stored in the memory to Realize the video conference control method.
本文还提供一种存储介质，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现所述视频会议控制方法。This document also provides a storage medium that stores one or more programs, and the one or more programs can be executed by one or more processors to implement the video conference control method.
附图说明Description of the drawings
图1为本文的流程示意图。Figure 1 is a schematic diagram of this article.
图2为本文第一实施例的实施方式流程图。Figure 2 is a flowchart of the implementation of the first embodiment of this document.
图3为本文第一实施例的实施方式时序图。Fig. 3 is a timing diagram of the implementation of the first embodiment herein.
图4为本文第二实施例的实施方式流程图。Figure 4 is a flowchart of the implementation of the second embodiment of this document.
图5为本文第二实施例的实施方式的时序图。Fig. 5 is a timing diagram of the implementation of the second embodiment herein.
图6为本文提供的一种网络设备的结构图。Figure 6 is a structural diagram of a network device provided in this article.
图7为本文提供的一种存储介质的结构图。Figure 7 is a structural diagram of a storage medium provided in this article.
具体实施方式Detailed ways
应当理解，此处所描述的具体实施例仅仅用于解释本文，并不用于限定本文。为了便于理解本文实施例中的自定义控制消息的视频会议处理***，以下将结合附图简要说明在具体的应用场景下本文的实现方法和***处理流程。It should be understood that the specific embodiments described herein are only used to explain the text, and not used to limit the text. In order to facilitate the understanding of the video conference processing system for custom control messages in the embodiments of this document, the following will briefly describe the implementation method and system processing flow of this document in specific application scenarios with reference to the accompanying drawings.
实施例一：Example one:
如图2所示，该方法应用到一智能终端设备中，该智能终端设备可以是单独的终端，也可以是智能手机等移动终端设备。As shown in Figure 2, this method is applied to a smart terminal device, which can be a standalone terminal or a mobile terminal device such as a smart phone.
步骤S201：客户端C1,客户端C2,......客户端n，通过输入自己的账号、密码连接登录到服务器S。Step S201: The client C1, the client C2, ... the client n, log in to the server S by entering their account and password connection.
步骤S202：客户端1发起多方视频会议，向服务端S发起创建视频会议请求。Step S202: The client 1 initiates a multi-party video conference, and initiates a request for creating a video conference to the server S.
在一实施方式中，在该终端设备中存在主控制界面，在该主控制界面中包含3个子控制界面，具体为：顶部为会议控制界面，中间为成员控制界面，底部为语音控制界面。每个子控制界面中包含了不同的功能按钮。In one embodiment, there is a main control interface in the terminal device, and the main control interface includes three sub-control interfaces, specifically: the top is the conference control interface, the middle is the member control interface, and the bottom is the voice control interface. Each sub-control interface contains different function buttons.
步骤S203：服务端S接收客户端C1请求，创建视频会议室，并邀请其他客户端C2,......客户端Cn进入会议室，开始视频通话。Step S203: The server S receives the request of the client C1, creates a video conference room, and invites other clients C2,...the client Cn to enter the conference room and start a video call.
在一实施方式中，在存在添加成员客户端的操作时，服务端会将指定的成员客户端 添加到***中，从而使成员客户端参加到会议中。In one embodiment, when there is an operation of adding a member client, the server adds the designated member client to the system, so that the member client can participate in the meeting.
在一实施方式中，服务端将会议成员对应的成员客户端添加到会议中，并向成员客户端发送响应信号。在存在添加成员客户端的操作时，服务端会将指定的成员客户端添加到***中，从而使成员客户端参加到会议中。In one embodiment, the server adds the member client corresponding to the meeting member to the meeting, and sends a response signal to the member client. When there is an operation to add a member client, the server will add the specified member client to the system so that the member client can participate in the meeting.
在一实施方式中，检测是否存在预设的成员客户端接入服务端的接入方式为，若不存在服务端指示某一成员客户端时，***还将检测是否存在其他成员客户端的主动接入，若存在其他成员客户端的主动接入时，***将检测接入的成员客户端的接入方式。然后***将判定该接入方式是否满足上述的接入方式，若满足上述的接入方式，则将成员客户端添加到服务端中，若不符合上述的接入方式，则提示成员客户端接入失败。In one embodiment, detecting whether there is a preset member client access method for accessing the server is, if there is no server indicating a member client, the system will also detect whether there is active access from other member clients If there is active access from other member clients, the system will detect the access mode of the member client. Then the system will determine whether the access mode meets the above-mentioned access mode. If the above-mentioned access mode is satisfied, the member client will be added to the server. If the above-mentioned access mode is not met, the member client will be prompted to connect. Entry failed.
步骤S204：各客户端客户端C1,客户端C2,......客户端n与服务端S建立专用长连接通道，所述专用连接通道用于传送客户端发送的自定义会议控制消息。Step S204: each client client C1, client C2, ... client n establishes a dedicated long connection channel with the server S, and the dedicated connection channel is used to transmit a custom conference control message sent by the client .
所述自定义会议控制消息包括被控客户端号码和控制命令，所述被控客户端号码用于指示被控客户端执行所述控制命令。The customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
在一实施方式中，通话过程中，客户端C1如果需要实现某种自定义会控功能，则通过专用连接通道发送自定义的会控指令到服务端。In one embodiment, during the call, if the client C1 needs to implement a certain custom conference control function, it sends a custom conference control instruction to the server through a dedicated connection channel.
在一实施方式中，所述自定义会议控制消息包括被控客户端号码和控制命令，所述被控客户端号码用于指示被控客户端执行所述控制命令。In an embodiment, the customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
此外，在本文实施例中，在所有成员客户端接入会议之后，客户端成员可以在服务端的主控制界面中进行操作，向服务端发送自定义会议控制消息。客户端在主控制界面的会议控制界面中包含的功能有：全体禁言、会议录音、屏幕共享、群组会话等功能。In addition, in this embodiment, after all member clients access the conference, the client members can operate in the main control interface of the server to send a custom conference control message to the server. The client's functions included in the conference control interface of the main control interface include: all mute, conference recording, screen sharing, group conversation and other functions.
在一实施方式中，针对全体禁言功能的实现原理为：检测在会议控制界面中是否存在触发全体成员客户端禁言的操作；若存在禁言的操作时，将所有成员客户端禁言。In one embodiment, the realization principle of the all-member muting function is: detecting whether there is an operation that triggers muting of all member clients in the conference control interface; if there is a muting operation, all member clients are muted.
针对会议录音功能的实现原理为：在检测到在会议控制界面中的开启会议记录的操作时，开启会议记录，并生成录音文件，并保存所述录音文件。The realization principle of the conference recording function is: when the operation of opening the conference record in the conference control interface is detected, the conference record is opened, and a recording file is generated, and the recording file is saved.
针对屏幕共享功能的实现原理为：在检测到在会议控制界面中的开启屏幕共享的操作时，开启屏幕共享，并展示共享文档。The implementation principle of the screen sharing function is: when the operation of opening screen sharing in the conference control interface is detected, screen sharing is turned on, and the shared document is displayed.
针对群组会话功能的实现原理为：在检测到在会议控制界面中的开启群组会话的操作时，开启群组会话，并直接调用IM即时通讯软件的所有功能。The realization principle of the group conversation function is: when the operation of opening the group conversation in the meeting control interface is detected, the group conversation is opened, and all the functions of the IM instant messaging software are directly invoked.
此外，在本文实施例中，在所有成员客户端接入会议之后，客户端可在语音控制界 面中进行操作，在主控制界面的语音控制界面中包含的功能有：开启静音、开启免提、退出或结束会议等功能，如图3所示。In addition, in this embodiment, after all member clients access the conference, the client can operate in the voice control interface. The functions included in the voice control interface of the main control interface include: mute on, hands-free, Exit or end the meeting and other functions, as shown in Figure 3.
针对开启静音功能的实现原理为：在检测到在成员控制界面中的开启静音的操作时，确定在服务端中选择的静音的成员客户端，并控制被选中的成员客户端静音。The implementation principle of the mute function is: when an operation of mute on the member control interface is detected, determine the member client selected in the server to mute, and control the selected member client to mute.
针对开启免提功能的实现原理为：在检测到在语音控制界面中的开启免提的操作时，开启服务端的外放功能。The realization principle for turning on the hands-free function is: when the operation of turning on the hands-free in the voice control interface is detected, the speaker function of the server is turned on.
针对退出或结束会议功能的实现原理为：在检测到在语音控制界面中的退出会议的操作时，将所述服务端的界面最小化或者挂断会议或者结束会议。The implementation principle for the function of exiting or ending the conference is: when the operation of exiting the conference in the voice control interface is detected, the interface of the server is minimized, the conference is hung up, or the conference is ended.
此外，在本文实施例中，在所有成员客户端接入会议之后，客户端可以在控制界面中进行操作，在主控制界面的成员控制界面中包含的功能有：开启视频、添加成员、开启静音、查看视频、请出会议等功能。In addition, in the embodiment of this article, after all the member clients access the meeting, the client can operate in the control interface. The functions included in the member control interface of the main control interface are: turn on video, add members, and turn on mute. , View video, please leave the meeting and other functions.
针对开启视频功能的实现原理为：在检测到在成员控制界面中的开启视频的操作时，开启本地视频，并展示采集到的视频；针对开启静音功能的实现原理为：在检测到在成员控制界面中的开启静音的操作时，确定在服务端中选择的静音的成员客户端，并控制被选中的成员客户端静音。The realization principle for turning on the video function is: when the operation of turning on the video in the member control interface is detected, the local video is turned on, and the collected video is displayed; the realization principle for turning on the mute function is: when the member control is detected When the mute is turned on in the interface, determine the member client to be muted in the server, and control the selected member client to mute.
针对查看视频功能的实现原理为：在检测到在成员控制界面中的查看视频的操作时，开启所有成员客户端的视频，并展示所有成本客户端的视频。The realization principle of the video viewing function is: when the operation of viewing the video in the member control interface is detected, the video of all member clients is turned on, and the video of all cost clients is displayed.
针对请出会议功能的实现原理为：在检测到在成员控制界面中的请出会议的操作时，确定在所述成员控制界面中选择的成员客户端，将选择成员客户端请出会议。The realization principle of the meeting out of meeting function is: when the operation out of meeting in the member control interface is detected, the member client selected in the member control interface is determined, and the member client is selected to leave the meeting.
针对添加成员功能的实现原理为：在检测到在成员控制界面中的添加成员的操作时，将指定成员客户端添加到服务端中。从而在成员控制界面中显示已添加的成员客户端。The realization principle of the function of adding members is: when the operation of adding members in the member control interface is detected, the designated member client is added to the server. Thus, the added member client is displayed in the member control interface.
步骤S205：服务端S接收到客户端C1发送的专有通道的会控消息后，不进行解析，将消息直接广播到各会议成员客户端C2...客户端Cn。Step S205: After the server S receives the conference control message of the dedicated channel sent by the client C1, it does not parse the message, and directly broadcasts the message to each conference member client C2...client Cn.
在本方案中，服务端与客户端功能解耦，客户端可以自定义会控指令，并进行解析和执行会控操作，不依赖于服务端的会控能力，客户端的功能升级独立于服务端的功能升级。In this solution, the server and client functions are decoupled. The client can customize conference control instructions, analyze and execute conference control operations, and does not depend on the server's conference control capabilities. The client's function upgrades are independent of the server's functions upgrade.
步骤S206：其他会议成员客户端C2...客户端Cn收到服务端S的广播消息后，解析该消息，提取消息的被控号码和控制指令，若需要自己执行相应会控操作，则执行上述对应的会控操作。Step S206: After receiving the broadcast message from the server S, other conference member clients C2...Client Cn parses the message, extracts the controlled number and control instruction of the message, and executes the corresponding conference control operation if needed The above corresponding conference control operations.
实施例二：Embodiment two:
当参加会议的客户端较多时,服务端处理压力会变大，为了缓解服务端处理压力，可以寻找在同一个局域网中的所有客户端终端，选择其中一个终端充当二级代理服务端的角色，服务端广播消息时，只需要将消息广播到该二级代理服务端，由该二级代理服务端进行中转该消息到本局域网中其他客户端。When there are more clients participating in the meeting, the processing pressure on the server will increase. In order to relieve the processing pressure on the server, you can find all the client terminals in the same local area network and choose one of them to act as the secondary proxy server. When the client broadcasts a message, it only needs to broadcast the message to the secondary proxy server, and the secondary proxy server will relay the message to other clients in the local area network.
如图4所示，As shown in Figure 4,
步骤S401：在各方会议成员，包括客户端C1...客户端Cn以及服务端S均接入视频会议中后，服务端S根据各客户端C1...客户端Cn的网络状态，根据设定的规则选择客户端C2充当二级代理服务端，由它负责广播自定义会控消息到它所在区域的所有客户端。Step S401: After all the members of the conference, including client C1...client Cn and server S are connected to the video conference, the server S according to the network status of each client C1...client Cn The set rules select client C2 to act as the secondary proxy server, which is responsible for broadcasting custom conference control messages to all clients in its area.
在一实施方式中，所述规则为服务器S根据指定的局网中的客户端C1...客户端Cn的CPU处理性能，选择客户端作为代理服务端。In one embodiment, the rule is that the server S selects the client as the proxy server according to the CPU processing performance of the client C1...the client Cn in the designated local network.
在一实施方式中，所述规则为服务器S根据指定时间内同一时间段内发送自定义会议控制消息数量最少的客户端作为二级代理服务端。In one embodiment, the rule is that the server S sends the client with the least number of customized meeting control messages within the same time period within a specified time as the secondary proxy server.
步骤S402：在选定了二级代理服务端(客户端C2)后，服务端S将二级代理服务端(客户端C2)的服务器信息同步到客户端C1...客户端Cn。Step S402: After the secondary proxy server (client C2) is selected, the server S synchronizes the server information of the secondary proxy server (client C2) to the client C1...client Cn.
步骤S403：各客户端C1,客户端C2,......客户端n与二级代理服务端(客户端C2)建立专用长连接通道，所述专用连接通道用于传送客户端发送的自定义会议控制消息。Step S403: each client C1, client C2, ... client n establishes a dedicated long connection channel with the secondary proxy server (client C2), and the dedicated connection channel is used to transmit the data sent by the client Customize meeting control messages.
在一实施方式中，所述自定义会议控制消息包括被控客户端号码和控制命令，所述被控客户端号码用于指示被控客户端执行所述控制命令。In an embodiment, the customized conference control message includes a controlled client number and a control command, and the controlled client number is used to instruct the controlled client to execute the control command.
在一实施方式中，在所有成员客户端接入会议之后，客户端成员可以在主控制界面中进行操作，向二级代理服务端发送自定义会议控制消息。客户端在主控制界面的会议控制界面中包含的功能有：全体禁言、会议录音、屏幕共享、群组会话等功能。In one embodiment, after all member clients access the conference, the client members can perform operations in the main control interface to send a custom conference control message to the secondary proxy server. The client's functions included in the conference control interface of the main control interface include: all mute, conference recording, screen sharing, group conversation and other functions.
步骤S404：客户端C1如果需要实现某种自定义会控功能，则通过专用连接通道发送自定义的会控指令到所在局域网中的二级代理服务端(客户端C2)。Step S404: If the client C1 needs to implement a certain custom conference control function, it sends a custom conference control instruction to the secondary proxy server (client C2) in the local area network through the dedicated connection channel.
步骤S405：收到自定义的会控指令消息的二级代理服务端(客户端C2)不进行解析，直接向服务端S转发自定义的会控指令消息。Step S405: The secondary proxy server (client C2) that receives the customized conference control instruction message does not perform analysis, and directly forwards the customized conference control instruction message to the server S.
步骤S406：服务端S将所述会控指令消息广播至所有局域网二级代理服务端Cx，Cy...Cz，本实施例中二级代理服务端为客户端C2。Step S406: The server S broadcasts the conference control instruction message to all the second-level agent servers Cx, Cy...Cz of the local area network. The second-level agent server in this embodiment is the client C2.
步骤S407：二级代理服务端Cx...Cz向所在局域网内的客户端C2...Cn转发所述会控 指令消息。Step S407: the secondary proxy server Cx...Cz forwards the conference control instruction message to the clients C2...Cn in the local area network.
步骤S408：二级代理服务端所在局域网内会议成员客户端C3...客户端Cn收到二级代理服务端Cx...Cz的广播消息后，解析该消息，提取消息的被控号码和控制指令，若需要自己执行相应会控操作，则执行上述对应的会控操作。Step S408: After receiving the broadcast message from the second-level proxy server Cx...Cz, the client C3...client Cn of the meeting members in the LAN where the secondary proxy server is located, parses the message and extracts the accused number and Control instructions, if you need to perform corresponding conference control operations yourself, perform the corresponding conference control operations above.
实施例三：Example three:
如图6所示，本发明一实施例提供一种设备110，包括存储器1110和处理器1120，所述存储器1110存储有程序，所述程序在被所述处理器1120读取执行时实现本发明所述的视频会议控制方法。As shown in FIG. 6, an embodiment of the present invention provides a device 110, including a memory 1110 and a processor 1120, the memory 1110 stores a program, and the program is read and executed by the processor 1120 to implement the present invention The described video conference control method.
存储器1110可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中，存储器1110可进一步包括相对于处理器1120远程设置的存储器，这些远程存储器可以通过网络连接至移动终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 1110 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1110 may further include a memory remotely provided with respect to the processor 1120, and these remote memories may be connected to the mobile terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
实施例四：Embodiment four:
如图7所示，本发明一实施例提供一种计算机可读存储介质120，所述计算机可读存储介质120存储有一个或者多个程序1210，所述一个或者多个程序1210可被一个或者多个处理器执行，以实现本发明内容所述的视频会议控制方法。As shown in FIG. 7, an embodiment of the present invention provides a computer-readable storage medium 120. The computer-readable storage medium 120 stores one or more programs 1210, and the one or more programs 1210 can be used by one or Multiple processors execute to implement the video conference control method described in the content of the present invention.
本发明解决视频会议中当接入服务端***的客户端终端增多时，服务端的网络压力也将相应增大，视频会议***稳定性降低的问题。The invention solves the problem that when the number of client terminals accessing the server system in the video conference increases, the network pressure of the server will increase correspondingly, and the stability of the video conference system decreases.
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、***、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于 RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。A person of ordinary skill in the art can understand that all or some of the steps, functional modules/units in the system, and apparatus in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may consist of several physical components. The components are executed cooperatively. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile memory implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Flexible, removable and non-removable media. Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage device, or Any other medium used to store desired information and that can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media .

Claims (10)

  1. 一种视频会议控制方法，包括：A video conference control method, including:
    在多方视频会议中，服务端与客户端建立专用连接通道，所述专用连接通道用于传送客户端发送的自定义会议控制消息；In a multi-party video conference, the server establishes a dedicated connection channel with the client, and the dedicated connection channel is used to transmit a custom conference control message sent by the client;
    所述服务端接收所述自定义会议控制消息，不进行解析，将所述自定义会议控制消息转发至多方视频会议中的各个客户端。The server receives the customized conference control message without parsing, and forwards the customized conference control message to each client in the multi-party video conference.
  2. 根据权利要求1所述的方法，其中，还包括：The method according to claim 1, further comprising:
    所述各个客户端接收所述自定义会议控制消息，并分别解析所述自定义会议控制消息后执行控制命令。The respective clients receive the custom conference control message, and execute the control command after parsing the custom conference control message respectively.
  3. 根据权利要求2所述的方法，其中，还包括：The method according to claim 2, further comprising:
    所述自定义会议控制消息包括被控客户端号码和控制命令。The customized conference control message includes the controlled client number and control commands.
  4. 根据权利要求3所述的方法，其中，还包括：The method according to claim 3, further comprising:
    所述控制命令为由发送客户端设定的，对被控客户端的视频信号和音频信号进行控制的命令。The control command is a command set by the sending client to control the video signal and audio signal of the controlled client.
  5. 根据权利要求4所述的方法，其中，还包括：The method according to claim 4, further comprising:
    所述服务端选择若干个客户端作为二级代理服务端，所述二级代理服务端用于转发所述自定义会议控制消息；The server selects several clients as the secondary proxy server, and the secondary proxy server is used to forward the custom meeting control message;
    所述二级代理服务端与客户端建立专用连接通道，所述专用连接通道用于接收客户端发送的自定义会议控制消息；The second-level proxy server establishes a dedicated connection channel with the client, and the dedicated connection channel is used to receive a custom conference control message sent by the client;
    所述二级代理服务端接收客户端发送的所述自定义会议控制消息，不进行解析，将所述自定义会议控制消息转发至服务端；The secondary proxy server receives the custom conference control message sent by the client, and forwards the custom conference control message to the server without parsing;
    所述二级代理服务端接收服务端转发的自定义会议控制消息，不进行解析，将所述定义会议控制消息转发至局域网内各个客户端。The secondary proxy server receives the custom conference control message forwarded by the server, and forwards the defined conference control message to each client in the local area network without parsing.
  6. 根据权利要求5所述的方法，其中，还包括：The method according to claim 5, further comprising:
    所述服务端选择若干个客户端作为二级代理服务端后，将所述二级代理服务端的物理信息发送至所有客户端。After the server selects several clients as the secondary proxy server, the physical information of the secondary proxy server is sent to all clients.
  7. 根据权利要求5所述的方法，其中，还包括：The method according to claim 5, further comprising:
    所述服务端选择指定局域网内CPU处理性能最好的客户端作为二级代理服务端。The server selects the client with the best CPU processing performance in the designated LAN as the secondary proxy server.
  8. 根据权利要求5所述的方法，其中，还包括：The method according to claim 5, further comprising:
    所述服务端选择指定局域网内同一时间段内发送自定义会议控制消息数量最少的客户端作为二级代理服务端。The server selects the client with the least number of custom conference control messages sent within the same time period in the designated local area network as the secondary proxy server.
  9. 一种网络设备，其中，包括：A network device, which includes:
    处理器、存储器及通信总线；Processor, memory and communication bus;
    所述通信总线用于实现处理器和存储器之间的连接通信；The communication bus is used to realize connection and communication between the processor and the memory;
    所述处理器用于执行存储器中存储的业务处理程序，以实现如权利要求1-8任一项所述视频会议控制方法。The processor is configured to execute the business processing program stored in the memory to implement the video conference control method according to any one of claims 1-8.
  10. 一种计算机可读存储介质，其中，所述计算机可读存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如权利要求1-8任一项所述视频会议控制方法。A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors, so as to implement claims 1-8 Any one of the video conference control methods.
PCT/CN2020/092621 2019-07-22 2020-05-27 Videoconference control method and device WO2021012780A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910663124.0A CN112291501B (en) 2019-07-22 2019-07-22 Video conference control method and device
CN201910663124.0 2019-07-22

Publications (1)

Publication Number Publication Date
WO2021012780A1 true WO2021012780A1 (en) 2021-01-28

Family

ID=74193245

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/092621 WO2021012780A1 (en) 2019-07-22 2020-05-27 Videoconference control method and device

Country Status (2)

Country Link
CN (1) CN112291501B (en)
WO (1) WO2021012780A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11848900B2 (en) 2021-08-31 2023-12-19 Microsoft Technology Licensing, Llc Contextual messaging in video conference

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114024942B (en) * 2022-01-10 2022-05-20 中兴通讯股份有限公司 Supplementary service implementation method, entity, terminal, electronic device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8966057B2 (en) * 2011-01-21 2015-02-24 At&T Intellectual Property I, L.P. Scalable policy deployment architecture in a communication network
CN104660952A (en) * 2015-03-04 2015-05-27 苏州科达科技股份有限公司 Video conference communication method and system
CN108810443A (en) * 2017-04-28 2018-11-13 南宁富桂精密工业有限公司 Video pictures synthetic method and multipoint control unit
CN108881134A (en) * 2017-09-25 2018-11-23 北京视联动力国际信息技术有限公司 A kind of communication means and system based on video conference

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101626302A (en) * 2008-07-09 2010-01-13 中兴通讯股份有限公司 System and method for multimedia conference management based on enterprise converged communication
CN101754090B (en) * 2008-12-16 2014-04-16 中兴通讯股份有限公司 Method and system for opening meetings when PC client is used for binding hard terminal
CN101656863A (en) * 2009-08-07 2010-02-24 深圳华为通信技术有限公司 Conference control method, device and system
CN101674451B (en) * 2009-09-27 2012-05-09 中兴通讯股份有限公司 Method, system, central control subsystem and video terminal for controlling multipoint videoconference
CN103414868B (en) * 2013-06-25 2016-06-22 苏州科达科技股份有限公司 A kind of video conference list conference terminal number expansion method based on H323 agreement
CN108632048B (en) * 2017-03-22 2020-12-22 展讯通信（上海）有限公司 Conference call control method and device and multi-pass terminal
CN109040658B (en) * 2018-09-25 2020-10-13 视联动力信息技术股份有限公司 Conference control method and device
CN109218654B (en) * 2018-10-19 2021-01-01 视联动力信息技术股份有限公司 Video networking conference control method and system
CN109688369A (en) * 2019-01-15 2019-04-26 随锐科技股份有限公司 Video conference control method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8966057B2 (en) * 2011-01-21 2015-02-24 At&T Intellectual Property I, L.P. Scalable policy deployment architecture in a communication network
CN104660952A (en) * 2015-03-04 2015-05-27 苏州科达科技股份有限公司 Video conference communication method and system
CN108810443A (en) * 2017-04-28 2018-11-13 南宁富桂精密工业有限公司 Video pictures synthetic method and multipoint control unit
CN108881134A (en) * 2017-09-25 2018-11-23 北京视联动力国际信息技术有限公司 A kind of communication means and system based on video conference

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11848900B2 (en) 2021-08-31 2023-12-19 Microsoft Technology Licensing, Llc Contextual messaging in video conference

Also Published As

Publication number Publication date
CN112291501A (en) 2021-01-29
CN112291501B (en) 2023-04-21

Similar Documents

Publication Publication Date Title
US8630208B1 (en) Muting of communication session participants
KR101685466B1 (en) Method for extending participants of video conference service
US9094524B2 (en) Enhancing conferencing user experience via components
US10732924B2 (en) Teleconference recording management system
CN107534679B (en) Method and system for endpoint control for a communication session
WO2015131709A1 (en) Method and device for participants to privately chat in video conference
WO2021012780A1 (en) Videoconference control method and device
US8704872B2 (en) Method and device for switching video pictures
US20220408321A1 (en) Voice Call Transfer Method and Electronic Device
WO2017113581A1 (en) Method, device and system for controlling call
CN104869106A (en) Sound recording method, voice switching equipment, sound recording server and sound recording system
US10609272B2 (en) Method, device and computer readable medium for communication using smart video cameras
US9762632B2 (en) Systems and methods for establishing and controlling conference call bridges
US20180097858A1 (en) Embedded side call sub-channel used in a telecommunication session
US20210084089A1 (en) Audio streaming from host bluetooth device to multiple receiving bluetooth devices
US11089164B2 (en) Teleconference recording management system
KR20160085985A (en) Apparatus and method for controlling howling
CN111355919B (en) Communication session control method and device
US20180183936A1 (en) Method and apparatus for managing conference call, terminal and network device
US20230421620A1 (en) Method and system for handling a teleconference
CN116938897B (en) Method and device for real-time communication of conference
CN117278982B (en) Video call method, device, equipment and storage medium
US20240056328A1 (en) Audio in audio-visual conferencing service calls
US20220113933A1 (en) Technologies for providing audio components/sessions to devices
CN116980377A (en) Network communication method, device, equipment and medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20844451

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20844451

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20844451

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22/09/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20844451

Country of ref document: EP

Kind code of ref document: A1