CN111212253A

CN111212253A - Monitoring processing method and device in video conference, electronic equipment and storage medium

Info

Publication number: CN111212253A
Application number: CN201911340208.7A
Authority: CN
Inventors: 王雷雷; 赵铎; 杨春晖; 吕倩
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-12-23
Filing date: 2019-12-23
Publication date: 2020-05-29
Anticipated expiration: 2039-12-23
Also published as: CN111212253B

Abstract

The invention provides a monitoring processing method and device in a video conference, electronic equipment and a storage medium. The method comprises the following steps: receiving a binding instruction sent by a client, and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier; generating a binding request carrying a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier, and transmitting the binding request to a monitoring protocol conversion server corresponding to the monitoring protocol conversion server identifier through a video networking server; receiving a binding response returned by the monitoring protocol conversion server and transmitted through the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound for the monitoring equipment corresponding to the monitoring equipment identifier; and when the binding indication information indicates that the binding is successful, adding the virtual terminal number to the video conference corresponding to the video conference identifier, and successfully adding the monitoring equipment to the video conference. The invention can add the monitoring equipment into the video conference, and has simple and convenient processing process and stronger flexibility.

Description

Monitoring processing method and device in video conference, electronic equipment and storage medium

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a monitoring processing method and apparatus in a video conference, an electronic device, and a storage medium.

Background

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other. The video network adopts a real-time high-definition video exchange technology, can integrate dozens of services such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast and the like on a network platform into a system platform, and realizes high-definition quality video playing through a television or a computer.

In the prior art, video network terminals participating in a video conference are usually added into the video conference before the video conference is started, and the roles of the video network terminals participating in the video conference are set. However, in a video conference, a requirement for viewing a monitoring video of a certain monitoring device often occurs, and in such a case, the monitoring device needs to be added to the video conference, but the prior art cannot add the monitoring device to the video conference.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a monitoring processing method, apparatus, electronic device and storage medium in a video conference, which overcome or at least partially solve the above problems.

In a first aspect, an embodiment of the present invention discloses a monitoring processing method in a video conference, where the method includes: receiving a binding instruction sent by a client, and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier carried in the binding instruction; generating a binding request carrying the monitoring protocol server identification and the monitoring equipment identification based on a video networking transparent transmission protocol, and transmitting the binding request to a monitoring protocol server corresponding to the monitoring protocol server identification through a video networking server; receiving a binding response returned by the monitoring co-transfer server and transparently transmitted by the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound by the monitoring co-transfer server for the monitoring equipment corresponding to the monitoring equipment identifier; and when the binding indication information indicates that the binding is successful, adding the virtual terminal number to the video conference corresponding to the video conference identifier, and successfully adding the monitoring equipment to the video conference.

Optionally, the generating a binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on the video networking transparent transmission protocol includes: taking the monitoring protocol conversion server identification as a first field, taking an operation code representing conference transparent transmission information as a second field, taking the operation code representing binding monitoring equipment and the monitoring equipment identification as subsequent fields, and generating the binding request; and after the video network server analyzes the first field and the second field, the binding request is transmitted to the monitoring protocol server.

Optionally, the binding request further carries a code stream type, where the code stream type includes a main code stream and a sub code stream; the generating of the binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on the video networking transparent transmission protocol includes: generating a binding request carrying the monitoring protocol conversion server identification, the monitoring equipment identification and the code stream type based on a video networking transparent transmission protocol; and the virtual terminal number is the virtual terminal number which is bound by the monitoring protocol conversion server for the monitoring equipment and corresponds to the code stream type.

Optionally, in the adding the virtual terminal number to the video conference corresponding to the video conference identifier, after the monitoring device successfully joins the video conference, the method further includes: receiving a unbinding instruction sent by the client, and analyzing to obtain the video conference identifier, the monitoring protocol server identifier, the monitoring equipment identifier and the virtual terminal number carried in the unbinding instruction; when the monitoring equipment is determined to be in an idle state, generating a unbinding request carrying the monitoring protocol server identification, the monitoring equipment identification and the virtual terminal number based on a video networking transparent transmission protocol, and transmitting the unbinding request to the monitoring protocol server through the video networking server; receiving a unbinding response returned by the monitoring co-transfer server and transparently transmitted by the video networking server, wherein the unbinding response carries the virtual terminal number and the unbinding indication information; and when the unbinding indication information indicates that the unbinding is successful, deleting the virtual terminal number from the video conference, and enabling the monitoring equipment to successfully quit the video conference.

Optionally, before receiving the binding instruction sent by the client, the method further includes: receiving a query instruction sent by the client under the condition that the monitoring equipment identifier is not stored, and analyzing to obtain the monitoring co-transfer server identifier and a first group of numbers carried by the query instruction; acquiring monitoring grouping information corresponding to the first group of numbers from the monitoring coordination server; the monitoring grouping information comprises a plurality of second group numbers, and the second group numbers are grouped correspondingly into subgroups of the first group number corresponding subgroups; and sequentially acquiring monitoring equipment information under the groups corresponding to the second groups of numbers from the monitoring coordination server until the monitoring equipment information contains the monitoring equipment identification.

In a second aspect, an embodiment of the present invention discloses a monitoring processing apparatus in a video conference, where the apparatus includes: the first analysis module is used for receiving a binding instruction sent by a client and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier carried in the binding instruction; the first generation module is used for generating a binding request carrying the monitoring protocol server identifier and the monitoring equipment identifier based on a video networking transparent transmission protocol; the first sending module is used for transmitting the binding request to a monitoring protocol conversion server corresponding to the monitoring protocol conversion server identification through a video networking server; the first receiving module is used for receiving a binding response returned by the monitoring protocol conversion server and transmitted through the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound by the monitoring protocol conversion server for the monitoring equipment corresponding to the monitoring equipment identifier; and the adding module is used for adding the virtual terminal number to the video conference corresponding to the video conference identifier when the binding indication information indicates that the binding is successful, and the monitoring equipment is successfully added to the video conference.

Optionally, the first generating module comprises: a request generating unit, configured to use the monitoring co-transfer server identifier as a first field, use an operation code indicating conference pass-through information as a second field, and use an operation code indicating that monitoring equipment is bound and the monitoring equipment identifier as subsequent fields to generate the binding request; and after the video network server analyzes the first field and the second field, the binding request is transmitted to the monitoring protocol server.

Optionally, the binding request further carries a code stream type, where the code stream type includes a main code stream and a sub code stream; the first generation module is specifically configured to generate a binding request carrying the monitoring protocol server identifier, the monitoring device identifier, and the code stream type based on a video networking transparent transmission protocol; and the virtual terminal number is the virtual terminal number which is bound by the monitoring protocol conversion server for the monitoring equipment and corresponds to the code stream type.

Optionally, the apparatus further comprises: the second analysis module is used for receiving a unbinding instruction sent by the client and analyzing to obtain the video conference identifier, the monitoring protocol server identifier, the monitoring equipment identifier and the virtual terminal number which are carried in the unbinding instruction; a second generation module, configured to generate, based on a video networking transparent transmission protocol, a unbinding request carrying the monitoring protocol forwarding server identifier, the monitoring device identifier, and the virtual terminal number when it is determined that the monitoring device is in an idle state; the second sending module is used for transparently transmitting the unbinding request to the monitoring and coordination server through the video networking server; the second receiving module is used for receiving a unbinding response which is returned by the monitoring co-transfer server and is transparently transmitted by the video networking server, wherein the unbinding response carries the virtual terminal number and the unbinding indication information; and the deleting module is used for deleting the virtual terminal number from the video conference when the unbinding indication information indicates that the unbinding is successful, and the monitoring equipment successfully exits the video conference.

Optionally, the apparatus further comprises: the third analysis module is used for receiving a query instruction sent by the client under the condition that the monitoring equipment identifier is not stored, and analyzing to obtain the monitoring protocol server identifier and the first group number carried by the query instruction; the first acquisition module is used for acquiring monitoring group information corresponding to the first group number from the monitoring coordination server; the monitoring grouping information comprises a plurality of second group numbers, and the second group numbers are grouped correspondingly into subgroups of the first group number corresponding subgroups; and the second acquisition module is used for sequentially acquiring the monitoring equipment information under the corresponding grouping of each second group of numbers from the monitoring coordination server until the monitoring equipment information contains the monitoring equipment identification.

In a third aspect, an embodiment of the present invention discloses an electronic device, including: one or more processors; and one or more machine-readable media having instructions stored thereon; the instructions, when executed by the one or more processors, cause the processors to perform a method of monitoring processing in a video conference as described in any one of the above.

In a fourth aspect, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the monitoring processing method in a video conference as described in any one of the above.

In the embodiment of the invention, a binding instruction sent by a client is received, and a video conference identifier, a monitoring protocol server identifier and a monitoring equipment identifier carried in the binding instruction are obtained through analysis; generating a binding request carrying the monitoring protocol server identification and the monitoring equipment identification based on a video networking transparent transmission protocol, and transmitting the binding request to a monitoring protocol server corresponding to the monitoring protocol server identification through a video networking server; receiving a binding response returned by the monitoring co-transfer server and transparently transmitted by the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound by the monitoring co-transfer server for the monitoring equipment corresponding to the monitoring equipment identifier; and when the binding indication information indicates that the binding is successful, adding the virtual terminal number to the video conference corresponding to the video conference identifier, and successfully adding the monitoring equipment to the video conference.

Therefore, in the embodiment of the invention, the user sets the video conference identifier, the monitoring transfer server identifier and the monitoring equipment identifier through the client, the conference management server can automatically generate a binding request according to the information and send the binding request to the monitoring transfer server, the monitoring transfer server binds the virtual terminal number for the monitoring equipment set by the user, and the conference management server adds the virtual terminal number to the corresponding video conference after obtaining the virtual terminal number, so that the monitoring equipment can be added into the video conference.

Drawings

Fig. 1 is a schematic diagram of device interaction according to an embodiment of the present invention.

Fig. 2 is a flowchart illustrating steps of a monitoring processing method in a video conference according to a first embodiment of the present invention.

Fig. 3 is a schematic diagram of a query flow according to a second embodiment of the present invention.

Fig. 4 is a schematic diagram of a binding flow according to a second embodiment of the present invention.

Fig. 5 is a schematic diagram of an unbinding procedure according to the second embodiment of the present invention.

Fig. 6 is a block diagram of a monitoring processing apparatus in a video conference according to a third embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Referring to fig. 1, a schematic diagram of device interaction according to an embodiment of the present invention is shown. As shown in fig. 1, the devices involved in the monitoring processing method in the video conference may include a client, a conference management server, a video networking server, a monitoring coordination server, and a monitoring device. The client-side and the conference management server are in bidirectional interaction, the conference management server is in bidirectional interaction with the video network server, the video network server is in bidirectional interaction with the monitoring transfer server, and the monitoring transfer server is in bidirectional interaction with the monitoring equipment.

The monitoring processing method in the video conference can be applied to a conference management server. The conference management server can realize the communication function between the client and the video networking server and realize the video conference function. The client may be conference control software, such as pamir (personal computer) side of PC (personal computer), APP (application program) of mobile terminal, Web side (Web page side), and the like. The monitoring cooperation server is a server for managing the monitoring equipment in the video network, and the conference management server interacts with the monitoring cooperation server through the video network server to realize the relevant operation of the monitoring equipment. The video conference in the embodiment of the present invention may be a 64-bit video conference.

Example one

Referring to fig. 2, a flowchart illustrating steps of a monitoring processing method in a video conference according to a first embodiment of the present invention is shown. The monitoring processing method in the video conference can comprise the following steps:

step 201, receiving a binding instruction sent by a client, and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring device identifier carried in the binding instruction.

When a certain monitoring device needs to be added into the video conference, the user can set relevant parameters on the client. For example, the client may provide an input box, and the user may input the relevant parameters such as the video conference identifier, the monitoring protocol server identifier, and the monitoring device identifier in the input box, or the client may provide a selection list, and the user may select the relevant parameters such as the video conference identifier, the monitoring protocol server identifier, and the monitoring device identifier in the list.

The monitoring equipment identification is an identification of target monitoring equipment to be added into the video conference, the monitoring transfer server identification is an identification of a monitoring transfer server accessed by the target monitoring equipment, and the video conference identification is an identification of the video conference to be added by the target monitoring equipment.

After the user sets the relevant parameters, the client is triggered to generate a binding instruction, the binding instruction carries the relevant parameters set by the user, such as a video conference identifier, a monitoring protocol server identifier, a monitoring device identifier and the like, and the client sends the binding instruction to the conference management server. And the conference management server analyzes the binding instruction to obtain relevant parameters set by the user, such as a video conference identifier, a monitoring protocol server identifier, a monitoring device identifier and the like carried in the binding instruction.

Step 202, generating a binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on a video networking transparent transmission protocol, and transmitting the binding request to a monitoring protocol server corresponding to the monitoring protocol server identifier through the video networking server.

The conference management server generates a binding request for the monitoring protocol server identification and the monitoring equipment identification based on the video networking transparent transmission protocol, and sends the binding request to the video networking server. And the video network server transparently transmits the binding request to a monitoring protocol server corresponding to the monitoring protocol server identification according to the monitoring protocol server identification.

Step 203, receiving a binding response returned by the monitoring protocol conversion server and transmitted through the video network server, where the binding response carries a virtual terminal number and binding indication information bound by the monitoring protocol conversion server for the monitoring device corresponding to the monitoring device identifier.

And after receiving the binding request, the monitoring protocol conversion server analyzes the binding request to obtain a monitoring protocol conversion server identifier and a monitoring equipment identifier carried in the binding request. And the monitoring protocol conversion server selects an idle virtual terminal number from preset virtual terminal numbers. And if the idle virtual terminal number exists, the monitoring coordination transfer server binds the selected virtual terminal number for the monitoring equipment corresponding to the monitoring equipment identification, and generates binding indication information indicating successful binding. And if the idle virtual terminal number does not exist, the monitoring co-forwarding server cannot bind the virtual terminal number for the monitoring equipment corresponding to the monitoring equipment identifier, and the virtual terminal number bound for the monitoring equipment is null under the condition, so that binding indication information indicating binding failure is generated.

And the monitoring protocol conversion server generates a binding response for the conference management server identifier, the virtual terminal number bound for the monitoring equipment corresponding to the monitoring equipment identifier and the binding indication information based on the video networking transparent transmission protocol, and sends the binding response to the video networking server. And the video network server transmits the binding response to the conference management server according to the conference management server identifier.

And 204, when the binding indication information indicates that the binding is successful, adding the virtual terminal number to the video conference corresponding to the video conference identifier, and successfully adding the monitoring equipment to the video conference.

And after receiving the binding response, the conference management server analyzes the binding response to obtain information such as the virtual terminal number bound for the monitoring equipment, binding indication information and the like. And when the binding indication information indicates that the binding is successful, the conference management server adds the virtual terminal number to the video conference corresponding to the video conference identifier, and the monitoring equipment is successfully added to the video conference.

In the embodiment of the invention, a user sets a video conference identifier, a monitoring transfer server identifier and a monitoring device identifier through a client, a conference management server can automatically generate a binding request according to the information and send the binding request to the monitoring transfer server, the monitoring transfer server binds a virtual terminal number for the monitoring device set by the user, and after the conference management server obtains the virtual terminal number, the virtual terminal number is added to the corresponding video conference, so that the monitoring device can be added into the video conference.

Example two

In the embodiment of the present invention, the monitoring processing method in the video conference may include three processes of querying, binding, and unbinding, and the 3 processes will be described below respectively.

Fig. 3 is a schematic diagram of a query flow according to a second embodiment of the present invention. As shown in fig. 3, the query process may include:

a1, the conference management server receives the inquiry instruction sent by the client.

When a user wants to add a certain monitoring device into the video network conference, if the monitoring device identification which the user wants to add is not stored in the client, the user can inquire the monitoring device identification which the user wants to add by performing corresponding operation on the client. The user sets the monitoring protocol server identification and the group number (called as the first group number) of the group to which the monitoring device to be inquired is connected on the client, and of course, can also set the video conference identification. The video conference identifier may include a conference identifier and a global conference identifier, which are used to uniquely identify a video conference. After the user sets the relevant parameters, the client is triggered to generate an inquiry instruction, and the inquiry instruction carries the monitoring co-transfer server identifier and the first group number and can also carry the relevant parameters set by the user, such as the video conference identifier and the like.

The client and the conference management server interact with each other based on a TCP (Transmission Control Protocol). The client encapsulates the parameters set by the user into a query instruction based on the TCP, and sends the query instruction to the conference management server through the TCP connection. And the conference management server receives the query instruction sent by the client under the condition that the monitoring equipment identifier is not stored, and analyzes the query instruction to obtain the monitoring co-transfer server identifier, the first group number, the video conference identifier and the like carried by the query instruction.

A2, the conference management server checks whether the data format is legal.

And the conference management server checks the parameters carried in the query instruction, and checks whether the data format of the parameters is legal or not. For example, whether the data format of the monitoring co-forwarding server identifier, the first group number, the video conference identifier, and the like is legal is checked.

For example, the legal data formats corresponding to the parameters are preset, the data format of the parameter obtained by analysis is compared with the legal data format corresponding to the parameter, and if the comparison result is consistent, the data format of the parameter can be determined to be legal.

When the data format of each parameter is verified to be legal, the process a3 is executed. And when the data format of at least one parameter is verified to be illegal, ending the processing process, and returning a response that the data format is illegal to the client through the TCP connection.

A3, the conference management server acquires the monitoring group information.

In an optional implementation manner, before obtaining the monitoring group information, the conference management server may further obtain the number of sub-groups and the number of monitoring devices corresponding to the first group number from the monitoring coordination server. The conference management server generates a resource query request carrying a monitoring protocol server identifier and a first group of numbers based on a video networking transparent transmission protocol, and transmits the resource query request to the monitoring protocol server through the video networking server; and receiving a resource query response returned by the monitoring co-rotating server and transmitted through the video network server, wherein the resource query response carries the sub-packet number and the monitoring equipment number under the packet corresponding to the first group of numbers.

In implementation, the conference management server uses the monitoring co-transfer server identifier as a first field, uses the operation code representing the conference pass-through information as a second field, and uses the operation code representing the resource query and the first group number as subsequent fields, and certainly the subsequent fields can also include the conference identifier and the global conference identifier, so as to generate the resource query request.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the resource query request is shown in table one:

resource inquiry request (conference management server → video network server → monitoring protocol server)

Watch 1

Wherein, 0x8405 is an operation code representing the conference transparent transmission information, the operation code representing the conference transparent transmission information is a type identifier of the signaling between the conference management server and the video network server, and when the video network server receives the signaling, the video network server does not analyze the signaling content and is only responsible for forwarding. 0x3011 is an opcode indicating a resource query.

And the conference management server sends the resource query request to the video network server. After receiving the resource query request, the video network server analyzes the resource query request from the first field of the resource query request. And after the first field and the second field are analyzed, obtaining the identification of the monitoring protocol conversion server and an operation code representing the conference transparent transmission information. And knowing that the resource query request needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding a corresponding monitoring protocol conversion server in the video network according to the monitoring protocol conversion server identifier (after the monitoring protocol conversion server successfully logs in the video network server, the video network server stores a server _ id corresponding to the login information, and the video network server can find the appointed monitoring protocol conversion server through the server _ id). Therefore, after the first field and the second field are analyzed, the video network server does not continue to analyze subsequent fields, and can transparently transmit the resource query request to the monitoring protocol conversion server corresponding to the monitoring protocol conversion server identifier.

The monitoring coordination server stores monitoring group information and monitoring equipment information corresponding to all monitoring equipment connected with the monitoring coordination server. And after receiving the resource query request, the monitoring protocol server analyzes the resource query request to obtain a first group of numbers, obtains the number of the sub-packets and the number of the monitoring devices under the group corresponding to the first group of numbers, and generates a resource query response carrying the number of the sub-packets and the number of the monitoring devices under the group corresponding to the first group of numbers.

In implementation, the monitoring protocol conversion server uses the conference management server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the sub-packet number and the monitoring device number under the corresponding packet of the operation code representing the resource query and the first group number as subsequent fields, and of course, the subsequent fields may also include the conference identifier, the global conference identifier and the first group number, and generate a resource query response.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the resource query response is shown in table two:

resource inquiry response (monitor cooperation server → video network server → conference management server)

Watch two

And the monitoring co-transformation server sends the resource query response to the video network server. After receiving the resource query response, the video network server performs analysis from the first field of the resource query response. And after the first field and the second field are analyzed, obtaining the conference management server identification and the operation code representing the conference transparent transmission information. And knowing that the resource inquiry response needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding conference management server in the video network according to the conference management server identifier (after the conference management server successfully logs in the video network server, the video network server stores a user _ id corresponding to the login information, and the video network server can find the designated conference management server through the user _ id). Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze the subsequent fields, and the resource query response can be transmitted to the conference management server.

And after receiving the resource query response, the conference management server analyzes the resource query response to obtain the sub-packet number and the monitoring equipment number under the grouping corresponding to the first group of numbers, and stores the number.

And the conference management server acquires the monitoring grouping information corresponding to the first group number from the monitoring coordination server. As shown in fig. 3, when acquiring the monitoring packet information, the conference management server generates a monitoring packet information query request carrying a monitoring protocol server identifier and a first group number based on a video networking transparent transmission protocol, and transmits the monitoring packet information query request to the monitoring protocol server through the video networking server; receiving a monitoring grouping information query response returned by the monitoring protocol conversion server and transmitted through the video network server, wherein the monitoring grouping information query response carries monitoring grouping information corresponding to the first group of numbers, the monitoring grouping information comprises a plurality of second group of numbers, and the second group of numbers are grouped into subgroups corresponding to the first group of numbers.

In implementation, the conference management server uses the monitoring co-transfer server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, uses the operation code representing the monitoring group information query and the first group number as subsequent fields, and of course, the subsequent fields may also include the conference identifier and the global conference identifier, so as to generate the monitoring group information query request.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the monitoring packet information query request is shown in table three:

monitoring grouping information inquiry request (conference management server → video network server → monitoring cooperation server)

Watch III

Where 0x3021 is an operation code indicating a supervision packet information inquiry.

And the conference management server sends the monitoring grouping information inquiry request to the video networking server. After receiving the monitoring group information inquiry request, the video network server analyzes the first field of the monitoring group information inquiry request. And after the first field and the second field are analyzed, obtaining the identification of the monitoring protocol conversion server and an operation code representing the conference transparent transmission information. And knowing that the monitoring grouping information query request needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding monitoring protocol conversion server in the video network according to the monitoring protocol conversion server identification. Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze subsequent fields, and can transparently transmit the monitoring grouping information query request to the monitoring protocol server corresponding to the monitoring protocol server identifier.

And after receiving the monitoring grouping information query request, the monitoring protocol server analyzes the monitoring grouping information to obtain a first group number, acquires the monitoring grouping information corresponding to the first group number, and generates a monitoring grouping information query response carrying the monitoring grouping information corresponding to the first group number.

In the implementation, the monitoring protocol conversion server uses the conference management server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the operation code representing the monitoring group information query and the monitoring group information corresponding to the first group number as subsequent fields, and of course, the subsequent fields may also include the conference identifier, the global conference identifier and the first group number, and generate the monitoring group information query response.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the monitoring packet information query response is shown in table four:

monitoring grouping information inquiry response (monitoring cooperation server → video network server → conference management server)

Watch four

Wherein, the field information of the group 1, the group 2, etc. is the monitoring group information. sequence _ count, sequence _ no indicate that when the reply data is too large, the packet identification field is split. sequence _ count represents the number of packets split by the whole reply signaling, sequence _ no represents the sequence number of the current packet, and the conference management server can judge how many data packets the reply instruction contains according to sequence _ count, and then sort according to sequence _ no to form a complete data packet. The DataCount indicates how many sub-packets are under the current packet (this number determines the number of packets, if there are 2 packets a and b under the current packet, then the following packet numbers and packet names are accumulated, i.e. the message content after the DataCount is a group number + a group name + b group number + b group name), and so on.

A4, the conference management server obtains the monitoring equipment information.

And the conference management server sequentially acquires the monitoring equipment information under the corresponding grouping of the second group numbers from the monitoring coordination server until the acquired monitoring equipment information contains the identification of the monitoring equipment which is to be added into the video conference. As shown in fig. 3, when acquiring the monitoring device information, the conference management server generates a monitoring device information query request carrying a monitoring protocol server identifier and a second group number based on a video networking transparent transmission protocol, and transmits the monitoring device information query request to the monitoring protocol server through the video networking server; and receiving a monitoring equipment information query response returned by the monitoring protocol server and transmitted through the video network server, wherein the monitoring equipment information query response carries the monitoring equipment information under the grouping corresponding to the second group of numbers.

In implementation, the conference management server uses the monitoring co-transfer server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the operation code representing the monitoring device information query and the second group number as subsequent fields, and certainly the subsequent fields can also include the conference identifier and the global conference identifier, so as to generate the monitoring device information query request.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and a format of a protocol corresponding to the monitoring device information query request is shown in table five:

information inquiry request of monitoring equipment (conference management server → video network server → monitoring transfer server)

Watch five

Where 0x3022 is an operation code indicating a monitoring device information inquiry.

And the conference management server sends the monitoring equipment information inquiry request to the video network server. After receiving the monitoring equipment information query request, the video network server starts to analyze from the first field of the monitoring equipment information query request. And after the first field and the second field are analyzed, obtaining the identification of the monitoring protocol conversion server and an operation code representing the conference transparent transmission information. And knowing that the monitoring equipment information query request needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding monitoring protocol conversion server in the video network according to the monitoring protocol conversion server identification. Therefore, after the first field and the second field are analyzed by the video network server, the subsequent fields are not analyzed any more, and the monitoring equipment information query request can be transmitted to the monitoring protocol server corresponding to the monitoring protocol server identifier.

And after receiving the monitoring equipment information query request, the monitoring protocol server analyzes the request to obtain a second group of numbers, acquires the monitoring equipment information under the group corresponding to the second group of numbers, and generates a monitoring equipment information query response carrying the monitoring equipment information under the group corresponding to the second group of numbers.

In the implementation, the monitoring protocol conversion server takes the conference management server identifier as a first field, takes the operation code representing the conference transparent transmission information as a second field, takes the operation code representing the monitoring equipment information query and the monitoring equipment information under the corresponding group of the second group number as a subsequent field, and the subsequent field can also comprise the conference identifier, the global conference identifier and the second group number to generate the monitoring group information query response.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and a format of a protocol corresponding to the monitoring device information query response is shown in table six:

monitoring equipment information inquiry response (monitoring transfer server → video network server → conference management server)

Watch six

Wherein, the field information such as dev1, dev 2, etc. is the monitoring device information.

And the conference management server judges whether monitoring group information and monitoring equipment information exist under the corresponding group of the first group number according to the number of the hild _ group _ count and the dev _ count until the required monitoring equipment information is inquired. And executing a binding process after inquiring the information of the monitoring equipment needing to be added into the video conference.

Fig. 4 is a schematic diagram of a binding flow according to a second embodiment of the present invention. As shown in fig. 4, the binding process may include:

and B1, the conference management server receives the binding instruction sent by the client.

When a user wants to add the inquired monitoring equipment into the video networking conference, a monitoring protocol conversion server identifier, a monitoring equipment identifier and a video conference identifier which the user wants to add are set on a client side, wherein the monitoring protocol conversion server identifier and the monitoring equipment identifier are connected with the monitoring equipment which the user wants to inquire. After the user sets the relevant parameters, the client is triggered to generate a binding instruction, and the binding instruction carries the video conference identifier, the monitoring protocol server identifier and the monitoring equipment identifier. The client encapsulates the parameters set by the user into a binding instruction based on the TCP protocol, and sends the binding instruction to the conference management server through the TCP connection. And the conference management server receives the binding instruction sent by the client, and analyzes the binding instruction to obtain the video conference identifier, the monitoring protocol server identifier and the monitoring equipment identifier carried in the binding instruction.

B2, the conference management server checks whether the data format is legal.

And the conference management server checks the video conference identifier, the monitoring protocol conversion server identifier and the monitoring equipment identifier carried in the binding instruction, and checks whether the data format is legal or not. The verification process may refer to process a2 described above. When the data format of each parameter is verified to be legal, the process B3 is executed. And when the data format of at least one parameter is verified to be illegal, ending the processing process, and returning a response that the data format is illegal to the client through the TCP connection.

B3, the conference management server triggers the binding monitoring device.

The conference management server generates a binding request carrying a monitoring protocol server identifier and a monitoring equipment identifier based on a video networking transparent transmission protocol, and transmits the binding request to a monitoring protocol server corresponding to the monitoring protocol server identifier through the video networking server; and receiving a binding response returned by the monitoring protocol conversion server and transparently transmitted by the video network server, wherein the binding response carries the virtual terminal number and the binding indication information bound by the monitoring equipment corresponding to the monitoring equipment identifier by the monitoring protocol conversion server.

In implementation, the conference management server uses the monitoring collaboration server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, uses the operation code representing the binding monitoring device and the monitoring device identifier as subsequent fields, and of course, the subsequent fields may also include the conference identifier and the global conference identifier to generate the binding request. Optionally, the conference management server may further obtain a code stream type from monitoring device information corresponding to the monitoring device to be bound, where the code stream type includes a main code stream and a sub code stream, and the binding request may also carry the code stream type.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the binding request is shown in table seven:

binding request (conference management server → video network server → monitor transfer server)

Watch seven

Wherein 0x3031 is an operation code representing a binding monitoring device. is _ sub represents the code stream type, true represents the main code stream, and false represents the sub-code stream.

The conference management server sends the binding request to the video networking server. After receiving the binding request, the video network server analyzes from the first field of the binding request. And after the first field and the second field are analyzed, obtaining the identification of the monitoring protocol conversion server and an operation code representing the conference transparent transmission information. And knowing that the binding request needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding a corresponding monitoring cooperative transmission server in the video network according to the monitoring cooperative transmission server identification. Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze subsequent fields, and can transmit the binding request to the monitoring protocol server corresponding to the monitoring protocol server identifier.

And a plurality of virtual terminal numbers are stored in the monitoring protocol conversion server, and the virtual terminal numbers have a corresponding relation with the code stream types. And after receiving the binding request, the monitoring protocol conversion server analyzes the binding request to obtain a monitoring equipment identifier and a code stream type, and selects an idle virtual terminal number corresponding to the code stream type. And if the idle virtual terminal number exists, the monitoring coordination transfer server binds the selected virtual terminal number for the monitoring equipment corresponding to the monitoring equipment identification, and generates binding indication information indicating successful binding. And if the idle virtual terminal number does not exist, the monitoring co-forwarding server cannot generate binding indication information for indicating the binding failure for the virtual terminal number bound for the monitoring equipment to be null. And the monitoring co-transfer server generates a binding response carrying the virtual terminal number bound for the monitoring equipment and the binding indication information.

In the implementation, the monitoring protocol conversion server uses the conference management server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the operation code representing the binding of the monitoring device, the virtual terminal number bound for the monitoring device, and the binding indication information as subsequent fields, and of course, the subsequent fields may also include the conference identifier, the global conference identifier, and the monitoring device identifier, and generate a binding response.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the binding response is shown in table eight:

binding response (monitor cooperation server → video network server → conference management server)

Table eight

And the monitoring protocol conversion server sends the binding response to the video network server. And after receiving the binding response, the video network server analyzes the binding response from the first field of the binding response. And after the first field and the second field are analyzed, obtaining the conference management server identification and the operation code representing the conference transparent transmission information. And knowing that the binding response needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding conference management server in the video network according to the conference management server identifier. Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze the subsequent fields, and can transmit the binding response to the conference management server.

B4, the conference management server judges whether the binding is successful.

And after receiving the binding response, the conference management server analyzes the binding response to obtain the virtual terminal number bound for the monitoring equipment and binding indication information. And judging whether the binding is successful according to the binding indication information, if so, executing the process B5, and if not, ending the process.

B5, the conference management server adds the virtual terminal number to the video conference.

The conference management server generates a conference joining request carrying the virtual terminal number and the video conference identifier based on the video networking protocol, and sends the conference joining request to the video networking server. And after receiving the conference entering request, the video networking server adds the virtual terminal number to the video conference corresponding to the video conference identifier. And if the adding is successful, setting the conference entering indication information as success, if the adding is failed, setting the conference entering indication information as failure, and replying a conference entering response carrying the conference entering indication information to the conference management server by the video network server.

B6, the conference management server judges whether the conference is successful.

And the conference management server receives the conference joining response and analyzes the conference joining response to obtain conference joining indication information. And if the conference entering indication information is successful, determining that the conference entering is successful, successfully adding the virtual terminal number into the video conference, successfully adding the monitoring equipment into the video conference, and ending the binding process. And if the session entering indication information is failure, determining that the session entering is failed, finishing the binding process, and returning a response of the session entering failure to the client.

The virtual terminal number bound for the monitoring equipment refers to an equipment number (video network number) corresponding to the monitoring equipment in the video network, and after the binding is successful, the operation on the virtual terminal number in the video network is equivalent to the operation on the monitoring equipment. Based on the virtual terminal number, the monitoring device corresponding to the virtual terminal number can be operated (for example, a speaker is switched, and the like), and the audio and video stream received by the virtual terminal number is the audio and video stream of the corresponding monitoring device.

If the monitoring device is no longer needed in the video conference, a unbinding procedure can be performed.

Fig. 5 is a schematic diagram of an unbinding procedure according to the second embodiment of the present invention. As shown in fig. 5, the unbinding procedure may include:

and C1, the conference management server receives the unbinding instruction sent by the client.

When a user wants to add the bound monitoring equipment into the video networking conference, a monitoring protocol conversion server identifier, a monitoring equipment identifier, a video conference identifier and a virtual terminal number bound by the monitoring equipment are set on a client. After the user sets the relevant parameters, the client is triggered to generate a unbinding instruction, and the unbinding instruction carries a video conference identifier, a monitoring protocol conversion server identifier, a monitoring device identifier and a virtual terminal number. The client encapsulates the parameters into unbinding instructions based on the TCP protocol, and sends the unbinding instructions to the conference management server through the TCP connection. And the conference management server receives the unbinding instruction sent by the client and analyzes the unbinding instruction to obtain the carried video conference identifier, the carried monitoring protocol conversion server identifier, the carried monitoring equipment identifier and the carried virtual terminal number.

C2, the conference management server checks whether the data format is legal.

And the conference management server checks the video conference identifier, the monitoring protocol conversion server identifier, the monitoring equipment identifier and the virtual terminal number carried in the unbinding instruction, and checks whether the data format is legal or not. The verification process may refer to process a2 described above. When the data format of each parameter is verified to be legal, the procedure C3 is executed. And when the data format of at least one parameter is verified to be illegal, ending the processing process, and returning a response that the data format is illegal to the client through the TCP connection.

C3, the conference management server triggers the unbinding monitoring device.

And the conference management server determines whether the monitoring equipment corresponding to the monitoring equipment identification is in an idle state. The state of each monitoring device can be recorded in real time in the conference management server, and when the client performs operations such as switching speakers and setting the monitoring and broadcasting aiming at the monitoring devices, the setting can be performed through the conference management server, so that the conference management server can know the state of the monitoring devices. If the monitoring equipment is in service, the state is in use, and if the monitoring equipment is not in service, the state is idle.

When the conference management server determines that the monitoring equipment is in the using state, the conference management server temporarily does not continue to execute the unbinding process, and can return an unbinding-impossible response to the client. When the conference management server determines that the monitoring equipment is in an idle state, a unbinding request carrying a monitoring protocol server identifier, a monitoring equipment identifier and a virtual terminal number is generated based on a video networking transparent transmission protocol, and the unbinding request is transmitted to the monitoring protocol server through the video networking server; and receiving a unbinding response returned by the monitoring protocol conversion server and transparently transmitted by the video networking server, wherein the unbinding response carries the virtual terminal number and the unbinding indication information of the monitoring protocol conversion server.

In the implementation, the conference management server takes the monitoring co-transfer server identifier as a first field, takes the operation code representing the conference pass-through information as a second field, and takes the operation code representing the unbinding monitoring device, the monitoring device identifier and the virtual terminal number as subsequent fields, and certainly the subsequent fields can also comprise the conference identifier and the global conference identifier to generate the unbinding request.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the unbinding request is shown in table nine:

unbinding request (conference management server → video network server → monitor transfer server)

Watch nine

Wherein 0x3032 is an operation code representing the unbinding monitoring device.

And the conference management server sends the unbinding request to the video network server. After receiving the unbinding request, the video network server carries out resolution from the first field of the unbinding request. And after the first field and the second field are analyzed, obtaining the identification of the monitoring protocol conversion server and an operation code representing the conference transparent transmission information. And knowing that the unbinding request needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding a corresponding monitoring protocol conversion server in the video network according to the monitoring protocol conversion server identification. Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze the subsequent fields, and can transmit the unbinding request to the monitoring protocol conversion server corresponding to the monitoring protocol conversion server identifier.

And after receiving the unbinding request, the monitoring protocol conversion server analyzes the unbinding request to obtain a monitoring equipment identifier and a virtual terminal number, and the monitoring equipment corresponding to the monitoring equipment identifier and the virtual terminal number are unbound by the monitoring protocol conversion server. And if the unbinding is successful, generating binding indication information indicating that the unbinding is successful. And if the unbinding fails, generating binding indication information indicating the unbinding failure. And the monitoring transfer server generates a unbinding response carrying the virtual terminal number and the unbinding indication information.

In the implementation, the monitoring protocol conversion server uses the conference management server identifier as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the operation code representing the unbinding monitoring device, the virtual terminal number and the unbinding indication information as subsequent fields, and of course, the subsequent fields may also include the conference identifier, the global conference identifier and the monitoring device identifier, and generate a unbinding response.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the binding response is shown in table ten:

unbinding response (monitor cooperation server → video network server → conference management server)

Watch ten

And the monitoring cooperation server sends the unbinding response to the video networking server. And after receiving the unbinding response, the video network server analyzes the unbinding response from the first field of the unbinding response. And after the first field and the second field are analyzed, obtaining the conference management server identification and the operation code representing the conference transparent transmission information. And knowing that the unbinding response needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding conference management server in the video network according to the conference management server identification. Therefore, after the video network server analyzes the first field and the second field, the video network server does not continue to analyze the subsequent fields, and can transmit the unbinding response to the conference management server.

C4, the conference management server judges whether the unbinding is successful.

And after receiving the unbinding response, the conference management server analyzes the unbinding response to obtain the virtual terminal number and the unbinding indication information. And judging whether the unbinding is successful or not according to the unbinding indication information, if so, executing the process C5, and if not, ending the process.

C5, the conference management server deletes the virtual terminal number from the video conference.

The conference management server generates a conference quitting request carrying the virtual terminal number and the video conference identifier based on the video networking protocol, and sends the conference quitting request to the video networking server. And after receiving the quit request, the video networking server deletes the virtual terminal number from the video conference corresponding to the video conference identifier. If the deletion is successful, the conference quit indication information is set to be successful, if the deletion is failed, the conference quit indication information is set to be failed, and the video network server replies a conference quit response carrying the conference quit indication information to the conference management server.

B6, the conference management server determines whether the fallback is successful.

And the conference management server receives the conference quit response and analyzes the conference quit response to obtain the conference quit indication information. And if the quit indication information is successful, determining that the quit is successful, deleting the virtual terminal number from the video conference successfully, and then the monitoring equipment quits the video conference successfully to finish the unbinding process. If the fallback indication information is failure, determining that the fallback fails, ending the unbinding process, and returning a response of the fallback failure to the client.

The embodiment of the invention realizes the query, binding and unbinding of the monitoring equipment in the video conference, and the processing process is simpler and more flexible.

EXAMPLE III

Referring to fig. 6, a block diagram of a monitoring processing apparatus in a video conference according to a third embodiment of the present invention is shown.

The monitoring processing device in the video conference of the embodiment of the invention can comprise the following modules: the first analysis module 601 is configured to receive a binding instruction sent by a client, and analyze the binding instruction to obtain a video conference identifier, a monitoring protocol server identifier, and a monitoring device identifier carried in the binding instruction; a first generating module 602, configured to generate a binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on a video networking transparent transmission protocol; a first sending module 603, configured to transmit the binding request to a monitoring protocol server corresponding to the monitoring protocol server identifier via a video networking server; a first receiving module 604, configured to receive a binding response returned by the monitoring protocol conversion server and transparently transmitted via the video network server, where the binding response carries a virtual terminal number and binding indication information that the monitoring protocol conversion server binds to the monitoring device corresponding to the monitoring device identifier; an adding module 605, configured to add the virtual terminal number to the video conference corresponding to the video conference identifier when the binding indication information indicates that the binding is successful, where the monitoring device successfully joins the video conference.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

In an embodiment of the invention, an electronic device is also provided. The electronic device may include one or more processors and one or more machine-readable media having instructions, such as an application program, stored thereon. The instructions, when executed by the one or more processors, cause the processors to perform the monitoring processing method in the video conference described above.

In an embodiment of the present invention, there is also provided a non-transitory computer-readable storage medium having a computer program stored thereon, where the computer program is executable by a processor of an electronic device to perform the monitoring processing method in a video conference. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The monitoring processing method, the monitoring processing device, the electronic device and the storage medium in the video conference provided by the invention are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A monitoring processing method in a video conference is characterized by comprising the following steps:

receiving a binding instruction sent by a client, and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier carried in the binding instruction;

generating a binding request carrying the monitoring protocol server identification and the monitoring equipment identification based on a video networking transparent transmission protocol, and transmitting the binding request to a monitoring protocol server corresponding to the monitoring protocol server identification through a video networking server;

receiving a binding response returned by the monitoring co-transfer server and transparently transmitted by the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound by the monitoring co-transfer server for the monitoring equipment corresponding to the monitoring equipment identifier;

and when the binding indication information indicates that the binding is successful, adding the virtual terminal number to the video conference corresponding to the video conference identifier, and successfully adding the monitoring equipment to the video conference.

2. The method of claim 1, wherein generating the binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on a video networking transparent transmission protocol comprises:

taking the monitoring protocol conversion server identification as a first field, taking an operation code representing conference transparent transmission information as a second field, taking the operation code representing binding monitoring equipment and the monitoring equipment identification as subsequent fields, and generating the binding request;

and after the video network server analyzes the first field and the second field, the binding request is transmitted to the monitoring protocol server.

3. The method of claim 1,

the binding request also carries a code stream type, and the code stream type comprises a main code stream and a sub code stream;

the generating of the binding request carrying the monitoring protocol server identifier and the monitoring device identifier based on the video networking transparent transmission protocol includes: generating a binding request carrying the monitoring protocol conversion server identification, the monitoring equipment identification and the code stream type based on a video networking transparent transmission protocol;

and the virtual terminal number is the virtual terminal number which is bound by the monitoring protocol conversion server for the monitoring equipment and corresponds to the code stream type.

4. The method according to claim 1, wherein after the monitoring device successfully joins the video conference in the video conference corresponding to the video conference identifier by adding the virtual terminal number to the video conference, the method further comprises:

receiving a unbinding instruction sent by the client, and analyzing to obtain the video conference identifier, the monitoring protocol server identifier, the monitoring equipment identifier and the virtual terminal number carried in the unbinding instruction;

when the monitoring equipment is determined to be in an idle state, generating a unbinding request carrying the monitoring protocol server identification, the monitoring equipment identification and the virtual terminal number based on a video networking transparent transmission protocol, and transmitting the unbinding request to the monitoring protocol server through the video networking server;

receiving a unbinding response returned by the monitoring co-transfer server and transparently transmitted by the video networking server, wherein the unbinding response carries the virtual terminal number and the unbinding indication information;

and when the unbinding indication information indicates that the unbinding is successful, deleting the virtual terminal number from the video conference, and enabling the monitoring equipment to successfully quit the video conference.

5. The method of claim 1, wherein before the receiving the binding instruction sent by the client, the method further comprises:

receiving a query instruction sent by the client under the condition that the monitoring equipment identifier is not stored, and analyzing to obtain the monitoring co-transfer server identifier and a first group of numbers carried by the query instruction;

acquiring monitoring grouping information corresponding to the first group of numbers from the monitoring coordination server; the monitoring grouping information comprises a plurality of second group numbers, and the second group numbers are grouped correspondingly into subgroups of the first group number corresponding subgroups;

and sequentially acquiring monitoring equipment information under the groups corresponding to the second groups of numbers from the monitoring coordination server until the monitoring equipment information contains the monitoring equipment identification.

6. A monitoring processing apparatus in a video conference, the apparatus comprising:

the first analysis module is used for receiving a binding instruction sent by a client and analyzing to obtain a video conference identifier, a monitoring protocol conversion server identifier and a monitoring equipment identifier carried in the binding instruction;

the first generation module is used for generating a binding request carrying the monitoring protocol server identifier and the monitoring equipment identifier based on a video networking transparent transmission protocol;

the first sending module is used for transmitting the binding request to a monitoring protocol conversion server corresponding to the monitoring protocol conversion server identification through a video networking server;

the first receiving module is used for receiving a binding response returned by the monitoring protocol conversion server and transmitted through the video network server, wherein the binding response carries a virtual terminal number and binding indication information bound by the monitoring protocol conversion server for the monitoring equipment corresponding to the monitoring equipment identifier;

and the adding module is used for adding the virtual terminal number to the video conference corresponding to the video conference identifier when the binding indication information indicates that the binding is successful, and the monitoring equipment is successfully added to the video conference.

7. The apparatus of claim 6, wherein the first generating module comprises:

a request generating unit, configured to use the monitoring co-transfer server identifier as a first field, use an operation code indicating conference pass-through information as a second field, and use an operation code indicating that monitoring equipment is bound and the monitoring equipment identifier as subsequent fields to generate the binding request;

8. The apparatus of claim 6,

the first generation module is specifically configured to generate a binding request carrying the monitoring protocol server identifier, the monitoring device identifier, and the code stream type based on a video networking transparent transmission protocol;

9. An electronic device, comprising:

one or more processors; and

one or more machine-readable media having instructions stored thereon;

the instructions, when executed by the one or more processors, cause the processors to perform a method of monitoring processing in a video conference as claimed in any one of claims 1 to 5.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a monitoring processing method in a video conference according to any one of claims 1 to 5.