CN110808843B

CN110808843B - Voice data transmission method, device, electronic equipment and storage medium

Info

Publication number: CN110808843B
Application number: CN201910919719.8A
Authority: CN
Inventors: 田永恒; 王晓辉; 安玉; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-09-26
Filing date: 2019-09-26
Publication date: 2022-08-19
Anticipated expiration: 2039-09-26
Also published as: CN110808843A

Abstract

The embodiment of the invention provides a voice data sending method, a device, electronic equipment and a storage medium, wherein a multi-conference call control client and a multi-conference call control server are introduced, a mode of dynamically adding a virtual terminal to each conference object is adopted, and first voice data of the conference object are directly introduced into the multi-conference call control server in real time through the virtual terminal; and the multi-conference call control client selects a corresponding conference object from the conference information according to the voice call requirement, sends a call switching command to the multi-conference call control server, and pushes target first voice data corresponding to the call switching command to the multi-conference call control client for playing after the multi-conference call control server receives the call switching command. By the embodiment of the invention, the user switches different conference IDs at the multi-conference call control client, so that the switching process is convenient and simple, and the real-time performance is strong.

Description

Voice data transmission method, device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for sending voice data, an electronic device, and a storage medium.

Background

A video network terminal is installed in each operating room of a hospital and used for voice communication between the operating room and the outside. In some surgical scenarios, an expert or professor is required to provide off-site voice guidance for the on-site situation of the surgery, the surgical specification, and the like. In the prior art, an expert or a professor establishes a video network conference with a video network terminal of the operating room through the video network terminal so as to realize remote voice communication with the operating room. In this scheme, the number of hospital operating rooms is the number of all meetings.

When an expert or professor is faced with the need to dynamically engage in voice calls or broadcast messages with each conference. By adopting the scheme, an expert or a professor can only communicate with one conference (operating room) each time, and can join the next conference only by exiting from the current conference when wanting to communicate with another conference, so that the whole process consumes a long time, and the real-time performance of the communication service of the operating room is greatly influenced.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a voice data transmission method, a voice data transmission apparatus, and a computer-readable storage medium and an electronic device that overcome or at least partially solve the above problems.

In order to solve the above problems, the embodiment of the present invention discloses a voice data transmission method, which is applied to a multi-conference call control server, wherein the multi-conference call control server is in communication connection with a conference management server and a multi-conference call control client respectively; a plurality of virtual terminals are configured in the multi-conference call control server; the method comprises the following steps:

receiving a conference opening notice sent by the conference management server; the conference opening notification comprises conference information, and the conference information comprises a conference ID of a currently opened conference object;

selecting a target virtual terminal in an idle state from the plurality of virtual terminals according to each conference ID in the conference information;

sending a dynamic adding command for adding the target virtual terminal to a target conference object corresponding to the conference ID to the conference management server;

after the target virtual terminal is added into a corresponding conference, receiving first voice data of the target conference object through the target virtual terminal;

receiving a call switching command sent by the multi-conference call control client aiming at the conference information; the switching conversation command is generated when the multi-conference conversation control client receives the triggering operation of switching a conference object in an interface for displaying the conference information;

pushing target first voice data corresponding to the call switching command to the multi-conference call control client;

receiving second voice data returned by the multi-conference call control client aiming at the target first voice data; the second voice data comprises a target conference ID of a conference object in which the target first voice data is positioned;

and sending the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

Optionally, each conference object includes a video networking terminal;

the conference information also comprises a conference name corresponding to the conference ID, conference start time and video networking terminal information.

Optionally, the multi-conference call control server includes a database;

after receiving the conference start notification sent by the conference management server, the method includes:

storing the meeting information in the database in the form of a meeting information list.

Optionally, the method includes:

receiving a conference information acquisition instruction sent by the multi-conference call control client; the conference information acquisition instruction is generated by the multi-conference call control client when being started;

and extracting the conference information list from the database according to the conference information acquisition instruction, and sending the conference information list to the multi-conference call control client.

In order to solve the above problems, an embodiment of the present invention discloses another method for sending voice data, which is applied to a multi-conference call control client, where the multi-conference call control client is in communication connection with a multi-conference call control server, and the multi-conference call control server is in communication connection with a conference management server; a plurality of virtual terminals are configured in the multi-conference call control server; the method comprises the following steps:

receiving conference information sent by the multi-conference call control server; the conference information is extracted and obtained by the multi-conference call control server from a conference start notification sent by the conference management server, and the conference information comprises a conference ID of a currently started conference object; the multi-conference call control server is used for selecting a target virtual terminal in an idle state from the plurality of virtual terminals according to each conference ID in the conference information, generating a corresponding dynamic adding command for the target virtual terminal and sending the dynamic adding command to the conference management server; the conference management server is used for adding the target virtual terminal to a target conference object corresponding to the conference ID according to the dynamic adding command; the multi-conference call control server is used for receiving first voice data of the target conference object through the target virtual terminal;

displaying the conference information, and generating a call switching command when receiving a trigger operation of switching a conference object;

sending the call switching command to the multi-conference call control server;

receiving target first voice data returned by the multi-conference call control server aiming at the call switching command, and playing the target first voice data;

acquiring voice data in the current environment, adding a target conference ID of a conference object where the target first voice data is located in the voice data, and generating second voice data;

sending the second voice data to the multi-conference call control server; and the multi-conference call control server is used for sending the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

In order to solve the above problem, the embodiment of the present invention further discloses a voice data sending device, which is applied to a multi-conference call control server, wherein the multi-conference call control server is in communication connection with a conference management server and a multi-conference call control client respectively; a plurality of virtual terminals are configured in the multi-conference call control server; the device comprises:

a conference start notification receiving module, configured to receive a conference start notification sent by the conference management server; the conference opening notification comprises conference information, and the conference information comprises a conference ID of a currently opened conference object;

a target virtual terminal selection module, configured to select a target virtual terminal in an idle state from the multiple virtual terminals according to each conference ID in the conference information;

a dynamic adding command sending module, configured to send a dynamic adding command used for adding the target virtual terminal to a target conference object corresponding to the conference ID to the conference management server;

the first voice data receiving module is used for receiving first voice data of the target conference object through the target virtual terminal after the target virtual terminal is added into the corresponding conference;

a switching call command receiving module, configured to receive a switching call command sent by the multi-conference call control client for the conference information; the switching conversation command is generated when the multi-conference conversation control client receives the triggering operation of switching a conference object in an interface for displaying the conference information;

the first voice data pushing module is used for pushing target first voice data corresponding to the call switching command to the multi-conference call control client;

the second voice data receiving module is used for receiving second voice data returned by the multi-conference call control client aiming at the target first voice data; the second voice data comprises a target conference ID of a conference object where the target first voice data is located;

and the second voice data forwarding module is used for sending the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

Optionally, the multi-conference call control server includes a database;

after the conference on notification receiving module, the apparatus includes:

and the database storage module is used for storing the conference information in the database in a conference information list form.

In order to solve the above problem, an embodiment of the present invention further discloses another voice data transmission apparatus, which is applied to a multi-conference call control client, where the multi-conference call control client is in communication connection with a multi-conference call control server, and the multi-conference call control server is in communication connection with a conference management server; a plurality of virtual terminals are configured in the multi-conference call control server; the device comprises:

the conference information receiving module is used for receiving the conference information sent by the multi-conference call control server; the conference information is extracted and obtained by the multi-conference call control server from a conference start notification sent by the conference management server, and the conference information comprises a conference ID of a currently started conference object; the multi-conference call control server is used for selecting a target virtual terminal in an idle state from the plurality of virtual terminals according to each conference ID in the conference information, generating a corresponding dynamic adding command aiming at the target virtual terminal and sending the dynamic adding command to the conference management server; the conference management server is used for adding the target virtual terminal to a target conference object corresponding to the conference ID according to the dynamic adding command; the multi-conference call control server is used for receiving first voice data of the target conference object through the target virtual terminal;

the switching conversation command generating module is used for displaying the conference information and generating a switching conversation command when receiving the triggering operation of switching the conference object;

the call switching command sending module is used for sending the call switching command to the multi-conference call control server;

the first voice data playing module is used for receiving target first voice data returned by the multi-conference call control server aiming at the call switching command and playing the target first voice data;

the second voice data generation module is used for acquiring voice data in the current environment, adding a target conference ID of a conference object where the target first voice data is located in the voice data, and generating second voice data;

the second voice data sending module is used for sending the second voice data to the multi-conference call control server; and the multi-conference call control server is used for sending the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

According to another aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, enables execution of the above-described voice data transmission method.

According to yet another aspect of the present invention, there is provided an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the above-mentioned voice data transmission method when executed.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, a multi-conference call control client and a multi-conference call control server are introduced, and the first voice data of each conference object is directly introduced into the multi-conference call control server in real time through a virtual terminal in a mode of dynamically adding the virtual terminal to each conference object; the multi-conference call control client selects a corresponding conference object from the conference information according to the voice call requirement, and sends a call switching command to the multi-conference call control server, after receiving the call switching command, the multi-conference call control server pushes target first voice data corresponding to the call switching command to the multi-conference call control client for playing, meanwhile, the multi-conference call control client also returns second voice data in the current environment to the multi-conference call control server, and the multi-conference call control server sends the second voice data to the conference object for playing through a corresponding target virtual terminal. By the embodiment of the invention, the user can dynamically realize the communication with each conference object by switching different conference IDs at the multi-conference communication control client, the process of switching the conference objects is convenient and simple, the real-time performance is strong, and the method and the system make great progress compared with the existing voice data sending mode.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

fig. 5 is a schematic networking diagram of a voice data transmission system according to an embodiment of the present invention;

fig. 6 is a flowchart illustrating steps of a first embodiment of a method for transmitting voice data according to an embodiment of the present invention;

fig. 7 is a flowchart illustrating steps of a second embodiment of a method for transmitting voice data according to the present invention;

fig. 8 is a schematic structural diagram of a third embodiment of a voice data transmitting apparatus according to the present invention;

fig. 9 is a schematic structural diagram of a fourth embodiment of a voice data transmitting apparatus according to the embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description thereof.

The video networking is an important milestone of network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of Internet applications to high-definition video, and high definition is face-to-face.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To enable those skilled in the art to better understand the embodiments of the present invention, the following description is given of the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by over one hundred times compared with that of the traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices on the metro network part can be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may interconnect and interwork via metropolitan and wide area video networks.

Visio networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol gateway), terminal (including various set-top box, coding board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the network interface module 201, the switching engine module 202, the CPU module 203, and the disk array module 204 are mainly included;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, if there is a packet, the ethernet MAC DA of the corresponding terminal is known according to the destination address DA of the packet in the video network, the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type are added, and the packet is sent.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., more than 2 connections between a node switch and a node server, between a node switch and a node switch, and between a node switch and a node server. However, the address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

In order to facilitate a more accurate understanding of the present invention for those skilled in the art, the following description will be given by way of a specific example of the technical problem of the present invention:

the existing operating rooms A, B and C are operated at the same time, and a video network conference is established in each operating room so as to meet respective service requirements. According to the related service requirements, the experts or professors in the hospital need to communicate with the conference corresponding to each operating room, and the communication with which operating room conference is dynamically and real-timely controlled is realized.

An expert or a professor is required to use a video networking terminal M to carry out real-time dynamic call control with the conference A, the conference B and the conference C. The current means is as follows:

1. the method comprises the steps that a video networking terminal M is communicated with a conference A, the video networking terminal M is dynamically added into the conference A (the video networking terminal is dispatched by a conference management service which provides that the video networking terminal is dynamically added into the conference and dynamically removed from the conference), an audio stream of the conference A can be received after the video networking terminal M successfully enters the conference, and then the audio stream of the video networking terminal M is pushed to the conference A, so that the communication is realized;

2. the method comprises the steps that a video networking terminal M is communicated with a conference B, the video networking terminal M is dynamically removed from a conference A at first, then the video networking terminal M is dynamically added into a conference B, an audio stream of the conference B can be received after the video networking terminal M successfully enters the conference, and then the audio stream of the video networking terminal M is pushed to the conference B, so that the communication is realized;

3. and the video networking terminal M is communicated with the conference C, firstly, the video networking terminal M is dynamically removed from the conference B, then, the video networking terminal M is dynamically added into the conference C, the audio stream of the conference C can be received after the video networking terminal M successfully enters the conference, and then, the audio stream of the video networking terminal M is pushed to the conference C, so that the communication is realized.

As can be seen from the above steps, the conventional call control means is: before a call, a video networking terminal needing to be called is dynamically removed from a current conference, and then is dynamically added into the conference needing to be called, the whole control process is a time-consuming process, the addition is influenced by a network environment, and the time consumption for dynamically executing operation each time cannot be determined. The whole execution process is about 2S, namely 2S delay waiting exists when the conference target of the call is switched every time, the call service requires real-time performance, especially in a special application scene of a hospital operating room, the 2S delay is not accepted, and the experience degree of a user is greatly influenced.

To solve the technical problem of the present invention, based on the above-mentioned characteristics of video networking, referring to fig. 5, a networking schematic diagram of a voice data transmission system according to an embodiment of the present invention is shown, where the system includes a conference management server 501, a multi-conference call control server 502, and a multi-conference call control client 503, where the multi-conference call control server 502 is in communication connection with the conference management server 501 and the multi-conference call control client 503; the multi-conference call control server 502 is configured with a plurality of virtual terminals.

The conference management server 501 is configured to control the start and end of the video network terminal conference, dynamically add and remove video network terminals to the conference, record detailed information of the conference, and perform backup and display based on the communication connection between the video network and each video network terminal in the video network. In the embodiment of the present invention, the conference management server 501 is mainly used for controlling the start and end of a conference and dynamically adding virtual terminals.

It should be noted that the video network terminal in the embodiments of the present invention may be an intelligent device equipped with a sound pickup, and the intelligent device may include, but is not limited to, a set-top box, a mobile phone, and a kiosk. The terminal of the video network may be configured with an android system, and includes the network interface module, the service processing module, and the CPU module described in the above content 1.2, where the network interface module may be configured with a video network card, and the video network card is used to access the video network through a core server of the video network, and receive or send data based on a video network protocol through the video network, such as sending a request to join a conference to the conference management server 501, or receiving a notification sent by the conference management server 501, and the like. The core server of the video network can provide servers for all terminals in the video network, wherein the servers can provide services such as registration, data forwarding, signaling control and the like, and data generated by each terminal can be sent to the core server of the video network firstly and then forwarded to a target terminal by the core server of the video network.

The multi-conference call control Client 503 belongs to one of the video networking terminals, and may be a Client program that runs based on a Client/Server architecture C/S (Client/Server) or a Browser/Server architecture B/S (Browser/Server). In the embodiment of the present invention, the multi-conference call control client 503 is configured with the IP and the port of the multi-conference call control server 502, and is used for communicating with the multi-conference call control server 502; the multi-conference call control client 503 mainly displays the conference information in a list form, sends a call control command to the multi-conference call control server 502, pushes the voice data of the client to the server, and receives and plays the voice data of the conference in which the call is performed.

The multi-conference call control server 502 is provided with a "conference management service" interface that establishes link communication with the conference management server 501 through the internet (IP and port). In practical applications, the multi-conference call control server 502 of the embodiment of the present invention may be connected to a plurality of conference management servers 501 to switch conference objects in different local area networks.

The virtual terminal is also called a virtual video network terminal, is another expression form of the video network terminal, is a software system encapsulated by codes, and after a program runs, the software system corresponds to a special and unique digital code (virtual terminal number) (for example: 1001/1002/1003 …), and can carry out video network meeting starting, meeting stopping, dynamic adding to a meeting, dynamic removing from the meeting and other service capabilities possessed by the video network terminal.

Based on the system shown in fig. 5, referring to fig. 6, a flowchart of a first step of a voice data sending method according to an embodiment of the present invention is shown, and is applied to the multi-conference call control server 502, where the method specifically includes the following steps:

step S601, receiving a conference start notification sent by the conference management server 501; the conference opening notification comprises conference information, and the conference information comprises a conference ID of a currently opened conference object;

the conference management server 501 is configured to pull a plurality of video networking terminals that need to participate in the entity conference into the conference according to the conference requirement, so as to complete the establishment of a video networking conference. The process of the conference management server 501 for establishing the video networking conference is the prior art, is not a core invention point of the present invention, and is not described herein again.

In the embodiment of the invention, the conference object refers to a video networking conference in a real environment. In a certain lan environment, a plurality of video networking conferences are simultaneously started, and the conference management server 501 creates a corresponding conference object in its own conference start service module according to the actually created video networking conference.

After the conference management server 501 opens the corresponding conference, the notification conference start interface of the multi-conference call control server 502 is called, and the conference information is sent to the multi-conference call control server 502.

Each video network terminal can correspond to one path of voice data, so each operating room at least comprises one video network terminal, namely each conference object comprises the video network terminal.

In an optional embodiment of the present invention, it is shown that the conference information further includes a conference name corresponding to the conference ID, a conference start time, and video network terminal information. The conference ID represents a conference object and is a unique identifier of the conference object. The conference name is a specific name of the conference object, and is used for being presented at the multi-conference call control client 503, so that a user of the multi-conference call control client 503 can quickly know the conference, and the conference name may be in various forms, for example, the conference name may be a number, such as 001; the name of the meeting room of the entity meeting, such as meeting room 1, operating room 1, etc.; of course, the meeting name may also be created according to a specific meeting topic, such as a second internal meeting in product development. The video networking terminal information may include identification, name, online status, etc. of the video networking terminal, so that the user of the multi-conference call control client 503 can communicate with the corresponding video networking terminal.

The multi-conference call control server 502 includes a database;

after receiving the conference start notification sent by the conference management server 501, the multi-conference call control server 502 executes the following steps:

storing the meeting information in the database in the form of a meeting information list. Since the multi-conference call control server 502 can be connected to a plurality of conference management servers 501 in a communication manner, different conference information lists may exist for the conference started by different conference management servers 501, that is, the database stores a plurality of conference information lists.

In addition, in order to facilitate the user to know the current conference situation in time, in a preferred embodiment of the present invention, the following method is provided, which specifically includes the following steps:

step one, receiving a conference information acquisition instruction sent by the multi-conference call control client 503; the conference information acquisition instruction is generated by the multi-conference call control client 503 when starting;

in the embodiment of the present invention, the conference information acquisition instruction is automatically generated by the multi-conference call control client 503 when starting, so that the user using the client can obtain the conference opening conditions in the multiple local area networks at the first time.

Step two, according to the conference information acquisition instruction, the conference information list is extracted from the database, and the conference information list is sent to the multi-conference call control client 503.

When receiving the conference information acquisition instruction, the multi-conference call control server 502 extracts the conference information list from its own database, and then pushes the conference information list to the multi-conference call control client 503. The embodiment of the invention stores the conference information in the form of the conference information list, so that the conference information is clearer and can be conveniently checked by a user using a client when being pushed to the client.

Step S602, selecting a target virtual terminal in an idle state from the plurality of virtual terminals according to each conference ID in the conference information;

step S603, sending a dynamic adding command for adding the target virtual terminal to a target conference object corresponding to the conference ID to the conference management server;

the multi-conference call control server 502 may select a target virtual terminal in an idle state from among the plurality of virtual terminals in the following manner:

first, the multi-conference call control server 502 selects an idle virtual terminal according to an instruction sent by the multi-conference call control client 503.

Specifically, after receiving the conference information, the multi-conference call control client 503 sends a virtual terminal search instruction carrying a conference ID to the multi-conference call control server 502; the multi-conference call control server 502 searches for a target virtual terminal in an idle state (the idle state refers to that the virtual terminal does not carry a flag in a service) from a plurality of virtual terminals configured by itself according to the instruction, and then generates a dynamic addition command for the target virtual terminal. The dynamic addition command includes the target virtual terminal and the conference ID, and instructs the conference management server 501 to add the target virtual terminal to the conference object corresponding to the conference ID. By the method, the virtual terminal can be occupied according to the requirements of the user, the problem that the virtual terminal is occupied and not used in time to cause resource waste of the virtual terminal is avoided, and the utilization rate of the virtual terminal can be improved.

Second, after receiving the conference information sent by the conference management server 501, the multi-conference call control server 502 selects an idle virtual terminal by using the conference information as a trigger signal.

Specifically, the multi-conference call control server 502 reads conference IDs from the conference information, determines the number of the conference IDs, and then selects a target virtual terminal in an idle state from the plurality of virtual terminals according to the number, the number of the selected target virtual terminal, the number of the conference IDs in the conference information, and the like. Next, the multi-conference call control server 502 randomly establishes a one-to-one correspondence between the conference ID and the plurality of target virtual terminals, and then generates a corresponding dynamic addition command. In this way, the target virtual terminal can be selected most quickly to complete the subsequent virtual terminal adding steps, and meanwhile, the multi-conference call control server 502 is not influenced to synchronously send the conference information to the multi-conference call control client 503, which is beneficial to saving data flow.

According to the two modes, the number of the conference IDs and the number of the virtual terminals contained in the generated dynamic adding command are the same, and the generated dynamic adding command is a conference ID and a target virtual terminal.

If the conference management server 501 starts three conferences, namely a conference object a, a conference object B and a conference object C, conference IDs of the three conference objects are A, B, C respectively; the virtual terminals searched by the multi-conference call control server 502 are 1001, 1002, and 1003, respectively; the generated dynamic addition commands are dynamic addition command 1, dynamic addition command 2 and dynamic addition command 3, respectively. Then, the generated dynamic addition command 1 contains a and 1001, the dynamic addition command 2 contains B and 1002, and the dynamic addition command 3 contains C and 1003.

In the embodiment of the present invention, the multi-conference call control server 502 invokes a "conference management service" interface, sends a dynamic addition command to the conference management server 501, and then the conference management server 501 adds a target virtual terminal to a target conference object corresponding to the conference ID.

If the conference IDs of the three conference objects are A, B, C respectively, the dynamic addition commands are 1,2, and 3 respectively; dynamic add command 1 contains a and 1001, dynamic add command 2 contains B and 1002, and dynamic add command 3 contains C and 1003. Then, the conference management server 501 adds the virtual terminal 1001 to the conference object corresponding to the conference ID a according to the dynamic addition command 1; similarly, according to the dynamic adding command 2, adding the virtual terminal 1002 to the conference object corresponding to the conference ID B; and according to the dynamic adding command 1, adding the virtual terminal 1003 to the conference object corresponding to the conference ID C. The adding steps executed by the conference management server 501 are prior art, are not essential for protection of the present invention, and are not described herein again.

Step S604, after the target virtual terminal is added into the corresponding conference, receiving first voice data of the target conference object through the target virtual terminal;

after the conference management server 501 completes adding the target virtual terminal, the target virtual terminal in the multi-conference call control server 502 is marked as a service, which indicates that the target virtual terminal is not in an idle state. Next, the multi-conference call control server 502 may receive the first voice data of the target conference object through the target virtual terminal.

Step S605, receiving a call switching command sent by the multi-conference call control client 503 for the conference information; the call switching command is generated when the multi-conference call control client 503 receives a trigger operation of switching a conference object in an interface for displaying the conference information;

step S606, pushing the target first voice data corresponding to the call switching command to the multi-conference call control client 503;

step S607, receiving second voice data returned by the multi-conference call control client 503 for the target first voice data; the second voice data comprises a target conference ID of a conference object in which the target first voice data is positioned;

step S608, sending the second voice data to a corresponding conference object through the target virtual terminal corresponding to the target conference ID.

In the embodiment of the present invention, after the multi-conference call control client 503 displays the conference information, the user may select the conference to be called in the interface to correspond to the conference, and perform an operation of switching the conference object.

Depending on the operation of switching the conference object, the specific embodiments of step S605 to step S608 include the following cases:

the first condition is as follows: the trigger operation of switching the conference object comprises the following actions: the selection operation of the target conference information list selects one target conference ID among the plurality of conference IDs of the target conference information list. For the trigger operation, the multi-conference call control client 503 generates a switch call command and sends the switch call command to the multi-conference call control server 502. After receiving the target conference ID, the multi-conference call control server 502 pushes the target first voice data corresponding to the target conference ID to the multi-conference call control client 503; after receiving the target first voice data, the multi-conference call control client 503 plays the target first voice data; meanwhile, the multi-conference call control client 503 also synchronously acquires the voice data in the current environment, adds the target conference ID of the conference object where the target first voice data is located to the voice data, generates second voice data and sends the second voice data to the multi-conference call control server 502, and after receiving the second voice data, the multi-conference call control server 502 finds a corresponding target virtual terminal according to the target conference ID of the conference object where the target first voice data is located, which is included in the second voice data, and sends the second voice data to the conference object sending the target first voice data through the virtual terminal for playing.

In this scheme, the number of the conference IDs for switching the call commands is one, and there is only one video networking terminal in the conference object corresponding to the conference ID, so that the video networking terminal in the conference object automatically serves as a conference chairman terminal (in the video networking conference, the conference chairman terminal is used for controlling a speaker to speak, and ensuring that only one video networking terminal speaks at a time, so that the video networking conference is normally carried out) to establish a binding relationship with the target virtual terminal, thereby establishing a voice communication relationship with the multi-conference call control client 503. After receiving the target voice data, the multi-conference call control client 503 can perform one-to-one call with the target conference. The scheme is particularly suitable for operating room environments, and the expert or professor can dynamically realize the communication with each operating room by switching different conference IDs and adopting one multi-conference communication control client 503, and the process of switching the communicated operating rooms is convenient and simple, and has strong real-time performance.

Case two: in the triggering operation of switching the conference object, the number of the selected target conference IDs is multiple, that is, the call switching command includes multiple target conference IDs. After receiving the target conference IDs, the multi-conference call control server 502 sends the first voice data of the target conference IDs to the multi-conference call control client, and at this time, the multi-conference call control client 503 establishes a voice relationship with the conference objects, and the multi-conference call control client 503 can send the voice relationship to each conference object at the same time, thereby implementing a broadcast function. In the embodiment of the present invention, the multi-conference call control client 503 can listen to the first voice data of each conference object, and the conference objects cannot hear each other's voice message. The scheme is particularly suitable for opinion statistic services, can ensure that opinions given by each conference object are not interfered by other conference objects, and is favorable for realizing quick and fair opinion statistics at the multi-conference call control client 503.

And in the third case, a plurality of video network terminals can be included in one conference object, but due to the particularity of voice call, only one video network terminal is allowed to speak as a chairman terminal at a time so as to avoid conference scene confusion and voice interference. Namely, the trigger operation for switching the conference object also comprises the selection operation of the target video network terminal information. Therefore, the embodiment of the invention aims at that the switching conversation command of a conference object comprises the target video networking terminal information; the specific implementation manner of step S607 may include:

and pushing the target first voice data corresponding to the target video networking terminal information to the multi-conference call control client 503.

The embodiment of the invention is suitable for the user to communicate with the specific video network terminal in the conference object through the multi-conference communication control client 503. For example, a conference is established for each operating room, and for different requirements of each operation, a video network terminal is installed at an operating table, a device monitoring (in the video network conference, the operating table and the device monitoring are separated from each other, so as to avoid mutual interference) and the like, and is used for acquiring voice data of different medical care personnel. The expert or the professor can guide the medical staff in front of different video network terminals of the operating room through the scheme.

Based on the system shown in fig. 5, referring to fig. 7, a flowchart of steps of a second embodiment of a method for sending voice data according to the present invention is shown, and is applied to the multi-conference call control client 503, and specifically includes the following steps:

step S701, receiving conference information sent by the multi-conference call control server 502; the conference information is extracted and obtained by the multi-conference call control server 502 from the conference opening notification sent by the conference management server 501, and the conference information includes the conference ID of the currently opened conference object; the multi-conference call control server 502 is configured to select a target virtual terminal in an idle state from the multiple virtual terminals according to each conference ID in the conference information, and generate a corresponding dynamic addition command for the target virtual terminal and send the dynamic addition command to the conference management server 501; the conference management server 501 is configured to add the target virtual terminal to a target conference object corresponding to the conference ID according to the dynamic addition command; the multi-conference call control server 502 is configured to receive first voice data of the target conference object through the target virtual terminal;

step S702, displaying the conference information, and generating a call switching command when receiving a trigger operation of switching a conference object;

step S703 of sending the call switching command to the multi-conference call control server 502;

step S704, receiving target first voice data returned by the multi-conference call control server 502 for the call switching command, and playing the target first voice data;

step S705, collecting voice data in the current environment, adding a target conference ID of a conference object where the target first voice data is located in the voice data, and generating second voice data;

step S706, sending the second voice data to the multi-conference call control server 502; the multi-conference call control server 502 is configured to send the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

The embodiment of the present invention explains possible implementation steps of the voice data transmission method from the perspective of the multi-conference call control client 503, and the specific implementation principle refers to the first embodiment and is not described herein. In the embodiment of the present invention, a "multi-conference call control client 503" and a "multi-conference call control server 502" are introduced, and a manner of dynamically adding a virtual terminal to each conference object is adopted, and first voice data of the conference object is directly introduced into the multi-conference call control server 502 in real time through the virtual terminal; the multi-conference call control client 503 selects a corresponding conference object from the conference information according to the voice call requirement, and sends a call switching command to the multi-conference call control server 502, after receiving the call switching command, the multi-conference call control server 502 pushes the target first voice data corresponding to the call switching command to the multi-conference call control client 503 for playing, meanwhile, the multi-conference call control client 503 also returns the second voice data in the current environment to the multi-conference call control server 502, and the multi-conference call control server 502 sends the second voice data to the conference object through a corresponding target virtual terminal for playing. By the embodiment of the invention, the user can dynamically realize the communication with each conference object by switching different conference IDs at the multi-conference communication control client 503, the process of switching the conference objects is convenient and simple, the real-time performance is strong, and the method and the system make great progress compared with the existing voice data sending mode.

It should be noted that for simplicity of description, the method embodiments are shown as a series of combinations of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those of skill in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the embodiments of the invention.

Based on the system shown in fig. 5, corresponding to the method described in the first embodiment, referring to fig. 8, a schematic structural diagram of a third embodiment of a voice data sending apparatus according to the embodiment of the present invention is shown, which is applied to a multi-conference call control server 502, and the apparatus may include the following modules:

a conference start notification receiving module 801, configured to receive a conference start notification sent by the conference management server 501; the conference opening notification comprises conference information, and the conference information comprises a conference ID of a currently opened conference object;

a target virtual terminal selection module 802, configured to select, according to each conference ID in the conference information, a target virtual terminal in an idle state from the multiple virtual terminals;

a dynamic adding command sending module 803, configured to send, to the conference management server, a dynamic adding command used for adding the target virtual terminal to a target conference object corresponding to the conference ID;

a first voice data receiving module 804, configured to receive, through the target virtual terminal, first voice data of the target conference object after the target virtual terminal is added to the corresponding conference;

a call switching command receiving module 805, configured to receive a call switching command sent by the multi-conference call control client 503 for the conference information; the call switching command is generated when the multi-conference call control client 503 receives a trigger operation of switching a conference object in an interface for displaying the conference information;

a first voice data pushing module 806, configured to push target first voice data corresponding to the call switching command to the multi-conference call control client 503;

a second voice data receiving module 807, configured to receive second voice data returned by the multi-conference call control client 503 for the target first voice data; the second voice data comprises a target conference ID of a conference object in which the target first voice data is positioned;

a second voice data forwarding module 808, configured to send the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

In an optional embodiment of the present invention, corresponding to the method of the first embodiment, the multi-conference call control server 502 includes a database;

after the conference open notification receiving module, the apparatus may include the following modules:

In an optional embodiment of the present invention, corresponding to the method of the first embodiment, the apparatus may include the following modules:

a conference information acquisition instruction receiving module, configured to receive a conference information acquisition instruction sent by the multi-conference call control client 503; the conference information acquisition instruction is generated by the multi-conference call control client 503 when starting;

a conference information list sending module, configured to extract the conference information list from the database according to the conference information obtaining instruction, and send the conference information list to the multi-conference call control client 503.

Based on the system shown in fig. 5, corresponding to the method described in the second embodiment, referring to fig. 9, a schematic structural diagram of a fourth embodiment of a voice data sending apparatus according to the embodiment of the present invention is shown, which is applied to a multi-conference call control client 503, and the apparatus may include the following modules:

a conference information receiving module 901, configured to receive conference information sent by the multi-conference call control server 502; the conference information is extracted and obtained by the multi-conference call control server 502 from the conference opening notification sent by the conference management server 501, and the conference information includes the conference ID of the currently opened conference object; the multi-conference call control server 502 is configured to select a target virtual terminal in an idle state from the multiple virtual terminals according to each conference ID in the conference information, and generate a corresponding dynamic addition command for the target virtual terminal and send the dynamic addition command to the conference management server 501; the conference management server 501 is configured to add the target virtual terminal to a target conference object corresponding to the conference ID according to the dynamic addition command; the multi-conference call control server 502 is configured to receive first voice data of the target conference object through the target virtual terminal;

a switching call command generating module 902, configured to display the conference information, and generate a switching call command when receiving a trigger operation of switching a conference object;

a call switching command sending module 903, configured to send the call switching command to the multi-conference call control server 502;

a first voice data playing module 904, configured to receive target first voice data returned by the multi-conference call control server 502 for the call switching command, and play the target first voice data;

a second voice data generation module 905, configured to collect voice data in a current environment, add a target conference ID of a conference object where the target first voice data is located in the voice data, and generate second voice data;

a second voice data sending module 906, configured to send the second voice data to the multi-conference call control server 502; the multi-conference call control server 502 is configured to send the second voice data to a corresponding conference object through a target virtual terminal corresponding to the target conference ID.

The embodiment of the voice data transmitting apparatus is basically similar to the embodiment of the voice data transmitting method, so that the description is relatively simple, and the relevant points can be referred to the partial description of the embodiment of the voice data transmitting method.

Based on the same inventive concept, another embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps in the method according to any of the above-mentioned embodiments of the present application.

Based on the same inventive concept, another embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the electronic device implements the steps of the method according to any of the above embodiments of the present application.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all changes and modifications that fall within the true scope of the embodiments of the present invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The present invention provides a voice data sending method, a voice data sending device, a computer readable storage medium and an electronic device, which are described in detail above, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the above description of the embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A voice data sending method is characterized in that the method is applied to a multi-conference call control server, and the multi-conference call control server is in communication connection with a conference management server and a multi-conference call control client respectively; a plurality of virtual terminals are configured in the multi-conference call control server; the method comprises the following steps:

receiving a call switching command sent by the multi-conference call control client aiming at a target conference ID determined from the conference information;

receiving second voice data returned by the multi-conference call control client aiming at the target first voice data; the second voice data comprises a target conference ID of a conference object where the target first voice data is located;

2. The method of claim 1, wherein each conference object includes a video networking terminal;

3. The method of claim 1, wherein the multi-conference call control server comprises a database;

4. A method according to claim 3, characterized in that the method comprises:

receiving a conference information acquisition instruction sent by the multi-conference call control client;

5. A voice data sending method is characterized by being applied to a multi-conference call control client, wherein the multi-conference call control client is in communication connection with a multi-conference call control server, and the multi-conference call control server is in communication connection with a conference management server; a plurality of virtual terminals are configured in the multi-conference call control server; the method comprises the following steps:

receiving conference information sent by the multi-conference call control server; the conference information comprises a conference ID of a currently opened conference object;

sending the call switching command to the multi-conference call control server;

and sending the second voice data to the multi-conference call control server.

6. A voice data sending device is characterized by being applied to a multi-conference call control server, wherein the multi-conference call control server is in communication connection with a conference management server and a multi-conference call control client respectively; a plurality of virtual terminals are configured in the multi-conference call control server; the device comprises:

a target virtual terminal selection module, configured to select, according to each conference ID in the conference information, a target virtual terminal in an idle state from the multiple virtual terminals;

a switching call command receiving module, configured to receive a switching call command sent by the multi-conference call control client for a target conference ID determined from the conference information;

the second voice data receiving module is used for receiving second voice data returned by the multi-conference call control client aiming at the target first voice data; the second voice data comprises a target conference ID of a conference object in which the target first voice data is positioned;

7. The apparatus of claim 6, wherein the multi-conference call control server comprises a database;

after the conference on notification receiving module, the apparatus includes:

8. A voice data sending device is characterized by being applied to a multi-conference call control client, wherein the multi-conference call control client is in communication connection with a multi-conference call control server, and the multi-conference call control server is in communication connection with a conference management server; a plurality of virtual terminals are configured in the multi-conference call control server; the device comprises:

the conference information receiving module is used for receiving the conference information sent by the multi-conference call control server; the conference information comprises a conference ID of a currently opened conference object;

the switching call command sending module is used for sending the switching call command to the multi-conference call control server;

the second voice data generation module is used for acquiring voice data in the current environment, adding a target conference ID of a conference object where the target first voice data is located into the voice data and generating second voice data;

and the second voice data sending module is used for sending the second voice data to the multi-conference call control server.

9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executed implements the steps of the method according to any of claims 1-5.