CN108965779B - Audio and video stream transmission method, recording and broadcasting method, device and system - Google Patents

Audio and video stream transmission method, recording and broadcasting method, device and system Download PDF

Info

Publication number
CN108965779B
CN108965779B CN201711216742.8A CN201711216742A CN108965779B CN 108965779 B CN108965779 B CN 108965779B CN 201711216742 A CN201711216742 A CN 201711216742A CN 108965779 B CN108965779 B CN 108965779B
Authority
CN
China
Prior art keywords
video
audio
networking
server
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711216742.8A
Other languages
Chinese (zh)
Other versions
CN108965779A (en
Inventor
王晓燕
李亮
李云鹏
王艳辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visionvera Information Technology Co Ltd
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN201711216742.8A priority Critical patent/CN108965779B/en
Publication of CN108965779A publication Critical patent/CN108965779A/en
Application granted granted Critical
Publication of CN108965779B publication Critical patent/CN108965779B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6405—Multicasting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a transmission method, a recording device and a recording system of audio and video streams, wherein the transmission method comprises the following steps: the video network server receives a video conference starting instruction input by a user; the video networking server sends video conference requests to a plurality of selected video networking terminals according to the video conference starting instruction; the video networking server receives video conference responses sent by the plurality of video networking terminals; the video networking server acquires video networking audio and video streams of the operation audio and video sent by the plurality of video networking terminals; the video networking server combines the video networking audio and video streams into a transport stream TS; and the video network server sends the transport stream TS to a recording and broadcasting server for recording and broadcasting through the video network. The embodiment of the invention solves the problem that the audio and video stream taught by the operation can not be pushed to the video network for recording and playing back in the prior art, and improves the experience degree of a user on medical informatization.

Description

Audio and video stream transmission method, recording and broadcasting method, device and system
Technical Field
The invention relates to the technical field of surgical teaching, in particular to a transmission method, a recording and broadcasting method, a transmission device, a recording and broadcasting device and a recording and broadcasting system of audio and video streams.
Background
With the increase of the culture of medical and health talents in China, the operation teaching and medical observation system gradually becomes a hot spot for the information construction of hospitals in recent years.
At present, most of operation teaching and medical viewing systems in the prior art realize video storage, teaching video file management and viewing of historical operation videos of real-time operations on the basis of monitoring and video conference products through the internet, but the viewing and management can only be limited to viewing and management of a background PC (personal computer) end, and cannot be pushed to a video networking platform for recording and playing and the like, so that the experience of users on medical informatization is reduced.
Therefore, how to push the surgical teaching to the video network for recording and broadcasting is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The technical problem to be solved by the embodiment of the invention is to provide a transmission method of audio and video stream and a recording and broadcasting method of audio and video stream, so as to solve the technical problem that the experience of a user on medical informatization is reduced because the prior art cannot push operation teaching to a video network for recording and broadcasting.
Correspondingly, the embodiment of the invention also provides a transmission device of the audio and video stream, a recording and broadcasting device of the audio and video stream and a recording and broadcasting system of the audio and video stream, which are used for ensuring the realization and the application of the method.
In order to solve the problems, the invention is realized by the following technical scheme:
a first aspect provides a method for transmitting audio and video streams, the method including:
the video network server receives a video conference starting instruction input by a user;
the video networking server sends video conference requests to a plurality of selected video networking terminals according to the video conference starting instruction;
the video networking server receives video conference responses sent by the plurality of video networking terminals;
the video networking server acquires video networking audio and video streams of the operation audio and video sent by the plurality of video networking terminals;
the video networking server combines the video networking audio and video streams into a transport stream TS;
and the video network server sends the transport stream TS to a recording and broadcasting server for recording and broadcasting through the video network.
Optionally, the video networking server combines the video networking audio and video streams into one transport stream TS, including:
and the video networking server calls a multiplexer to combine the video networking audio and video streams into a transport stream TS.
Optionally, the method further includes:
the video network server uniformly manages a plurality of video network terminals which are registered and authorized, and stores the configuration of all the video network terminals which are registered and authorized, wherein the configuration comprises the following steps: the device number, name and addressing address of the video networking terminal.
Optionally, the method further includes:
the video networking server receives a video conference ending instruction input by a user;
and the video networking server stops acquiring the video networking audio and video stream of the operation audio and video sent by the plurality of video networking terminals according to the video conference ending instruction.
A second aspect provides a method for transmitting audio and video streams, the method comprising:
the video network terminal receives a video conference request sent by a video network server;
the video networking terminal sends a video conference request response to the video networking server and joins in a video conference;
the video networking terminal acquires audio and video signals of operation videos and audios sent by a plurality of video source devices;
the video network terminal respectively encodes the multiple paths of audio and video signals to obtain standard video network audio and video streams;
and the video networking terminal sends the video networking audio and video stream to a video networking server so that the video networking server can combine the video networking audio and video stream into a transport stream TS.
Optionally, before receiving the video conference request, the method further includes:
the video network terminal sends a registration authorization request to the video network server;
and the video network terminal receives the registration authorization response sent by the video network server.
A third aspect provides a method for recording and playing audio and video streams, where the method includes:
the recording and broadcasting server receives a transmission stream TS sent by the video networking server, wherein the transmission stream TS is formed by combining video networking audio and video streams;
the recording and broadcasting server stores the transport stream TS into a TS file for recording;
and the recording and broadcasting server sends the transport stream TS to a web management platform of a webpage in a multicast mode for broadcasting.
Optionally, the sending, by the recording and playing server, the transport stream TS to a web page web management platform in a multicast manner for playing includes:
and the recording and broadcasting server sends the transport stream TS to a webpage web management platform for broadcasting in a multicast mode through a user datagram protocol UDP.
A fourth aspect provides an apparatus for transmitting audio and video streams, comprising:
the first receiving unit is used for receiving a video conference starting instruction input by a user;
the first sending unit is used for sending video conference requests to the selected video networking terminals according to the video conference starting instruction;
the second receiving unit is used for receiving the video conference responses sent by the plurality of video networking terminals;
the acquisition unit is used for acquiring the video networking audio and video stream of the operation audio and video sent by the plurality of video networking terminals;
the combination unit is used for self-synthesizing the video networking audio and video stream into a transport stream TS;
and the second sending unit is used for sending the transport stream TS to a recording and broadcasting server through a video network for recording and broadcasting.
Optionally, the combining unit is specifically configured to invoke a multiplexer to combine the video networking audio and video streams into one transport stream TS.
Optionally, the apparatus further comprises:
the management unit is used for uniformly managing the video network terminals which are registered and authorized;
the storage unit is used for storing the configuration of all the video network terminals which are registered and authorized, and the configuration comprises the following steps: the device number, name and addressing address of the video networking terminal.
Optionally, the apparatus further comprises:
the third receiving unit is used for receiving a video conference ending instruction input by a user;
and the stopping unit is used for stopping acquiring the video networking audio and video stream of the operation audio and video sent by the video networking terminal according to the video conference ending instruction.
A fifth aspect provides an apparatus for transmitting audio and video streams, the apparatus comprising:
the receiving unit is used for receiving a video conference request sent by the video networking server;
the first sending unit is used for sending a video conference request response to the video networking server and joining the video conference;
the acquisition unit is used for acquiring the audio and video signals of the operation video and audio sent by the video source equipment;
the coding processing unit is used for coding the audio and video signals to obtain standard video networking audio and video stream;
and the second sending unit is used for sending the video networking audio and video stream to a video networking server so that the video networking server can combine the video networking audio and video stream into a transport stream TS.
Optionally, the apparatus further comprises:
a registration request unit, configured to send a registration authorization request to the video networking server before the first receiving unit receives the video conference request;
and the registration response unit is used for receiving the registration authorization response sent by the video network server.
A sixth aspect provides an apparatus for recording and playing audio and video streams, the apparatus comprising:
the receiving unit is used for receiving a transport stream TS sent by a video networking server, wherein the transport stream TS is formed by packaging video networking audio and video streams;
the recording unit is used for storing the transport stream TS into a TS file for recording;
and the transmitting unit is used for transmitting the transport stream TS to a webpage web management platform for playing in a multicast mode through the Internet.
Optionally, the sending unit is specifically configured to send the transport stream TS to a web management platform via a user datagram protocol UDP in a multicast manner through the internet for playing.
A seventh aspect provides a system for recording and playing audio and video streams, including: the system comprises a webpage management platform, a video network server, a plurality of video network terminals, a multiplexer and a recording and broadcasting server; wherein,
the webpage management platform is used for receiving a video conference starting instruction input by a user;
the video networking server is used for sending video conference requests to a plurality of selected video networking terminals and receiving video conference responses sent by the plurality of video networking terminals when receiving a video conference starting instruction sent by the webpage management platform;
each video networking terminal is used for receiving a video conference request sent by the video networking server, sending a video conference request response to the video networking server, joining a video conference and acquiring audio and video signals of operation videos and audios sent by a plurality of video source devices; respectively coding the multiple paths of audio and video signals to obtain standard video networking audio and video streams; sending the video networking audio and video stream to a video networking server;
the video networking server is also used for receiving the video networking audio and video streams sent by the plurality of video networking terminals and sending the video networking audio and video streams to the multiplexer;
the multiplexer is used for receiving video networking audio and video streams sent by a video networking server, combining the video networking audio and video streams into a transport stream TS through a multiplexing technology, and sending the transport stream TS to the video networking server;
the video network server is also used for sending the transport stream TS to the recording and broadcasting server through the video network;
the recording and broadcasting server is used for receiving the transport stream TS sent by the video networking server, storing the transport stream TS into a TS file for recording, and sending the transport stream TS to the webpage management platform in a multicast mode;
and the webpage management platform is used for playing the received transport stream TS.
Compared with the prior art, the embodiment of the invention has the following advantages:
in the embodiment of the invention, when receiving a video conference starting instruction, the video networking server acquires video networking audio and video streams of operation videos from a plurality of selected video networking terminals, combines the video networking audio and video streams into a transport stream TS, and sends the transport stream TS to the recording and playing server through the video networking for recording and playing. That is to say, in the embodiment of the present invention, the video networking server obtains the audio and video stream for the surgical teaching through the video networking, converts the audio and video stream into a transport stream, and sends the transport stream to the recording and playing server through the video networking for recording and playing, so as to solve the problem that the audio and video stream for the surgical teaching cannot be pushed to the video networking for recording and playing in the prior art, and improve the experience of the user on the medical informatization.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
Fig. 1 is a flowchart of a transmission method of audio and video streams according to an embodiment of the present invention;
fig. 2 is another flowchart of a transmission method of audio and video streams according to an embodiment of the present invention;
fig. 3 is a flowchart of a method for recording audio and video streams according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for transmitting audio and video streams according to an embodiment of the present invention;
fig. 5 is another schematic structural diagram of an apparatus for transmitting audio/video streams according to an embodiment of the present invention;
fig. 6 is another schematic structural diagram of an apparatus for transmitting audio/video streams according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an apparatus for recording audio and video streams according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a recording system for audio and video streams according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Before the embodiment of the invention is introduced, the video networking is introduced briefly, and the video networking has a special network characteristic, is a data transmission network realized by adopting a two-layer network protocol, and is a network completely without an IP concept. Communication interaction, data transmission and the like among the devices in the video network depend on protocol addressing to realize interconnection and intercommunication. That is to say, the video networking is the higher grade form of internet, is a real-time network, can realize the whole net high definition video real-time transmission that present internet can't realize, pushes numerous internet application to high definition video ization, and the high definition is face-to-face. It can be seen that based on such network characteristics, the video network can provide performance indexes of large bandwidth, high efficiency, low delay, and the like. Due to these technical characteristics, the service requirement of multi-party access of the surgical medical video conference can be supported.
The audio and video recording and broadcasting (such as operation teaching recording and broadcasting) provided by the embodiment of the invention is based on a video network architecture, and a complete video network environment needs to be constructed, and the audio and video recording and broadcasting (such as operation teaching recording and broadcasting) comprises the following steps: the video network server and video network terminal, and the exchange route network equipment used for connecting the circuit, still need to deploy the recorded broadcast server with network protocol conversion, etc., the recorded broadcast server supports the double network card, one end connects the video network, another end connects the internet, as the bridge that the internal video network interacts with external internet equipment, finish internal and external communication, data transmission, etc. by it.
Based on the above video networking architecture, please refer to fig. 1, which is a flowchart of a method for transmitting audio and video streams provided by the embodiment of the present invention, specifically, the method may include the following steps:
step 101: the video network server receives a video conference starting instruction input by a user;
in the step, a user can create an audio and video recording (such as operation teaching) record through a webpage (web) management platform, namely, a video conference starting instruction is initiated, and when the webpage management platform receives the video conference starting instruction, the webpage management platform sends the video conference starting instruction to a video server, and simultaneously, the selected video network terminal of the video network is informed to be ready for the video conference.
Step 102: the video networking server sends video conference requests to a plurality of selected video networking terminals according to the video conference starting instruction;
the video network terminals in the step are terminals which are registered in advance and authorized to the video network, are uniformly managed by the video network server, and record the equipment number, name, addressing address and the like of each video network terminal.
Step 103: the video networking server receives video conference responses sent by the plurality of video networking terminals;
in this step, when receiving the video conference request, the multiple video networking terminals feed back a video conference response to the video networking server, and join the video conference.
Step 104: the video networking server acquires video networking audio and video streams of the operation audio and video sent by the plurality of video networking terminals;
some of the multiple video networking terminals in this embodiment are arranged in an operating room, and are connected with different medical devices (i.e., video source devices) for inputting video signals and connected with a high-definition digital television for outputting and displaying the video signals; some of the devices are arranged in other places, are connected with a camera, a microphone and a high-definition digital television, and carry out input and output of audio and video signals through the camera, the microphone and the high-definition digital television.
Step 105: the video network server combines the video network audio and video streams into a Transport Stream (TS, Transport Stream);
in this embodiment, the video networking server may invoke a Multiplexer (Mux, Multiplexer) to combine the video networking audio and video streams into one transport stream TS, specifically: the video network server sends the video network audio and video stream to the multiplexer, after the multiplexer receives the video network audio and video stream, the video network audio and video stream is unpacked to obtain multiple paths of audio and video data, then the video network protocol header in each path of audio and video data is removed (namely the relevant content of the video network protocol is removed), finally, the audio and video data with the protocol header removed are combined together, the video network protocol header is added to the combined audio and video data to obtain a transport stream TS, and finally, the transport stream TS is sent to the video network server.
The fixed packet length of the transport stream TS is 188B, and the content of the TS is identified by a process identifier PID value, which is well known to those skilled in the art and will not be described herein.
Step 106: and the video network server sends the transport stream TS to a recording and broadcasting server for recording and broadcasting through the video network.
In the embodiment of the invention, when receiving a video conference starting instruction, the video networking server acquires video networking audio and video streams of operation videos from a plurality of selected video networking terminals, combines the video networking audio and video streams into a transport stream TS, and sends the transport stream TS to the recording and playing server through the video networking for recording and playing. That is to say, in the embodiment of the present invention, the video networking server obtains the audio and video stream for the surgical teaching through the video networking, converts the audio and video stream into a transport stream, and sends the transport stream to the recording and playing server through the video networking for recording and playing, so as to solve the problem that the audio and video stream for the surgical teaching cannot be pushed to the video networking for recording and playing in the prior art, and improve the experience of the user on the medical informatization.
Optionally, in another embodiment, on the basis of the above embodiment, the method may further include:
the video network server uniformly manages a plurality of video network terminals which are registered and authorized, and stores the configuration of all the video network terminals which are registered and authorized, wherein the configuration comprises the following steps: the device number, name and addressing address of the video networking terminal.
In the embodiment of the invention, each video network terminal needs to send a registration authorization request to the video network server; and each video network terminal receives the registration authorization response sent by the video network server respectively. That is to say, each terminal in the video network should access all the video network authorization, and the video network server performs unified management, so as to make the video network server store a configuration table of all the video network terminals, and the device numbers, names, addressing addresses, etc. of all the authorized video network terminals recorded in the configuration table.
Optionally, in another embodiment, on the basis of the above embodiment, the method may further include:
the video networking server receives a video conference ending instruction input by a user;
and the video networking server stops acquiring the video networking audio and video stream of the operation video and audio sent by the video networking terminal according to the video conference ending instruction.
In this embodiment, after the audio/video stream for surgical teaching is recorded, the video networking server receives a video conference end instruction input by a user through the web page management platform, and stops acquiring the video networking audio/video stream of the surgical audio/video from the plurality of video networking terminals according to the stop instruction, that is, recording is completed.
Referring to fig. 2, another flow chart of a method for transmitting audio/video stream according to an embodiment of the present invention is shown, where the method includes the following steps:
step 201: the video network terminal receives a video conference request sent by a video network server;
in this embodiment, the video network server sends a video conference request to a selected plurality of video network terminals, and each video network terminal receives the video conference request.
Step 202: the video networking terminal sends a video conference request response to the video networking server and joins in a video conference;
in this step, the video network terminal that receives the video conference request feeds back a video conference request response to the video network server, indicating that the request is accepted, and agrees to join the video conference.
Step 203: the video networking terminal acquires audio and video signals of operation videos and audios sent by a plurality of video source devices;
in this embodiment, some of the terminals of the video network are placed in an operating room, and have access to different medical devices (i.e., video source devices) for inputting video signals, and have access to a high-definition digital television for outputting and displaying video signals; still some place in other places, accessed camera, microphone and high definition digital television, through them carry out audio and video signal's input and output. And the input and output of the audio and video signals of all the video network terminals are scheduled and controlled by the video network server.
Step 204: the video network terminal respectively encodes the multiple paths of audio and video signals to obtain standard video network audio and video streams;
in the step, after receiving different audio and video signals, the video networking terminal compresses the audio and video signals, then adds a video networking protocol header to the compressed audio and video signals, and then encodes the audio and video signals added with the video networking protocol header according to a standard audio and video encoding mode, thereby obtaining standard video networking audio and video streams.
And unpacking different audio and video signals according to the video networking protocol, removing relevant contents of the video networking protocol, and then coding the audio and video signals according to a standard audio and video coding and decoding mode to obtain standard video networking audio and video stream. The standard video networking audio/video stream is an audio/video data packet containing a video networking protocol.
Step 205: and the video networking terminal sends the video networking audio and video stream to a video networking server so that the video networking server can combine the video networking audio and video stream into a transport stream TS.
The video networking terminal sends the video networking audio and video stream obtained after coding to a video networking server, and the video networking server calls a multiplexer to combine the video networking audio and video stream into a transport stream TS, and the specific process is as follows: the video network server sends the video network audio and video stream to the multiplexer, after the multiplexer receives the video network audio and video stream, the video network audio and video stream is unpacked to obtain multiple paths of audio and video data, then a video network protocol header in each path of audio and video data is removed (namely relevant content with a video network protocol is removed), finally, the audio and video data with the protocol header removed are combined together, and the video network protocol header is added to the combined audio and video data to obtain a transport stream TS.
According to the embodiment of the invention, when a video conference request is received, a video networking terminal joins the video conference, acquires the audio and video signals of the operation audio and video from a plurality of video source devices, respectively encodes the audio and video signals in multiple paths to obtain the standard video networking audio and video stream, and sends the standard video networking audio and video stream to a video networking server. That is to say, in the embodiment of the present invention, the video network terminal sends the acquired audio and video of the operation video to the video network server through the video network, so that the video network server converts the audio and video stream into a transport stream and sends the transport stream to the recording and playing server through the video network for recording and playing, thereby solving the problem that the audio and video stream taught by the operation cannot be pushed to the video network for recording and playing in the prior art, and improving the experience of the user on medical informatization.
Optionally, in another embodiment, on the basis of the foregoing embodiment, before receiving the video conference request, the method may further include:
the video network terminal sends a registration authorization request to the video network server;
and the video network terminal receives the registration authorization response sent by the video network server.
In this embodiment, each of the terminals in the video network should be all authorized to access the video network, and the video network server performs unified management, so that the video network server stores a configuration table of all the terminals in the video network, and the configuration table records the device numbers, names, addressing addresses, and the like of all the authorized terminals in the video network.
Fig. 3 is a flowchart of a method for recording and playing audio and video streams according to an embodiment of the present invention. The method may include:
step 301: the recording and broadcasting server receives a transmission stream TS sent by the video networking server, wherein the transmission stream TS is formed by combining video networking audio and video streams;
the recording and broadcasting server in this embodiment is configured with dual network cards, the first network card is used for connecting with the video network, and the second network card is used for connecting with the internet. In addition, the recording and broadcasting server is provided with virtual terminal numbers capable of communicating with the video network terminals, and the virtual terminal numbers are bound to a network card connected with the video network. The purpose is that the recorded and broadcast virtual terminal number receives the invitation of the video network conference and joins the video network conference when in a meeting, and the video network server in the video network schedules the transport stream TS for the recorded and broadcast virtual terminal number, namely, the recorded and broadcast acquires the audio and video stream to be recorded through the virtual terminal number.
In this step, the recording and playing server receives the transport stream TS sent by the video network server through the first network card.
Step 302: the recording and broadcasting server stores the transport stream TS into a TS file for recording;
in the step, after receiving the transport stream TS, the recording and broadcasting server unpacks the transport stream TS to obtain multi-path audio and video data, and records the multi-path audio and video data according to the distributed virtual terminal number after removing a video networking protocol header in each path of multi-path audio and video data.
One way is that when the recording and broadcasting server receives the transport stream TS, the recording and broadcasting server unpacks the packet to obtain the multiple paths of audio and video data, then removes the protocol header of the video networking, stores the multiple paths of audio and video data into a TS file according to the dynamically allocated virtual terminal number for recording, and stops recording until the transport stream TS is not received.
The other mode is that when the recording and broadcasting server receives the transport stream TS, firstly unpacking the transport stream TS to obtain multi-channel audio and video data, then removing the video networking protocol header, and storing the audio and video data without the video networking protocol header into a TS file according to the dynamically allocated virtual terminal number when receiving a recording start instruction sent by a user through a webpage management platform; and when the recording and broadcasting server receives a recording and broadcasting stopping instruction sent by the user through the webpage management platform, stopping recording, namely completing recording.
In this embodiment, how many virtual terminal numbers are configured on each recording and broadcasting server is preset, and the virtual short number is related to the number of operating rooms, and in general, each operating room corresponds to at least the first virtual short number. Wherein, a part of the virtual terminal numbers are used for recording or storing TS files, and a part of the virtual terminal numbers are used for playing back the TS files.
Step 303: and the recording and broadcasting server sends the transport stream TS to a web management platform of a webpage in a multicast mode for broadcasting.
In this step, the recording and playing server sends the transport stream TS to a web management platform for playing in a multicast manner through a User Datagram Protocol (UDP). It should be noted that the virtual terminal number pre-bound by the recording and playing server is used for receiving the multiplexed transport stream TS from the video network, saving the file, and sending the file to the multicast address in the form of UDP multicast.
In the embodiment of the invention, when the recording and broadcasting server receives the transport stream TS, on one hand, the transport stream TS is stored as a TS file, and on the other hand, the transport stream TS is multicast through a user datagram protocol UDP for being played by a webpage web browser in real time. After the recording is finished, the video files in the history record can be played through a web management platform or ipad through history playback. The embodiment of the invention solves the problem that the audio and video stream taught by the operation can not be pushed to the video network for recording and playing back in the prior art, and improves the experience degree of a user on medical informatization.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a schematic structural diagram of a transmission device for audio and video streams according to an embodiment of the present invention is shown, where the device may include: a first receiving unit 41, a first transmitting unit 42, a second receiving unit 43, an obtaining unit 44, a combining unit 45 and a second transmitting unit 46, wherein,
a first receiving unit 41 for receiving a video conference start instruction input by a user;
a first sending unit 42, configured to send a video conference request to the selected multiple video networking terminals according to the video conference start instruction;
a second receiving unit 43, configured to receive video conference responses sent by the multiple video networking terminals;
an obtaining unit 44, configured to obtain video networking audio and video streams of the operation audio and video sent by the multiple video networking terminals;
a combination unit 45, configured to self-combine the video networking audio and video streams into a transport stream TS;
the combining unit 45 is specifically configured to combine the video networking audio and video streams into one transport stream TS by using a multiplexing technique.
And a second sending unit 46, configured to send the transport stream TS to a recording and playing server through a video network for recording and playing.
Optionally, in another embodiment, on the basis of the above embodiment of this implementation example, the apparatus may further include: the management unit 51 and the storage unit 52 are schematically shown in fig. 5, wherein,
the management unit 51 is used for performing unified management on the video networking terminals registered and authorized before the first sending unit 42 sends the video conference request;
a storage unit 52, configured to store configurations of all authorized video networking terminals, where the configurations include: the device number, name and addressing address of the video networking terminal.
Optionally, in another embodiment, on the basis of the above embodiment of this implementation example, the apparatus may further include: a third receiving unit and a stopping unit (not shown), wherein,
the third receiving unit is used for receiving a video conference ending instruction input by a user;
and the stopping unit is used for stopping acquiring the video networking audio and video stream of the operation audio and video sent by the video networking terminal according to the video conference ending instruction.
Optionally, the audio/video stream transmission device may be integrated in a video networking server, or may be deployed independently, which is not limited in this embodiment.
Referring to fig. 6, another schematic structural diagram of an apparatus for transmitting audio/video stream according to an embodiment of the present invention is shown, where the apparatus may include: a receiving unit 61, a first transmitting unit 62, an obtaining unit 63, a codec unit 64 and a second transmitting unit 65, wherein,
a receiving unit 61, configured to receive a video conference request sent by a video networking server;
a first sending unit 62, configured to send a video conference request response to the video networking server, and join in a video conference;
the acquisition unit 63 is configured to acquire an audio/video signal of the surgical image and sound sent by the video source device;
the coding and decoding unit 64 is used for coding the audio and video signals to obtain standard video networking audio and video streams;
a second sending unit 65, configured to send the video networking audio and video streams to a video networking server, so that the video networking server combines the video networking audio and video streams into one transport stream TS.
Optionally, in another embodiment, on the basis of the above embodiment of this implementation example, the apparatus may further include: a registration request unit and a registration response unit (not shown), wherein,
a registration request unit, configured to send a registration authorization request to the video networking server before the first receiving unit receives the video conference request;
and the registration response unit is used for receiving the registration authorization response sent by the video network server.
Optionally, the audio/video stream transmission device may be integrated in a video networking terminal, or may be deployed independently, which is not limited in this embodiment.
Referring to fig. 7, a schematic structural diagram of an apparatus for recording and playing audio and video streams according to an embodiment of the present invention is shown, where the apparatus may include: a receiving unit 71, a recording unit 72, and a transmitting unit 73, wherein,
a receiving unit 71, configured to receive a transport stream TS sent by a video networking server, where the transport stream TS is formed by packaging video networking audio and video streams;
a recording unit 72, configured to store the transport stream TS as a TS file for recording;
and the sending unit 73 is configured to send the transport stream TS to the web management platform for playing through the internet in a multicast manner. Specifically, the sending unit 73 is specifically configured to send the transport stream TS to a web page web management platform for playing through a user datagram protocol UDP through the internet in a multicast manner.
Optionally, the recording and playing device for the audio and video stream may be integrated in the recording and playing server, or may be deployed independently, which is not limited in this embodiment.
Referring to fig. 8, a schematic structural diagram of an audio/video stream recording and playing system according to an embodiment of the present invention is provided, where the audio/video stream recording and playing system is based on a video network, and the network of the video network is built, a core video network server and a video network terminal device are to be deployed, and a medical device, a television, a camera, a microphone, and other video source devices for audio/video input and output are accessed, and are connected to the video source device through a network switch and a routing device. The system may include: a web page management platform 81, a video network server 82, a plurality of video network terminals 83 (in this embodiment, one video network terminal is taken as an example), a multiplexer 84 and a recording and broadcasting server 85; wherein,
the web page management platform 81 is configured to receive a video conference start instruction input by a user;
namely, the user creates audio and video conference records for surgical teaching through the webpage management platform.
In this embodiment, a user may create a video conference appointment and real-time schedule through a web page (web) management platform, and receive a meeting message from the video network and the internet when the video conference begins to execute.
The video networking server 82 is configured to, when receiving a video conference start instruction sent by the web page management platform 81, send a video conference request to the selected multiple video networking terminals according to the video conference start instruction, and receive video conference responses sent by the multiple video networking terminals;
each video network terminal 83 is configured to receive a video conference request sent by the video network server 82, send a video conference request response to the video network server 82, join a video conference, and obtain audio and video signals of surgical videos and audios sent by multiple video source devices; respectively coding the multiple paths of audio and video signals to obtain standard video networking audio and video streams; sending the video networking audio and video stream to a video networking server;
the video networking server 82 is further configured to receive video networking audio and video streams sent by the plurality of video networking terminals 83, and send the video networking audio and video streams to the multiplexer 84;
the multiplexer 84 is configured to receive video networking audio and video streams sent by the video networking server 82, combine the video networking audio and video streams into a transport stream TS through a multiplexing technique, and send the transport stream TS to the video networking server 82;
the video network server 82 is further configured to send the transport stream TS to the recording and playing server 5 through a video network;
the recording and playing server 85 is configured to receive the transport stream TS sent by the video network server 82, store the transport stream TS as a TS file for recording, and send the transport stream TS to the web page management platform 81 in a multicast manner;
in this embodiment, the recording and broadcasting server needs to have a function of network protocol conversion service, a high-performance x86 server may be selected, the x86 server supports dual-network card access, and a network protocol conversion server program is installed and deployed on the video networking server. The recording and broadcasting server is also provided with equipment capable of being mounted for data storage and is communicated with a line through network equipment.
The web page management platform 81 is further configured to play the received transport stream TS.
In this embodiment, the recorded video file may be played through a web or an ipad through history playback.
In the embodiment of the invention, the operation condition in the operation process taught by the operation is recorded, the real-time image condition is forwarded to the interface of the web browser through the video network, and the operation teaching condition is watched through the web page, so that the problem that the audio and video stream taught by the operation cannot be pushed to the video network for recording and broadcasting in the prior art is solved, and the experience degree of medical informatization is improved.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, system, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices or systems, computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The transmission method of the audio and video stream, the recording method and device of the audio and video stream and the recording system of the audio and video stream provided by the invention are introduced in detail, and specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (15)

1. A method for transmitting audio/video streams, comprising:
the video network server receives a video conference starting instruction input by a user;
the video networking server sends video conference requests to a plurality of selected video networking terminals according to the video conference starting instruction;
the video networking server receives video conference responses sent by the plurality of video networking terminals;
the video networking server acquires video networking audio and video streams of the operation audio and video sent by the plurality of video networking terminals;
the video networking server combines the video networking audio and video streams into a transport stream TS;
the video network server sends the transport stream TS to a recording and broadcasting server through a video network for recording and broadcasting; the recording and broadcasting server is provided with a virtual terminal number capable of communicating with the video network terminal, and the virtual terminal number is bound to a network card connected with the video network, so that the recorded and broadcasting virtual terminal number can receive the invitation of the video network conference and join the video network conference when in a meeting; the recording and broadcasting server acquires audio and video streams to be recorded through the virtual terminal number;
the step of combining the video networking audio and video streams into a transport stream TS by the video networking server comprises the following steps:
the video networking server calls a multiplexer, and the multiplexer unpacks the video networking audio and video stream to obtain multi-channel audio and video data;
the multiplexer removes the video networking protocol header in each path of audio and video data;
the multiplexer combines the audio and video data without the protocol header and adds a video networking protocol header to the combined audio and video data to obtain the transport stream TS.
2. The method of claim 1, further comprising:
the video network server uniformly manages a plurality of video network terminals which are registered and authorized, and stores the configuration of all the video network terminals which are registered and authorized, wherein the configuration comprises the following steps: the device number, name and addressing address of the video networking terminal.
3. The method of claim 1, further comprising:
the video networking server receives a video conference ending instruction input by a user;
and the video networking server stops acquiring the video networking audio and video stream of the operation audio and video sent by the plurality of video networking terminals according to the video conference ending instruction.
4. A method for transmitting audio/video streams, comprising:
the video networking terminal receives a video conference request sent by a video networking server, wherein the video conference request is sent to a plurality of selected video networking terminals by the video networking server according to a video conference starting instruction input by a user;
the video networking terminal sends a video conference request response to the video networking server and joins in a video conference;
the video networking terminal acquires audio and video signals of operation videos and audios sent by a plurality of video source devices;
the video network terminal respectively encodes the multiple paths of audio and video signals to obtain standard video network audio and video streams;
the video network terminal sends the video network audio and video stream to a video network server so that the video network server can combine the video network audio and video stream into a transport stream TS, wherein the video network server combines the video network audio and video stream into a transport stream TS, and the method comprises the following steps: the video networking server calls a multiplexer, and the multiplexer unpacks the video networking audio and video stream to obtain multi-channel audio and video data; the multiplexer removes the video networking protocol header in each path of audio and video data; the multiplexer combines the audio and video data without the protocol header and adds a video networking protocol header to the combined audio and video data to obtain the transport stream TS;
the video network server is used for sending the transport stream TS to a recording and broadcasting server through a video network for recording and broadcasting; the recording and broadcasting server is provided with a virtual terminal number capable of communicating with the video network terminal, and the virtual terminal number is bound to a network card connected with the video network, so that the recorded and broadcasting virtual terminal number can receive the invitation of the video network conference and join the video network conference when in a meeting; the recording and broadcasting server acquires audio and video streams to be recorded through the virtual terminal number;
the method comprises the following steps that the video networking terminal respectively encodes and processes a plurality of paths of audio and video signals to obtain standard video networking audio and video streams, and comprises the following steps:
compressing the multiple paths of audio and video signals to obtain compressed audio and video signals;
adding a video link protocol header to the compressed audio and video signal;
and coding the compressed audio and video signals added with the video networking protocol header according to a standard audio and video coding mode to obtain the standard video networking audio and video stream.
5. The method of claim 4, wherein prior to receiving the video conference request, the method further comprises:
the video network terminal sends a registration authorization request to the video network server;
and the video network terminal receives the registration authorization response sent by the video network server.
6. A method for recording and playing audio and video stream is characterized by comprising the following steps:
the recording and broadcasting server receives a transmission stream TS sent by a video networking server, wherein the transmission stream TS is formed by combining video networking audio and video streams sent by a video networking terminal arranged in an operating room;
the recording and broadcasting server stores the transport stream TS into a TS file for recording;
the recording and broadcasting server sends the transport stream TS to a web management platform of a webpage in a multicast mode for broadcasting;
the recording and broadcasting server is provided with a first network card for connecting a video network, and a virtual terminal number in the recording and broadcasting server is bound with the first network card so that the recording and broadcasting server can obtain the transport stream TS to be recorded through the virtual terminal number; the number of the virtual terminal numbers is positively correlated with the number of the operating rooms, and each operating room at least corresponds to one virtual terminal number.
7. The method of claim 6, wherein the recording and playing server sends the transport stream TS to a web management platform for playing in a multicast manner, and the method comprises:
and the recording and broadcasting server sends the transport stream TS to a webpage web management platform for broadcasting in a multicast mode through a user datagram protocol UDP.
8. An apparatus for transmitting audio/video stream, comprising:
the first receiving unit is used for receiving a video conference starting instruction input by a user;
the first sending unit is used for sending video conference requests to the selected video networking terminals according to the video conference starting instruction;
the second receiving unit is used for receiving the video conference responses sent by the plurality of video networking terminals;
the acquisition unit is used for acquiring the video networking audio and video stream of the operation audio and video sent by the plurality of video networking terminals;
the combination unit is used for self-combining the video networking audio and video stream into a transport stream TS;
the second sending unit is used for sending the transport stream TS to a recording and broadcasting server through a video network for recording and broadcasting; the recording and broadcasting server is provided with a virtual terminal number capable of communicating with the video network terminal, and the virtual terminal number is bound to a network card connected with the video network, so that the recorded and broadcasting virtual terminal number can receive the invitation of the video network conference and join the video network conference when in a meeting; the recording and broadcasting server acquires audio and video streams to be recorded through the virtual terminal number;
the combination unit is specifically used for calling a multiplexer to combine the video networking audio and video streams into a transport stream TS;
the step of combining the video networking audio and video streams into a transport stream TS by the video networking server comprises the following steps:
the video networking server calls a multiplexer, and the multiplexer unpacks the video networking audio and video stream to obtain multi-channel audio and video data;
the multiplexer removes the video networking protocol header in each path of audio and video data;
the multiplexer combines the audio and video data without the protocol header and adds a video networking protocol header to the combined audio and video data to obtain the transport stream TS.
9. The apparatus of claim 8, further comprising:
the management unit is used for uniformly managing the video network terminals which are registered and authorized;
the storage unit is used for storing the configuration of all the video network terminals which are registered and authorized, and the configuration comprises the following steps: the device number, name and addressing address of the video networking terminal.
10. The apparatus of claim 8, further comprising:
the third receiving unit is used for receiving a video conference ending instruction input by a user;
and the stopping unit is used for stopping acquiring the video networking audio and video stream of the operation audio and video sent by the video networking terminal according to the video conference ending instruction.
11. An apparatus for transmitting audio/video stream, comprising:
the video conference system comprises a receiving unit, a selecting unit and a processing unit, wherein the receiving unit is used for receiving a video conference request sent by a video networking server, and the video conference request is sent to a plurality of selected video networking terminals according to a video conference starting instruction received by the video networking server and input by a user;
the first sending unit is used for sending a video conference request response to the video networking server and joining the video conference;
the acquisition unit is used for acquiring the audio and video signals of the operation video and audio sent by the video source equipment;
the coding processing unit is used for coding the audio and video signals to obtain standard video networking audio and video stream;
a second sending unit, configured to send the video networking audio/video stream to a video networking server, so that the video networking server combines the video networking audio/video stream into a transport stream TS, where the step of combining the video networking audio/video stream into a transport stream TS by the video networking server includes: the video networking server calls a multiplexer, and the multiplexer unpacks the video networking audio and video stream to obtain multi-channel audio and video data; the multiplexer removes the video networking protocol header in each path of audio and video data; the multiplexer combines the audio and video data without the protocol header and adds a video networking protocol header to the combined audio and video data to obtain the transport stream TS;
the video network server is used for sending the transport stream TS to a recording and broadcasting server through a video network for recording and broadcasting; the recording and broadcasting server is provided with a virtual terminal number capable of communicating with the video network terminal, and the virtual terminal number is bound to a network card connected with the video network, so that the recorded and broadcasting virtual terminal number can receive the invitation of the video network conference and join the video network conference when in a meeting; the recording and broadcasting server acquires audio and video streams to be recorded through the virtual terminal number;
the method comprises the following steps that the video networking terminal respectively encodes and processes a plurality of paths of audio and video signals to obtain standard video networking audio and video streams, and comprises the following steps:
compressing the multiple paths of audio and video signals to obtain compressed audio and video signals;
adding a video link protocol header to the compressed audio and video signal;
and coding the compressed audio and video signals added with the video networking protocol header according to a standard audio and video coding mode to obtain the standard video networking audio and video stream.
12. The apparatus of claim 11, further comprising:
a registration request unit, configured to send a registration authorization request to the video networking server before the receiving unit receives the video conference request;
and the registration response unit is used for receiving the registration authorization response sent by the video network server.
13. An apparatus for recording and playing audio/video stream, comprising:
the receiving unit is used for receiving a transport stream TS sent by a video networking server, and the transport stream TS is formed by packaging video networking audio and video streams sent by a video networking terminal arranged in an operating room;
the recording unit is used for storing the transport stream TS into a TS file for recording;
the transmitting unit is used for transmitting the transport stream TS to a webpage web management platform for playing in a multicast mode through the Internet;
the recording and broadcasting server is provided with a first network card for connecting a video network, and a virtual terminal number in the recording and broadcasting server is bound with the first network card so that the recording and broadcasting server can obtain the transport stream TS to be recorded through the virtual terminal number; the number of the virtual terminal numbers is positively correlated with the number of the operating rooms, and each operating room at least corresponds to one virtual terminal number.
14. The apparatus according to claim 13, wherein the sending unit is specifically configured to send the transport stream TS to a web page web management platform for playing in a multicast manner through an internet via a user datagram protocol UDP.
15. A system for recording and playing audio and video streams, comprising: the system comprises a webpage management platform, a video network server, a plurality of video network terminals, a multiplexer and a recording and broadcasting server; wherein,
the webpage management platform is used for receiving a video conference starting instruction input by a user;
the video networking server is used for sending video conference requests to a plurality of selected video networking terminals and receiving video conference responses sent by the plurality of video networking terminals when receiving a video conference starting instruction sent by the webpage management platform;
each video networking terminal is used for receiving a video conference request sent by the video networking server, sending a video conference request response to the video networking server, joining a video conference and acquiring audio and video signals of operation videos and audios sent by a plurality of video source devices; respectively coding the multiple paths of audio and video signals to obtain standard video networking audio and video streams; sending the video networking audio and video stream to a video networking server;
the video networking server is also used for receiving video networking audio and video streams sent by the plurality of video networking terminals and sending the video networking audio and video streams to the multiplexer;
the multiplexer is used for receiving video networking audio and video streams sent by a video networking server, combining the video networking audio and video streams into a transport stream TS through a multiplexing technology, and sending the transport stream TS to the video networking server;
the video network server is also used for sending the transport stream TS to the recording and broadcasting server through the video network;
the recording and broadcasting server is used for receiving the transport stream TS sent by the video networking server, storing the transport stream TS into a TS file for recording, and sending the transport stream TS to the webpage management platform in a multicast mode; the recording and broadcasting server is provided with a virtual terminal number capable of communicating with the video network terminal arranged in an operating room, and the virtual terminal number is bound to a network card connected with the video network, so that the recorded and broadcasting virtual terminal number can receive the invitation of a video network conference and join the video network conference when in a meeting; the recording and broadcasting server is provided with a first network card for connecting a video network, and a virtual terminal number in the recording and broadcasting server is bound with the first network card so that the recording and broadcasting server acquires the transport stream TS to be recorded through the virtual terminal number; the number of the virtual terminal numbers is positively correlated with the number of the operating rooms, and each operating room at least corresponds to one virtual terminal number;
the webpage management platform is used for playing the received transport stream TS;
wherein, the step of combining the video networking audio and video streams into one transport stream TS through a multiplexing technology comprises:
the video networking server calls a multiplexer, and the multiplexer unpacks the video networking audio and video stream to obtain multi-channel audio and video data;
the multiplexer removes the video networking protocol header in each path of audio and video data;
the multiplexer combines the audio and video data without the protocol header and adds a video networking protocol header to the combined audio and video data to obtain the transport stream TS;
the step of respectively coding the multiple paths of audio and video signals to obtain standard video networking audio and video streams comprises the following steps:
compressing the multiple paths of audio and video signals to obtain compressed audio and video signals;
adding a video link protocol header to the compressed audio and video signal;
and coding the compressed audio and video signals added with the video networking protocol header according to a standard audio and video coding mode to obtain the standard video networking audio and video stream.
CN201711216742.8A 2017-11-28 2017-11-28 Audio and video stream transmission method, recording and broadcasting method, device and system Active CN108965779B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711216742.8A CN108965779B (en) 2017-11-28 2017-11-28 Audio and video stream transmission method, recording and broadcasting method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711216742.8A CN108965779B (en) 2017-11-28 2017-11-28 Audio and video stream transmission method, recording and broadcasting method, device and system

Publications (2)

Publication Number Publication Date
CN108965779A CN108965779A (en) 2018-12-07
CN108965779B true CN108965779B (en) 2021-07-06

Family

ID=64495295

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711216742.8A Active CN108965779B (en) 2017-11-28 2017-11-28 Audio and video stream transmission method, recording and broadcasting method, device and system

Country Status (1)

Country Link
CN (1) CN108965779B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109788230B (en) * 2018-12-17 2021-01-22 视联动力信息技术股份有限公司 Conference recording method and device
CN109922351B (en) * 2019-02-20 2021-08-20 视联动力信息技术股份有限公司 Method and device for releasing live broadcast service
CN110035249A (en) * 2019-03-08 2019-07-19 视联动力信息技术股份有限公司 A kind of video gets method and apparatus ready
CN110139133B (en) * 2019-04-02 2022-03-25 视联动力信息技术股份有限公司 Advertisement playing method and device
CN110049274A (en) * 2019-04-04 2019-07-23 视联动力信息技术股份有限公司 Video conference recording system
CN110213602A (en) * 2019-05-05 2019-09-06 视联动力信息技术股份有限公司 A kind of processing method of audio, video data, system and device and storage medium
CN110198478B (en) * 2019-05-10 2022-04-15 广州视源电子科技股份有限公司 Interactive recording and broadcasting method, system, client, device, equipment and storage medium
CN110475090B (en) * 2019-08-05 2021-04-27 视联动力信息技术股份有限公司 Conference control method and system
CN111182258B (en) * 2020-02-11 2022-12-23 视联动力信息技术股份有限公司 Data transmission method and device for network conference
CN111669538A (en) * 2020-06-17 2020-09-15 上海维牛科技有限公司 Real-time audio and video dynamic confluence technology
CN113824723B (en) * 2021-09-23 2023-12-08 上海安威士科技股份有限公司 End-to-end system solution method applied to audio and video data transmission

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202059505U (en) * 2011-06-01 2011-11-30 北京鹏博佳讯信息技术有限公司 Remote consultation video system control center device
CN203118262U (en) * 2013-02-26 2013-08-07 江苏省中医院 Operation teaching system adopted in hospitals
WO2014138280A1 (en) * 2013-03-05 2014-09-12 Vtm, Llc Medical telecommunications system
CN205336429U (en) * 2016-01-11 2016-06-22 江苏省中医院 Hospital remote consultation and teaching system
CN106162040A (en) * 2015-03-30 2016-11-23 北京视联动力国际信息技术有限公司 The method and apparatus that video conference accesses in many ways

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202059505U (en) * 2011-06-01 2011-11-30 北京鹏博佳讯信息技术有限公司 Remote consultation video system control center device
CN203118262U (en) * 2013-02-26 2013-08-07 江苏省中医院 Operation teaching system adopted in hospitals
WO2014138280A1 (en) * 2013-03-05 2014-09-12 Vtm, Llc Medical telecommunications system
CN106162040A (en) * 2015-03-30 2016-11-23 北京视联动力国际信息技术有限公司 The method and apparatus that video conference accesses in many ways
CN205336429U (en) * 2016-01-11 2016-06-22 江苏省中医院 Hospital remote consultation and teaching system

Also Published As

Publication number Publication date
CN108965779A (en) 2018-12-07

Similar Documents

Publication Publication Date Title
CN108965779B (en) Audio and video stream transmission method, recording and broadcasting method, device and system
JP6845223B2 (en) Transport of coded audio data
JP6404912B2 (en) Live broadcasting system
WO2016150317A1 (en) Method, apparatus and system for synthesizing live video
CN111010614A (en) Method, device, server and medium for displaying live caption
CN102104762B (en) Media recording method, equipment and system of IMS (Internet Management Specification) video conference
US8745256B2 (en) Method and system for multimedia audio video transfer
EP2713566A1 (en) Sharing method, system, server and terminal device for personal content
CN104093067A (en) Device and method for sharing and playing audio and visual fragments in terminal
CN103327361B (en) Acquisition methods, the apparatus and system of real-time video communication playback data stream
US20170187986A1 (en) Live streaming media method, publish side live, server and terminal
WO2017107440A1 (en) Streaming media live broadcasting method, releasing terminal, client terminal and system
JP2014512716A (en) Remote control studio, camera system
WO2015064383A1 (en) Transmission device, transmission method, reception device, and reception method
CN110099242A (en) A kind of remote living broadcast method and device
Kim et al. Cloud‐based gaming service platform supporting multiple devices
CN106358050A (en) Android based audio and video streaming push method and device as well as Android based audio and video streaming playing method and device
EP2924985A1 (en) Low-bit-rate video conference system and method, sending end device, and receiving end device
CN108966024B (en) Audio and video stream transmission method, playback method, device and system
CN108337556B (en) Method and device for playing audio-video file
JP2019036969A (en) Live broadcast system
CN112019792A (en) Conference control method, conference control device, terminal equipment and storage medium
CN105191324A (en) Communication apparatus, communication data generation method, and communication data processing method
CN110113298B (en) Data transmission method, device, signaling server and computer readable medium
CN103648021B (en) The method that network video file is played from USB storage device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100000 Gehua Building 1103, No. 1 Qinglong Hutong, Dongcheng District, Beijing

Applicant after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 100000 Beijing city Dongcheng District Qinglong Hutong No. 1 Gehua building A1103-1113

Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant