CN113612734A

CN113612734A - Cross-network remote court trial media stream transmission method and device

Info

Publication number: CN113612734A
Application number: CN202110791789.7A
Authority: CN
Inventors: 钟威; 刘凯; 祝文明; 吴洋; 李振华
Original assignee: Gongdao Network Technology Co ltd
Current assignee: Gongdao Network Technology Co ltd
Priority date: 2021-07-13
Filing date: 2021-07-13
Publication date: 2021-11-05

Abstract

The application provides a method and a device for transmitting cross-network remote court trial media streams. The method comprises the following steps: receiving a first media stream which is sent by a first trial user terminal in a local network and accords with a first protocol; the network isolation device does not support transmission of a first media stream conforming to a first protocol; converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol supported by the network isolation device; and sending the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal. By adopting the method, special court trial equipment does not need to be additionally configured, the cost is reduced, and the resource utilization rate is improved.

Description

Cross-network remote court trial media stream transmission method and device

Technical Field

The application relates to the technical field of internet, in particular to a method and a device for transmitting cross-network remote court trial media streams.

Background

With the development of the technology, the court and the party can carry out online court trial in an online video mode, and compared with offline court trial, the court and the party are more convenient and efficient. When in court trial, a court and a party are generally required to transmit information through the internet, the court equipment is usually connected with an internal network, a lot of internal data which are inconvenient to disclose to the outside may be stored on the court equipment, and if the court equipment is connected with the internet, the safety hazard of internal data leakage exists.

In the related art, a court may be specially configured with an intranet-connected device and an extranet-connected device, wherein the intranet-connected device is used for processing internal services, and the extranet-connected device is used for online court trial. On the one hand, however, this method requires additional equipment and is costly; on the other hand, related data inside the court may be used in the court trial, and the data needs to be acquired from equipment connected with the intranet, so that the operation is inconvenient and the efficiency is low.

Disclosure of Invention

In view of the above, the present application provides a method and an apparatus for transmitting a cross-network remote court trial media stream. Specifically, the method is realized through the following technical scheme: a cross-network remote court trial media stream transmission method is provided with a court trial system in advance, wherein the court trial system comprises a court trial user terminal in a court intranet, a court trial user terminal in the Internet and network isolation equipment, and the court trial user terminal in the court intranet and the court trial user terminal in the Internet are in safe interaction through the network isolation equipment; the court trial user terminal in the court intranet and the court trial user terminal in the internet support the transceiving of a first media stream conforming to a first protocol; the court inner network is also preconfigured with a court trial server, and the Internet is also preconfigured with the court trial server; wherein, the court trial server in court intranet or internet all can regard as the sending end and/or the receiving end of court trial media stream, is applied to the sending end, includes:

receiving a first media stream which is sent by a first trial user terminal in a local network and accords with a first protocol; the network isolation device does not support transmission of a first media stream conforming to a first protocol;

converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol supported by the network isolation device;

and sending the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal.

A cross-network remote court trial media stream transmission method is provided with a court trial system in advance, wherein the court trial system comprises a court trial user terminal in a court intranet, a court trial user terminal in the Internet and network isolation equipment, and the court trial user terminal in the court intranet and the court trial user terminal in the Internet are in safe interaction through the network isolation equipment; the court trial user terminal in the court intranet and the court trial user terminal in the internet support the transceiving of a first media stream conforming to a first protocol; the court inner network is also preconfigured with a court trial server, and the Internet is also preconfigured with the court trial server; wherein, the court trial server in court intranet or internet all can regard as the sending end and/or the receiving end of court trial media stream, is applied to the receiving end, includes:

receiving a second media stream which is sent by the first trial user terminal based on the network isolation equipment and conforms to a second protocol; the network isolation equipment supports the transmission of a second media stream of a second protocol and does not support the transmission of a first media stream conforming to a first protocol;

converting the second media stream conforming to the second protocol into a first media stream conforming to the first protocol, which is supported and transmitted by a second court trial user terminal corresponding to the first court trial user terminal;

and sending the first media stream to a second court trial user terminal in the local network.

A transmission system of cross-network remote court trial media streams comprises a court trial user terminal and a court trial server in a court intranet, a court trial user terminal and a court trial server in the Internet and network isolation equipment; court trial servers in the court intranet or the internet can be used as a sending end and/or a receiving end of court trial media streams, and the court trial servers comprise:

a sending end receives a first media stream which is sent by a first trial user terminal in a local side network and accords with a first protocol; the network isolation device does not support transmission of a first media stream conforming to a first protocol;

the sending end converts the first media stream conforming to the first protocol into a second media stream conforming to a second protocol, which is supported and transmitted by the network isolation device;

the sending end sends the second media stream to the network isolation device;

the network isolation equipment sends the second media stream to a receiving end;

a receiving end receives a second media stream which is sent by the network isolation equipment and conforms to a second protocol;

and the receiving terminal equipment converts the second media stream into a first media stream conforming to a first protocol and sends the first media stream to a second court trial user terminal corresponding to the first court trial user terminal.

A device for transmitting a cross-web remote trial media stream, the device comprising:

the first receiving unit is used for receiving a first media stream which is sent by a first trial user terminal in a local network and accords with a first protocol; the network isolation device does not support transmission of a first media stream conforming to a first protocol;

the first conversion unit is used for converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol, which is supported and transmitted by the network isolation equipment;

and the first sending unit is used for sending the second media stream to the network isolation device so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal.

the second receiving unit is used for receiving a second media stream which is sent by the first trial user terminal based on the network isolation equipment and conforms to a second protocol; the network isolation equipment supports the transmission of a second media stream of a second protocol and does not support the transmission of a first media stream conforming to a first protocol;

the second conversion unit is used for converting the second media stream conforming to the second protocol into a first media stream conforming to the first protocol and transmitted by the second court trial user terminal corresponding to the first court trial user terminal;

and the second sending unit is used for sending the first media stream to a second court trial user terminal in the local network.

As can be seen from the above description, in one embodiment of the present application, a court trial system may be configured in advance, where the court trial system includes a court trial user terminal and a court trial server in a court intranet, a court trial user terminal and a court trial server in the internet, and a network isolation device, and the court intranet and the internet are isolated based on the network isolation device. The court trial servers in the court intranet and the internet can be used as a sending end and/or a receiving end of the court trial media stream. The sending end can receive a first media stream which is in accordance with a first protocol and sent by a first trial user terminal in a local network, convert the first media stream into a second media stream which is in accordance with a second protocol and is supported and transmitted by the network isolation device, and send the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end in an opposite network, and the receiving end device can convert the second media stream into the first media stream in accordance with the first protocol and send the first media stream to a second trial user terminal corresponding to the first trial user terminal.

By adopting the method, court trial servers can be respectively configured in a court intranet and the Internet, and conversion of media streams with different protocols is carried out through the court trial servers, so that the media streams can be transmitted between two networks based on network isolation equipment. For the court, equipment on the Internet does not need to be specially configured for online court trial, so that the cost can be saved, and the equipment resources can be fully utilized; and if the data in the court trial process needs to be used, the related data can be directly acquired through equipment for court trial without the need of acquiring the data across the network, so that the operation is convenient and fast. In addition, for the court trial user terminals, the media streams of the original supporting protocols are used for interaction, so that the method is low in invasiveness and high in safety.

Drawings

FIG. 1 is a schematic illustration of a court trial system shown in an exemplary embodiment of the present application;

FIG. 2 is a schematic flow chart diagram illustrating a method for cross-web remote trial media stream transmission according to an exemplary embodiment of the present application;

FIG. 3 is a schematic flow chart diagram illustrating another method for cross-web remote trial media stream transmission according to an exemplary embodiment of the present application;

FIG. 4 is a multi-party interaction diagram illustrating a court trial room creation and joining method according to an exemplary embodiment of the present application;

FIG. 5 is a schematic flow chart diagram illustrating another method for cross-web remote trial media stream transmission according to an exemplary embodiment of the present application;

fig. 6 is a hardware block diagram of an electronic device in which a cross-network remote court trial media stream transmission apparatus according to an exemplary embodiment of the present application is located;

FIG. 7 is a block diagram illustrating an apparatus for cross-web remote court trial media stream transmission in accordance with an exemplary embodiment of the present application;

fig. 8 is a block diagram illustrating another apparatus for transmitting a cross-web remote trial media stream according to an exemplary embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

The application provides a cross-network remote court trial media stream transmission method, which can realize on-line internet court trial by performing remote cross-network interaction on a court trial user terminal in a court intranet and a court trial user terminal in the court internet. Compared with the prior art, the court does not need to be specially configured with equipment on the Internet, and the cost can be saved. And if the data in the court needs to be used in the court trial process, the related data can be quickly found through equipment in the inner network of the court, so that the convenience is improved.

First, a description will be given of a scenario of a transmission method of a cross-network remote court trial media stream according to the present application.

Referring to fig. 1, fig. 1 is a schematic diagram of a court trial system according to an exemplary embodiment of the present application.

FIG. 1 illustratively depicts a court trial system comprising two networks: court intranet and internet. The court intranet can be, for example, a private government network, and the private government network is a non-confidential office network of an office organization, is isolated from an external network through a gatekeeper or a shutter, does not support common protocols such as HTTP, SMTP and FTP, and is basically not threatened by unsafe factors of the Internet.

The court internal network comprises two court trial user terminals which are respectively a court trial user terminal used by a court officer and a court trial user terminal used by a bookmarker. The Internet also comprises two court trial user terminals which are respectively a court trial user terminal used by the original report and a court trial user terminal used by the report. The trial user terminals in different networks can perform safe interaction through the network isolation equipment. The network isolation device may be, for example, a safety isolation optical gate, or may be another device, which is not limited in particular.

Of course, the court trial user terminals shown in fig. 1 are only exemplary, and in practical applications, the internet court trial may further include a conference family member, an original reporting agent, a reported agent, a witness, and the like, and these users may also use their own terminals to join the internet court trial. The court trial user terminal may be any device supporting media stream transmission, such as a PC (Personal Computer), a tablet Computer, and a mobile phone, which is not limited in particular.

In practical applications, a media streaming protocol supported by the network isolation device is usually different from a media streaming protocol supported by the user terminal, and if the transmission across the network is to be implemented, the media streaming needs to be protocol-converted. In the application, court trial servers can be configured in both a court intranet and the internet, and conversion of media stream protocols is realized based on the court trial servers. The court trial user terminal can send the media stream of the self supporting protocol to the court trial server, and the court trial server can convert the media stream into the media stream conforming to the network isolation device supporting protocol and send the media stream to the court trial server in the opposite side network based on the network isolation device. Correspondingly, after receiving the media stream, the court trial server in the opposite network can convert the media stream into a media stream of a protocol supported by the court trial user terminal equipment and send the media stream to the court trial user terminal. By adopting the method, the media stream can be transmitted between the two networks based on the network isolation equipment through the conversion of the protocol, and the court trial user terminal still uses the media stream which originally supports the protocol for interaction, so that the method has small invasiveness and high safety.

The following describes an embodiment of a method for transmitting a cross-network remote court trial media stream provided by the present application.

In this embodiment, a court trial system may be preconfigured, where the court trial system includes a court trial user terminal in a court intranet, a court trial user terminal in the internet, and a network isolation device, and the court trial user terminal in the court intranet and the court trial user terminal in the internet may perform secure interaction through the network isolation device. The court trial user terminal in the court intranet and the court trial user terminal in the internet support the transceiving of a first media stream conforming to a first protocol; the network isolation device supports transceiving of a second media stream that conforms to a second protocol. And the court inner network is pre-configured with a court trial server, the Internet is pre-configured with the court trial server, and media stream conversion of different protocols, pulling and sending of the media stream can be carried out through the court trial server. The court trial server in the court intranet and the court trial server in the internet can be used as a sending end and/or a receiving end of the court trial media stream. The court trial media stream may be video, voice, or a combination of video and voice, and is not limited in particular.

Referring to fig. 2, fig. 2 is a flowchart illustrating a method for transmitting a cross-network remote court trial media stream according to an exemplary embodiment of the present application. The method may be applied to a transmitting end of a court trial media stream. The sending end may be, for example, a court trial server in a court intranet in fig. 1, or a court trial server in the internet.

The method for transmitting the cross-network remote court trial media stream can comprise the following steps:

102, receiving a first media stream which is sent by a first trial user terminal in a local network and accords with a first protocol; the network isolated device does not support transmission of a first media stream conforming to a first protocol.

Step 104, converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol supported by the network isolation device.

And 106, sending the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal.

The above steps are explained in detail below.

In this embodiment, for example, the court trial user terminal in the court intranet sends the media stream to the internet court trial user terminal, the sending end is the court trial server in the court intranet, and the receiving end is the court trial server in the internet.

A court trial user terminal (a first court trial user terminal) in the court intranet may send a first media stream conforming to a first protocol to a court trial server in the local network, where the first protocol is a protocol supported by the court trial user terminal, for example, a protocol supporting a web browser for real-time voice conversation or video conversation.

After receiving the first media stream, a court trial server (sending end) in the court intranet may convert the first media stream into a second media stream of a second protocol supported by the network isolation device. Wherein the network isolated device does not support the first protocol and supports a second protocol, which is typically different, such as a real-time media streaming protocol. The media stream protocol conversion method will be described in detail in the following embodiments.

After the sending end converts the first media stream conforming to the first protocol into the second media stream conforming to the second protocol, the second media stream may be sent to the network isolation device, the network isolation device may send the second media stream to the receiving end in the opposite side network (i.e., a court trial server in the internet), and the receiving end may convert the second media stream into the first media stream conforming to the first protocol and send the first media stream to the second court trial user terminal corresponding to the first court trial user terminal (i.e., a court trial user terminal in the internet). The specific method will be described in detail in the examples below.

Of course, the above example is described by taking an example in which the court trial user terminal in the court intranet sends the court trial media stream to the court trial user terminal in the internet, in practical applications, the court trial user terminal in the internet may also send the court trial media stream to the court trial user terminal in the court intranet, and a specific flow is similar to the above method, and is not described again in this embodiment.

The following describes an embodiment of another cross-network remote court trial media stream transmission method provided by the present application.

In this embodiment, a description will be given by taking an example in which a court trial user terminal in a court intranet transmits a court trial media stream to a court trial user terminal in the internet.

In this embodiment, the first Protocol may be a webRTC (Web Real-Time Communication, originated from Web instant messaging) Protocol, and the second Protocol may be a RTSP (Real Time Streaming Protocol). Of course, in addition to the two protocols, other protocols may also be used, for example, the security isolation optical gate also supports a Session Initiation Protocol (SIP) Protocol, and the second Protocol may also be a SIP Protocol, which is not illustrated here.

Referring to fig. 3, fig. 3 is a flowchart illustrating another method for transmitting a cross-network remote court trial media stream according to an exemplary embodiment of the present application, where the method may be applied to a transmitting end of a court trial media stream, such as a court trial server in a court intranet. The method may comprise the steps of:

step 302, receiving a first media stream which is sent by a first trial user terminal in a local network and conforms to a first protocol; the network isolated device does not support transmission of a first media stream conforming to a first protocol.

In this embodiment, the first court trial user terminal may be loaded with a camera module, such as a camera, through which video may be captured during the court trial, and may also be loaded with a sound capture module, such as a microphone, through which audio may be captured, thereby obtaining a court trial media stream that includes video as well as audio. Of course, the camera module and the sound collection module may not be installed on the first trial user terminal, or may be independent other devices, which is not limited to this.

After acquiring the court trial media stream, the first court trial user terminal can convert the court trial media stream into a first media stream (webRTC stream) conforming to a first protocol (webRTC protocol), and sends the webRTC stream to the court trial server in the local-side network. The specific method for obtaining the webRTC stream can refer to the related art, and this embodiment is not particularly limited.

Step 304, extracting an original media stream from the first media stream.

In this embodiment, after receiving the webRTC stream, the court trial server may extract an original media stream, where the original media stream may be an RTP (Real-Time Transport Protocol) stream. For example, the court trial server may negotiate with the first court trial user terminal to obtain a key, and decrypt the webRTC stream with the key to obtain the RTP stream, which may specifically refer to related technologies, and this embodiment is not described here.

Step 306, constructing the original media stream as a second media stream based on a second protocol.

In this embodiment, the court trial server may perform interaction of the second protocol with the network isolation device, including negotiating a format of media stream transmission, determining communication addresses of both parties, and the like. For example, for the RTSP protocol, the interaction procedure includes OPTION, DESCRIBE, SET UP, PLAY, and the specific interaction method may refer to the related art. After the interaction is finished, the court trial server and the network isolation device can establish a media stream transmission link of a second protocol (RTSP protocol), and the RTP stream transmitted based on the link is the RTSP stream conforming to the RTSP protocol.

The network isolation device may be, for example, a security isolation optical gate, and the optical gate supports the RTSP protocol but does not support the webRTC protocol. Of course, the network isolation device may be other devices, and is not limited in particular.

Step 308, sending a second media stream acquisition notification to the receiving end, so that the receiving end establishes a media stream transmission link of a second protocol with the network isolation device after monitoring the second media stream acquisition notification.

In this embodiment, the court trial server belonging to the sending end may further send a second media stream acquisition notification to the court trial server belonging to the receiving end on the opposite side of the network. After receiving the notification, the receiving end may perform interaction of the second protocol with the network isolation device to establish a media streaming link of the second protocol.

Similarly, the receiving end can also perform RTSP interaction with the network isolation device, including OPTION, DESCRIBE, SET UP, PLAY, and after the interaction is completed, a media streaming link of the RTSP can be obtained.

Step 310, when receiving a link establishment message returned by the network isolation device, where the link establishment message is used to indicate that the network isolation device has established a media stream transmission link of the second protocol with the receiving end, and send the second media stream to the network isolation device, so that the network isolation device sends the second media stream to the receiving end based on the link.

In this embodiment, after the network isolation device and the receiving end have established the media stream transmission link of the second protocol, the network isolation device may return a link establishment message to the sending end, where the link establishment message is used to indicate that the network isolation device has established the media stream transmission link of the second protocol with the receiving end.

Of course, the receiving end may also send a link establishment message to the sending end, which is not limited in this embodiment.

After receiving the message, the sending end may send an RTP stream to the network isolation device based on an RTSP media stream transmission link between the sending end and the network isolation device, and since the RTP stream is transmitted in the RTSP media stream transmission link obtained by interaction after the sending end performs RTSP interaction with the network isolation device, the transmitted media stream may be considered as an RTSP stream. The network isolated device may then send the RTSP stream to the receiving end based on an RTSP media streaming link between itself and the receiving end.

After receiving the RTSP stream, the receiving end needs to transmit the media stream to a second court trial user terminal in the local network. Since the second trial user terminal supports the webRTC protocol but not the RTSP protocol, the receiving end needs to convert the RTSP stream into a webRTC stream.

The receiving end can extract the original media stream, i.e. the RTP stream, from it. And then, negotiating with a second court trial user terminal to obtain a key, and encrypting the RTP stream by using the key to obtain the webRTC stream, wherein the specific method can refer to the related technology. The webRTC stream is then sent to a second trial user terminal.

As can be seen from the above description, in one embodiment of the present application, the court trial servers may be configured separately in the court intranet and the internet, and the conversion of the media streams of different protocols may be performed by the court trial servers, so that the media streams may be transmitted between the two networks based on the network isolation device. For the court, equipment on the Internet does not need to be specially configured for online court trial, so that the cost can be saved, and the equipment resources can be fully utilized; and if the data in the court trial process needs to be used, the related data can be directly acquired through equipment for court trial without the need of acquiring the data across the network, so that the operation is convenient and fast. In addition, for the court trial user terminals, the media streams of the original supporting protocols are used for interaction, so that the method is low in invasiveness and high in safety.

In this embodiment, the court may first determine the people participating in the internet court trial, such as the court, the bookmaker, the original, the agent of the original, the announcements, the agent of the announcements, etc., and then create rooms on the business system before the court trial begins and notify these people to join the rooms for the internet court trial.

For example, a court officer may first log into a business system (which may be used to create at least a court trial room, although other court-related functions may be included without specific limitation), send a room creation request to the business system, and may carry in the request the persons to participate in the court trial, such as court officer a and party B, the business system may generate a room based on the request, including generating a room number (e.g., 001), and generating a court trial code for each of the participants in the court trial (e.g., the court trial code for court officer a is aaa and the court trial code for party B is bbb), and may store a mapping relationship between the room number and the court trial code. The business system may distribute the court trial code to each of the trial participants.

In the process of joining the court trial of each participant, taking the judge a as an example, assuming that the judge a has logged in the business system, the judge a may send a request for joining the court trial to the business system, and carry the court trial code aaa of the judge a in the request. The service system can find the corresponding room number 001 according to the court trial code and determine that the judge A joins the court trial. Similarly, taking the party B as an example, the party B may log in the service system first, and send a request for joining in the court trial to the service system, where the request carries the court trial code bbb of the party B, and the service system may find the corresponding room number 001 according to the court trial code and determine that the party B has joined in the court trial.

The business system may also interface with the court trial server and provide the court trial server with a message that each participant joined the room and the corresponding room number, such that the court trial media stream corresponding to each participant is forwarded to the corresponding other participants based on the court trial server, as will be described in detail below. The physical carrier of the business system may be a court trial server, or may be another server, which is not limited in particular.

The process of court trial media stream interaction among the participants is described below. In this embodiment, a description will be given by taking an example in which a first court trial user terminal transmits a court trial media stream thereof to a second court trial user terminal.

In this embodiment, the court trial server may include a webRTC server module, an RTP distribution module, and an RTSP module, and the RTSP module may include an RTSP server sub-module and an RTSP client sub-module. The webRTC server module is used for interacting with the court trial user terminal and receiving webRTC streams sent by the court trial user terminal and sending the webRTC streams to the court trial user terminal. The RTP distribution module is used for converting the webRTP stream into an RTP stream and distributing the RTP stream so as to determine a court trial room to which the RTP stream belongs and determine that the RTP stream needs to be distributed to other court trial user terminals in the court trial room. The RTSP server sub-module is configured to notify the court trial server in the opposite-side network to pull the court trial media stream, and send the RTSP stream to the court trial server in the opposite-side network, and the RTSP client sub-module is configured to receive the RTSP stream generated by the court trial user terminal in the local-side network, which will be described in detail in the following embodiments.

Referring to fig. 4, fig. 4 is a multi-party interaction diagram illustrating a court trial room creation and joining method according to an exemplary embodiment of the present application. The method comprises the following steps:

step 402, the first court trial user terminal joins a court trial room.

In this embodiment, for example, the first court trial user terminal is a terminal used by the judge a in the above example, the first court trial user may send a request for joining a court trial to the service system, and the request carries its own court trial code, and the service system may find the corresponding room number based on the court trial code. And the service system can also be connected with the first court trial server and send the room number and the identifier of the first court trial user terminal to the court trial server, for example, to an RTP distribution module in the court trial server. The RTP distribution module in the court trial server may determine that the first court trial user terminal joined the court trial room.

Similarly, other court trial user terminals may also join the court trial room by the method described above. For example, in step 424 of this embodiment, a second court trial user terminal (e.g., the terminal used by party B in the above example) may also join the court trial room by the above method, and the first court trial user terminal and the second court trial user terminal are in the same court trial room.

After any court trial user terminal joins a court trial room, the business system can send a notice to other non-joined court trial user terminals belonging to the room to notify the joining of the court trial room.

After a new court trial user terminal joins the court trial room, the court trial server can also inform the existing court trial user terminal in the room that the new court trial user terminal joins so that the existing court trial user terminal requests to acquire a court trial media stream of the new court trial user terminal.

And step 404, the first court trial user terminal and the first court trial server perform webRTC interaction.

Step 406, the first court trial user terminal sends the webRTC stream to the first court trial server.

In this embodiment, the first court trial user terminal may interact with the first court trial server, for example, interact with a webRTC server module in the first court trial server.

Specifically, the first trial user terminal and the webRTC server module may exchange SDP, negotiate codecs of each other, perform handshake between ICE and DTLS, and establish a media stream transmission link of the webRTC. The specific interaction method may refer to related technologies, and this embodiment is not described here. After the interaction is finished, the first court trial user terminal can send the webRTC stream to the webRTC server module in the first court trial server.

Step 408, the first court trial server obtains the RTP stream.

In this embodiment, after the webRTC server module in the first court trial server receives the webRTC stream, the RTP stream may be obtained by decryption. Specifically, the decryption may be performed by using a secret key obtained by the webRTC server module and the first trial user terminal in the webRTC interaction process, which may specifically refer to related technologies.

After the webRTC server module obtains the RTP stream, it may send it to the RTP distribution module. The RTP distribution module can determine a court trial session to which the first court trial user terminal belongs and subsequently send the court trial media stream to other court trial user terminals in the court trial session.

The court trial session may comprise a court trial user terminal in the local network and may also comprise a court trial user terminal in the opposite network.

For the court trial user terminal in the local network, the RTP distribution module may send the RTP stream to the webRTC server module, so that the webRTC server module re-encrypts the RTP stream to obtain a webRTC stream, and sends the webRTC stream to the court trial user terminal in the local network.

For a trial user terminal within the contralateral network, the trial media stream may be transmitted to the trial user terminal by the following steps.

And step 410, the first trial server and the network isolation device perform RTSP interaction.

In step 412, the first court trial server sends an RTSP stream acquisition notification to the second court trial server.

And step 414, the second court trial server and the network isolation device perform RTSP interaction.

In this embodiment, on one hand, the RTSP server sub-module in the first court trial server may perform RTSP interaction with the network isolation device, where the RTSP interaction includes OPTION, DESCRIBE, SET UP, and PLAY, and after the interaction is completed, a media streaming link of the RTSP may be obtained. The specific interaction method can refer to the related art.

On the other hand, the RTSP server sub-module in the first court trial server may also send an RTSP stream acquisition notification to the RTSP client sub-module in the second court trial server. The RTSP client sub-module in the second court trial server may send a second media stream acquisition request to the RTSP server sub-module in the first court trial server in response to the second media stream acquisition notification, where the request carries verification information, such as a stream pull address, and the address may include information such as a room number to which the second court trial user terminal belongs, an identifier of the requested first court trial user terminal, and the like. After receiving the second media stream acquisition request, the RTSP server sub-module in the first court trial server may verify the verification information carried in the request, for example, whether the room number in the pull stream address is the established room number, and whether the identifier of the first court trial user terminal belongs to the room number. If the verification is passed, the RTSP server sub-module in the first court trial server can send the RTSP stream to the RTSP client sub-module in the second court trial server in the subsequent process; if not, the RTSP stream may not be sent.

If the verification is passed, the RTSP server sub-module in the first court trial server may return a message to the RTSP server sub-module in the second court trial server, so that the RTSP client sub-module in the second court trial server performs RTSP interaction with the network isolation device to establish an RTSP media streaming link, and subsequently, an RTSP stream may be received based on the link.

It should be noted that, although the step 414 is after the step 412 in the embodiment, in practical applications, the step 414 may be before the step 412, or the two steps may also be executed in parallel, which is not limited in this respect.

At step 416, the network isolation device sends a link setup message to the first trial server.

Step 418, the first court trial server sends the RTSP stream to the network isolation device.

Step 420, the network isolation device sends the RTSP stream to the second court trial server.

In this embodiment, after the network isolation device and the RTSP client sub-module in the second court trial server successfully establish the media streaming link of the RTSP, the network isolation device may send a link establishment message to the RTSP server sub-module in the first court trial server. After receiving the link establishment message, the RTSP server sub-module in the first court trial server may send an RTSP stream to the network isolation device, and the network isolation device may send the RTSP stream to the RTSP client sub-module in the second court trial server.

Step 422, the second court trial server obtains the RTP stream.

The RTSP client sub-module in the second court trial server may send the RTSP stream to the RTP distribution module. The RTP distribution module may derive the RTP stream based on the RTSP stream. And determining a court trial room to which the RTP stream belongs, and determining that the RTP stream needs to be distributed to court trial user terminals in the court trial room in the local network.

At step 424, the second court trial user terminal joins the court trial room.

The method for joining the second court trial user terminal to the court trial room is described in reference to the foregoing description, and will not be repeated herein.

And 426, the second court trial server and the second court trial user terminal perform webRTC interaction.

At step 428, the second trial server sends the webRTC stream to the second trial user terminal.

In this embodiment, the webRTC client module in the second court trial server may perform webRTC interaction with the second court trial user terminal, including exchanging SDP, negotiating codecs of each other, performing handshake between ICE and DTLS, and establishing a media stream transmission link of the webRTC. The RTP stream is then encrypted to obtain a webRTC stream, where the encryption uses a key negotiated in the webRTC interaction.

After the link is established, the webRTCclient module may send the webRTC stream to the second court trial server via the link.

As can be seen from the above description, in one embodiment of the present application, several modules may be provided in the court trial server, each for implementing a different function. The court trial rooms to which the received court trial media streams belong can be determined through the RTP distribution module, so that the court trial media streams are distributed to the corresponding rooms to be distributed to the corresponding court trial user terminals.

By adopting the method, the cross-network court trial media stream transmission can be realized, and for a court, equipment on the Internet does not need to be specially configured for online court trial, so that the cost can be saved, and the equipment resources can be fully utilized; and if the data in the court trial process needs to be used, the related data can be directly acquired through equipment for court trial without the need of acquiring the data across the network, so that the operation is convenient and fast. In addition, for the court trial user terminals, the media streams of the original supporting protocols are used for interaction, so that the method is low in invasiveness and high in safety.

The application also provides another embodiment of a cross-network remote court trial media stream transmission method, which can be applied to a court trial server belonging to a court trial media stream receiving end.

Referring to fig. 5, fig. 5 is a flow chart illustrating another method for transmitting a cross-web remote court trial media stream according to an exemplary embodiment of the present application, the method including the steps of:

step 502, receiving a second media stream which is sent by the first trial user terminal based on the network isolation device and conforms to a second protocol; the network isolation equipment supports the transmission of a second media stream of a second protocol and does not support the transmission of a first media stream conforming to a first protocol;

step 504, converting the second media stream conforming to the second protocol into a first media stream conforming to the first protocol, which is supported and transmitted by a second court trial user terminal corresponding to the first court trial user terminal;

step 506, the first media stream is sent to a second court trial user terminal in the local network.

The specific implementation method of the above steps can refer to the foregoing embodiments, and details are not described herein.

Embodiments of another cross-network remote trial media stream transmission system are also provided. The system comprises a court trial user terminal and a court trial server which are positioned in a court intranet, a court trial user terminal and a court trial server which are positioned in the Internet and network isolation equipment; and the court trial server in the court intranet or the internet can be used as a sending end and/or a receiving end of the court trial media stream.

The method comprises the steps that a sending end receives a first media stream which is sent by a first trial user terminal in a local network and accords with a first protocol; the network isolation device does not support transmission of a first media stream conforming to a first protocol;

the sending end sends the second media stream to the network isolation device;

The specific implementation method of each execution main body in the system may refer to the foregoing embodiments, and is not described herein again.

Corresponding to the embodiment of the method for transmitting the cross-network remote court trial media stream, the application also provides an embodiment of the device for transmitting the cross-network remote court trial media stream.

The embodiment of the transmission device for the cross-network remote court trial media stream can be applied to the electronic equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading, by a processor of the electronic device where the device is located, a corresponding computer program instruction in the nonvolatile memory into the memory for operation. From a hardware aspect, as shown in fig. 6, a hardware structure diagram of an electronic device in which a transmission apparatus for cross-network remote court hearing media streams is located in the present application is shown, except for the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 6, the electronic device in which the apparatus is located in the embodiment may also include other hardware according to an actual function of the electronic device, which is not described again.

Referring to fig. 7, fig. 7 is a block diagram illustrating a cross-web remote trial media stream transmission apparatus 700 according to an exemplary embodiment of the present application. The cross-network remote court trial media stream transmission apparatus 700 may be applied to the electronic device shown in fig. 6, and includes a first receiving unit 710, a first converting unit 720, and a first transmitting unit 730.

The first receiving unit 710 is configured to receive a first media stream that conforms to a first protocol and is sent by a first trial user terminal in a local network; the network isolation device does not support transmission of a first media stream conforming to a first protocol;

a first conversion unit 720, configured to convert the first media stream conforming to the first protocol into a second media stream conforming to a second protocol supported by the network isolated device;

a first sending unit 730, configured to send the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal.

Optionally, the first conversion unit 720 is specifically configured to:

extracting an original media stream from the first media stream;

constructing the original media stream into a second media stream based on a second protocol.

Optionally, the first sending unit 730 is specifically configured to:

sending a second media stream acquisition notification to a receiving end, so that the receiving end establishes a media stream transmission link of a second protocol with the network isolation device after monitoring the second media stream acquisition notification;

when receiving a link establishment message returned by the network isolation device, the link establishment message is used to indicate that the network isolation device has established a media stream transmission link of a second protocol with the receiving end, and send a second media stream to the network isolation device, so that the network isolation device sends the second media stream to the receiving end based on the link.

Optionally, the first protocol is a webrtc protocol, and the second protocol is an RTSP protocol or an SIP protocol.

Optionally, the user is a judge, bookkeeper, council member, grandfather agent, defendant agent, or witness.

Referring to fig. 8, fig. 8 is a block diagram illustrating another apparatus 800 for cross-web remote trial media stream transmission according to an exemplary embodiment of the present application. The cross-network remote court trial media stream transmission device 800 can be applied to the electronic equipment shown in fig. 6 and comprises a second receiving unit 810, a second converting unit 820 and a second sending unit 830.

The second receiving unit 810 is configured to receive a second media stream that conforms to a second protocol and is sent by the first trial user terminal based on the network isolation device; the network isolation equipment supports the transmission of a second media stream of a second protocol and does not support the transmission of a first media stream conforming to a first protocol;

a second converting unit 820, configured to convert the second media stream conforming to the second protocol into a first media stream conforming to the first protocol, where the first media stream is supported and transmitted by a second court trial user terminal corresponding to the first court trial user terminal;

a second sending unit 830, configured to send the first media stream to a second court trial user terminal in the local network.

Optionally, the second receiving unit 810 is specifically configured to:

receiving a second media stream acquisition notice sent by a sending end;

establishing a media stream transmission link of a second protocol with the network isolated device in response to the second media stream acquisition notification;

and receiving a second media stream which is sent by the network isolation equipment and conforms to a second protocol based on the link.

Optionally, the second conversion unit 820 is specifically configured to:

extracting an original media stream from the second media stream;

the original media stream is constructed as a first media stream based on a first protocol.

The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.

For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may take the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.

Corresponding to the embodiment of the method for transmitting the cross-network remote court trial media stream, the application also provides a device for transmitting the cross-network remote court trial media stream, which comprises the following steps: a processor and a memory for storing machine executable instructions. Wherein the processor and the memory are typically interconnected by means of an internal bus. In other possible implementations, the device may also include an external interface to enable communication with other devices or components.

In this embodiment, by reading and executing machine-executable instructions stored by the memory corresponding to the cross-web remote trial media stream transmission logic, the processor is caused to:

Optionally, when converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol supported by the network isolated device for transmission, the processor is caused to:

extracting an original media stream from the first media stream;

Optionally, when sending the second media stream to the network isolated device, the processor is caused to:

Optionally, upon receiving a second media stream conforming to a second protocol sent by the first trial user terminal based on the network isolated device, the processor is caused to:

receiving a second media stream acquisition notice sent by a sending end;

Optionally, when converting the second media stream conforming to the second protocol to a first media stream conforming to the first protocol for transmission supported by a second court trial user terminal corresponding to the first court trial user terminal, the processor is caused to:

extracting an original media stream from the second media stream;

In correspondence with the foregoing embodiments of the method for transmitting a cross-web remote court trial media stream, the present application further provides a computer-readable storage medium having a computer program stored thereon, which when executed by a processor, implements the steps of:

Optionally, the converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol, where the second media stream conforms to the second protocol and is supported by the network isolation device, includes:

extracting an original media stream from the first media stream;

Optionally, the sending the second media stream to the network isolated device includes:

Optionally, the receiving a second media stream that conforms to a second protocol and is sent by the first trial user terminal based on the network isolation device includes:

receiving a second media stream acquisition notice sent by a sending end;

Optionally, the converting the second media stream conforming to the second protocol into a first media stream conforming to the first protocol and supported by a second court trial user terminal corresponding to the first court trial user terminal includes:

extracting an original media stream from the second media stream;

The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims

1. A transmission method of cross-network remote court trial media streams is characterized in that a court trial system is configured in advance, the court trial system comprises a court trial user terminal in a court intranet, a court trial user terminal in the Internet and network isolation equipment, and the court trial user terminal in the court intranet and the court trial user terminal in the Internet are in safe interaction through the network isolation equipment; the court trial user terminal in the court intranet and the court trial user terminal in the internet support the transceiving of a first media stream conforming to a first protocol; the court inner network is also preconfigured with a court trial server, and the Internet is also preconfigured with the court trial server; the court trial server in the court intranet or the internet can be used as a sending end and/or a receiving end of the court trial media stream, the method is applied to the sending end, and the method comprises the following steps:

2. The method of claim 1, wherein converting the first media stream conforming to the first protocol into a second media stream conforming to a second protocol for transmission supported by the network isolated device comprises:

extracting an original media stream from the first media stream;

3. The method of claim 1, wherein sending the second media stream to the network isolated device comprises:

4. The method of claim 1, wherein the first protocol is a webrtc protocol and the second protocol is an RTSP protocol or an SIP protocol.

5. The method of claim 1,

the user is a judge, bookkeeper, council member, plaintiff agent, defendant agent, or witness.

6. A transmission method of cross-network remote court trial media streams is characterized in that a court trial system is configured in advance, the court trial system comprises a court trial user terminal in a court intranet, a court trial user terminal in the Internet and network isolation equipment, and the court trial user terminal in the court intranet and the court trial user terminal in the Internet are in safe interaction through the network isolation equipment; the court trial user terminal in the court intranet and the court trial user terminal in the internet support the transceiving of a first media stream conforming to a first protocol; the court inner network is also preconfigured with a court trial server, and the Internet is also preconfigured with the court trial server; the court trial server in the court intranet or the internet can be used as a sending end and/or a receiving end of the court trial media stream, the method is applied to the receiving end, and the method comprises the following steps:

7. The method of claim 6, wherein receiving the second media stream according to the second protocol sent by the first trial user terminal based on the network isolated device comprises:

receiving a second media stream acquisition notice sent by a sending end;

8. The method of claim 6, wherein converting the second media stream compliant with the second protocol to the first media stream compliant with the first protocol for transmission supported by a second trial user terminal corresponding to the first trial user terminal comprises:

extracting an original media stream from the second media stream;

9. A transmission system of cross-network remote court trial media streams is characterized by comprising a court trial user terminal and a court trial server which are positioned in a court intranet, a court trial user terminal and a court trial server which are positioned in the Internet and network isolation equipment; court trial servers in the court intranet or the internet can be used as a sending end and/or a receiving end of court trial media streams, and the court trial servers comprise:

the sending end sends the second media stream to the network isolation device;

10. A device for transmitting a cross-web remote court trial media stream, the device comprising:

a first conversion unit, configured to convert the first media stream conforming to the first protocol into a second media stream conforming to a second protocol, which is supported and transmitted by the network isolation device;

and the first sending unit is used for sending the second media stream to the network isolation device, so that the network isolation device sends the second media stream to a receiving end, so that the receiving end device converts the second media stream into a first media stream conforming to a first protocol, and sends the first media stream to a second trial user terminal corresponding to the first trial user terminal.

11. A device for transmitting a cross-web remote court trial media stream, the device comprising:

the second conversion unit is used for converting the second media stream conforming to the second protocol into a first media stream conforming to the first protocol and transmitted by a second court trial user terminal corresponding to the first court trial user terminal;

12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.

13. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1-8 are implemented when the program is executed by the processor.