CN112653925B

CN112653925B - Cross-device transfer method, system, device and storage medium for media playing

Info

Publication number: CN112653925B
Application number: CN202011523552.2A
Authority: CN
Inventors: 谢志钢; 韦国华; 胡小鹏; 顾振华
Original assignee: Suzhou Keda Special Video Co ltd; Suzhou Keda Technology Co Ltd
Current assignee: Suzhou Keda Special Video Co ltd; Suzhou Keda Technology Co Ltd
Priority date: 2020-12-21
Filing date: 2020-12-21
Publication date: 2023-03-24
Anticipated expiration: 2040-12-21
Also published as: CN112653925A

Abstract

The invention provides a cross-device transfer method, a system, a device and a storage medium for media playing, wherein the method comprises the following steps: a transfer valve receives a receiving request sent by transfer receiving equipment, wherein the transfer valve is configured to establish a first media transmission channel for media data transmission with transfer initiating equipment; the transfer valve initiates the establishment of a second media transmission channel with the transfer receiving device; the transfer valve receives an authorization request sent by transfer initiating equipment; and the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel. By adopting the invention, a transfer valve is arranged at the downstream of the media source, the transfer valve acts as a channel keeper of the media stream in the cross-equipment transfer process of the real-time media stream, and the cross-equipment transfer of the real-time media stream can be realized by realizing the channel switching service of the media data through the transfer valve.

Description

Cross-device transfer method, system, device and storage medium for media playing

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a method, a system, a device, and a storage medium for transferring media playing across devices.

Background

Most of the current intelligent 3C devices construct a rich media content sharing application based on AirPlay, dlna, miracast and other protocols, for example, the same-screen interaction between the intelligent mobile devices, such as sharing of pictures, videos, music and data files, and also such as television screen projection of on-demand programs.

The miracast Protocol established by the Wi-Fi alliance enables the receiving device to share Real-Time media content in the transmitting device at the receiving device end after discovering the receiving device at the transmitting device end through the Wi-Fi direct network and establishing Real Time Streaming Protocol (RTSP) Real-Time media stream from the transmitting device to the receiving device. Miracast or similar on-screen sharing techniques require the transmitting device to undertake the distribution of the media stream during the whole sharing process, so that the media stream cannot be separated from the media sharing behavior, otherwise, the sharing behavior is immediately finished.

The apple inc media sharing scheme, airPlay, allows users to share media files between apple devices or AirPlay-enabled devices authorized by apple inc. AirPlay discovers devices based on mDNS protocol, the services provided by devices are described in DNS-SD protocol, and the upper layer is proprietary protocol of apple inc. However, media file sharing by AirPlay is limited to HTTP (HyperText Transfer Protocol) Protocol.

Dlna is a media file sharing technology protocol often used by content providers to deliver video content to users. The media file played on one device (such as a smart phone) can be put to another device (such as a smart television) to be played through dlna instead. However, dlna's media file delivery or sharing is limited to the HTTP protocol.

The playing behavior of the Real-time media stream is different from that of the playing media file, the Real-time media stream (such as an RTP (Real-time Transport Protocol) data stream) is generated in Real time and changes in Real time along with the time lapse, the Real-time media stream playing is instant, cannot be played back, does not have the phenomenon that the playing is jumped at a selected time point, and cannot be interrupted randomly in the playing process. The existing various media sharing applications use media files as sharing objects to reproduce on different devices, and the requirement of cross-device transfer of the real-time media stream being played cannot be met.

Disclosure of Invention

The present invention provides a method, a system, a device and a storage medium for cross-device transfer of media playing, which can realize cross-device transfer of real-time media streams by implementing channel switching service of media data through a transfer valve.

The embodiment of the invention provides a cross-device transfer method for media playing, which comprises the following steps:

a transfer valve receives a receiving request sent by transfer receiving equipment, wherein the transfer valve is configured to establish a first media transmission channel for media data transmission with transfer initiating equipment;

the transfer valve initiates the establishment of a second media transmission channel with the transfer receiving device;

the transfer valve receives an authorization request sent by transfer initiating equipment;

and the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel.

In some embodiments, before the transfer valve receives the receiving request sent by the transfer receiving device, the method further includes the following steps:

the transfer initiating device and the transfer receiving device establish a signaling negotiation channel;

the transfer initiating device sends a transfer request to the transfer receiving device through the signaling negotiation channel, wherein the transfer request comprises a transfer valve address;

and when the transfer receiving equipment selects to receive the transfer request, initiating a receiving request to the corresponding transfer valve according to the address of the transfer valve in the transfer request.

In some embodiments, after the transfer valve initiates the establishment of the second media transmission channel with the transfer receiving device, the method further comprises the following steps:

the transfer receiving device sends a receiving response to the transfer initiating device;

and after receiving the receiving response, the transfer initiating device cuts off a signaling negotiation channel with the transfer receiving device and sends an authorization request to the transfer valve.

In some embodiments, the authorization request includes a play delay time of a second media transmission channel of the transfer receiving device;

the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel, and the method comprises the following steps:

after receiving the authorization request, the transfer valve sends media data of the media source to the first media transmission channel and the second media transmission channel simultaneously, and starts timing;

and when the timing of the transfer valve reaches the playing delay time, the transfer valve cuts off the first media transmission channel and only continues to send the media data of the media source to the second media transmission channel.

In some embodiments, the method further includes the steps of the diversion valve initiating establishment of a second media transmission channel with the diversion receiving device and the diversion valve sending media data of a media source to the diversion receiving device through the second media transmission channel, and further including:

the transfer valve sends a test media stream to the transfer receiving equipment through the second media channel;

the transfer receiving equipment plays the test media stream after receiving the test media stream, and evaluates the play delay time of the second media channel according to the play action;

the transfer receiving device sends a reception response including the play delay time to the transfer initiating device, and the transfer receiving device sends an authorization request including the play delay time to the transfer valve.

In some embodiments, before the transfer valve initiates establishment of the second media transmission channel with the transfer recipient device, the method further comprises: establishing a second signaling transmission channel between a source agent in the transfer valve and a device agent of the transfer receiving device through an agent service module, wherein the agent service module is arranged inside or outside the transfer valve;

the transfer valve shutting off the first media transport path comprises: and cutting off a first signaling transmission channel and the first media transmission channel which are established between a source agent in the transfer valve and a device agent of the transfer initiating device through an agent service module.

By adopting the cross-equipment transfer method for media playing, a transfer valve is arranged at the downstream of a media source, the channel switching service of media data is realized through the transfer valve, the cross-equipment transfer of the real-time media stream can be realized, and the transfer valve is used as a channel keeper of the media stream in the cross-equipment transfer process of the real-time media stream, so that the transfer initiating equipment is completely released after the playing transfer operation is completed, and the playing behavior of the real-time media stream cannot be interrupted. The cross-device transfer method can be applied to the cross-device transfer during the real-time media stream playing and the cross-device transfer during the media file playing, and can also ensure the continuity and the fluency during the cross-device transfer playing of the media files.

The embodiment of the present invention further provides a system for transferring media playing across devices, which is applied to the method for transferring media playing across devices, the system includes a transfer valve, the transfer valve includes a transfer valve receiving end, a first sending end, a second sending end and a source agent, wherein:

the transfer valve receiving end is configured to receive media data from a media source;

the first sending terminal is configured to establish a first media transmission channel for media data transmission with a transfer initiating device, and send the media data to the transfer initiating device through the first media transmission channel;

the source agent is configured to instruct the second sending end to prepare for establishing a second media transmission channel when receiving a receiving request sent by a transfer receiving device, send a request response to the transfer receiving device, and receive an authorization request sent by a transfer initiating device;

the second sending end is configured to establish a second media transmission channel with the transfer receiving device, and send the media data to the transfer receiving device through the second media transmission channel after the source agent receives the authorization request.

In some embodiments, the system further comprises a transfer initiating device, where the transfer initiating device includes a first device agent, a first device receiving end, a first signaling negotiation end, and a first playing end; wherein:

the first device agent is configured to send a receiving request to the source agent, and after receiving a request response of the source agent, instruct the first device receiving end to establish a first media transmission channel with the first sending end of the transfer valve;

the first device receiving end is configured to receive media data through the first media transmission channel, and the first playing end is configured to play the received media data;

the first signaling negotiation end is used for establishing a signaling negotiation channel with the transfer receiving equipment, sending a transfer request to the transfer receiving equipment through the signaling negotiation channel, and judging whether to close the signaling negotiation channel when receiving response information of the transfer receiving equipment.

In some embodiments, the system further comprises a transfer receiving device, where the transfer receiving device includes a second device agent, a second device receiving end, a second signaling negotiation end, and a second playing end;

the second signaling negotiation end is used for establishing a signaling negotiation channel with the first signaling negotiation end and sending response information to the transfer receiving equipment when receiving the transfer request;

the second device agent is configured to send a receiving request to the source agent, and after receiving a request response of the source agent, instruct the second device receiving end to establish a second media transmission channel with the second sending end of the transfer valve;

the second device receiving end is configured to receive the media data through the second media transmission channel, and the second playing end is configured to play the received media data.

By adopting the cross-device transfer system for media playing, a transfer valve is arranged at the downstream of a media source, and the channel switching service of media data is realized through the transfer valve, so that the cross-device transfer of the real-time media stream can be realized. The cross-device transfer method can be applied to the cross-device transfer during the real-time media stream playing and the cross-device transfer during the media file playing, and can also ensure the continuity and the fluency during the cross-device transfer playing of the media files.

An embodiment of the present invention further provides a cross-device transfer device for media playing, including:

a processor;

a memory having stored therein executable instructions of the processor;

wherein the processor is configured to perform the steps of the cross-device transfer method of media playback via execution of the executable instructions.

By adopting the cross-device transfer equipment for media playing provided by the invention, the processor executes the cross-device transfer method for media playing when executing the executable instruction, thereby obtaining the beneficial effect of the cross-device transfer method for media playing.

The embodiment of the invention also provides a computer-readable storage medium for storing a program, and the program realizes the steps of the cross-device transfer method for media playing when being executed by a processor.

By adopting the computer readable storage medium provided by the invention, the stored program realizes the steps of the cross-device transfer method of the media playing when being executed, thereby obtaining the beneficial effects of the cross-device transfer method of the media playing.

Drawings

Other features, objects and advantages of the present invention will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, with reference to the accompanying drawings.

FIG. 1 is a flow chart of a cross-device transfer method of media playing according to an embodiment of the present invention;

FIG. 2 is a schematic diagram illustrating an implementation process of a cross-device transfer method for media playing according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a transfer valve of a media playing cross-device transfer system according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a cross-device transfer system for media playback according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a cross-device transfer system for media playback according to another embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a cross-device transfer device for media playing according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of a computer storage medium according to an embodiment of the present invention.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their repetitive description will be omitted.

As shown in fig. 1, in an embodiment, the present invention provides a cross-device transfer method for media playing, including the following steps:

s100: a transfer valve receives a receiving request sent by transfer receiving equipment, wherein the transfer valve is configured to establish a first media transmission channel for media data transmission with transfer initiating equipment;

s200: the transfer valve initiates the establishment of a second media transmission channel with the transfer receiving device;

s300: the transfer valve receives an authorization request sent by transfer initiating equipment;

s400: and the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel.

By adopting the cross-device transfer method of media playing of the invention, a transfer valve is arranged at the downstream of a media source, when a receiving request of a transfer receiving device is received by the transfer valve in the step S100, a second media transmission channel is established between the transfer valve and the transfer receiving device in the step S200, and after an authorization request sent by a transfer initiating device is received by the transfer valve in the step S300, media data is sent to the transfer receiving device in the step S400, thereby realizing channel switching service of the media data and realizing cross-device transfer of real-time media stream. The transfer valve acts as a channel keeper of the media stream in the cross-device transfer process of the real-time media stream, so that the transfer initiating device is completely released after the playing transfer operation is completed, and the playing behavior of the real-time media stream cannot be interrupted. The cross-device transfer method can be applied to the cross-device transfer during the real-time media stream playing and the cross-device transfer during the media file playing, and can also ensure the continuity and the fluency during the cross-device transfer playing of the media files.

The cross-device transfer method according to this embodiment will be described in detail below with reference to fig. 2. This embodiment takes as an example that the transfer initiating device is a transfer initiating play slot a and the transfer receiving device is a transfer receiving play slot B. Each node of the cross-device transfer method in this embodiment is a media source, a transfer valve, a transfer initiating play slot a (hereinafter referred to as a play slot a), and a transfer receiving play slot B (hereinafter referred to as a play slot B), where a dotted line connection between nodes represents a signaling channel, and a solid line connection between nodes represents a media transmission channel, which is a media transmission channel in this embodiment. The media stream in the media transmission channel is sent from the media source, passes through the diversion valve node and flows towards the direction which takes the play slot as the purpose. The playing slot a serves as an initiator of the transfer operation of the playing behavior of the media stream, and the playing slot B serves as a receiver of the transfer operation of the playing behavior of the media stream.

The first media transport channel and the first signalling transport channel 1 of the real-time media stream have been established with the transfer valve before the play slot a initiates the play transfer operation and are in the play state of the real-time media stream. At this time, no signaling negotiation channel 2 is established between the playing slot a and the playing slot B, and a second media transmission channel and a second signaling transmission channel 3 of the real-time media stream are also not established between the playing slot B and the transfer valve. But slot B is ready and in a service state listening to receive transfer requests, or a standby state with low power consumption.

The cross-device transfer method in this embodiment mainly includes a negotiation stage, a reception stage, and an authorization stage. Steps S100 and S200 correspond to a receiving phase, and steps S300 and S400 correspond to an authorization phase. Therefore, before step S100, a negotiation phase is also included. In the negotiation phase, i.e. before the step S100, the following steps are also included:

the transfer initiating device initiates a transfer request to the transfer receiving device through the signaling negotiation channel;

the transferred receiving equipment responds to the transfer request;

and when receiving the response information of the transfer receiving equipment, the transfer initiating equipment judges whether to close the signaling negotiation channel.

Specifically, in this embodiment, the negotiation stage includes:

when the playing slot A initiates the playing transfer operation to the playing slot B, a signaling negotiation channel 2 is established with the playing slot A. If the playing slot B is still in the standby state, the playing slot B is waken up by the playing slot A to enter the service state of intercepting and receiving the transfer request, and then the signaling negotiation channel 2 is tried to be established with the playing slot B.

The playing slot a makes the description information of the real-time flowing media stream in the playing first media transmission channel into a transfer request, and sends the transfer request to the playing slot B through the signaling negotiation channel 2 to inquire whether the real-time media stream can be received in the current state.

When receiving the transfer request, the play slot B may choose to send to the play slot a: refusing, receiving, busy, etc.

When the play slot B selects to reject the response, the signaling negotiation channel 2 is cut off together. (thereafter allowing to re-enter a service state listening to receive the transfer request, or a standby state).

When the response such as busy is selected, the play slot B keeps the signaling negotiation channel 2, and sends out the signaling negotiation channel 2 to the play slot a again every unit cycle time (for example, 40 ms): refusal, accept, busy, etc. responses.

The playback slot B can only be conditioned to send a reception response to the playback slot a after the reception phase has been completed. When sending a reception response, the following conditions must be satisfied:

condition 1: the capability set of the own media processing has been checked according to the media specification described in the transfer request, confirming the capability of processing;

condition 2: the second media transport channel has been created, the media stream is played, and the playback delay is evaluated.

A reject response must be made when condition 1 is not met.

When the condition 2 is not satisfied, a response such as busy or a rejection response may be made.

The play slot B must periodically respond to the transfer request, such as busy, before it can respond to the transfer request or receive the response.

The receiving stage corresponds to the above-described step S100 and step S200. Specifically, the step S200 includes: and when the transfer receiving equipment selects to receive the transfer request, initiating a receiving request to the corresponding transfer valve according to the transfer request. The authorization phase corresponds to steps S300 and S400 described above.

In this embodiment, the step S200: before the transfer valve initiates establishment of a second media transmission channel with the transfer receiving device, the method further includes: and establishing a second signaling transmission channel between a source agent in the transfer valve and a device agent of the transfer receiving device through an agent service module, wherein the agent service module is arranged inside or outside the transfer valve.

In the receiving phase, the step S200: after the transfer valve initiates the establishment of a second media transmission channel with the transfer receiving device, the method further comprises the following steps:

and after receiving the receiving response, the transfer initiating device cuts off a signaling negotiation channel with the transfer receiving device.

In an authorization phase, the transfer initiating device sends an authorization request to the transfer valve after receiving the receipt response. Preferably, the authorization request includes a play-out delay time of the second media transmission channel of the transfer receiving device. The step S400: the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel, and the method comprises the following steps:

Therefore, through the timing control of the transfer valve, when the transfer receiving equipment is in an unstable working state easily in the processes of awakening the transfer receiving equipment and newly establishing the media transmission channel and the playing channel, the media data is sent to the second media transmission channel and simultaneously sent to the first media transmission channel, and the transfer authorization is not completed until the transfer receiving equipment works stably, so that the effectiveness and the continuity of the transfer operation of the playing behavior are ensured, and the perfect connection of the media playing behavior at the moment of playing transfer and no loss phenomenon of media content are ensured.

The transfer valve shuts off the first media transport path, comprising: and cutting off a first signaling transmission channel and the first media transmission channel which are established between a source agent in the transfer valve and a device agent of the transfer initiating device through an agent service module.

In this embodiment, the step S200: after the transfer valve initiates the establishment of a second media transmission channel with the transfer receiving device, the method further comprises the following steps:

the transfer valve sends a test media stream to the transfer receiving device through the second media channel, where the test media stream may be a blank media stream, but the present invention is not limited thereto, and the test media stream may also be a pre-recorded media stream dedicated for testing, or a section of previously transmitted media stream data;

the transfer receiving device sends a receiving response to the transfer initiating device, wherein the receiving response comprises the playing delay time of the second media transmission channel;

and after receiving the receiving response, the transfer receiving equipment sends an authorization request to the transfer valve.

Therefore, the direct coupling between the media source and the playing equipment is isolated through the transfer valve, the playing behavior of the test media stream is established with the transfer receiving equipment in advance in the receiving stage, the unstable working state which is easily caused in the processes of awakening the receiving playing slot, newly establishing a playing media pipeline and the like in the process of transferring the original playing behavior between the two playing slots is allowed, the transfer authorization is completed after the stable working of the receiving playing slot is waited, and the effectiveness of the transferring operation of the playing behavior is ensured.

Specifically, in this embodiment, the receiving stage includes:

when the play slot B confirms that it can handle the transfer request, it sends a receiving request according to the address of the transfer valve in the request description, where the receiving request includes the description information of the media stream of the receiving request, and is used to request the transfer valve to establish a second media transmission channel and a second signaling transmission channel, where the second media transmission channel meets the real-time transmission of the media stream specification described in the transmitting and receiving request.

The transfer valve establishes a media transmission channel to play the slot B according to the receiving request of the slot B, and sends a blank media stream on the second media transmission channel according to the description in the receiving request in the second media transmission channel.

The playing slot B receives the blank video stream transmitted from the transfer valve on the second media transmission channel, and the playing action of the blank video stream is well done.

The playing slot B and the transfer valve together evaluate the playing delay time from the transfer valve to the playing slot B for playing the media stream according to the playing action of the blank media stream in the second media transmission channel.

The playing slot B combines the second media transmission channel with the playing delay time to make a receiving response, informs the playing slot A and cuts off the signaling negotiation channel.

Specifically, in this embodiment, the authorization phase includes:

after receiving the receiving response of the playing slot B, the playing slot A makes information such as the playing delay time of the first media transmission channel number, the second media transmission channel number and the like into an authorization request and submits the authorization request to the transfer valve.

After receiving the authorization request, the transfer valve sends a key frame application to the media source, feeds back that the authorization request is accepted by the play slot A, and then enters a key frame waiting state.

After the media source receives the key frame application, the key frames of all the media are compiled and sent to the transfer valve.

And after receiving the key frame, the transfer valve sends the media content to the first media transmission channel and the second media transmission channel simultaneously and starts timing.

When the transfer valve timer reaches the playing delay time, the authorization completion is fed back to the playing slot A, and then the first media transmission channel and the signaling transmission channel connected to the playing slot A are cut off.

When receiving the transmission channel, the playing slot a closes the media stream playing on the first media transmission channel. (Play slot A is thereafter allowed to enter a low power standby state.)

As shown in fig. 3, an embodiment of the present invention further provides a system for transferring media playing across devices, which is applied to the method for transferring media playing across devices, where the system includes a transfer valve, and the transfer valve includes a transfer valve receiving end M21, a first sending end M22, a second sending end M23, and a source agent M24, where:

the transfer valve receiving end M21 is configured to receive media data from the media source M1;

the first sending end M22 is configured to establish a first media transmission channel for media data transmission with a transfer initiating device, and send the media data to the transfer initiating device through the first media transmission channel;

the source agent M24 is configured to, when receiving a receiving request sent by a transfer receiving device, instruct the second sending end M23 to prepare for establishing a second media transmission channel, send a request response to the transfer receiving device, and receive an authorization request sent by a transfer initiating device;

the second sending end M23 is configured to establish a second media transmission channel with the transfer receiving apparatus, and send the media data to the transfer receiving apparatus through the second media transmission channel after the source agent receives the authorization request.

By adopting the cross-device transfer system for media playing, a transfer valve is arranged at the downstream of a media source, when a receiving request of a transfer receiving device is received through the source agent M24, a second media transmission channel is established between a second sending end M23 of the transfer valve and the transfer receiving device, and after an authorization request sent by the transfer initiating device is received through the source agent M24, the second sending end M23 sends media data to the transfer receiving device through the second media transmission channel, so that channel switching service of the media data is realized, and cross-device transfer of real-time media stream can be realized. The transfer valve acts as a channel keeper of the media stream in the cross-device transfer process of the real-time media stream, so that the transfer initiating device is completely released after the playing transfer operation is completed, and the playing behavior of the real-time media stream cannot be interrupted. The cross-device transfer system not only can be applied to cross-device transfer during real-time media stream playing, but also can be applied to cross-device transfer during media file playing, and can also guarantee the continuity and the fluency of the media file when the media file is transferred and played.

As shown in fig. 4, the cross-device transfer system further includes a transfer initiating device M3, where the transfer initiating device M3 includes a first device agent M31, a first device receiving end M32, a first signaling negotiation end M34, and a first playing end M33; wherein:

the first device agent M31 is configured to send a receiving request to the source agent, and after receiving a request response of the source agent, instruct the first device receiving end M32 to establish a first media transmission channel with the first sending end M22 of the transfer valve M2;

the first device receiving end M32 is configured to receive media data through the first media transmission channel, and the first playing end M33 is configured to play the received media data;

the first signaling negotiation end M34 is configured to establish a signaling negotiation channel with the transfer receiving device M3, send a transfer request to the transfer receiving device M3 through the signaling negotiation channel, and determine whether to close the signaling negotiation channel when receiving response information of the transfer receiving device M3.

As shown in fig. 4, in this embodiment, the cross-device transfer system further includes a transfer receiving device M3, where the transfer receiving device M3 includes a second device agent M41, a second device receiving end M42, a second signaling negotiation end, and a second playing end M43;

the second signaling negotiation end establishes a signaling negotiation channel with the first signaling negotiation end M34, and sends response information to the transfer receiving device M3 when receiving the transfer request;

the second device agent M41 is configured to send a receiving request to the source agent, and after receiving a request response of the source agent, instruct the second device receiving end M42 to establish a second media transmission channel with the second sending end M23 of the transfer valve M2;

the second device receiving end M42 is configured to receive the media data through the second media transmission channel, and the second playing end M43 is configured to play the received media data.

The following specifically describes a flow when the cross-device transfer system according to this embodiment is used to perform a cross-device transfer with reference to fig. 4.

The transfer valve M2 is composed of a transfer valve receiving end M21, a first sending end M22, a second sending end M23, a source agent M24, an agent service module M25, and a timer M26.

The media source M1 establishes a connection with the transfer valve receiving end M21 of the transfer valve M2 through the media transmission channel M51, and transmits media data, in this embodiment, a real-time media stream, to the transfer valve M2. Each of the media Transport channels M51, M52, and M53 may be established based on protocols such as RTP, SRTP (Secure Real-time Transport Protocol), DTLS-SRTP (data gram Transport Layer Security-Secure Real-time Transport Protocol, packet Security Layer Transport Protocol, and Secure Real-time Transport Protocol). In this embodiment, RTP/AVPF is selected, and when a real-time media stream is composed of an audio stream and a video stream, a UDP (User Datagram Protocol) based RTP connection and a TCP (Transmission Control Protocol) based RTCP connection are provided for the corresponding audio stream, and a UDP based RTP connection and a TCP based RTCP connection are also provided for the corresponding video stream.

The media source M1 immediately encodes a media key frame in response to the media key frame request from the switch receiving end M21 of the switch M2, and sends the encoded media key frame to the switch M2 over the media transmission channel M51. In this embodiment, according to the RTP/AVPF protocol, the transfer valve M2 may send a key frame request to the media source M1 by feeding back a feedback message such as SLI, PLI, FIR (key frame request, which is used to request the sender to regenerate and send a key frame when the key frame is lost and cannot be decoded) to the media source M1 on the media transmission channel M51, and the media source M1 immediately encodes the media key frame after obtaining the feedback and refreshes the real-time media stream on the media transmission channel M51.

The transfer initiating device M3 is composed of a first device agent M31, a first device receiving end M32, a first player M33, and a first signaling negotiation end M34. In this embodiment, the first signaling negotiation end M34 is a bluetooth device.

The transfer valve M2 establishes a first media transmission channel M52 with the first device receiving end M32 of the transfer initiating device M3 through the first sending end M22, and forwards the media stream packet received by the transfer valve receiving end M21 to the transfer initiating device M3 in real time. Corresponding to the media transmission channel M51, the first media transmission channel M52 of the present embodiment also selects RTP/AVPF, and accordingly, each of the audio stream and the video stream has a pair of RTP connection and RTCP connection.

The first player M33 of the transfer initiating device M3 synchronously plays real-time media streams such as real-time audio streams and real-time video streams received from the first device receiving end M32.

The proxy service module M25 of the transfer valve M2 manages media sessions between the source proxy and the device proxy, and the management of these sessions can be implemented based on the RTSP protocol, or can be based on the SIP protocol or other session protocols. The management behavior of the proxy service module M25 is explained based on the SIP protocol in the present embodiment. The proxy service identifies each proxy by the proxy name of each user agent connected to the service, and the proxy name contains a piece of content describing the address of the proxy service it is managing. Alternatively, CNAME may be used as the proxy name.

The source agent M24 of the transfer valve M2 is a local built-in session end agent managed by the agent service module M25, represents the identity of the media source in the source agent M24, and represents the user agent of the media source identity during the media session of the real-time media stream connected to the media source through the transfer valve in the play slot, and can establish the media session with the device agent of the play slot through the agent service module M25. In case when the diversion valve M2 manages only one media source M1, only one user agent, representing the session user agent identity of the media source M1, is the source agent M24.

The first device agent M31 of the transfer initiating device M3 is the very user agent at the other end of the media session opposite the source agent M24, which invites the source agent M24 to establish a media playback session by establishing a first signaling transport channel M62 with the proxy service module M25 of the transfer valve M2.

Although the procedure of establishing media playback by the transfer initiation device M3 is not within the technical features of the present invention, for the sake of completeness description of the media session, the behavior of the present embodiment is described herein to help the related technical person to understand the technical environment of the transfer playback behavior more conveniently. In this embodiment, taking the SIP protocol as an example, the first device proxy M31 issues a subscription invitation to the proxy service module M25, and the accompanying description shows that it is necessary to connect to the media source M1 and receive a real-time media stream sent therefrom. The proxy service module M25 submits this invitation to the source proxy M24. The source agent M24 directs the media source M1 to which the valve M2 is connected to be diverted according to the accompanying description of the invitation and is ready for media delivery at the first sender M22. After the first sender M22 is ready for media sending, the source agent M24 attaches the media specification and the connection parameter of the first sender M22 to the ring response fed back by the proxy service module M25 to inform the first device agent M31. The first device agent M31 directs the first device receiver M32 of the transfer initiating device M3 to establish a first media transmission channel M52 with the first sender M22. As soon as the first media transmission channel M52 is established, the transfer valve M2 immediately forwards the real-time media stream data received by the transfer valve receiving end M21 to the first device receiving end M32 on the first media transmission channel M52 through the first sending end M22. The transfer initiating device M3 instructs the first player M33 to synchronously play the real-time media stream data received at the first device receiving end M32, so as to implement the play behavior of the real-time media stream sent by the media source M1 on the transfer initiating device M3.

The transfer originating device M3 may discover the transfer receiving device M4 in various ways and establish a signaling negotiation channel with it, for example, bluetooth communication, ultrasonic communication, wiFi communication, etc. may be used. In this embodiment, bluetooth communication is used to establish the signaling negotiation channel.

The transfer receiving device M4 is composed of a device agent M41, a second device receiver M42, a second player M43, and a second signaling negotiation end M44.

The transfer initiating device M3 discovers the second signaling negotiation end M44 of the transfer receiving device M4 through the first signaling negotiation end M34, and forms a bluetooth pair, so that the transfer initiating device M3 can establish a bluetooth communication connection with the paired second signaling negotiation end M44 through the first signaling negotiation end M34, thereby establishing a signaling negotiation channel M61 for negotiation.

When the transfer initiator M3 initiates a transfer operation for the currently ongoing play behavior to the transfer receiver M4, the transfer initiator M3 establishes a signaling negotiation channel M61 with the paired second signaling negotiation end M44 through the first signaling negotiation end M34. When the signaling negotiation channel M61 is established, the transfer receiving device M4 is then awakened if it is in a standby state.

The transfer initiating device M3 makes the description information of the real-time streaming media stream received by the first device receiving end M32 and the agent name of the source agent M24 of the opposite end of the first device agent M31 into a transfer request, and sends the transfer request to the second signaling negotiation end M44 of the opposite end through the first signaling negotiation end M34 on the signaling negotiation channel M61.

When the transfer receiving device M4 receives the transfer request from the second signaling negotiation end M44, the second signaling negotiation end M44 may be operated to send a rejection response or a busy response on the signaling negotiation channel M61.

When the first signaling negotiation end M34 receives the rejection response on the signaling negotiation channel M61, the signaling negotiation channel M61 with the second signaling negotiation end M44 is cut off, the transfer initiating device M3 knows that the transfer has failed, the first device receiving end M32 and the first player M33 maintain the previous working state, and continue the current playing behavior.

When the first signaling negotiation end M34 receives a busy response or the like on the signaling negotiation channel M61, the transfer initiating device M3 may optionally operate a player or other accessory facility to feed back visual information to the viewer watching the play to remind that the current play will be transferred to the transfer receiving device M4 to draw the necessary attention of the relevant viewer.

When the second signaling negotiation end M44 transmits the busy information on the signaling negotiation channel M61, it is necessary for the transfer receiving device M4 to periodically operate the second signaling negotiation end M44 to transmit the busy information again. The embodiment selects the cycle time interval to be 40 msec. If the first signaling negotiation end M34 does not receive the information such as busy or the like after timeout, and does not receive other information, it will feed back to the audience that the transfer receiving device M4 is busy or faulty, and operate the first signaling negotiation end M34 to cut off the signaling negotiation channel M61, and the play transfer fails, and the first device receiving end M32 and the first player M33 keep the previous working state, and continue the current play behavior.

The transfer receiving device M4 checks whether the second player M43 has the capability of playing the media specification described in the transfer request while the second signaling negotiation end M44 receives the transfer request and periodically keeps busy or other information transmission on the signaling negotiation channel M61, and if not, operates the second signaling negotiation end M44 to transmit rejection information on the signaling negotiation channel M61, optionally, the rejection reason may be described in a friendly way as the media specification is not supported.

The transfer receiving device M4 operates the device agent M41 to send a receiving invitation according to the session protocol by using the source agent name in the transfer request, and the device agent M41 finds the agent service module M25 and the source agent M24 managed by the agent service module M25, and establishes a second signaling transmission channel M63 to submit the subscription invitation to the source agent M24. In particular, for example, in this embodiment, according to the SIP protocol, the device agent M41 may not necessarily belong to one proxy service management together with the first device agent M31 and the source agent M24, the device agent M41 may directly issue a subscription invitation destined to the source agent M24 to the proxy service to which it belongs, and the proxy service to which the device agent M41 belongs may route the subscription invitation to the proxy service module M25 according to the protocol and deliver the subscription invitation to the source agent M24.

If the transfer receiving device M4 does not successfully establish the second signaling transmission channel M63, that is, the subscription invitation is not successfully delivered to the source proxy M24 through the session protocol, the transfer receiving device M4 operates the second signaling negotiation end M44 to send out rejection information on the signaling negotiation channel M61, and optionally, the rejection reason may be more friendly to be attached to describe that the subscription invitation to the source proxy M24 fails.

The source agent M24 of the transfer valve M2, upon receiving the subscription invitation from the device agent M41, directs the transfer valve M2 to operate the second sender M23 to prepare for the establishment of the second media transmission channel, and returns a ring response to the device agent M41.

After the device agent M41 of the transfer receiving device M4 receives the ring response, the operation receiver M42 establishes a second media transmission channel M53 from the second transmitting end M23. If the second media transmission channel M53 fails to be established, the second signaling negotiation end M44 is operated to send rejection information on the signaling negotiation channel M61, optionally, the rejection reason may be described more friendly as the establishment of the second media transmission channel M53 fails, and the second signaling transmission channel M63 is cut off.

When the second media transmission channel M53 is established, the second device receiver M42 of the transfer receiving device M4 operates the second player M43 to prepare for starting the playing operation, and synchronously plays the real-time media stream received from the second device receiver M42 on the second player M43.

When the second sender M23 establishes the second media transmission channel M53, the transfer valve M2 sends a blank media stream on the transmission channel M53. With regard to the blank media stream in the present embodiment, for example, a silent audio stream is transmitted on the corresponding RTP/AVPF connection when the described media stream contains one piece of audio, and for example, a video stream of a black screen picture is transmitted on the corresponding RTP/AVPF connection when the described media stream contains one piece of video.

The transfer receiving device M4 obtains the maximum time delay of audio and video transmitted by the media stream on the second media transmission channel M53, i.e. the channel delay, according to the AVPF feedback of the receiver M42 on the second media transmission channel M53; the maximum time delay from the reception of the data from the second device receiving end M42 to the completion of the playing in the second player M43, i.e. the presentation delay, is actually evaluated by the second player M43 during the playing process. The channel delay and the presentation delay are added together to form the playout delay time.

The transfer receiving device M4 makes the play delay time and the proxy name of the device proxy M41 as a receiving response, and operates the second signaling negotiation end M44 to transmit on the signaling negotiation channel M61.

After the first signaling negotiation end M34 of the transfer initiating device M3 receives the receiving response information on the signaling negotiation channel M61, the first signaling negotiation end M34 is operated to cut off the signaling negotiation channel M61.

The transfer originator M3 regards the agent name of the source agent M24 of the transfer valve M2, the agent name of the first device agent M31 of the transfer originator M3, the agent name of the device agent M41 of the transfer recipient M4, and the play delay time of the transfer recipient M4 as delay transfer times, and together these four elements form an authorization request, and the first device agent M31 is operated to submit the authorization request to the source agent M24 of the transfer valve M2 over the first signaling transmission channel M62.

After receiving the authorization request, the source agent M24 of the transfer valve M2 checks whether the media stream of the transfer valve receiving end M21 in the current state is being sent to the first media transmission channel M52 by the first sending end M22 corresponding to the first device agent M31, and if not, makes an error response.

The transfer valve M2 checks whether a second device agent M41 is establishing a receive session with the source agent M24 in the current state and, if not, responds with an error.

The transfer valve M2 checks whether the second transmitting end M23 corresponding to the device agent M41 in the current state has already established the second media transmission channel M53, and if not, makes an error response.

After the transfer valve M2 does not make the above-mentioned error response, the transfer valve receiving end M21 is operated to feed back two different types of key frame requests of FIR + PLI to the media source M1 through the AVPF of the transmission channel.

When the transfer valve receiving end M21 of the transfer valve M2 receives the video key frame, the media stream data received by the transfer valve receiving end M21 is forwarded to the second media transmission channel M53 through the second sending end M23, and at the same time, a copy is copied and sent to the first media transmission channel M52 through the first sending end M22, and at the same time, the timer M26 is set to be timed to the delay transfer time, and the source agent replies to the first device agent M31 to notify that the authorization request has been successfully executed.

Alternatively, the first device agent M31 of the transfer initiating device M3, upon receiving the execution success response of the authorization request, may more comfortably feed back to the viewer the visual feedback that the authorization request was successful and that the player is about to be turned off.

Optionally, the first device agent M31 of the transfer initiating device M3 may start a timer to trigger the operation of closing the play action after the authorized play delay time when receiving the authorization request and executing the successful response.

The timer M26 of the transfer valve M2, when triggered at a certain time, operates the source agent M24 to send hang-up signaling to the first device agent M31 on the first signaling transmission channel M62 and to cut off the first signaling transmission channel M62.

The timer M26 of the transfer valve M2 operates the first sending terminal M22 to cut off the first media transmission channel M52 when the timing is triggered.

When the first device agent M31 receives the hang-up signaling or the self-started timer times and closes the play operation trigger, the transfer initiating device M3 cuts off the first signaling transmission channel M62, cuts off the first media transmission channel M52, and closes the play behavior on the first player M33.

The play delay time described in the above embodiment is transmitted by the transfer reception device M4 to the transfer initiation device M3 by receiving the response, and then transmitted by the transfer initiation device M3 to the transfer valve M2 by the authorization request. Thus, the transfer valve M2 can know the play delay time in the switching process while receiving the authorization request.

The above embodiment takes one transfer initiator M3 and one transfer recipient M4 as an example for explanation. In practical applications, there may be a plurality of transfer initiating devices M3 and a plurality of transfer receiving devices M4 sharing one transfer valve M2. The authorization request includes the information of the transfer receiving device M4 authorized and the play delay time, and is used to indicate media play transfer between different devices. And when the transfer valve M2 receives a plurality of authorization requests, sequentially executing the playing transfer operation according to the time sequence of the received authorization requests.

In another alternative embodiment, the transfer receiving device M4 may also directly send the transfer valve M2 after calculating the play delay time, and the transfer valve M2 controls the play switching process according to the received play delay time after receiving the authorization request from the transfer initiating device M3.

Fig. 5 is a schematic diagram illustrating an implementation of a transfer method in a cross-device transfer system according to another embodiment of the present invention. In this embodiment, when there is an externally available proxy service, the transfer valve M2 may be implemented internally without implementing the proxy service, only with implementing the source proxy. The architecture of the embodiment of fig. 5 is formed by eliminating the proxy service module M25 of the embodiment of fig. 4 and replacing it with an externally present proxy service module M5.

The transfer valve M2 of the embodiment of fig. 5 is not substantially different from the transfer valve M2 of the embodiment of fig. 4. The signaling transport path M64 of the embodiment of fig. 5 is simply an extension of the first signaling transport path M62 and the second signaling transport path M63 across the proxy service module M5 to connect to the source proxy M24.

The embodiment of the invention also provides cross-equipment transfer equipment for media playing, which comprises a processor; a memory having stored therein executable instructions of the processor; wherein the processor is configured to perform the steps of the cross-device transfer method of media playback via execution of the executable instructions.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.

As shown in fig. 6, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 that couples various system components including the memory unit 620 and the processing unit 610, a display unit 640, and the like.

Wherein the storage unit stores program code executable by the processing unit 610 to cause the processing unit 610 to perform steps according to various exemplary embodiments of the present invention described in the above-mentioned electronic prescription flow processing method section of the present specification. For example, the processing unit 610 may perform the steps as shown in fig. 1.

The storage unit 620 may include readable media in the form of volatile storage units, such as a random access memory unit (RAM) 62M1 and/or a cache memory unit 62M2, and may further include a read only memory unit (ROM) 6203.

The memory unit 620 may also include a program/utility 62M4 having a set (at least one) of program modules 62M5, such program modules 62M5 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Bus 630 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via the bus 630. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The embodiment of the invention also provides a computer-readable storage medium for storing a program, and the program realizes the steps of the cross-device transfer method for media playing when being executed by a processor. In some possible embodiments, aspects of the present invention may also be implemented in the form of a program product comprising program code for causing a terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above-mentioned electronic prescription flow processing method section of this specification, when the program product is run on the terminal device.

Referring to fig. 7, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or cluster. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

By adopting the computer-readable storage medium provided by the invention, the stored program realizes the steps of the cross-device transfer method of the media playing when being executed, thereby the beneficial effects of the cross-device transfer method of the media playing can be obtained.

The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.

Claims

1. A cross-device transfer method for media playing is characterized by comprising the following steps:

the transfer valve sends the media data of the media source to the transfer receiving equipment through the second media transmission channel;

before the transfer valve receives a receiving request sent by the transfer receiving equipment, the method further comprises the following steps:

the transfer initiating device sends a transfer request to the transfer receiving device through the signaling negotiation channel, wherein the transfer request comprises a transfer valve address and description information of a media stream;

the transfer receiving equipment judges whether the media specification in the description information of the media stream can be played or not according to the description information of the media stream;

and when the transfer receiving equipment confirms that the media specification in the description information of the media stream can be played, selecting to receive the transfer request, and initiating a receiving request to the corresponding transfer valve according to the address of the transfer valve in the transfer request.

2. The method of claim 1, wherein after the transfer valve initiates the establishment of the second media transmission channel with the transfer receiving device, the method further comprises the following steps:

3. The method of claim 1, wherein the authorization request includes a playback delay time of a second media transmission channel of the transfer recipient device;

4. The method of claim 3, wherein the transfer valve initiates establishing a second media transmission channel with the transfer receiving device and the transfer valve sends media data of a media source to the transfer receiving device through the second media transmission channel, further comprising the steps of:

the transfer receiving device sends a reception response including the play delay time to the transfer initiating device, and the transfer initiating device sends an authorization request including the play delay time to the transfer valve.

5. The method of claim 3, wherein before the transfer valve initiates establishment of the second media transmission channel with the transfer receiving device, the method further comprises: establishing a second signaling transmission channel between a source agent in the transfer valve and a device agent of the transfer receiving device through an agent service module, wherein the agent service module is arranged inside or outside the transfer valve;

6. A system for transferring media playing across devices, which is applied to the method for transferring media playing across devices of any one of claims 1 to 5, the system comprising a transfer valve, the transfer valve comprising a transfer valve receiving end, a first transmitting end, a second transmitting end and a source agent, wherein:

7. The system for transferring media playing according to claim 6, further comprising a transfer initiating device, wherein the transfer initiating device comprises a first device agent, a first device receiving end, a first signaling negotiation end, and a first playing end; wherein:

8. The system of claim 7, further comprising a transfer receiving device, wherein the transfer receiving device comprises a second device agent, a second device receiving end, a second signaling negotiation end, and a second playing end;

the second signaling negotiation end is used for establishing a signaling negotiation channel with the first signaling negotiation end and sending response information to the transfer initiating equipment when receiving the transfer request;

9. A cross-device transfer device for media playback, comprising:

a processor;

a memory having stored therein executable instructions of the processor;

wherein the processor is configured to perform the steps of the cross device transfer method of media playing of any of claims 1 to 5 via execution of the executable instructions.

10. A computer-readable storage medium storing a program, which when executed by a processor implements the steps of the cross-device transfer method of media playing of any one of claims 1 to 5.