CN110602430A - Video synchronization method, terminal, color ring platform, system and readable storage medium - Google Patents

Video synchronization method, terminal, color ring platform, system and readable storage medium Download PDF

Info

Publication number
CN110602430A
CN110602430A CN201910869964.2A CN201910869964A CN110602430A CN 110602430 A CN110602430 A CN 110602430A CN 201910869964 A CN201910869964 A CN 201910869964A CN 110602430 A CN110602430 A CN 110602430A
Authority
CN
China
Prior art keywords
terminal
video
color ring
resource
stream file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910869964.2A
Other languages
Chinese (zh)
Other versions
CN110602430B (en
Inventor
聂国梁
徐嵩
赵琦
谭泽北
庄晓亮
王科
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MIGU Culture Technology Co Ltd
Original Assignee
MIGU Culture Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MIGU Culture Technology Co Ltd filed Critical MIGU Culture Technology Co Ltd
Priority to CN201910869964.2A priority Critical patent/CN110602430B/en
Publication of CN110602430A publication Critical patent/CN110602430A/en
Application granted granted Critical
Publication of CN110602430B publication Critical patent/CN110602430B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides a video synchronization method, a terminal, a color ring platform, a system and a readable storage medium, wherein the method comprises the following steps: under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; according to the screen recording operation on the first terminal, the video stream file generated by the screen recording operation is pushed to a color ring platform in real time through the first video resource, so that the color ring platform pushes the video stream file to a second terminal in real time; the embodiment of the invention can realize the synchronous playing of the videos of the first terminal and the second terminal based on the resources of the video color ring, expand the application scene of the video color ring and improve the user experience.

Description

Video synchronization method, terminal, color ring platform, system and readable storage medium
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a video synchronization method, a terminal, a color ring platform, a system, and a readable storage medium.
Background
The video calls are classified into internet video calls and mobile network video calls according to the difference of the underlying network. In the internet video call, a user accesses the internet, connects with an opposite terminal through an APP (Application program), and then forwards information such as voice, video and the like through an IP packet on the internet. Currently, there are many social software applications, and the social software application is the most common way to apply video calls.
The mobile network video telephone is characterized in that a user selects a video call function by using a dial pad of a mobile phone and then two ends interact. The video telephone in the mode is interacted through a mobile network, and the reliability is high.
However, since the internet video call depends on the internet, the reliability is low, and the APP needs to be installed and used, the use is complicated; the mobile network video telephone has high reliability, but can not activate the video as required at will.
The Voice over Long-Term Evolution (lte) video color ring service is a service customized by a called subscriber and provides a piece of pleasant, colorful or interesting video media to a calling subscriber to replace a common network ring back tone.
In order to support video color ring, the system needs to inject the media file first, and the file injection only needs to be performed once. At present, there are two media file generation methods for video media: 1. manually braking DIY; 2. a content platform. Although the generation is different, the media file injection paths are basically consistent: the central music platform- > the polyphonic ringtone centralized platform- > the province polyphonic ringtone platform- > the video polyphonic ringtone media file is played.
The playing of the video color ring is a plurality of actions, and the playing path is as follows: provincial color ring platform- > SBC (Session Border Controller) > terminal. Once the called party answers, the system stops playing the video color ring.
From the above, the video media asset file of the video color ring is generated statically; media playing is carried out with stream pushing from the color ring platform every time; the called party answers the video color ring and stops playing.
Disclosure of Invention
The embodiment of the invention aims to provide a video synchronization method, a terminal, a color ring platform, a system and a readable storage medium, so as to solve the application limitation of video color ring in the prior art.
In order to solve the above problem, an embodiment of the present invention provides a video synchronization method applied to a first terminal, including:
under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform;
and pushing the video stream file generated by the screen recording operation to a color ring platform in real time through the first video resource according to the screen recording operation on the first terminal, so that the color ring platform pushes the video stream file to a second terminal in real time.
Wherein, according to the screen recording operation on the first terminal, the method further comprises the following steps of pushing the video stream file generated by the screen recording operation to the color ring back tone platform in real time through the first video resource:
receiving a first input;
sending a video synchronization starting notification to the color ring platform so that the color ring platform starts a local push streaming function; and after the stream pushing function of the home terminal is started, the color ring back tone platform can push the video stream file to the second terminal.
After the video stream file generated by the screen recording operation is pushed to the color ring back tone platform in real time through the first video resource according to the screen recording operation on the first terminal, the method further comprises the following steps:
receiving a second input;
and sending a video synchronization closing notification to the color ring platform so that the color ring platform stops the stream pushing function from the local end.
The embodiment of the invention also provides a video synchronization method, which is applied to a second terminal and comprises the following steps:
under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform;
and receiving a video stream file pushed by the color ring back tone platform in real time through the second video resource, and playing the video stream file.
The embodiment of the invention also provides a video synchronization method, which is applied to the color ring platform and comprises the following steps:
under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource and a second video resource; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform;
receiving a video stream file pushed by a first terminal in real time through the first video resource;
and pushing the received video stream file to the second terminal in real time through the second video resource so as to play the video stream file by the second terminal.
Before receiving the video stream file pushed by the first terminal in real time through the first video resource, the method further includes:
receiving a video synchronization starting notification sent by a first terminal;
starting a local push streaming function according to the starting video synchronous notification; and after the stream pushing function of the home terminal is started, the color ring back tone platform can push the video stream file to the second terminal.
Wherein, the pushing the received video stream file to the second terminal in real time through the second video resource comprises:
converting the received video stream file into a video stream file matched with the capability negotiation result according to the capability negotiation result of the polyphonic ringtone platform and the second terminal;
and pushing the video stream file matched with the capability negotiation result to the second terminal in real time through the second video resource.
After the received video stream file is pushed to the second terminal in real time through the second video resource, the method further includes:
receiving a video synchronization closing notification sent by a first terminal;
and stopping the local terminal stream pushing function according to the video synchronization closing notification.
An embodiment of the present invention further provides a system, including: the system comprises a first terminal, a second terminal and a color ring platform;
wherein the first terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; according to the screen recording operation on the first terminal, the video stream file generated by the screen recording operation is pushed to a color ring platform in real time through the first video resource, so that the color ring platform pushes the video stream file to a second terminal in real time;
the second terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by the color ring back tone platform in real time through the second video resource, and playing the video stream file;
the color ring back tone platform is used for: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource and a second video resource; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by a first terminal in real time through the first video resource; and pushing the received video stream file to the second terminal in real time through the second video resource so as to play the video stream file by the second terminal.
The embodiment of the invention also provides a terminal, which comprises a memory, a processor and a program which is stored on the memory and can be run on the processor, wherein the processor realizes the video synchronization method when executing the program.
The embodiment of the invention also provides a color ring platform which comprises a memory, a processor and a program which is stored on the memory and can be operated on the processor, wherein the video synchronization method is realized when the processor executes the program.
Embodiments of the present invention also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the video synchronization method as described above.
The technical scheme of the invention at least has the following beneficial effects:
in the video synchronization method, the terminal, the color ring platform and the computer-readable storage medium of the embodiment of the invention, under the condition that a call is successfully established between the first terminal and the second terminal, the first video resource and the second video resource are kept not to be released, the first terminal pushes a video stream file generated by screen recording operation of the first terminal to the color ring platform in real time through the first video resource, the color ring platform pushes the video stream file to the second terminal in real time through the second video resource, and the second terminal plays the video stream file in real time; the embodiment of the invention can realize the synchronous playing of the videos of the first terminal and the second terminal based on the resources of the video color ring, expand the application scene of the video color ring and improve the user experience.
Drawings
Fig. 1 is a flowchart illustrating steps of a video synchronization method applied to a first terminal according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating steps of a video synchronization method applied to a second terminal according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating steps of a video synchronization method applied to a color ring platform according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a video synchronization method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a color ring platform according to an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
In order to facilitate understanding of the embodiments of the present invention, a video color ring and a color ring are first described.
1) From the aspect of function scope, the function scope of the video color ring and the color ring is the inclusion relation. Specifically, the video color ring is the upgrade of the color ring, and can support the playing of videos and the like besides meeting all functions of the color ring.
2) From the perspective of technical support, the technical support of video color ring and color ring is different. In the process of paging a called end by a calling end, compared with a signaling flow of the color ring, at least two processes of media resource capability negotiation and resource reservation are added in the signaling flow of the video color ring.
3) From the aspect of terminal support, the playing of the video polyphonic ringtone requires the capability of the corresponding terminal for supporting the video playing, and the playing of the polyphonic ringtone only requires the capability of the corresponding terminal for supporting the audio playing.
4) From the perspective of core network bearing, the video color ring can allocate a video bearing with the bandwidth of 974Kbps and an audio bearing with the bandwidth of 146 Kbps; and the polyphonic ringtone is only allocated with an audio bearer with the bandwidth of 146 Kbps.
In summary, the video color ring can satisfy all the requirements of the color ring, but the color ring cannot satisfy all the requirements of the video color ring.
It should be noted that, in the embodiment of the present invention, the first terminal may be a calling terminal or a called terminal, and similarly, the second terminal may be a called terminal or a calling terminal. For example, when the first terminal is a calling terminal, the second terminal is a called terminal; or, when the first terminal is a called terminal, the second terminal is a calling terminal.
As shown in fig. 1, an embodiment of the present invention provides a video synchronization method applied to a first terminal, including:
step 11, under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource; the first video resource is a resource for transmitting video color ring between the first terminal and the color ring platform.
In this step, the calling terminal dials the called terminal, and the calling terminal and the called terminal simultaneously play the video color ring customized by the called or calling party pushed by the color ring platform. Under the condition that a called party is off-hooked (namely under the condition that the first terminal and the second terminal successfully establish a call), the polyphonic ringtone platform stops pushing the video polyphonic ringtone customized by the called party or the calling party; however, in order to ensure the transmission of the subsequent video stream file, the first terminal still maintains the first video resource, i.e. the first terminal does not release the first video resource.
And step 12, pushing the video stream file generated by the screen recording operation to a color ring back tone platform in real time through the first video resource according to the screen recording operation on the first terminal, so that the color ring back tone platform pushes the video stream file to a second terminal in real time.
For example, the video synchronization method provided by the embodiment of the present invention can be applied to the following scenes: the user A is unfamiliar with the operation of the mobile phone, calls the user B, and hopes that the user B can demonstrate how to operate the mobile phone; after the call between the user A and the user B is successfully established, the user B starts a screen recording function and operates on an operation interface of the user B, the whole operation process is recorded, and a video stream file is generated; and transmitting the video stream file to the color ring platform in real time through the first video resource which is not released before, sending the video stream file to the user A by the color ring platform in real time, and playing the video stream file by the terminal side of the user A in real time to realize video synchronization.
Optionally, in the foregoing embodiment of the present invention, the maintaining the first video resource in step 11 includes:
receiving an indication message for maintaining video resources sent by the polyphonic ringtone platform;
and keeping the first video resource according to the indication message.
For example, the polyphonic ringtone platform sends an update message to the first terminal, and if m in the update message is video0RTP/AVP 97, the first terminal maintains the first video resource according to the update message.
In the traditional video color ring, the video is not played continuously after the call is connected, so that the corresponding video resource needs to be released after the called party goes off the hook. For example, the polyphonic ringtone platform sends an update message to the first terminal, and if m in the update message is video0RTP/AVP 0, the first terminal releases the corresponding video resource according to the update message.
It should be noted that, in the foregoing embodiment of the present invention, after the called party goes off-hook (that is, after the first terminal and the second terminal successfully establish a call), the first terminal further needs to perform capability update negotiation with the color ring platform, so that the color ring platform obtains the relevant capability of the video supported by the first terminal.
Optionally, in the above embodiment of the present invention, before step 12, the method further includes:
receiving a first input, the first input for triggering a video synchronization function;
and sending a video synchronization starting notification to the color ring platform so that the color ring platform starts a local push streaming function. And if not, the polyphonic ringtone platform cannot push the video stream file to the second terminal.
For example, a "video synchronization" button is added on a display interface of the first terminal, and the first terminal transmits a command for starting a video synchronization notification to the color ring back tone platform through http; for another example, based on the dial-up keypad, the DTMF (Dual-tone multi frequency) is used to carry the special payload of RTP (Real-time Transport Protocol) to carry the "start video synchronization notification" for transmission; the polyphonic ringtone platform detects the command in an in-band detection mode and executes corresponding operation.
Optionally, when the polyphonic ringtone platform starts the stream pushing function from the home terminal, a matching relationship between the first terminal and the polyphonic ringtone platform and a matching relationship between the polyphonic ringtone platform and the second terminal need to be created, so as to ensure that a subsequent video stream file received from the first terminal can be forwarded to the second terminal.
Accordingly, step 12 comprises:
responding to the first input, and starting screen recording software;
and recording the screen by the screen recording software in real time according to the operation of the user on the first terminal operation interface, and generating the video stream file.
For example, a user clicks "video synchronization" to trigger the screen recording software to be started; at this time, the listening screen of the first terminal rolls up (i.e., the listening screen is hidden). A user clicks an APP on a screen of a first terminal to perform demonstration operation; the screen recording software records the screen in real time, generates a video stream file and stores the video stream file to the local at intervals, for example, every 50ms, the interval storage time can be set at will, and is not limited specifically herein.
Optionally, in the above embodiment of the present invention, the method further includes:
receiving a second input for turning off a video synchronization function;
and sending a video synchronization closing notification to the color ring platform so that the color ring platform stops the stream pushing function from the local end. Wherein, in response to the second input, the screen recording software stops recording the screen.
For example, a "stop video synchronization" button is added on a display interface of the first terminal, and the first terminal transmits a command for closing the video synchronization notification to the color ring back tone platform through http; for another example, based on the dial-up keypad, the DTMF (Dual-tone multi frequency) is used to carry the special payload of RTP (Real-time Transport Protocol) to carry the "close video synchronization notification" for transmission; the polyphonic ringtone platform detects the command in an in-band detection mode and executes corresponding operation.
Optionally, the polyphonic ringtone platform stops the stream pushing function from the home terminal, and deletes the matching relationship between the first terminal and the polyphonic ringtone platform, and between the polyphonic ringtone platform and the second terminal, which are created before.
In summary, in the above embodiment of the present invention, under the condition that the first terminal and the second terminal successfully establish a call, the first video resource and the second video resource are kept not to be released, and the first terminal pushes the video stream file generated by the screen recording operation of the first terminal to the color ring platform in real time through the first video resource, the color ring platform pushes the video stream file to the second terminal in real time through the second video resource, and the second terminal plays the video stream file in real time; the embodiment of the invention can realize the synchronous playing of the videos of the first terminal and the second terminal based on the resources of the video color ring, expand the application scene of the video color ring and improve the user experience.
As shown in fig. 2, an embodiment of the present invention further provides a video synchronization method applied to a second terminal, including:
step 21, under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; and the second video resource is a resource for transmitting the video color ring between the second terminal and the color ring platform.
In this step, the calling terminal dials the called terminal, and the calling terminal and the called terminal simultaneously play the video color ring customized by the called or calling party pushed by the color ring platform. Under the condition that a called party is off-hooked (namely under the condition that the first terminal and the second terminal successfully establish a call), the polyphonic ringtone platform stops pushing the video polyphonic ringtone customized by the called party or the calling party; however, in order to ensure the transmission of the subsequent video stream file, the second terminal still maintains the second video resource, i.e. the second terminal does not release the second video resource.
And step 22, receiving the video stream file pushed by the polyphonic ringtone platform in real time through the second video resource, and playing the video stream file.
For example, the video synchronization method provided by the embodiment of the present invention can be applied to the following scenes: the user A is unfamiliar with the operation of the mobile phone, calls the user B, and hopes that the user B can demonstrate how to operate the mobile phone; after the call between the user A and the user B is successfully established, the user B starts a screen recording function and operates on an operation interface of the user B, the whole operation process is recorded, and a video stream file is generated; and transmitting the video stream file to a color ring platform through the first video resource which is not released before among the generated video stream files, sending the video stream file to a user A by the color ring platform, and playing the video stream file in real time at the terminal side of the user A to realize video synchronization.
Optionally, in the foregoing embodiment of the present invention, the maintaining the second video resource in step 21 includes:
receiving an indication message for maintaining video resources sent by the polyphonic ringtone platform;
and keeping the second video resource according to the indication message.
For example, the polyphonic ringtone platform sends an update message to the second terminal, and if m in the update message is video0RTP/AVP 97, the second terminal maintains the second video resource according to the update message.
In the traditional video color ring, the video is not played continuously after the call is connected, so that the corresponding video resource needs to be released after the called party goes off the hook. For example, the polyphonic ringtone platform sends an update message to the second terminal, and if m in the update message is video0RTP/AVP 0, the first terminal releases the corresponding video resource according to the update message.
It should be noted that, in the foregoing embodiment of the present invention, after the called party goes off-hook (that is, after the first terminal and the second terminal successfully establish a call), the second terminal further needs to perform capability update negotiation with the color ring platform, so that the color ring platform obtains the relevant capability of the video supported by the second terminal.
In summary, in the above embodiment of the present invention, under the condition that the first terminal and the second terminal successfully establish a call, the first video resource and the second video resource are kept not to be released, and the first terminal pushes the video stream file generated by the screen recording operation of the first terminal to the color ring platform in real time through the first video resource, the color ring platform pushes the video stream file to the second terminal in real time through the second video resource, and the second terminal plays the video stream file in real time; the embodiment of the invention can realize the synchronous playing of the videos of the first terminal and the second terminal based on the resources of the video color ring, expand the application scene of the video color ring and improve the user experience.
As shown in fig. 3, an embodiment of the present invention further provides a video synchronization method, which is applied to a color ring platform, and includes:
step 31, under the condition that the first terminal and the second terminal successfully establish a call, maintaining the first video resource and the second video resource (the first terminal needs to be instructed to maintain the first video resource, and the second terminal is instructed to maintain the second video resource); the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; and the second video resource is a resource for transmitting the video color ring between the second terminal and the color ring platform.
In this step, the calling terminal dials the called terminal, and the calling terminal and the called terminal simultaneously play the video color ring customized by the called or calling party pushed by the color ring platform. Under the condition that a called party is off-hooked (namely under the condition that the first terminal and the second terminal successfully establish a call), the polyphonic ringtone platform stops pushing the video polyphonic ringtone customized by the called party or the calling party; however, in order to ensure the transmission of the subsequent video stream file, the first terminal still maintains the first video resource, that is, the first terminal does not release the first video resource; the second terminal still holds the second video resource, i.e. the second terminal releases the second video resource.
Step 32, receiving a video stream file pushed by the first terminal in real time through the first video resource;
and step 33, pushing the received video stream file to the second terminal in real time through the second video resource, so that the second terminal plays the video stream file.
For example, the video synchronization method provided by the embodiment of the present invention can be applied to the following scenes: the user A is unfamiliar with the operation of the mobile phone, calls the user B, and hopes that the user B can demonstrate how to operate the mobile phone; after the call between the user A and the user B is successfully established, the user B starts a screen recording function and operates on an operation interface of the user B, the whole operation process is recorded, and a video stream file is generated; and transmitting the video stream file to a color ring platform through the first video resource which is not released before among the generated video stream files, sending the video stream file to a user A by the color ring platform, and playing the video stream file in real time at the terminal side of the user A to realize video synchronization.
Optionally, the above embodiment of the present invention further includes:
and respectively sending an indication message for maintaining the video resource to the first terminal and the second terminal.
For example, the polyphonic ringtone platform sends an update message to the first terminal, and if m in the update message is video0RTP/AVP 97, the first terminal maintains the first video resource according to the update message. And the polyphonic ringtone platform sends an update message to the second terminal, and the second terminal keeps the second video resource according to the update message if m in the update message is equal to video0RTP/AVP 97.
It should be noted that, in the foregoing embodiment of the present invention, after the called party goes off-hook (that is, after the first terminal and the second terminal successfully establish a call), the first terminal and the second terminal respectively perform capability update negotiation with the color ring platform, so that the color ring platform obtains the related capability of the video supported by the first terminal and the related capability of the video supported by the second terminal.
Optionally, in the above embodiment of the present invention, before step 32, the method further includes:
receiving a video synchronization starting notification sent by a first terminal;
and starting a local push streaming function according to the starting video synchronous notification. And if not, the polyphonic ringtone platform cannot push the video stream file to the second terminal.
For example, a "video synchronization" button is added on a display interface of the first terminal, and the first terminal transmits a command for starting a video synchronization notification to the color ring back tone platform through http; for another example, based on the dial-up keypad, the DTMF (Dual-tone multi frequency) is used to carry the special payload of RTP (Real-time Transport Protocol) to carry the "start video synchronization notification" for transmission; the polyphonic ringtone platform detects the command in an in-band detection mode and executes corresponding operation.
Optionally, when the polyphonic ringtone platform starts the stream pushing function from the home terminal, a matching relationship between the first terminal and the polyphonic ringtone platform and a matching relationship between the polyphonic ringtone platform and the second terminal need to be created, so as to ensure that a subsequent video stream file received from the first terminal can be forwarded to the second terminal.
Optionally, in the foregoing embodiment of the present invention, step 33 includes:
converting the received video stream file into a video stream file matched with the capability negotiation result according to the capability negotiation result of the polyphonic ringtone platform and the second terminal;
and pushing the video stream file matched with the capability negotiation result to the second terminal in real time through the second video resource.
Because the capability negotiation is respectively performed between the second terminal and the polyphonic ringtone platform and between the polyphonic ringtone platform and the first terminal, the situation that the capability of the first terminal is inconsistent with the capability of the second terminal may exist, and therefore the polyphonic ringtone platform is required to perform conversion; if the first terminal capability is consistent with the second terminal capability, the conversion step can be omitted, and the polyphonic ringtone platform can directly forward.
Optionally, in the above embodiment of the present invention, after the received video stream file is pushed to the second terminal in real time through the second video resource, the method further includes:
receiving a video synchronization closing notification sent by a first terminal;
and stopping the local terminal stream pushing function according to the video synchronization closing notification.
If the video synchronization stopping button is added on the display interface of the first terminal, the first terminal transmits a command for closing the video synchronization notification to the color ring back tone platform through http; for another example, based on the dial-up keypad, the DTMF (Dual-tone multi frequency) is used to carry the special payload of RTP (Real-time Transport Protocol) to carry the "close video synchronization notification" for transmission; the polyphonic ringtone platform detects the command in an in-band detection mode and executes corresponding operation.
Optionally, the polyphonic ringtone platform stops the stream pushing function from the home terminal, and deletes the matching relationship between the first terminal and the polyphonic ringtone platform, and between the polyphonic ringtone platform and the second terminal, which are created before.
In summary, in the above embodiment of the present invention, under the condition that the first terminal and the second terminal successfully establish a call, the first video resource and the second video resource are kept not to be released, and the first terminal pushes the video stream file generated by the screen recording operation of the first terminal to the color ring platform in real time through the first video resource, the color ring platform pushes the video stream file to the second terminal in real time through the second video resource, and the second terminal plays the video stream file in real time; the embodiment of the invention can realize the synchronous playing of the videos of the first terminal and the second terminal based on the resources of the video color ring, expand the application scene of the video color ring and improve the user experience.
An embodiment of the present invention further provides a system, which includes: the system comprises a first terminal, a second terminal and a color ring platform;
wherein the first terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; according to the screen recording operation on the first terminal, the video stream file generated by the screen recording operation is pushed to a color ring platform in real time through the first video resource, so that the color ring platform pushes the video stream file to a second terminal in real time;
the second terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by the color ring back tone platform in real time through the second video resource, and playing the video stream file;
the color ring back tone platform is used for: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource and a second video resource; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by a first terminal in real time through the first video resource; and pushing the received video stream file to the second terminal in real time through the second video resource so as to play the video stream file by the second terminal.
To more clearly describe the working principle of the system, the following description is made with reference to fig. 4: wherein, suppose that the first terminal is a called terminal, the second terminal is a calling terminal:
the calling party dials the called party, and the calling party and the called party play the customized video color ring of the called party simultaneously.
1. The called party picks up the phone;
2. the polyphonic ringtone platform respectively carries out capability updating negotiation with the calling party and the called party (the polyphonic ringtone platform stops pushing video polyphonic ringtone);
in the embodiment of the present invention, the video stream needs to be transmitted after the call, so the capability negotiation after the off-hook needs to ensure that the video resource cannot be released, and therefore, the m-video XXX setting in the Update message is valid. At the moment, the calling party and the called party still keep video resources, and subsequent users can transmit videos according to needs.
For example: update message to keep video assets: m-video 0RTP/AVP 97
3. The called terminal clicks video synchronization (the calling tells the called user what help is needed through voice), a starting video synchronization notification is sent to the SBC, and the SBC forwards the starting video synchronization notification to the color ring platform;
4. the polyphonic ringtone platform starts to push flow from the local terminal;
the polyphonic ringtone platform receives the notice of starting the video synchronization, retains information, prepares local resources for the video synchronization, establishes a matching relation between the called terminal and the polyphonic ringtone platform and between the polyphonic ringtone platform and the calling terminal, and ensures that a video stream received from the called terminal subsequently is forwarded to the calling terminal.
5. The called party locally records the screen;
the called party clicks video synchronization and triggers local screen recording software. The called answering screen rolls up. And the called party clicks the APP on the screen to perform demonstration operation. The screen recording software records the screen in real time and stores the screen to the local at intervals, for example, every 50ms, the interval storage time can be set.
6. The called party pushes the stream to the color ring platform;
and monitoring the local video stream file in real time, and pushing the local video stream file to the color ring platform once the generation of a new video file is monitored.
Because the channel of the video color ring currently requires the code rate of the video and the like, the video transcoding is required to be performed according to the conclusion of the negotiation of the previous video capability. In order to maintain the continuity of the video, the listening box needs to perform plug-flow smoothing.
7. The color ring platform performs video processing;
and the polyphonic ringtone platform receives the video stream and transcodes the video stream into a new video stream according to a negotiation conclusion of the platform and the calling party. Because the capability negotiation is respectively performed between the calling party and the polyphonic ringtone platform and between the called party and the polyphonic ringtone platform, inconsistency may exist, and therefore conversion needs to be performed on the polyphonic ringtone platform.
8. The calling party plays a real-time video stream;
9. the called party clicks 'stop video synchronization'; the called party triggers the screen recording software to stop recording the screen.
10. And the color ring platform stops pushing the stream from the home terminal, and deletes the matching relationship between the called party and the color ring platform and between the color ring platform and the calling party.
11. When the called party hangs up, the conversation is ended, and the color ring platform releases video resources and audio resources with the calling terminal and the called terminal.
As shown in fig. 5, an embodiment of the present invention further provides a terminal, including a memory 510, a processor 500, and a program stored in the memory 510 and capable of being executed on the processor 500, where when the processor 500 executes the program, the above-mentioned processes applied in the video synchronization method embodiment of the first terminal are implemented, and the same technical effects can be achieved, and are not described again to avoid repetition; or, when the processor executes the program, the processes in the embodiment of the video synchronization method applied to the second terminal are implemented, and the same technical effect can be achieved.
As shown in fig. 6, an embodiment of the present invention further provides a color ring platform, which includes a memory 610, a processor 600, and a program that is stored in the memory 610 and can be run on the processor 600, where the processor 600 implements the processes in the video synchronization method embodiment applied to the color ring platform as described above when executing the program, and can achieve the same technical effect, and details are not repeated here to avoid repetition.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process in the video synchronization method embodiment described above, and can achieve the same technical effect, and details are not repeated here to avoid repetition. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block or blocks.
These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (12)

1. A video synchronization method applied to a first terminal is characterized by comprising the following steps:
under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform;
and pushing the video stream file generated by the screen recording operation to a color ring platform in real time through the first video resource according to the screen recording operation on the first terminal, so that the color ring platform pushes the video stream file to a second terminal in real time.
2. The method according to claim 1, wherein before pushing the video stream file generated by the screen recording operation to the color ring back tone platform in real time through the first video resource according to the screen recording operation on the first terminal, the method further comprises:
receiving a first input;
sending a video synchronization starting notification to the color ring platform so that the color ring platform starts a local push streaming function; and after the stream pushing function of the home terminal is started, the color ring back tone platform can push the video stream file to the second terminal.
3. The method according to claim 2, wherein after the video stream file generated by the screen recording operation is pushed to a color ring platform in real time through the first video resource according to the screen recording operation on the first terminal, the method further comprises:
receiving a second input;
and sending a video synchronization closing notification to the color ring platform so that the color ring platform stops the stream pushing function from the local end.
4. A video synchronization method applied to a second terminal is characterized by comprising the following steps:
under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform;
and receiving a video stream file pushed by the color ring back tone platform in real time through the second video resource, and playing the video stream file.
5. A video synchronization method is applied to a color ring platform and is characterized by comprising the following steps:
under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource and a second video resource; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform;
receiving a video stream file pushed by a first terminal in real time through the first video resource;
and pushing the received video stream file to the second terminal in real time through the second video resource so as to play the video stream file by the second terminal.
6. The method of claim 5, wherein before receiving the video stream file pushed by the first terminal in real time through the first video resource, the method further comprises:
receiving a video synchronization starting notification sent by a first terminal;
starting a local push streaming function according to the starting video synchronous notification; and after the stream pushing function of the home terminal is started, the color ring back tone platform can push the video stream file to the second terminal.
7. The method according to claim 5, wherein said streaming the received video stream file to the second terminal in real time through the second video resource comprises:
converting the received video stream file into a video stream file matched with the capability negotiation result according to the capability negotiation result of the polyphonic ringtone platform and the second terminal;
and pushing the video stream file matched with the capability negotiation result to the second terminal in real time through the second video resource.
8. The method according to claim 6, wherein after the received video stream file is pushed to the second terminal in real time through the second video resource, the method further comprises:
receiving a video synchronization closing notification sent by a first terminal;
and stopping the local terminal stream pushing function according to the video synchronization closing notification.
9. A system, comprising: the system comprises a first terminal, a second terminal and a color ring platform;
wherein the first terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, a first video resource is kept; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; according to the screen recording operation on the first terminal, the video stream file generated by the screen recording operation is pushed to a color ring platform in real time through the first video resource, so that the color ring platform pushes the video stream file to a second terminal in real time;
the second terminal is configured to: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a second video resource; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by the color ring back tone platform in real time through the second video resource, and playing the video stream file;
the color ring back tone platform is used for: under the condition that the first terminal and the second terminal successfully establish a call, maintaining a first video resource and a second video resource; the first video resource is a resource for transmitting video color ring between the first terminal and a color ring platform; the second video resource is a resource for transmitting video color ring between the second terminal and the color ring platform; receiving a video stream file pushed by a first terminal in real time through the first video resource; and pushing the received video stream file to the second terminal in real time through the second video resource so as to play the video stream file by the second terminal.
10. A terminal comprising a memory, a processor, and a program stored on the memory and executable on the processor; wherein the processor, when executing the program, implements the video synchronization method of any of claims 1-3; alternatively, the processor implements the video synchronization method of claim 4 when executing the program.
11. A color ring platform comprises a memory, a processor and a program which is stored on the memory and can run on the processor; characterized in that the processor, when executing the program, implements the video synchronization method according to any of claims 5-8.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the video synchronization method according to any one of claims 1 to 3; or the program, when executed by a processor, implements the steps in the video synchronization method of claim 4; alternatively, the program realizes the steps in the video synchronization method according to any one of claims 5 to 8 when executed by a processor.
CN201910869964.2A 2019-09-16 2019-09-16 Video synchronization method, terminal, color ring platform, system and readable storage medium Active CN110602430B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910869964.2A CN110602430B (en) 2019-09-16 2019-09-16 Video synchronization method, terminal, color ring platform, system and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910869964.2A CN110602430B (en) 2019-09-16 2019-09-16 Video synchronization method, terminal, color ring platform, system and readable storage medium

Publications (2)

Publication Number Publication Date
CN110602430A true CN110602430A (en) 2019-12-20
CN110602430B CN110602430B (en) 2021-08-06

Family

ID=68859595

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910869964.2A Active CN110602430B (en) 2019-09-16 2019-09-16 Video synchronization method, terminal, color ring platform, system and readable storage medium

Country Status (1)

Country Link
CN (1) CN110602430B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114006980A (en) * 2021-10-15 2022-02-01 广州启生信息技术有限公司 Method and device for realizing user interaction on video color ring

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150758A (en) * 2007-09-24 2008-03-26 北京市佳贝林科技有限公司 Playing method based caller CRBT or caller video CRBT
CN102131009A (en) * 2010-01-15 2011-07-20 华为技术有限公司 Method for playing video CRBT (color ring back tone), multimedia CRBT server and user equipment
CN105704539A (en) * 2016-02-15 2016-06-22 努比亚技术有限公司 Video sharing device and video sharing method
CN105827484A (en) * 2016-05-11 2016-08-03 厦门美图移动科技有限公司 Synchronous test image display method and system
CN107465958A (en) * 2017-09-07 2017-12-12 北京奇虎科技有限公司 A kind of video sharing method, apparatus, electronic equipment and medium
CN107483873A (en) * 2017-08-29 2017-12-15 珠海格力电器股份有限公司 A kind of video sharing method, device and mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150758A (en) * 2007-09-24 2008-03-26 北京市佳贝林科技有限公司 Playing method based caller CRBT or caller video CRBT
CN102131009A (en) * 2010-01-15 2011-07-20 华为技术有限公司 Method for playing video CRBT (color ring back tone), multimedia CRBT server and user equipment
CN105704539A (en) * 2016-02-15 2016-06-22 努比亚技术有限公司 Video sharing device and video sharing method
CN105827484A (en) * 2016-05-11 2016-08-03 厦门美图移动科技有限公司 Synchronous test image display method and system
CN107483873A (en) * 2017-08-29 2017-12-15 珠海格力电器股份有限公司 A kind of video sharing method, device and mobile terminal
CN107465958A (en) * 2017-09-07 2017-12-12 北京奇虎科技有限公司 A kind of video sharing method, apparatus, electronic equipment and medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114006980A (en) * 2021-10-15 2022-02-01 广州启生信息技术有限公司 Method and device for realizing user interaction on video color ring
CN114006980B (en) * 2021-10-15 2024-02-09 广州启生信息技术有限公司 Method for realizing user interaction of video color ring

Also Published As

Publication number Publication date
CN110602430B (en) 2021-08-06

Similar Documents

Publication Publication Date Title
KR101868533B1 (en) Video media playing methods, apparatuses and systems, and computer storage medium
CN110536028B (en) Video color ring realization method, color ring platform, terminal and storage medium
US20060203802A1 (en) Method and system for dynamically specifying and instantly transmitting and representing/displaying call data
KR20100058432A (en) Method and application server for providing early-media service based on session initiation protocol
CN101909192B (en) Television terminal and communication method thereof
CN1984373B (en) System and method for providing multimedia contents in a communication system
CN110602430B (en) Video synchronization method, terminal, color ring platform, system and readable storage medium
CN109391666A (en) A kind of video call method, apparatus and computer-readable medium
WO2015014174A1 (en) Ring-back playing method and apparatus, and ring-back service system
CN108377576B (en) Incoming call answering method and device of multi-channel terminal
CN110650254B (en) Information transmission method, information reception method, terminal, and storage medium
CN102664863B (en) Method, device, and system for realizing call waiting by user equipment
CN110351570B (en) Video live broadcast method and system under 5G network
CN104683602A (en) Music and image color ring back tone processing method and music and image color ring back tone processing device
CN100450311C (en) Method, system and device for control call
CN100461878C (en) Method for realizing media gateway control protocol playback
CN111212192B (en) Method, device and storage medium for playing voice when IMS fixed telephone user dials VOLTE user
CN112637676B (en) Multimedia file processing method, system, communication device and readable storage medium
CN102185983B (en) Voice prompt playing method and equipment for interactive voice response (IVR) call
KR20090084229A (en) Videophone game system, video game server and method for providing video game
CN108076205B (en) Incoming call recording method and device for multi-channel terminal
CN105516123A (en) Method for communication between VOIP (Voice over Internet Protocol) and telephone network telephone and PCLS
KR20100086642A (en) Method and system for providing calling information designation service by caller
EP3554035A1 (en) Method and device for communications based on integrating device, and storage medium
CN102111727A (en) Method and system for realizing touch-type ring back tone

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant