CN107147949B - Live broadcast time shifting playing progress control method and system - Google Patents
Live broadcast time shifting playing progress control method and system Download PDFInfo
- Publication number
- CN107147949B CN107147949B CN201710311607.5A CN201710311607A CN107147949B CN 107147949 B CN107147949 B CN 107147949B CN 201710311607 A CN201710311607 A CN 201710311607A CN 107147949 B CN107147949 B CN 107147949B
- Authority
- CN
- China
- Prior art keywords
- time
- content information
- content
- shifting
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method and a system for controlling the playing progress of live broadcast time shifting, wherein the method comprises the following steps: acquiring content information appearing in each video frame in a live video stream, and memorizing the release time point of the content information; associating the content information with the corresponding video frame through the release time point; receiving a time shifting playing request sent by a user, judging whether the current live video stream meets a time shifting condition, and providing a positioning time shifting searching interface for the user; searching content information in a database according to key fields input by a user and performing matching processing; quickly jumping to a frame picture of a video frame associated with the content information according to the release time point of the content information, and playing; the system comprises a database and information acquisition module, a correlation module, a request receiving module, an interface creating module, a search matching module and a skipping module. The invention can quickly position and jump to the playing position desired by the user, the time shifting progress is more humanized, and the accuracy of time shifting is effectively improved.
Description
Technical Field
The invention relates to the technical field of multimedia playing, in particular to a playing progress control method and a playing progress control system for live broadcast time shifting.
Background
Time-shifting refers to the ability of a viewer to arbitrarily play back live content from past times. The time shifting is a new service formed by combining live broadcasting and on-demand broadcasting, and is a supplement of the live broadcasting service. When watching the live program, the user can pause in the middle and continue watching from the pause position later, so as to avoid missing some important stories. Technically, when a pause request is made, the playing server records the program list, and when the playing is continued, the recorded program is replayed in a unicast mode.
For live programs, the streaming media live broadcasting system with the time shifting function can watch programs at any time later, such as playing a ball game, does not need to watch the ball game live, and can pause, replay, advance or play at any time, namely, the synchronism of the playing time of the ball game is eliminated, the user wants to watch the programs at any time, and the user can watch the programs at any wonderful moment when the user wants to watch a goal, so that convenience is brought to the user.
At present, when a user watches a live video and wants to adjust the playing progress, the user can only adjust the playing progress by manually or case-pulling a playing progress bar, for example, a live time-shifting playing progress adjusting bar and a control method thereof disclosed in the prior patent publication No. CN102664032A, in the technology, the user can adjust the playing progress by adjusting the playing progress bar, but the user cannot quickly and accurately position the desired progress in the playing progress adjusting process by the technology, and the back-and-forth adjustment of the progress is tedious, the positioning error is large, the user cannot quickly position and jump to the desired playing position according to the played content, the progress adjustment is not humanized enough, the user experience is poor, and therefore, a live time-shifting playing progress control method and a live time-shifting playing progress control system capable of accurately positioning the playing progress are urgently needed to be developed.
Disclosure of Invention
The invention provides a live broadcast time shifting playing progress control method and system capable of accurately positioning a playing progress, and aims to solve the problems that in the existing video playing progress adjustment technology, the desired playing progress cannot be quickly and accurately positioned, the back-and-forth adjustment progress is relatively boring, the positioning error is relatively large, the user cannot quickly position and jump to the desired playing position according to the played content, the progress adjustment is not humanized, the user experience degree is relatively poor and the like.
The specific technical scheme of the invention is as follows:
the invention provides a playing progress control method of live broadcast time shift, which comprises the following steps:
s1, collecting content information appearing in each video frame in a live video stream, and memorizing the release time point of the content information, wherein the release time point is a playing time stamp of the video frame in the live video stream and is stored in a database, and the content information comprises subtitle content, bullet screen content or audio content;
s2, associating the content information with the corresponding video frame through the publishing time point;
s3, the user sends a time-shift play request, wherein the time-shift play request comprises fast-backward, fast-forward or pause;
s4, receiving the time-shift playing request, judging whether the current live video stream meets a time-shift condition, and if so, providing a positioning time-shift searching interface for a user;
s5, searching the content information in the database according to the key fields input by the user in the positioning and time-shifting search interface and performing matching processing;
s6, when the matching is successful, the matched content information in the database is obtained, and the frame picture of the video frame related to the content information is quickly jumped to according to the release time point of the content information and played.
Further, in step S1, the acquiring of the content information appearing in each video frame in the live video stream includes the following steps:
①, judging whether caption content or bullet screen content exists in the frame picture of the video frame, if so, capturing keywords or key words of the caption content or the bullet screen content and storing the keywords or the key words in the database, and if not, entering a step ②;
②, monitoring the audio content in the video frame, performing speech recognition on the audio content, acquiring keywords or key words in the audio content, and storing the keywords or key words in the audio content in the database.
Further, in step S2, associating the content information with the corresponding video frame through the distribution time point specifically includes the following steps:
s2-1, associating the content information with the corresponding video frame;
s2-2, forming a progress bar by the playing time stamps of the video frames according to the playing time progress, wherein the time node of the progress bar corresponds to the playing time stamps of the video frames;
s2-3, linking each video frame with the time point node of the progress bar through the corresponding playing time stamp.
Further, in step S4, the time-shift play request is received, whether the current live video stream meets the time-shift condition is determined, and if yes, a positioning time-shift search interface is provided for the user, where the specific method is as follows:
s4-1, receiving the time-shifting playing request sent by the user, exiting the live broadcasting state, and transferring to the semi-live broadcasting state with the buffer memory, and determining the current live broadcasting time point and the time-shifting request time point;
s4-2, taking the time shift request time point as the starting time of the playing progress, and taking the current live broadcast time point as the ending time of the playing progress;
s4-3, judging whether the video stream between the starting time and the ending time has a cache or not, and determining a storage position;
s4-4, if no cache exists, the time shifting condition is not satisfied, and time shifting failure information is sent to the user; if the cache exists, the time shifting condition is met, and at the moment, a positioning time shifting search interface is provided for the user.
Preferably, in step S5, the content information is searched in the database according to the key field input by the user in the positioning and time-shifting search interface, and the matching process is performed, where the specific method includes the following steps:
s5-1, identifying key fields input by the user in the positioning and time-shifting search interface;
s5-2, searching the database for the content information similar to the key fields according to the identified key fields, and performing matching processing;
s5-3, if the matching is unsuccessful, the automatic time shifting request cannot be realized, and the user can only manually adjust the playing progress; if the matching is successful, the process proceeds to step S6.
Preferably, step S5-2 further includes the steps of:
if a plurality of content information similar to the key fields are searched in the database according to the identified key fields, reminding a user to input other key fields for the second time in the positioning and time-shifting search interface, and searching the content information matched with the key fields in the two times in the similar content information searched for the first time;
if a plurality of content information is still searched in the database according to the two key fields, reminding the user to input other key fields for the third time in the positioning and time-shifting search interface until one matched content information is searched.
The invention also provides a system for controlling the playing progress of live broadcasting time shifting, which comprises a database, an information acquisition module, a correlation module, a request receiving module, an interface creating module, a search matching module and a skipping module, wherein the information acquisition module, the correlation module, the request receiving module, the interface creating module, the search matching module and the skipping module are communicated with the database;
the information acquisition module is used for acquiring content information appearing in each video frame in a live video stream, memorizing the release time point of the content information and storing the release time point to the database, wherein the release time point is a playing time stamp of the video frame in the live video stream, and the content information comprises subtitle content, bullet screen content or audio content;
the association module is used for associating the content information with the corresponding video frame through the release time point;
the request receiving module is used for receiving the time-shifting playing request sent by a user, judging whether the current live video stream meets a time-shifting condition or not, and if so, generating a searching instruction and sending the searching instruction to the interface creating module;
the interface creating module is used for receiving the search instruction and providing a created positioning time-shifting search interface for a user;
the searching and matching module is used for searching the content information in the database according to the key fields input by the user in the positioning and time-shifting searching interface and performing matching processing, and if the content information is matched with the key fields, generating a time-shifting instruction and sending the time-shifting instruction to the skipping module;
the skipping module is used for acquiring the matched content information in the database, and skipping to the frame picture of the video frame associated with the content information according to the release time point of the content information and playing the content information.
Further, the information acquisition module comprises a content judgment unit, a capture unit, a monitoring unit and a voice recognition unit which are communicated with the database, wherein the content judgment unit is used for judging whether caption content or barrage content exists in a frame picture of the video frame, and if the caption content or the barrage content exists in the frame picture of the video frame, a content capture instruction is generated and sent to the capture unit; the capturing unit is used for capturing keywords or key words of the subtitle content or the bullet screen content and storing the keywords or the key words into the database; if the audio content does not exist, generating an audio monitoring instruction and sending the audio monitoring instruction to the monitoring unit, wherein the monitoring unit is used for monitoring the audio content in the video frame and sending the audio content to the voice recognition unit; the voice recognition unit is used for performing voice recognition on the audio content, acquiring keywords or key words in the audio content and storing the keywords or key words in the audio content to the database.
Furthermore, the request receiving module comprises a receiving unit, a state switching unit and a cache judging unit which are communicated with each other, wherein the receiving unit is used for receiving the time-shift playing request sent by a user; the state switching unit is used for controlling the playing state to exit the live broadcasting state according to the time shifting playing request, and switching to a semi-live broadcasting state with a cache to determine the current live broadcasting time point and the time shifting request time point; the cache judging unit is used for judging whether the video stream between the time shifting request time point and the current live broadcast time point has a cache or not, determining a storage position, and if the cache exists, generating a search instruction and sending the search instruction to the interface creating module.
Preferably, the search matching module comprises a field identification unit and a search unit, wherein the field identification unit is communicated with the database and is used for identifying key fields input by a user in the positioning and time-shifting search interface and sending the key fields to the search unit; the searching unit is used for searching the content information similar to the identified key field in the database according to the identified key field, performing matching processing, and if matching is successful, generating a time shifting instruction and sending the time shifting instruction to the skipping module.
The invention has the following beneficial effects: the method provided by the invention can realize rapid and accurate positioning and move to the progress which the user wants to see, and overcomes the defects that the user manually adjusts the progress bar and cannot accurately position the playing progress according to the content of the video frame and the like in the prior art.
Drawings
Fig. 1 is a flowchart illustrating a method for controlling a play progress of live time shifting according to embodiment 1;
fig. 2 is a flowchart of a method for acquiring content information in step S1 in a method for controlling a play progress of live time shifting according to embodiment 2;
fig. 3 is a flowchart illustrating a specific operation of step S2 in the method for controlling a play progress of a live time shift according to embodiment 2;
fig. 4 is a flowchart illustrating a specific operation of step S4 in the method for controlling a play progress of a live time shift according to embodiment 2;
fig. 5 is a flowchart illustrating a specific operation of step S5 in the method for controlling a play progress of a live time shift according to embodiment 2;
fig. 6 is a block diagram illustrating a system for controlling a play progress of a live time shift according to embodiment 3;
fig. 7 is a block diagram illustrating a structure of an information collection module in a live time-shifted play progress control system according to embodiment 4;
fig. 8 is a block diagram illustrating a structure of a request receiving module in a play progress control system for live time shifting according to embodiment 4;
fig. 9 is a block diagram illustrating a structure of a search matching module in a play progress control system for live time shifting according to embodiment 4.
Wherein: 1. a database; 2. an information acquisition module; 201. a content judgment unit; 202. a grasping unit; 203. a monitoring unit; 204. a voice recognition unit; 3. a correlation module; 4. a request receiving module; 401. a receiving unit; 402. a state switching unit; 403. a cache judging unit; 5. an interface creation module; 6. a search matching module; 601. a field identification unit; 602. a search unit; 7. and a skip module.
Detailed Description
The present invention will be described in further detail with reference to the following examples and drawings.
Example 1
As shown in fig. 1, an embodiment 1 of the present invention provides a method for controlling a play progress of live time shifting, where the method for controlling a play progress of live time shifting includes the following steps:
s1, content information appearing in each video frame in the live video stream is collected, the release time point of the content information is memorized, the release time point is the playing time stamp of the video frame in the live video stream and is stored in the database 1, the time code of the content information is corresponding to the playing time stamp of the video frame, so that the video frame can be searched correspondingly through the content information, and the video frame is convenient to locate. The content information comprises subtitle content, bullet screen content or audio content; the content information can extract keywords from subtitles or barrages of frame pictures of the video frames, if the subtitles or barrages are not arranged in the frame pictures, audio in the frame pictures can be collected, and the keyword information is identified through analysis of the audio, so that later-stage users can conveniently retrieve the frame pictures through the keywords.
S2, associating the content information with the corresponding video frame through the publishing time point; after the content information is associated with the video frame, the video frame can be directly connected through the content information.
S3, the user sends a time-shift play request, wherein the time-shift play request comprises fast-backward, fast-forward or pause; the time-shifting playing request can be fast backward, fast forward or pause, when the time-shifting playing request is sent, the live broadcasting mode is exited, the on-demand state is entered, and at the moment, the system continuously caches from the time-shifting playing request sending to the live broadcasting nodes.
S4, receiving the time-shifting playing request, in order to realize time shifting, judging whether the current live video stream meets a time-shifting condition, and if so, providing a positioning time-shifting searching interface for a user; and if time shifting can be realized, the main system has or does not buffer the time-shifted stage.
S5, in order to realize accurate positioning and time shifting and improve the accuracy and the positioning efficiency of time shifting, positioning and retrieving are carried out through key fields, and the content information is searched in the database 1 according to the key fields input by the user in the positioning and time shifting search interface and is subjected to matching processing;
s6, when the matching is successful, the matched content information in the database 1 is obtained, and the frame picture of the video frame related to the content information is quickly jumped to according to the release time point of the content information and played. If the matching is unsuccessful, the system will prompt the failure of time shifting.
The method provided by the invention can be used for searching in the database 1 through the key field input by the user, so that the associated video frame can be accurately positioned through the matching of the key field, the accuracy of time shifting positioning is improved, the user can quickly position and jump to the playing position desired by the user, the time shifting progress is more humanized, the time for the user to play back the wonderful picture in the video stream is saved, the positioning is accurate, and the practicability is strong.
For example, when a user watches a live game, if the moment of watching a wonderful goal is delayed due to some things, the user may pause the live game, enter an on-demand state by sending a time-shift play request, and retrieve related content information in the database 1 by inputting a key field of "goal, goal" or the like, and simultaneously match the retrieved content information with related video frames, thereby playing the retrieved video frames.
Example 2
The embodiment 2 of the invention further defines the specific operation method of each step in the playing progress control method of live broadcast time shift on the basis of the embodiment 1, and effectively improves the accurate positioning of live broadcast time shift.
As shown in fig. 2, it should be further explained that, in step S1, the acquiring of the content information appearing in each video frame in the live video stream includes the following steps:
①, judging whether caption content or bullet screen content exists in the frame picture of the video frame, if so, capturing keywords or key words of the caption content or the bullet screen content and storing the keywords or the key words in the database 1, and if not, entering a step ②;
②, monitoring the audio content in the video frame, performing speech recognition on the audio content, acquiring keywords or key words in the audio content, and storing the keywords or key words in the audio content in the database 1.
The video stream is formed by continuously playing a plurality of video frames along with time, in order to realize the positioning of the video frames, content information in the video frames needs to be collected, the information in the video frames can comprise subtitles, barrages or audios, in order to improve the collection efficiency of the content information, the subtitles or barrages can be firstly identified, the processing and the content extraction are convenient, if the subtitles or the barrages are not arranged in the frame picture of the video frames, in order to realize the content extraction, the information of the video frames can be identified through the audios, for example, in the process of live-broadcast ball games, audios of a host, a fan, a team member, a referee and the like can be collected, key information is identified, the collection of the content information is carried out, and the information extraction efficiency is.
As shown in fig. 3, it should be further explained that, in step S2, associating the content information with the video frame corresponding to the content information through the distribution time point specifically includes the following steps:
s2-1, associating the content information with the corresponding video frame;
s2-2, forming a progress bar by the playing time stamps of the video frames according to the playing time progress, wherein the time node of the progress bar corresponds to the playing time stamps of the video frames; the progress bar is used for displaying the speed, the completion degree, the size of the residual unfinished tasks and the possibly required processing time of the processing tasks in a picture form in real time when the computer processes the tasks, and is generally displayed in a rectangular bar form. The time on the progress bar corresponds to the play time stamp of the video frame in the video stream.
S2-3, linking each video frame with the time point node of the progress bar through the corresponding playing time stamp. When the time node on the progress bar is adjusted, the linked video frames can be correspondingly jumped out, so that different videos can be conveniently played back and advanced.
As shown in fig. 4, it should be further noted that, in step S4, the time-shift play request is received, whether the current live video stream meets the time-shift condition is determined, and if yes, a positioning time-shift search interface is provided for the user, where the specific method is as follows:
s4-1, receiving the time-shifting playing request sent by the user, exiting the live broadcasting state, and transferring to the semi-live broadcasting state with the buffer memory, and determining the current live broadcasting time point and the time-shifting request time point;
s4-2, taking the time shift request time point as the starting time of the playing progress, and taking the current live broadcast time point as the ending time of the playing progress;
s4-3, judging whether the video stream between the starting time and the ending time has a cache or not, and determining a storage position;
s4-4, if no cache exists, the time shifting condition is not satisfied, and time shifting failure information is sent to the user; if the cache exists, the time shifting condition is met, and at the moment, a positioning time shifting search interface is provided for the user.
The time shifting of the live video can be realized only when the video cache exists in the system, therefore, in the live broadcasting process, when a user sends a time shifting playing request, the live broadcasting state needs to be quitted and cached, then whether the video of the time shifting time point which is requested to be played has the cache or not is detected, and the time shifting can be realized only if the cache exists.
As shown in fig. 5, preferably, in step S5, the content information is searched in the database 1 according to the key field input by the user in the positioning and time-shifting search interface, and the matching process is performed, where the specific method includes the following steps:
s5-1, identifying key fields input by the user in the positioning and time-shifting search interface;
s5-2, searching the content information similar to the key fields in the database 1 according to the identified key fields, and performing matching processing;
s5-3, if the matching is unsuccessful, the automatic time shifting request cannot be realized, and the user can only manually adjust the playing progress; if the matching is successful, the process proceeds to step S6.
When the key field input by the user can retrieve the extracted content information associated with the video frame in the database 1, the matching is proved to be successful, and if the relevant content information is not retrieved, the matching content information is proved to be absent.
Preferably, step S5-2 further includes the steps of:
if a plurality of content information similar to the key fields are searched in the database 1 according to the identified key fields, reminding a user to input other key fields for the second time in the positioning and time-shifting search interface, and searching the content information matched with the key fields in the two times in the similar content information searched for the first time;
if a plurality of content information is still searched in the database 1 according to the two key fields, reminding the user to input other key fields for the third time in the positioning and time-shifting search interface until one matched content information is searched.
When a user inputs a first keyword, if a plurality of content information is retrieved from the database 1, in order to realize accurate positioning of video frames, the second keyword can be input, the keywords can be retrieved in an 'and' form, the content information is further accurately positioned, if a plurality of corresponding content information still exist, a third keyword can be further input, and further retrieval and positioning are carried out until only one corresponding content is retrieved, so that the accurate positioning of the video frames is realized.
For example, when playing a ball game, the information retrieval can be performed by using the keywords such as "goal and goal", if 3 pieces of content information matched with the keywords appear, the retrieval can be performed by using the keywords such as "goal and goal team member", that is, only one piece of content information matched with the keywords can be retrieved, and the accurate positioning of the video frame is realized.
Example 3
As shown in fig. 6, embodiment 3 of the present invention provides a system for controlling a play progress of live broadcast time shifting, including a database 1, an information acquisition module 2, a correlation module 3, a request receiving module 4, an interface creation module 5, a search matching module 6, and a skip module 7, which are in communication with the database 1;
the information acquisition module 2 is configured to acquire content information appearing in each video frame in a live video stream, memorize a release time point of the content information, and store the release time point to the database 1, where the release time point is a play time stamp of the video frame in the live video stream, and the content information includes subtitle content, bullet screen content, or audio content;
the association module 3 is configured to associate the content information with the corresponding video frame through the publishing time point;
the request receiving module 4 is configured to receive the time-shift playing request sent by the user, determine whether the current live video stream meets a time-shift condition, and if so, generate a search instruction and send the search instruction to the interface creating module 5;
the interface creating module 5 is used for receiving the search instruction and providing a created positioning time-shifting search interface for a user;
the search matching module 6 is used for searching the content information in the database 1 according to the key fields input by the user in the positioning and time-shifting search interface and performing matching processing, and if the content information is matched with the key fields, generating a time-shifting instruction and sending the time-shifting instruction to the skipping module 7;
the skipping module 7 is configured to obtain the content information matched in the database 1, and skip to a frame of the video frame associated with the content information according to the release time point of the content information, and play the video frame.
The system provided by the invention has a simple structure, can realize accurate positioning of the time shifting progress of the user through acquisition of the content information of the video frame and retrieval of the content information, and has strong practicability.
Example 4
As shown in fig. 7, embodiment 4 of the present invention is further limited to embodiment 3, where the information acquisition module 2 includes a content determination unit 201, a capture unit 202, a monitoring unit 203, and a voice recognition unit 204, the content determination unit 201 is configured to determine whether a subtitle content or a bullet content exists in a frame of the video frame, and if so, generate a content capture instruction and send the content capture instruction to the capture unit 202; the capturing unit 202 is configured to capture keywords or key terms of the subtitle content or the bullet screen content and store the keywords or the key terms into the database 1; if the audio content does not exist, an audio monitoring instruction is generated and sent to the monitoring unit 203, where the monitoring unit 203 is configured to monitor the audio content in the video frame and send the audio content to the voice recognition unit 204; the speech recognition unit 204 is configured to perform speech recognition on the audio content, acquire keywords or key words in the audio content, and store the keywords or key words in the database 1.
The information acquisition module 2 can accurately acquire the content information in the video frame, so that the video frame can be conveniently positioned and screened by the content information in the later period, and the time shifting efficiency is effectively improved.
As shown in fig. 8, it should be further explained that the request receiving module 4 includes a receiving unit 401, a state switching unit 402, and a buffer determining unit 403, where the receiving unit 401 is configured to receive the time-shift play request sent by the user; the state switching unit 402 is configured to control the playing state to exit the live playing state according to the time-shift playing request, and transition to a semi-live playing state with a cache to determine a current live playing time point and a time-shift request time point; the cache determining unit 403 is configured to determine whether a cache exists in the video stream between the time shift request time point and the current live broadcast time point, determine a storage location, and if the cache exists, generate a search instruction and send the search instruction to the interface creating module 5.
As shown in fig. 9, it should be preferably noted that the search matching module 6 includes a field identification unit 601 and a search unit 602, which are in communication with the database 1, where the field identification unit 601 is configured to identify a key field input by a user in the positioning and time-shifting search interface and send the key field to the search unit 602; the searching unit 602 is configured to search the database 1 for the content information similar to the identified key field according to the identified key field, perform matching processing, and if matching is successful, generate a time shift instruction and send the time shift instruction to the skip module 7.
When the key field input by the user can retrieve the extracted content information associated with the video frame in the database 1, the matching is proved to be successful, and if the relevant content information is not retrieved, the matching content information is proved to be absent.
The present invention is not limited to the above-mentioned preferred embodiments, and any other products in various forms can be obtained by anyone in the light of the present invention, but any changes in the shape or structure thereof, which have the same or similar technical solutions as those of the present application, fall within the protection scope of the present invention.
Claims (5)
1. A playing progress control method of live time shifting is characterized by comprising the following steps:
s1, collecting content information appearing in each video frame in a live video stream, and memorizing the release time point of the content information, wherein the release time point is a playing time stamp of the video frame in the live video stream and is stored in a database (1), and the content information comprises subtitle content, bullet screen content or audio content;
s2, associating the content information with the corresponding video frame through the publishing time point;
s3, the user sends a time-shift play request, wherein the time-shift play request comprises fast-backward, fast-forward or pause;
s4, receiving the time-shift playing request, judging whether the current live video stream meets a time-shift condition, and if so, providing a positioning time-shift searching interface for a user;
s5, searching the content information in the database (1) according to the key fields input by the user in the positioning and time-shifting search interface and performing matching processing;
s6, when the matching is successful, acquiring the matched content information in the database (1), quickly jumping to the frame picture of the video frame associated with the content information according to the release time point of the content information, and playing;
step S1, the acquiring of the content information appearing in each video frame in the live video stream includes the following steps:
①, judging whether caption content or bullet screen content exists in the frame picture of the video frame, if so, capturing keywords or key words of the caption content or the bullet screen content and storing the keywords or the key words in the database (1), and if not, entering a step ②;
②, monitoring the audio content in the video frame, performing voice recognition on the audio content, acquiring keywords or key words in the audio content, and storing the keywords or key words in the audio content to the database (1);
in step S5, the content information is searched in the database (1) according to the key fields input by the user in the positioning and time-shifting search interface and is subjected to matching processing, and the specific method includes the following steps:
s5-1, identifying key fields input by the user in the positioning and time-shifting search interface;
s5-2, searching the database (1) for the content information similar to the key fields according to the identified key fields, and performing matching processing;
s5-3, if the matching is unsuccessful, the automatic time shifting request cannot be realized, and the user can only manually adjust the playing progress; if the matching is successful, the step S6 is entered;
in step S5-2, the method further includes the steps of:
if a plurality of content information similar to the key fields are searched in the database (1) according to the identified key fields, reminding a user to input other key fields for the second time in the positioning and time-shifting search interface, and searching the content information matched with the key fields in the two times in the similar content information searched for the first time;
if a plurality of content information is still searched in the database (1) according to the two key fields, reminding the user to input other key fields for the third time in the positioning and time-shifting search interface until one matched content information is searched.
2. The method for controlling the playing progress of live time shifting according to claim 1, wherein in step S2, the step of associating the content information with the video frame corresponding to the content information through the publishing time point specifically includes the following steps:
s2-1, associating the content information with the corresponding video frame;
s2-2, forming a progress bar by the playing time stamps of the video frames according to the playing time progress, wherein the time node of the progress bar corresponds to the playing time stamps of the video frames;
s2-3, linking each video frame with the time point node of the progress bar through the corresponding playing time stamp.
3. The method as claimed in claim 1, wherein in step S4, the time shift play request is received, whether the current live video stream meets a time shift condition is determined, and if yes, a positioning time shift search interface is provided for the user, and the specific method is as follows:
s4-1, receiving the time-shifting playing request sent by the user, exiting the live broadcasting state, and transferring to the semi-live broadcasting state with the buffer memory, and determining the current live broadcasting time point and the time-shifting request time point;
s4-2, taking the time shift request time point as the starting time of the playing progress, and taking the current live broadcast time point as the ending time of the playing progress;
s4-3, judging whether the video stream between the starting time and the ending time has a cache or not, and determining a storage position;
s4-4, if no cache exists, the time shifting condition is not satisfied, and time shifting failure information is sent to the user; if the cache exists, the time shifting condition is met, and at the moment, a positioning time shifting search interface is provided for the user.
4. A playing progress control system for live broadcast time shifting is characterized by comprising a database (1), an information acquisition module (2) communicated with the database (1), a correlation module (3), a request receiving module (4), an interface creating module (5), a search matching module (6) and a skipping module (7);
the information acquisition module (2) is used for acquiring content information appearing in each video frame in a live video stream, memorizing the release time point of the content information, and simultaneously storing the release time point to the database (1), wherein the release time point is a playing time stamp of the video frame in the live video stream, and the content information comprises subtitle content, bullet screen content or audio content;
the association module (3) is used for associating the content information with the corresponding video frame through the release time point;
the request receiving module (4) is used for receiving the time-shift playing request sent by the user, judging whether the current live video stream meets a time-shift condition or not, and if so, generating a search instruction and sending the search instruction to the interface creating module (5);
the interface creating module (5) is used for receiving the search instruction and providing a created positioning time-shifting search interface for a user;
the searching and matching module (6) is used for searching the content information in the database (1) according to the key fields input by the user in the positioning and time-shifting searching interface and performing matching processing, and if the content information is matched with the key fields, generating a time-shifting instruction and sending the time-shifting instruction to the skipping module (7);
the skipping module (7) is used for acquiring the matched content information in the database (1), and skipping to the frame picture of the video frame associated with the content information according to the release time point of the content information and playing the content information;
the information acquisition module (2) comprises a content judgment unit (201) communicated with the database (1), a grabbing unit (202), a monitoring unit (203) and a voice recognition unit (204), wherein the content judgment unit (201) is used for judging whether caption content or barrage content exists in a frame picture of the video frame, and if the caption content or the barrage content exists in the frame picture of the video frame, a content grabbing instruction is generated and sent to the grabbing unit (202); the grabbing unit (202) is used for grabbing keywords or key words of the subtitle content or the bullet screen content and storing the keywords or the key words into the database (1); if the audio content does not exist, generating an audio monitoring instruction and sending the audio monitoring instruction to a monitoring unit (203), wherein the monitoring unit (203) is used for monitoring the audio content in the video frame and sending the audio content to a voice recognition unit (204); the voice recognition unit (204) is used for performing voice recognition on the audio content, acquiring keywords or key terms in the audio content and storing the keywords or the key terms in the audio content to the database (1);
the search matching module (6) comprises a field identification unit (601) and a search unit (602), wherein the field identification unit (601) is communicated with the database (1), and the field identification unit (601) is used for identifying key fields input by a user in the positioning and time-shifting search interface and sending the key fields to the search unit (602); the searching unit (602) is configured to search the database (1) for the content information similar to the identified key field according to the identified key field, perform matching processing, and if matching is successful, generate a time shift instruction and send the time shift instruction to the skip module (7).
5. The system for controlling the playing progress of live time shifting according to claim 4, wherein the request receiving module (4) comprises a receiving unit (401), a status switching unit (402), and a buffer judging unit (403) which are in communication, and the receiving unit (401) is configured to receive the time-shifting playing request sent by a user; the state switching unit (402) is used for controlling the playing state to exit the live broadcasting state according to the time shifting playing request, and switching to a semi-live broadcasting state with a cache to determine the current live broadcasting time point and the time shifting request time point; the cache judging unit (403) is configured to judge whether the video stream between the time shift request time point and the current live broadcast time point has a cache, determine a storage location, and if the video stream has the cache, generate a search instruction and send the search instruction to the interface creating module (5).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710311607.5A CN107147949B (en) | 2017-05-05 | 2017-05-05 | Live broadcast time shifting playing progress control method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710311607.5A CN107147949B (en) | 2017-05-05 | 2017-05-05 | Live broadcast time shifting playing progress control method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107147949A CN107147949A (en) | 2017-09-08 |
| CN107147949B true CN107147949B (en) | 2020-05-05 |
Family
ID=59776758
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710311607.5A Active CN107147949B (en) | 2017-05-05 | 2017-05-05 | Live broadcast time shifting playing progress control method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107147949B (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107786902A (en) * | 2017-11-07 | 2018-03-09 | Tcl海外电子（惠州）有限公司 | Direct broadcast time-shift method, TV and computer-readable recording medium |
| CN109874043B (en) * | 2017-12-01 | 2021-07-27 | 腾讯科技（深圳）有限公司 | Video stream sending method, video stream playing method and video stream playing device |
| CN109922375A (en) * | 2017-12-13 | 2019-06-21 | 上海聚力传媒技术有限公司 | Event methods of exhibiting, playback terminal, video system and storage medium in live streaming |
| JP6337193B1 (en) * | 2017-12-14 | 2018-06-06 | 株式会社ドワンゴ | Server and program |
| CN108900885A (en) * | 2018-05-15 | 2018-11-27 | 北京字节跳动网络技术有限公司 | Barrage playback method, device and computer readable storage medium |
| CN108833946A (en) * | 2018-06-22 | 2018-11-16 | 青岛海信传媒网络技术有限公司 | Video broadcasting method and device |
| CN109168036A (en) * | 2018-10-08 | 2019-01-08 | 联想(北京)有限公司 | Playback method, system and electronic equipment |
| CN109947993B (en) * | 2019-03-14 | 2022-10-21 | 阿波罗智联(北京)科技有限公司 | Plot skipping method and device based on voice recognition and computer equipment |
| CN109996124B (en) * | 2019-03-19 | 2021-08-20 | 北京奇艺世纪科技有限公司 | Bullet screen processing method, system and storage medium |
| CN113438544A (en) * | 2019-07-17 | 2021-09-24 | 刘进 | Processing method of internet streaming media big data barrage |
| CN110401879A (en) * | 2019-08-13 | 2019-11-01 | 宇龙计算机通信科技(深圳)有限公司 | A kind of control method of video playing, device, terminal and storage medium |
| CN110784751B (en) * | 2019-08-21 | 2024-03-15 | 腾讯科技（深圳）有限公司 | Information display method and device |
| CN110677735A (en) * | 2019-10-17 | 2020-01-10 | 网易（杭州）网络有限公司 | Video positioning method and device |
| CN110913241B (en) * | 2019-11-01 | 2022-09-30 | 北京奇艺世纪科技有限公司 | Video retrieval method and device, electronic equipment and storage medium |
| CN110856014B (en) * | 2019-11-05 | 2023-03-07 | 北京奇艺世纪科技有限公司 | Moving image generation method, moving image generation device, electronic device, and storage medium |
| CN112437240B (en) * | 2021-01-27 | 2021-04-09 | 南京美乐威电子科技有限公司 | Video frame and time code binding method, video file recording method and encoder |
| CN113742411B (en) * | 2021-09-06 | 2024-05-31 | 科大讯飞股份有限公司 | Information acquisition method, device, system and computer readable storage medium |
| CN115802070B (en) * | 2023-01-31 | 2023-05-16 | 广州市千钧网络科技有限公司 | Live broadcast time-shift playing method and related device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064846A (en) * | 2007-05-24 | 2007-10-31 | 上海交通大学 | Time-shifted television video matching method combining program content metadata and content analysis |
| CN102387310A (en) * | 2010-08-31 | 2012-03-21 | 腾讯科技（深圳）有限公司 | Method and device for positioning video segments |
| CN102664032A (en) * | 2012-05-07 | 2012-09-12 | 乐视网信息技术（北京）股份有限公司 | Live broadcast time shifting play progress slider and control method thereof |
| CN103442300A (en) * | 2013-08-27 | 2013-12-11 | Tcl集团股份有限公司 | Audio and video skip playing method and device |
| CN105163178A (en) * | 2015-08-28 | 2015-12-16 | 北京奇艺世纪科技有限公司 | Method and device for locating video playing position |
| CN105898362A (en) * | 2015-11-25 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Video content retrieval method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100792261B1 (en) * | 2006-07-19 | 2008-01-07 | 삼성전자주식회사 | System for managing video based on topic and method usign the same and method for searching video based on topic |
-
2017
- 2017-05-05 CN CN201710311607.5A patent/CN107147949B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064846A (en) * | 2007-05-24 | 2007-10-31 | 上海交通大学 | Time-shifted television video matching method combining program content metadata and content analysis |
| CN102387310A (en) * | 2010-08-31 | 2012-03-21 | 腾讯科技（深圳）有限公司 | Method and device for positioning video segments |
| CN102664032A (en) * | 2012-05-07 | 2012-09-12 | 乐视网信息技术（北京）股份有限公司 | Live broadcast time shifting play progress slider and control method thereof |
| CN103442300A (en) * | 2013-08-27 | 2013-12-11 | Tcl集团股份有限公司 | Audio and video skip playing method and device |
| CN105163178A (en) * | 2015-08-28 | 2015-12-16 | 北京奇艺世纪科技有限公司 | Method and device for locating video playing position |
| CN105898362A (en) * | 2015-11-25 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Video content retrieval method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107147949A (en) | 2017-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147949B (en) | Live broadcast time shifting playing progress control method and system | |
| US11956516B2 (en) | System and method for creating and distributing multimedia content | |
| US9578366B2 (en) | Companion device services based on the generation and display of visual codes on a display device | |
| CA2924065C (en) | Content based video content segmentation | |
| CN104798346B (en) | For supplementing the method and computing system of electronic information relevant to broadcast medium | |
| CN101267523B (en) | Device for processing motion image, imaging apparatus, image display control method | |
| KR100547317B1 (en) | Simultaneous recording and playback apparatus with indexing/searching/browsing functionality | |
| US8855471B2 (en) | Media generation system | |
| US9100723B2 (en) | Method and system for managing information on a video recording | |
| EP1827018B1 (en) | Video content reproduction supporting method, video content reproduction supporting system, and information delivery program | |
| KR100792261B1 (en) | System for managing video based on topic and method usign the same and method for searching video based on topic | |
| US20170055044A1 (en) | Methods, systems, and media for presenting supplemental content relating to media content | |
| KR100589823B1 (en) | Method and apparatus for fast metadata generation, delivery and access for live broadcast program | |
| US11153663B2 (en) | Automatically generating supercuts | |
| CN101025987A (en) | Video play fast forward/fast rewind method and device based on video content | |
| CN103747366B (en) | A kind of display methods and player of HLS playback of media files progress | |
| CN111010598A (en) | Screen capture application method and smart television | |
| WO2017008498A1 (en) | Method and device for searching program | |
| JP5106669B1 (en) | Image information processing apparatus and image information processing method | |
| KR20180089977A (en) | System and method for video segmentation based on events | |
| TW201312999A (en) | An apparatus and method for selecting clips | |
| US11477541B2 (en) | Automatically generating supercuts | |
| JP2006180306A (en) | Moving picture recording and reproducing apparatus | |
| CN102572294A (en) | Field recoding system with ranking function | |
| CN101833978A (en) | Character signal-triggered court trial video real-time indexing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |