CN108111896B - Subtitle synchronization method and device - Google Patents
Subtitle synchronization method and device Download PDFInfo
- Publication number
- CN108111896B CN108111896B CN201810040905.XA CN201810040905A CN108111896B CN 108111896 B CN108111896 B CN 108111896B CN 201810040905 A CN201810040905 A CN 201810040905A CN 108111896 B CN108111896 B CN 108111896B
- Authority
- CN
- China
- Prior art keywords
- video frame
- caption
- current video
- subtitle
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Studio Circuits (AREA)
Abstract
The invention provides a subtitle synchronization method and a device, wherein the method comprises the following steps: acquiring a current video frame and continuous counting bits of subtitles; if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end; and if the counting value of the continuous counting bits of the subtitles is more than 0, directly transmitting the current video frame to a receiving end. In the invention, the sending end inserts the caption information corresponding to the video frame into the SEI of the video frame, so that the caption information becomes a part of the video frame data, and the caption information and the corresponding video frame can simultaneously reach the receiving end when the video is transmitted. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
Description
Technical Field
The invention relates to the technical field of video processing, in particular to a subtitle synchronization method and device.
Background
Currently, real-time videos exist in a plurality of application scenes such as live broadcast, instant messaging, safety monitoring and the like, and subtitle information needs to be processed when the real-time videos are played remotely, so that the subtitle information is synchronous with corresponding video frames.
Currently, most application scenes do not display subtitle information when playing real-time video. In a small part of application scenes, a receiving end acquires subtitle information from a sending end in advance, and when receiving real-time video transmitted by the sending end, the receiving end simultaneously plays video frames corresponding to the subtitle information. However, the receiving end needs to determine which video frames the subtitle information corresponds to through a very complicated operation process, and the synchronization efficiency of the subtitle information and the video frames is very low and the synchronization accuracy is low.
Because the subtitle information is not displayed when the real-time video is played currently, or the operation of displaying the subtitle information is complex, and the efficiency and the accuracy are low, a new subtitle synchronization scheme is urgently needed to simplify the subtitle synchronization process and improve the synchronization efficiency and the accuracy.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a method and an apparatus for synchronizing subtitles, so as to solve the problems of the prior art that subtitle information is not displayed when a real-time video is played, or the operation of displaying subtitle information is complex, and the efficiency and accuracy are low.
In a first aspect, an embodiment of the present invention provides a method for synchronizing subtitles, where the method includes:
acquiring a current video frame and continuous counting bits of subtitles;
if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end;
and if the counting value of the caption continuous counting bit is more than 0, directly transmitting the current video frame to a receiving end.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the inserting the subtitle information into the current video frame includes:
analyzing the current video frame, and positioning a supplemental enhancement information unit (SEI) from the current video frame;
inserting the subtitle information into the SEI.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where after the inserting the subtitle information into the current video frame, the method further includes:
the subtitle information comprises a subtitle file and a subtitle continuous frame number; if the continuous caption frame number is greater than 1, caching the continuous caption frame number, and adding one to the counting value of the continuous caption counting bit; alternatively, the first and second electrodes may be,
the subtitle information comprises a subtitle file and subtitle duration; if the caption duration is longer than the display duration corresponding to the current video frame, caching the caption duration, and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where after the directly transmitting the current video frame to a receiving end, the method further includes:
acquiring currently cached subtitle information;
if the caption information comprises the caption continuous frame number, adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous number of the subtitles included in the subtitle information after an operation is added, resetting the counting value to be 0, and deleting the cached subtitle information;
if the caption information comprises caption duration, increasing the counting value of the caption duration counting bit by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
In a second aspect, an embodiment of the present invention provides a subtitle synchronization method, where the method includes:
receiving a current video frame transmitted by a transmitting end;
obtaining a counting value of a caption continuous counting bit, if the counting value is 0, determining whether the current video frame contains caption information, if so, extracting the caption information corresponding to the current video frame from the current video frame, playing the current video frame, and simultaneously displaying the caption information; if not, directly playing the current video frame;
and if the counting value is larger than 0, acquiring the subtitle information cached currently, playing the current video frame, and simultaneously displaying the subtitle information cached currently.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the extracting, from the current video frame, subtitle information corresponding to the current video frame includes;
analyzing the current video frame, and positioning SEI from the current video frame;
and extracting subtitle information corresponding to the current video frame from the SEI.
With reference to the second aspect, an embodiment of the present invention provides a second possible implementation manner of the second aspect, where after the extracting the subtitle information corresponding to the current video frame from the current video frame, the method further includes:
the subtitle information comprises a subtitle file and a subtitle continuous frame number; if the continuous caption frame number is greater than 1, caching the caption information, and adding one to the counting value of the continuous caption counting bit;
the subtitle information comprises a subtitle file and subtitle duration; if the caption duration is longer than the display duration corresponding to the current video frame, caching the caption information, and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
With reference to the second aspect, an embodiment of the present invention provides a third possible implementation manner of the second aspect, where after the playing the current video frame and simultaneously displaying the currently cached subtitle information, the method further includes:
if the caption information comprises the caption continuous frame number, adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous number of the subtitles included in the subtitle information cached at present after an operation is added, resetting the counting value to be 0, and deleting the cached subtitle information;
if the caption information comprises caption duration, increasing the counting value of the caption duration counting bit by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the current cached caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
In a third aspect, an embodiment of the present invention provides a subtitle synchronization apparatus, where the apparatus includes:
the acquisition module is used for acquiring the current video frame and the continuous counting bit of the caption;
the inserting module is used for acquiring the subtitle information corresponding to the current video frame and inserting the subtitle information into the current video frame when the counting value of the subtitle continuous counting bits acquired by the acquiring module is 0 and the subtitle information corresponding to the current video frame exists;
the transmission module is used for transmitting the current video frame after the insertion operation to a receiving end; and the video frame acquisition module is further used for directly transmitting the current video frame to a receiving end when the counting value of the caption continuous counting bit acquired by the acquisition module is greater than 0.
In a fourth aspect, an embodiment of the present invention provides a subtitle synchronization apparatus, where the apparatus includes:
the receiving module is used for receiving the current video frame transmitted by the transmitting end;
the extraction module is used for obtaining a counting value of a caption continuous counting bit, if the counting value is 0, determining whether the current video frame contains caption information, and if so, extracting the caption information corresponding to the current video frame from the current video frame;
the playing module is used for playing the current video frame and simultaneously displaying the subtitle information when the counting value is 0 and the current video frame contains the subtitle information; and when the count value is 0 and the current video frame does not contain subtitle information, directly playing the current video frame; and the video display device is used for acquiring the currently cached subtitle information, playing the current video frame and simultaneously displaying the currently cached subtitle information if the counting value of the subtitle continuous counting digit is greater than 0.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information becomes a part of the video frame data, and the video frame with the inserted subtitle information is transmitted to the receiving end. And after receiving the video frame inserted with the subtitle information, the receiving end displays the corresponding subtitle information while playing the video frame. The invention can make the caption information and the corresponding video frame reach the receiving end at the same time when transmitting the video. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a flowchart illustrating a subtitle synchronization method according to embodiment 1 of the present invention;
fig. 2 is a flowchart illustrating another subtitle synchronization method according to embodiment 1 of the present invention;
fig. 3 is a flowchart illustrating a subtitle synchronization method according to embodiment 2 of the present invention;
fig. 4 is a flowchart illustrating another subtitle synchronization method according to embodiment 2 of the present invention;
fig. 5 is a schematic structural diagram illustrating a subtitle synchronization apparatus according to embodiment 3 of the present invention;
fig. 6 is a schematic structural diagram illustrating a subtitle synchronization apparatus according to embodiment 4 of the present invention;
fig. 7 is a schematic structural diagram illustrating a subtitle synchronization apparatus according to embodiment 6 of the present invention;
fig. 8 is a schematic structural diagram illustrating a subtitle synchronization apparatus according to embodiment 8 of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
In view of the fact that no subtitle information is displayed when a real-time video is played currently, or the subtitle information is displayed in a complex manner and the efficiency and accuracy are low, a new subtitle synchronization scheme is urgently needed to simplify the subtitle synchronization process and improve the synchronization efficiency and accuracy. Based on this, embodiments of the present invention provide a method and an apparatus for subtitle synchronization, which are described below by way of embodiments.
Example 1
Referring to fig. 1, an embodiment of the present invention provides a subtitle synchronization method, which specifically includes the following steps:
step 101: and acquiring the continuous counting bits of the current video frame and the caption.
The execution main body of the embodiment of the invention is a real-time video sending end. Because the video has the condition that the caption information of a plurality of video frames is the same, the embodiment of the invention sets the caption continuous counting bit in the sending end, marks the frame number of the current caption information which is continuously displayed through the caption continuous counting bit, or marks the duration of the current caption information which is continuously displayed through the caption continuous counting bit.
When the continuous counting bit of the caption is used for marking the number of frames of the current caption information which is continuously displayed and the continuously displayed caption information exists at present, adding one to the counting value of the continuous counting bit of the caption when the sending end finishes sending one video frame, judging whether the counting value of the continuous counting bit of the caption is equal to the continuous number of frames corresponding to the caption information or not, and resetting the counting value of the continuous counting bit of the caption to be 0 if the counting value of the continuous counting bit of the caption is equal to the continuous number of frames corresponding to the caption information. When the caption continuous counting bit is used for marking the duration of continuous display of the current caption information and the continuously displayed caption information exists at present, the counting value of the caption continuous counting bit is increased by the display duration corresponding to a video frame when the sending end finishes sending one video frame, whether the counting value of the caption continuous counting bit is equal to the continuous duration corresponding to the caption information or not is judged, and if the counting value of the caption continuous counting bit is equal, the counting value of the caption continuous counting bit is reset to be 0.
The sending end obtains the current video frame and simultaneously obtains the current counting value of the continuous counting bit of the caption. And judging whether the counting value of the continuous counting bit of the subtitle is 0, if so, indicating that no subtitle information needing to be continuously displayed exists, and then executing the operation of the step 102. If not, it indicates that there is subtitle information that needs to be continuously displayed, and then the operation of step 103 is performed.
Step 102: and if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end.
And when the sending end judges that the counting value of the continuous counting digit of the caption is 0, further judging whether caption information corresponding to the current video frame exists, and if not, directly transmitting the current video frame to the receiving end. If yes, acquiring subtitle information corresponding to the current video frame, and inserting the subtitle information into the current video frame in the following way, specifically comprising:
analyzing the current video frame, and positioning an SEI (Supplemental enhancement information) from the current video frame; the subtitle information is inserted into the SEI of the current video frame.
And after the subtitle information is inserted into the SEI of the current video frame, transmitting the current video frame with the inserted subtitle information to a receiving end. In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information corresponding to the video frame and the video frame can simultaneously reach the receiving end, the synchronization of the subtitle and the video picture is realized when the receiving end plays the video, and the situation that the subtitle is not matched with the video picture is avoided.
Because the subtitle information of a plurality of video frames is the same in the video, if the subtitle information contained in the current video frame is just the subtitle information required to be continuously displayed, if the current video frame loses packets in the transmission process, the receiving end cannot play the subtitle information for a plurality of continuous video frames when playing the video. Therefore, in the embodiment of the present invention, when the sending end transmits the current video frame inserted with the subtitle information to the receiving end, in order to reduce the situation that the subtitle information is lost due to packet loss in the transmission process, the embodiment of the present invention adds a packet loss retransmission strategy in the video transmission process. The transmission based on a reliable UDP (User Datagram Protocol) is enabled for the current video frame inserted with the subtitle information, for example, the current video frame inserted with the subtitle information is transmitted through a KCP (fast reliable Protocol).
When the current video frame with the inserted caption information is transmitted through a KCP protocol, the sending end inserts the caption information into the current video frame, then caches the current video frame, allocates a unique identifier for the current video frame, and then transmits the current video frame and the unique identifier thereof to the receiving end through the KCP protocol. And after receiving the current video frame and the unique identifier, the receiving end returns the unique identifier to the sending end. And when the sending end receives the unique identifier, the sending end confirms that the sending of the current video frame is successful, and continues to process the subsequent video frame. If the sending end does not receive the unique identification returned by the receiving end within a period of time after sending the current video frame and the unique identification to the receiving end, the sending end confirms that the current video frame loses packets, obtains the cached current video frame, and sends the current video frame and the unique identification thereof to the receiving end again through a KCP protocol. And deleting the cached current video frame by the sending end until the sending end confirms that the current video frame is successfully sent to the receiving end, and then continuing to process the subsequent video frame.
In the embodiment of the present invention, after the subtitle information is inserted into the current video frame, it is further determined whether the subtitle information corresponding to the current video frame needs to be continuously displayed. Whether or not the subtitle information needs to be continuously displayed may be identified by a subtitle duration frame number or a subtitle duration. When the caption information comprises a caption file and a caption continuous frame number, the sending end judges whether the caption continuous frame number included by the caption information is greater than 1, if the caption continuous frame number is greater than 1, the caption information needs to be continuously displayed, the sending end caches the caption continuous frame number, and the counting value of the caption continuous counting digit is increased by one. If the continuous frame number of the caption is equal to 1, the caption information does not need to be continuously displayed.
When the caption information comprises a caption file and caption duration, the sending end judges whether the caption duration included by the caption information is longer than the display duration corresponding to the current video frame, if the caption duration is longer than the display duration corresponding to the current video frame, the sending end indicates that the caption information needs to be displayed continuously, the sending end caches the caption duration, and the counting value of the caption duration counting bits is increased by the display duration corresponding to the current video frame. If the continuous duration of the caption is equal to the display duration corresponding to the current video frame, it indicates that the caption information does not need to be continuously displayed.
Step 103: and if the counting value of the continuous counting bits of the subtitles is more than 0, directly transmitting the current video frame to a receiving end.
When the sending end judges that the current counting value of the continuous counting digit of the caption is more than 0, the sending end confirms that the caption information which needs to be continuously displayed exists at present, and the caption information is inserted into the video frame before the current video frame and is transmitted to the receiving end. Therefore, the subtitle information does not need to be transmitted repeatedly, and the subtitle information does not need to be inserted into the current video frame at the moment, but the current video frame is directly transmitted to the receiving end. For video frames not containing subtitle information, the sending end can adopt an unreliable UDP protocol for transmission, and can also adopt a reliable UDP protocol for transmission.
When the count value of the continuous counting bits of the subtitle is greater than 0, although the subtitle information does not need to be inserted into the current video frame, the count value of the continuous counting bits of the subtitle also needs to be modified. For the caption information needing to be continuously displayed, when the caption information is inserted into a video frame and transmitted to a receiving end, a transmitting end caches the caption information, therefore, when the counting value of the continuous counting bit of the caption is larger than 0, and the transmitting end directly transmits the current video frame to the receiving end, the currently cached caption information is also obtained, and if the caption information comprises a caption file and the continuous frame number of the caption, the counting value of the continuous counting bit of the caption is increased by one. And then judging whether the counting value after one adding operation is equal to the continuous caption frame number included in the caption information, if so, indicating that the continuous display of the caption information is cut off, resetting the counting value of the continuous caption counting bit to be 0, and deleting the cached caption information. If not, the continuous display of the subtitle information is not finished.
And if the subtitle information stored in the cache at present comprises the subtitle file and the subtitle duration, increasing the counting value of the subtitle duration counting bit by the display duration corresponding to the current video frame. And then judging whether the counting value after the increasing operation is equal to the caption duration included in the caption information, if so, indicating that the caption information is continuously displayed and stopped, resetting the counting value of the caption continuous counting bit to 0, and deleting the cached caption information. If not, the continuous display of the subtitle information is not finished.
In the embodiment of the present invention, after the current video frame is acquired in step 101, it is further necessary to determine whether subtitle information update exists, and if so, the updated subtitle information is sent to the encoder and stored. If not, subtitle synchronization is achieved through the operation of step 102 or 103.
In order to facilitate understanding of the core synchronization strategy of the subtitle synchronization scheme provided by the embodiment of the present invention, the following description is made in detail with reference to the accompanying drawings. As shown in fig. 2, S1: and judging whether the subtitle information is updated or not, if so, executing step S2, and if not, executing step S4. S2: the updated subtitle information is transmitted to the encoder and saved, and then step S4 is performed. S3: and acquiring the current video frame. S4: and judging whether the subtitle information corresponding to the current video frame exists, if so, executing the step S5, and if not, executing the step S6. S5: the subtitle information is inserted into the SEI of the current video frame. S6: and transmitting the current video frame to a receiving end.
For each video frame, the video frame is the same as the current video frame, and the sending end realizes the subtitle synchronization according to the method provided by the embodiment of the invention.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information becomes a part of the video frame data, and the video frame with the inserted subtitle information is transmitted to the receiving end. And after receiving the video frame inserted with the subtitle information, the receiving end displays the corresponding subtitle information while playing the video frame. The invention can make the caption information and the corresponding video frame reach the receiving end at the same time when transmitting the video. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
Example 2
Referring to fig. 3, an embodiment of the present invention provides a subtitle synchronization method, which specifically includes the following steps:
step 201: and receiving the current video frame transmitted by the transmitting end.
The execution main body of the embodiment of the invention is a video receiving end. The receiving end receives the current video frame transmitted by the transmitting end.
Step 202: acquiring a counting value of a caption continuous counting bit, if the counting value is 0, determining whether a current video frame contains caption information, if so, extracting the caption information from the current video frame, playing the current video frame, and simultaneously displaying the caption information; if not, directly playing the current video frame.
After receiving the current video frame transmitted by the transmitting end, the receiving end judges whether the caption information corresponding to the current video frame exists. Specifically, a caption duration count bit for marking the number of frames or the duration for which caption information has been continuously displayed is also set in the receiving end. And the receiving terminal acquires the counting value of the caption continuous counting bit and judges whether the counting value of the caption continuous counting bit is 0 or not. If the count value of the continuous counting digit of the caption is 0, the caption information needing to be continuously displayed does not exist at present. And then the receiving end judges whether the current video frame contains the subtitle information. Specifically, the receiving end parses the current video frame and locates the SEI from the current video frame. And checking whether the SEI of the current video frame contains the subtitle information, if so, acquiring the subtitle information from the current video frame, and displaying the subtitle information while playing the current video frame. If not, it indicates that there is no subtitle information corresponding to the current video frame, and the current video frame is directly played.
The embodiment of the invention acquires the subtitle information from the current video frame in the following way, and specifically comprises the following steps: analyzing the current video frame, and positioning SEI from the current video frame; and extracting subtitle information corresponding to the current video frame from the SEI.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information corresponding to the video frame and the video frame can simultaneously reach the receiving end, the synchronization of the subtitle and the video picture is realized when the receiving end plays the video, and the situation that the subtitle is not matched with the video picture is avoided.
In the foregoing embodiment 1, when the sending end sends the current video frame with inserted subtitle information, in order to reduce the situation that subtitle information is lost due to packet loss in the transmission process, the sending end enables a packet loss retransmission policy, that is, enables transmission based on a reliable UDP protocol for the current video frame with inserted subtitle information, for example, transmits the current video frame with inserted subtitle information through a KCP protocol. When the sending end transmits the current video frame to the receiving end through the KCP protocol, the unique identification of the current video frame is also transmitted to the receiving end. And after receiving the current video frame and the unique identifier, the receiving end returns the unique identifier to the sending end so as to ensure that the sending end confirms that the current video frame is successfully sent when receiving the unique identifier, thereby continuing to process the subsequent video frame. If the packet loss occurs in the transmission of the current video frame, the receiving end cannot receive the current video frame and the unique identifier thereof, so that the sending end does not receive the unique identifier returned by the receiving end after a certain time, the packet loss of the current video frame is confirmed, and the sending end retransmits the current video frame until the current video frame is confirmed to be successfully sent to the receiving end.
When the continuous counting bit of the subtitle is 0 and the current video frame contains subtitle information, the receiving end needs to judge whether the subtitle information corresponding to the current video frame needs to be continuously displayed after extracting the subtitle information corresponding to the current video frame from the current video frame. Whether the subtitle information needs to be continuously displayed is identified by the subtitle duration frame number or the subtitle duration. When the caption information acquired from the current video frame comprises a caption file and a caption continuous frame number, the receiving end judges whether the caption continuous frame number included by the caption information is greater than 1, if the caption continuous frame number is greater than 1, the caption information needs to be continuously displayed, the receiving end caches the caption information, and the counting value of the caption continuous counting bit is increased by one. If the continuous frame number of the caption is equal to 1, the caption information does not need to be continuously displayed.
When the caption information acquired from the current video frame comprises a caption file and caption duration, the receiving end judges whether the caption duration included by the caption information is longer than the display duration corresponding to the current video frame, if the caption duration is longer than the display duration corresponding to the current video frame, the caption information needs to be continuously displayed, the receiving end caches the caption information, and the counting value of the caption continuous counting digit is increased by the display duration corresponding to the current video frame. If the continuous duration of the caption is equal to the display duration corresponding to the current video frame, it indicates that the caption information does not need to be continuously displayed.
Step 203: and if the counting value of the continuous counting bits of the caption is more than 0, acquiring the caption information currently cached, playing the current video frame and simultaneously displaying the caption information currently cached.
If the count value of the continuous counting digit of the subtitle obtained in step 202 is greater than 0, it is determined that the subtitle information to be continuously displayed exists at present, and the receiving end has obtained and cached the subtitle information from the video frame before the current video frame. It can be determined that the subtitle information is not contained in the current video frame. And the receiving end directly acquires the subtitle information from the cache and displays the subtitle information of the current cache while playing the current video frame.
After the current video frame is played and the currently cached subtitle information is displayed at the same time, the receiving end needs to modify the counting value of the continuous counting bits of the subtitles. Specifically, the receiving end acquires the currently cached subtitle information, and if the subtitle information comprises a subtitle file and a subtitle continuous frame number, the counting value of the subtitle continuous counting digit is increased by one. And then judging whether the counting value after one adding operation is equal to the continuous caption frame number included in the caption information, if so, indicating that the continuous display of the caption information is cut off, resetting the counting value of the continuous caption counting bit to be 0, and deleting the cached caption information. If not, the continuous display of the subtitle information is not finished.
If the subtitle information stored in the cache at present comprises a subtitle file and subtitle duration, increasing the display duration corresponding to the current video frame by the counting value of the subtitle duration counting bit, then judging whether the counting value after the increasing operation is equal to the subtitle duration included in the subtitle information, if so, indicating that the continuous display of the subtitle information is cut off, resetting the counting value to be 0, and deleting the cached subtitle information. If not, the continuous display of the subtitle information is not finished.
In order to facilitate understanding of the core synchronization strategy of the subtitle synchronization scheme provided by the embodiment of the present invention, the following description is made in detail with reference to the accompanying drawings. As shown in fig. 4, a 1: analyzing the current video frame transmitted by the transmitting end. A2: and judging whether the current video frame contains SEI, if so, executing the step A3, and if not, executing the step A5. A3: and judging whether the SEI of the current video frame contains subtitle information, if so, executing the step A4, and if not, executing the step A5. A4: the subtitle information is appended to the decoded current video frame. A5: the current video frame is displayed.
Each video frame transmitted by the transmitting end is the same as the current video frame, and the receiving end realizes the subtitle synchronization according to the method provided by the embodiment of the invention.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information becomes a part of the video frame data, and the video frame with the inserted subtitle information is transmitted to the receiving end. And after receiving the video frame inserted with the subtitle information, the receiving end displays the corresponding subtitle information while playing the video frame. The invention can make the caption information and the corresponding video frame reach the receiving end at the same time when transmitting the video. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
Example 3
Referring to fig. 5, an embodiment of the present invention provides a subtitle synchronization apparatus for performing the subtitle synchronization method provided in embodiment 1 above, where the apparatus includes:
an obtaining module 30, configured to obtain a current video frame and a continuous counting bit of a subtitle;
the inserting module 31 is configured to, when the count value of the continuous counting number of the subtitles obtained by the obtaining module 30 is 0 and the subtitle information corresponding to the current video frame exists, obtain the subtitle information corresponding to the current video frame and insert the subtitle information into the current video frame;
a transmission module 32, configured to transmit the current video frame after the insertion operation to a receiving end; and the video frame acquisition module is also used for directly transmitting the current video frame to a receiving end when the counting value of the caption continuous counting bits acquired by the acquisition module is greater than 0.
The inserting module 31 is configured to parse a current video frame and locate a supplemental enhancement information unit SEI from the current video frame; the subtitle information is inserted into the SEI.
In the embodiments of the present invention. The device also includes: a modification module for modifying the continuous counting bits of the caption;
when the caption information comprises a caption file and a caption continuous frame number, if the caption continuous frame number is greater than 1, a modification module is used for caching the caption continuous frame number and adding one to the counting value of the caption continuous counting digit; alternatively, the first and second electrodes may be,
and when the caption information comprises a caption file and a caption duration, if the caption duration is longer than the display duration corresponding to the current video frame, the modification module is used for caching the caption duration and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
After the current video frame is directly transmitted to the receiving end, the device also comprises a resetting module which is used for acquiring the subtitle information of the current cache; if the caption information comprises the caption continuous frame number, adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous number of the subtitles included in the subtitle information after an operation is added, resetting the counting value to be 0, and deleting the cached subtitle information; if the caption information comprises the caption duration, increasing the counting value of the caption duration counting bit by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information becomes a part of the video frame data, and the video frame with the inserted subtitle information is transmitted to the receiving end. And after receiving the video frame inserted with the subtitle information, the receiving end displays the corresponding subtitle information while playing the video frame. The invention can make the caption information and the corresponding video frame reach the receiving end at the same time when transmitting the video. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
Example 4
Referring to fig. 6, an embodiment of the present invention provides a subtitle synchronization apparatus for performing the subtitle synchronization method provided in embodiment 2 above, where the apparatus includes:
a receiving module 40, configured to receive a current video frame transmitted by a sending end;
the extracting module 41 is configured to obtain a count value of the continuous count bits of the subtitles, determine whether the current video frame includes subtitle information if the count value is 0, and extract subtitle information corresponding to the current video frame from the current video frame if the current video frame includes the subtitle information;
the playing module 42 is configured to play the current video frame and simultaneously display the subtitle information when the count value is 0 and the current video frame includes the subtitle information; and when the counting value is 0 and the current video frame does not contain subtitle information, directly playing the current video frame; and the video display device is used for acquiring the currently cached subtitle information, playing the current video frame and simultaneously displaying the currently cached subtitle information if the counting value of the subtitle continuous counting digit is greater than 0.
The extracting module 41 is configured to parse the current video frame and locate an SEI from the current video frame; and extracting subtitle information corresponding to the current video frame from the SEI.
After extracting the subtitle information corresponding to the current video frame from the current video frame, the device further comprises a modification module for modifying the subtitle persistence technology bit.
When the caption information comprises a caption file and a caption continuous frame number, if the caption continuous frame number is greater than 1, a modification module is used for caching the caption information and adding one to the counting value of the caption continuous counting digit;
and when the caption information comprises a caption file and caption duration, if the caption duration is longer than the display duration corresponding to the current video frame, the modification module is used for caching the caption information and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
The device also comprises a resetting module, wherein after the current video frame is played and the currently cached caption information is displayed at the same time, if the caption information comprises the caption continuous frame number, the resetting module is used for adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous frame number of the caption contained in the caption information which is cached at present after the operation is added, resetting the counting value to be 0, and deleting the cached caption information;
if the caption information comprises the caption duration, a resetting module is used for increasing the counting value of the caption duration counting bits by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the current cached caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
In the embodiment of the invention, the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information becomes a part of the video frame data, and the video frame with the inserted subtitle information is transmitted to the receiving end. And after receiving the video frame inserted with the subtitle information, the receiving end displays the corresponding subtitle information while playing the video frame. The invention can make the caption information and the corresponding video frame reach the receiving end at the same time when transmitting the video. The synchronization of the caption and the video picture is realized when the receiving end plays the video, and the problems of caption missing or caption and picture mismatching during video playing are avoided.
Example 5
An embodiment of the present invention provides a non-volatile computer storage medium, where a computer-executable instruction is stored in the computer storage medium, where the computer-executable instruction can execute the subtitle synchronization method in embodiment 1, and specifically execute the following method: acquiring a current video frame and continuous counting bits of subtitles; if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end; and if the counting value of the continuous counting bits of the subtitles is more than 0, directly transmitting the current video frame to a receiving end.
The computer-executable instructions stored in the computer storage medium, when executed, insert the subtitle information corresponding to the video frame into the SEI of the video frame, so that the subtitle information can arrive at the receiving end simultaneously with the video frame corresponding to the subtitle information when transmitting video. When the receiving end plays the video, the synchronization of the caption and the video picture is realized, and the situation that the caption is not matched with the video picture is avoided.
Example 6
As shown in fig. 7, an embodiment of the present invention provides a subtitle synchronization apparatus 60, including: a processor 61, a memory 62 and a bus 63, wherein the memory 62 stores execution instructions, and when the device is operated, the processor 61 communicates with the memory 62 through the bus 63, and the processor 61 executes the following execution instructions stored in the memory 62: acquiring a current video frame and continuous counting bits of subtitles; if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end; and if the counting value of the continuous counting bits of the subtitles is more than 0, directly transmitting the current video frame to a receiving end.
The caption synchronization device inserts the caption information corresponding to the video frame into the SEI of the video frame by the processor 61 executing the above instructions, so that the caption information can arrive at the receiving end simultaneously with the video frame corresponding thereto when transmitting video. When the receiving end plays the video, the synchronization of the caption and the video picture is realized, and the situation that the caption is not matched with the video picture is avoided.
Example 7
An embodiment of the present invention provides a non-volatile computer storage medium, where a computer-executable instruction is stored in the computer storage medium, where the computer-executable instruction can execute the subtitle synchronization method in embodiment 2, and specifically execute the following method: receiving a current video frame transmitted by a transmitting end; acquiring a counting value of a caption continuous counting bit, if the counting value is 0, determining whether a current video frame contains caption information, if so, extracting the caption information corresponding to the current video frame from the current video frame, playing the current video frame, and simultaneously displaying the caption information; if not, directly playing the current video frame; if the counting value is larger than 0, acquiring the subtitle information currently cached, playing the current video frame, and simultaneously displaying the subtitle information currently cached.
And the sending end inserts the subtitle information corresponding to the video frame into the SEI of the video frame and transmits the video frame to the receiving end. After the computer executable instructions stored in the computer storage medium are executed, the receiving end receives the video frame inserted with the caption information and displays the caption information while playing the video frame. The caption information and the corresponding video frame arrive at the receiving end at the same time. When the receiving end plays the video, the synchronization of the caption and the video picture is realized, and the situation that the caption is not matched with the video picture is avoided.
Example 8
As shown in fig. 8, an embodiment of the present invention provides a subtitle synchronization apparatus, where the subtitle synchronization apparatus 80 includes: a processor 81, a memory 82 and a bus 83, wherein the memory 82 stores execution instructions, and when the device is operated, the processor 81 and the memory 82 communicate through the bus 83, and the processor 81 executes the following execution instructions stored in the memory 82: receiving a current video frame transmitted by a transmitting end; acquiring a counting value of a caption continuous counting bit, if the counting value is 0, determining whether a current video frame contains caption information, if so, extracting the caption information corresponding to the current video frame from the current video frame, playing the current video frame, and simultaneously displaying the caption information; if not, directly playing the current video frame; if the counting value is larger than 0, acquiring the subtitle information currently cached, playing the current video frame, and simultaneously displaying the subtitle information currently cached.
The subtitle synchronization apparatus executes the above instruction through the processor 81, and the sending end inserts subtitle information corresponding to the video frame into the SEI of the video frame and transmits the video frame to the receiving end. And the receiving end receives the video frame inserted with the subtitle information and displays the subtitle information while playing the video frame. The caption information and the corresponding video frame arrive at the receiving end at the same time. When the receiving end plays the video, the synchronization of the caption and the video picture is realized, and the situation that the caption is not matched with the video picture is avoided.
The subtitle synchronization apparatus provided by the embodiment of the present invention may be specific hardware on the device, or software or firmware installed on the device, or the like. The device provided by the embodiment of the present invention has the same implementation principle and technical effect as the method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the method embodiments without reference to the device embodiments. It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the foregoing systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments provided by the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus once an item is defined in one figure, it need not be further defined and explained in subsequent figures, and moreover, the terms "first", "second", "third", etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the present invention in its spirit and scope. Are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. A method for synchronizing subtitles, the method comprising:
acquiring a current video frame and continuous counting bits of subtitles; the caption continuous counting bit is used for marking the frame number of the current caption information which is continuously displayed or the duration of the current caption information which is continuously displayed;
if the counting value of the continuous counting bits of the subtitles is 0 and the subtitle information corresponding to the current video frame exists, acquiring the subtitle information corresponding to the current video frame, inserting the subtitle information into the current video frame, and transmitting the current video frame after the inserting operation to a receiving end;
and if the counting value of the caption continuous counting bit is more than 0, directly transmitting the current video frame to a receiving end.
2. The method of claim 1, wherein said inserting the caption information into the current video frame comprises:
analyzing the current video frame, and positioning a supplemental enhancement information unit (SEI) from the current video frame;
inserting the subtitle information into the SEI.
3. The method of claim 1, wherein after inserting the subtitle information into the current video frame, further comprising:
the subtitle information comprises a subtitle file and a subtitle continuous frame number; if the continuous caption frame number is greater than 1, caching the continuous caption frame number, and adding one to the counting value of the continuous caption counting bit; alternatively, the first and second electrodes may be,
the subtitle information comprises a subtitle file and subtitle duration; if the caption duration is longer than the display duration corresponding to the current video frame, caching the caption duration, and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
4. The method of claim 1, wherein directly after transmitting the current video frame to a receiving end, further comprising:
acquiring currently cached subtitle information;
if the caption information comprises the caption continuous frame number, adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous number of the subtitles included in the subtitle information after an operation is added, resetting the counting value to be 0, and deleting the cached subtitle information;
if the caption information comprises caption duration, increasing the counting value of the caption duration counting bit by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
5. A method for synchronizing subtitles, the method comprising:
receiving a current video frame transmitted by a transmitting end;
obtaining a counting value of a caption continuous counting bit, if the counting value is 0, determining whether the current video frame contains caption information, if so, extracting the caption information corresponding to the current video frame from the current video frame, playing the current video frame, and simultaneously displaying the caption information; if not, directly playing the current video frame; the caption continuous counting bit is used for marking the frame number of the current caption information which is continuously displayed or the duration of the current caption information which is continuously displayed;
and if the counting value is larger than 0, acquiring the subtitle information cached currently, playing the current video frame, and simultaneously displaying the subtitle information cached currently.
6. The method according to claim 5, wherein said extracting subtitle information corresponding to the current video frame from the current video frame comprises;
analyzing the current video frame, and positioning SEI from the current video frame;
and extracting subtitle information corresponding to the current video frame from the SEI.
7. The method according to claim 5, further comprising, after extracting the subtitle information corresponding to the current video frame from the current video frame:
the subtitle information comprises a subtitle file and a subtitle continuous frame number; if the continuous caption frame number is greater than 1, caching the caption information, and adding one to the counting value of the continuous caption counting bit;
the subtitle information comprises a subtitle file and subtitle duration; if the caption duration is longer than the display duration corresponding to the current video frame, caching the caption information, and increasing the counting value of the caption duration counting digit by the display duration corresponding to the current video frame.
8. The method of claim 5, wherein after the playing the current video frame and simultaneously displaying the currently buffered subtitle information, further comprising:
if the caption information comprises the caption continuous frame number, adding one to the counting value of the caption continuous counting digit; if the counting value is equal to the continuous number of the subtitles included in the subtitle information cached at present after an operation is added, resetting the counting value to be 0, and deleting the cached subtitle information;
if the caption information comprises caption duration, increasing the counting value of the caption duration counting bit by the display duration corresponding to the current video frame; and if the counting value is equal to the caption duration included in the current cached caption information after the increasing operation, resetting the counting value to 0 and deleting the cached caption information.
9. A subtitle synchronization apparatus, comprising:
the acquisition module is used for acquiring the current video frame and the continuous counting bit of the caption; the caption continuous counting bit is used for marking the frame number of the current caption information which is continuously displayed or the duration of the current caption information which is continuously displayed;
the inserting module is used for acquiring the subtitle information corresponding to the current video frame and inserting the subtitle information into the current video frame when the counting value of the subtitle continuous counting bits acquired by the acquiring module is 0 and the subtitle information corresponding to the current video frame exists;
the transmission module is used for transmitting the current video frame after the insertion operation to a receiving end; and the video frame acquisition module is further used for directly transmitting the current video frame to a receiving end when the counting value of the caption continuous counting bit acquired by the acquisition module is greater than 0.
10. A subtitle synchronization apparatus, comprising:
the receiving module is used for receiving the current video frame transmitted by the transmitting end;
the extraction module is used for obtaining a counting value of a caption continuous counting bit, if the counting value is 0, determining whether the current video frame contains caption information, and if so, extracting the caption information corresponding to the current video frame from the current video frame; the caption continuous counting bit is used for marking the frame number of the current caption information which is continuously displayed or the duration of the current caption information which is continuously displayed;
the playing module is used for playing the current video frame and simultaneously displaying the subtitle information when the counting value is 0 and the current video frame contains the subtitle information; and when the count value is 0 and the current video frame does not contain subtitle information, directly playing the current video frame; and the video display device is used for acquiring the currently cached subtitle information, playing the current video frame and simultaneously displaying the currently cached subtitle information if the counting value of the subtitle continuous counting digit is greater than 0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810040905.XA CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810040905.XA CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108111896A CN108111896A (en) | 2018-06-01 |
| CN108111896B true CN108111896B (en) | 2020-05-05 |
Family
ID=62220179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810040905.XA Active CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108111896B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113382291A (en) * | 2020-03-09 | 2021-09-10 | 海信视像科技股份有限公司 | Display device and streaming media playing method |
| CN112887781A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Subtitle processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105959772A (en) * | 2015-12-22 | 2016-09-21 | 合网络技术（北京）有限公司 | Streaming media and caption instant synchronization display and matching processing method, device and system |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
| CN107005733A (en) * | 2014-12-19 | 2017-08-01 | 索尼公司 | Dispensing device, sending method, reception device and method of reseptance |
| CN107211170A (en) * | 2015-02-20 | 2017-09-26 | 索尼公司 | Transmitting device, transmission method, reception device and method of reseptance |
| CN107431835A (en) * | 2015-04-13 | 2017-12-01 | 索尼公司 | Dispensing device, sending method, transcriber and reproducting method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9800855B2 (en) * | 2013-08-20 | 2017-10-24 | Sony Corporation | Reproduction device, reproduction method, and recording medium |
| US9609397B1 (en) * | 2015-12-28 | 2017-03-28 | International Business Machines Corporation | Automatic synchronization of subtitles based on audio fingerprinting |
-
2018
- 2018-01-16 CN CN201810040905.XA patent/CN108111896B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107005733A (en) * | 2014-12-19 | 2017-08-01 | 索尼公司 | Dispensing device, sending method, reception device and method of reseptance |
| CN107211170A (en) * | 2015-02-20 | 2017-09-26 | 索尼公司 | Transmitting device, transmission method, reception device and method of reseptance |
| CN107431835A (en) * | 2015-04-13 | 2017-12-01 | 索尼公司 | Dispensing device, sending method, transcriber and reproducting method |
| CN105959772A (en) * | 2015-12-22 | 2016-09-21 | 合网络技术（北京）有限公司 | Streaming media and caption instant synchronization display and matching processing method, device and system |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108111896A (en) | 2018-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108270738B (en) | Video processing method and network equipment | |
| WO2018076982A2 (en) | Audio and video synchronous playback method, and terminal | |
| EP3291551A1 (en) | Image delay detection method and system | |
| US20160295269A1 (en) | Information pushing method, device and system | |
| CN108111896B (en) | Subtitle synchronization method and device | |
| CN111277854A (en) | Display method and device of virtual live broadcast room, electronic equipment and storage medium | |
| CN108184136B (en) | Video converging method and device | |
| CN107071506A (en) | A kind of method and system for pushing barrage | |
| US20210211777A1 (en) | Information Presenting Method, Terminal Device, Server and System | |
| CN110932931A (en) | Detection method and device for network delay of data center | |
| JP2010130689A (en) | Apparatus and method for inserting or extracting network timestamp | |
| CN112104909A (en) | Interactive video playing method and device, computer equipment and readable storage medium | |
| CN111431964B (en) | Message synchronous processing method, device and storage medium | |
| CN110086703B (en) | Message transmission method and device based on TCP (Transmission control protocol) | |
| CN108156500B (en) | Multimedia data time correction method, computer device and computer readable storage medium | |
| CN109728879B (en) | Synchronous error correction method for serial burst access application layer SLIP protocol message | |
| CN109525852B (en) | Live video stream processing method, device and system and computer readable storage medium | |
| CN107634928A (en) | A kind of processing method and processing device of bit stream data | |
| US20160142456A1 (en) | Method and Device for Acquiring Media File | |
| CN106686466B (en) | Video data positioning method | |
| CN115801927A (en) | Message parsing method and device | |
| CN114866827A (en) | Audio and video synchronization detection method and device, storage medium and electronic equipment | |
| CN102868930B (en) | Method and device for decoding transport-stream data packets | |
| CN108829824B (en) | Resource processing method and device in internet operation activity | |
| CN106658156A (en) | Method for acquiring display parameters of display device, display device, and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210302 Address after: Room 1702-03, Lantian Hesheng building, 32 Zhongguancun Street, Haidian District, Beijing 100082 Patentee after: BEIJING CENTURY TAL EDUCATION TECHNOLOGY Co.,Ltd. Address before: 102200 a1-05-001 maker Plaza, 338 Huilongguan East Street, Changping District, Beijing Patentee before: BEIJING SANTICLOUD TECHNOLOGY Co.,Ltd. |