CN113395585A - Video detection method, video playing control method and device and electronic equipment - Google Patents
Video detection method, video playing control method and device and electronic equipment Download PDFInfo
- Publication number
- CN113395585A CN113395585A CN202110176453.XA CN202110176453A CN113395585A CN 113395585 A CN113395585 A CN 113395585A CN 202110176453 A CN202110176453 A CN 202110176453A CN 113395585 A CN113395585 A CN 113395585A
- Authority
- CN
- China
- Prior art keywords
- video
- information
- target
- playing
- evaluation result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 74
- 238000000034 method Methods 0.000 title claims description 81
- 238000011156 evaluation Methods 0.000 claims abstract description 149
- 230000015654 memory Effects 0.000 claims description 38
- 238000012545 processing Methods 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 17
- 230000004044 response Effects 0.000 claims description 12
- 230000001960 triggered effect Effects 0.000 claims description 9
- 239000012634 fragment Substances 0.000 claims description 8
- 230000009191 jumping Effects 0.000 claims description 7
- 230000001976 improved effect Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 19
- 238000013473 artificial intelligence Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 8
- 238000010801 machine learning Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 241000282414 Homo sapiens Species 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000013135 deep learning Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 238000013526 transfer learning Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a video detection method, a video playing control device and electronic equipment, and relates to the technical field of computers. The video detection method provided by the embodiment of the application can adopt the target video player to obtain the playing information of the video file from the video file of the video to be detected, and can obtain the target information by detecting the playing information of the video file, wherein the target information comprises information used for indicating that the playing information is unmatched with the target video player, and based on the target information, the compatibility evaluation result of the target video player to the video to be detected can be determined. Before the video to be detected is played, whether the target video player is used for playing the video to be detected is determined according to the determined compatibility evaluation result of the video to be detected, and when the compatibility evaluation result meets the requirement, the target video player is used for playing the video to be detected, so that the playing quality of the video player to the video can be improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a video detection method, a video playing control device and electronic equipment.
Background
When a video player is used for playing a video, if the video player is completely incompatible with the video, the video player may not complete video decoding, and thus the video cannot be played. If the video player is not completely incompatible with the video, the video player may be able to complete the video decoding and play the video, but the decoded video may have some problems.
At present, for a video to be played, if a display timestamp of the video decoded by a video player has a small jump and an audio display timestamp is normal, the video played by the video player will have a short pause or frame jump, and at this time, the video player will not quit playing but continue playing the video. However, the above problems in the video may cause a short pause or frame skipping phenomenon to the video being played, thereby affecting the playing quality of the video by the video player.
Disclosure of Invention
In order to solve technical problems in the related art, embodiments of the present application provide a video detection method, a video playing control device, and an electronic device, which can improve the playing quality of a video player for a video.
In order to achieve the above purpose, the technical solution of the embodiment of the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a video detection method, where the method includes:
acquiring playing information of a video file from the video file of a video to be detected by adopting a target video player;
detecting the playing information of the video file to obtain target information; the target information comprises information for indicating that the playing information has a mismatch with the target video player;
determining a compatibility evaluation result of the target video player on the video to be detected based on the target information;
and determining a processing strategy aiming at the video to be detected according to the compatibility evaluation result.
In a second aspect, an embodiment of the present application provides a video playback control method, where the method includes:
starting a standby video player in response to a play operation triggered by the target video player for the target video; the standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting playing information of a video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video;
and playing the target video through the standby video player.
In a third aspect, an embodiment of the present application further provides a video detection apparatus, where the apparatus includes:
the device comprises a playing information determining unit, a playing information determining unit and a playing information determining unit, wherein the playing information determining unit is used for acquiring playing information of a video file from the video file of a video to be detected by adopting a target video player;
the target information determining unit is used for detecting the playing information of the video file to obtain target information; the target information comprises information for indicating that the playing information has a mismatch with the target video player;
the evaluation result determining unit is used for determining a compatible evaluation result of the target video player on the video to be detected based on the target information;
and the processing strategy determining unit is used for determining the processing strategy aiming at the video to be detected according to the compatible evaluation result.
In an optional embodiment, the playing information of the video file at least includes timestamp information of each data frame of the video file; the target information determining unit is specifically configured to:
detecting timestamp information of each data frame of the video file;
if the timestamp information of any data frame is detected to be not in accordance with the first set condition, first prompt information used for representing timestamp information errors is recorded in the target information.
In an alternative embodiment, the time stamp information includes display time stamp information and decoding time stamp information; the first setting condition includes at least one of:
jumping of first set time occurs in the display timestamp information of any two adjacent data frames in the video file;
the decoding time stamp information of any two adjacent data frames in the video file has jumping of a second set time;
any data frame in the video file does not contain the display timestamp information or the decoding timestamp information;
any one data frame in the video file does not contain the display time stamp information and the decoding time stamp information.
In an alternative embodiment, the playing information at least includes the encoding type of the video file; the target information determining unit is specifically configured to:
detecting the encoding type of the video file;
if the coding type is not detected to include the network abstraction layer unit, recording second prompt information for representing that the network abstraction layer unit is lacked in the target information; or,
and if the detected network abstraction layer unit in the coding type does not accord with a second set condition, recording third prompt information for representing the error of the network abstraction layer unit in the target information.
In an alternative embodiment, the second setting condition includes at least one of:
a sequence parameter set, a picture parameter set, or a video parameter set included in the network abstraction layer unit is not located at a set position;
the network abstraction layer unit only contains specified information.
In an optional embodiment, the playing information at least includes an audio playing time, a video playing time and a total playing time of the video file; the target information determining unit is specifically configured to:
detecting the audio playing time, the video playing time and the total playing time of the video file;
if the audio playing time is not equal to the video playing time, or the audio playing time is greater than the total playing time, or the video playing time is greater than the total playing time, fourth prompt information used for representing that the playing time information is wrong is recorded in the target information.
In an optional embodiment, the playing information further includes a playing control parameter; the target information determining unit is specifically configured to:
detecting the playing control parameters;
if the playing control parameter does not accord with a third set condition, recording fifth prompt information for representing the playing control parameter error in the target information; the third setting condition includes at least one of:
determining that the total playing time of the video file is less than a set threshold value according to the playing control parameter;
determining that the playing time lengths of the audio data and the video data separated slices of the video file are not aligned according to the playing control parameters;
determining that the video file lacks a set initialization fragment according to the playing control parameter; the initialization fragment is used for initializing the video file when the resolution of the video to be detected is switched.
In an optional embodiment, the evaluation result determining unit is specifically configured to:
determining information types corresponding to all prompt information contained in the target information;
determining the value of the target video player on the compatibility evaluation result of the video to be detected according to the obtained number of the information types; or determining the value of the target video player for the compatibility evaluation result of the video to be detected according to the number of the prompt messages corresponding to each information type.
In an optional embodiment, the processing policy determining unit is specifically configured to:
if the value of the compatibility evaluation result meets a set threshold range, the video to be detected is issued to a video platform corresponding to the target video player;
and if the value of the compatibility evaluation result does not meet the set threshold range, outputting the target information.
In an optional embodiment, the processing policy determining unit is further configured to:
if the value of the compatibility evaluation result meets a set threshold range, playing the video to be detected by using the target video player;
and if the value of the compatibility evaluation result does not meet the set threshold range, starting a standby video player to play the video to be detected.
In a fourth aspect, an embodiment of the present application further provides a video playback control apparatus, where the apparatus includes:
a player starting unit for starting a standby video player in response to a play operation triggered for a target video by the target video player; the standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting playing information of a video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video;
and the video playing unit is used for playing the target video through the standby video player.
In a fifth aspect, this application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the video detection method of the first aspect is implemented.
In a sixth aspect, the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the video playback control method in the second aspect is implemented.
In a seventh aspect, this application embodiment further provides an electronic device, including a memory and a processor, where the memory stores a computer program that is executable on the processor, and when the computer program is executed by the processor, the processor is enabled to implement the video detection method of the first aspect.
In an eighth aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that is executable on the processor, and when the computer program is executed by the processor, the processor is enabled to implement the video playback control method in the second aspect.
According to the video detection method, the video playing control device and the electronic equipment, the target video player can be adopted to obtain the playing information of the video file from the video file of the video to be detected, the target information can be obtained by detecting the playing information of the video file, the target information comprises information used for indicating that the playing information is not matched with the target video player, and based on the target information, the compatibility evaluation result of the target video player to the video to be detected can be determined. Before the video to be detected is played, whether the target video player is used for playing the video to be detected is determined according to the determined compatibility evaluation result of the video to be detected, and when the compatibility evaluation result meets the requirement, the target video player is used for playing the video to be detected, so that the playing quality of the video player to the video can be improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is an application scene diagram of a video detection method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a video detection method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a display interface provided in an embodiment of the present application;
FIG. 4 is a schematic diagram of another display interface provided in an embodiment of the present application;
FIG. 5 is a schematic diagram of another display interface provided by an embodiment of the present application;
fig. 6 is a schematic flowchart of another video detection method according to an embodiment of the present application;
fig. 7 is a schematic flowchart of a video playing control method according to an embodiment of the present application;
fig. 8 is a schematic view of a display interface of a terminal device according to an embodiment of the present disclosure;
fig. 9 is a block diagram of a video detection apparatus according to an embodiment of the present application;
fig. 10 is a block diagram illustrating a structure of a video playback control apparatus according to an embodiment of the present disclosure;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that references in the specification of the present application to the terms "comprises" and "comprising," and variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Some terms in the embodiments of the present application are explained below to facilitate understanding by those skilled in the art.
(1) The video player: the software is software capable of playing videos stored in a digital signal form, has a video playing function, and can be installed on terminal equipment. For example, a mobile terminal such as a mobile phone is provided with a client of a video player, and a user can watch an online video or a local video through the client of the video player.
(2) Presentation Time Stamp (PTS): the method is used for prompting the video player to display the time corresponding to each data frame in the video file.
(3) Decoding Time Stamp (DTS): the method is used for prompting the video player to decode the time corresponding to each data frame in the video file.
(4) Network Abstraction Layer Unit (NALU): the NALU comprises a Header (Header) part and a Payload Data (Payload Data) part, and according to different types of Data carried, the NALU can comprise two types of network abstraction Layer units (Video Code Layer NALU, VCLU) for a Video coding Layer and non-Video coding Layer, and can be distinguished according to a NALU Type field in the Header.
The word "exemplary" is used hereinafter to mean "serving as an example, embodiment, or illustration. Any embodiment described as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
The terms "first" and "second" are used herein for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.
Embodiments of the present application relate to Artificial Intelligence (AI) and Machine Learning (ML) technologies, and are designed based on Computer Vision (CV) technology and Machine Learning in Artificial Intelligence.
Artificial intelligence is a theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technique of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence. Artificial intelligence is the research of the design principle and the realization method of various intelligent machines, so that the machines have the functions of perception, reasoning and decision making. The artificial intelligence technology mainly comprises a computer vision technology, a voice processing technology, machine learning/deep learning and other directions.
With the research and progress of artificial intelligence technology, artificial intelligence is developed and researched in a plurality of fields, such as common smart home, image retrieval, video monitoring, video detection, smart speakers, smart marketing, unmanned driving, automatic driving, unmanned aerial vehicles, robots, intelligent medical treatment and the like.
Computer vision technology is an important application of artificial intelligence, which studies relevant theories and techniques in an attempt to build an artificial intelligence system capable of obtaining information from images, videos or multidimensional data to replace human visual interpretation. Typical computer vision techniques generally include image processing and video analysis. The embodiment of the application provides a video detection method, and belongs to a method for video analysis.
Machine learning is a multi-field cross discipline, and relates to a plurality of disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and the like. The special research on how a computer simulates or realizes the learning behavior of human beings so as to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve the performance of the computer. Machine learning is the core of artificial intelligence, is the fundamental approach for computers to have intelligence, and is applied to all fields of artificial intelligence. Machine learning and deep learning generally include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and the like. In the video detection process, the normalization of the network abstraction layer unit and the like is detected through machine learning or deep learning.
In order to better understand the technical solution provided by the embodiment of the present application, some brief descriptions are provided below for application scenarios to which the technical solution provided by the embodiment of the present application is applicable, and it should be noted that the application scenarios described below are only used for illustrating the embodiment of the present application and are not limited. In specific implementation, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.
The video detection method provided by the embodiment of the application can be applied to the application scene shown in fig. 1. Referring to fig. 1, the server 100 is communicatively connected to the terminal device 300 through a network 200, wherein the network 200 may be, but is not limited to, a local area network, a metropolitan area network, a wide area network, or the like, and the number of the terminal devices 300 connected to the server 100 may be plural. The terminal device 300 can transmit communication data and messages to and from the server 100 through the network 200.
The terminal 300 may be a portable device (e.g., a mobile phone, a tablet Computer, a notebook Computer, etc.), or may be a Computer, a smart screen, a Personal Computer (PC), etc. The server 100 may be a server or a server cluster or a cloud computing center composed of a plurality of servers, or a virtualization platform, and may also be a personal computer, a large and medium-sized computer, or a computer cluster, etc. According to implementation needs, the application scenario in the embodiment of the present application may have any number of terminal devices and servers. The embodiment of the present application is not particularly limited to this.
For example, a client of a certain playing video player is installed on the terminal device 300, and an online video provided on a certain playing video platform corresponding to the server 100 or a local video stored on the terminal device 300 may be played through the client of the certain playing video player.
The terminal device 300 may further record a video and upload the recorded video to the server 100, or acquire a locally stored video and upload the video to the server 100, and distribute the video to a certain video playing platform through the server 100, or the server 100 may further acquire a video through another path, such as acquiring a video from a network or another server, and distribute the acquired video on a certain video playing platform.
In the related art, when a client of a certain broadcast video player is used by a terminal device to play an online video published on a certain broadcast video platform, the video player is required to decode a video file of the online video and play the online video based on the decoded video file. If the video player can complete decoding of the video, even if the video file obtained through decoding has the problems of small-amplitude jump of a display timestamp and the like, the video player can continue to play the video, so that the phenomenon of short pause or frame jump and the like can occur in the process of playing the video by the video player, and the playing quality of the video by the video player is influenced.
Based on this, when the method is applied to a server, before the server issues a video to a video playing platform, a target video player may be called to perform decapsulation operation on the video to be detected, so as to obtain playing information of a video file. And then, detecting the playing information of the video file to obtain target information, and determining a compatibility evaluation result of the target video player to-be-detected video according to the target information. And finally, determining whether to release the video to be detected to the video playing platform according to the determined compatibility evaluation result.
For example, before a server of a certain broadcast video platform releases a video, a certain broadcast video player can be used as a target video player, a compatibility evaluation result of the certain broadcast video player for a video to be detected is determined by the method, and when the compatibility evaluation result meets a requirement, the video can be released to the certain broadcast video platform. Therefore, when the terminal equipment plays the video published on a certain playing video platform by using a certain playing video player, the phenomena of short pause or frame skipping and the like in the playing process can be avoided, the playing quality of the video player on the video is further improved, and the film watching experience of a user when the user watches the video by using the video player is increased.
Fig. 2 shows a flowchart of a video detection method provided in an embodiment of the present application, where the method may be executed by the server 100 in fig. 1, or may be executed by a terminal device or other electronic devices. Illustratively, the following describes a specific implementation process of the video detection method according to the embodiment of the present application, with a server for video detection as an execution subject. The specific implementation process performed by other devices is similar to the process performed by the server alone, and is not described herein again.
As shown in fig. 2, the video detection method includes the following steps:
step S201, a target video player is used to obtain playing information of a video file from the video file of the video to be detected.
The target video player can be any video player. For example, for a server of a certain video playing platform, a short video recorded and distributed by a user through a client of a certain video playing player may be acquired, or a video may be acquired from a network. After the server acquires the video, the video needs to be detected first.
The server may decapsulate the video file of the video to be detected by using the target video player to obtain the playing information of the video file. The playback information may include at least one of the following information: PTS information and DTS information of each data frame of the video file, coding type of the video file, audio playing time, video playing time, total playing time, playing control parameters and the like of the video file. For example, after the server uses the target video player to decapsulate the video file of the video to be detected, the playing information of the video file as shown in fig. 3 may be displayed. As shown in fig. 3, the encoding type of the video file is H265 format, the audio playing time of the video file is 120min, the video playing time of the video file is 121min, the total playing time of the video file is 120min, and the playing control parameter is M3U8 content.
In an embodiment, by configuring the player parameters, the decoding and synchronizing module in the target video player may be skipped, and only the decapsulating module in the target video player is used to perform decapsulation on the video file of the video to be detected. By performing decapsulation operation on the video to be detected, code stream information such as PTS/DTS information, coding type, total playing time and the like of each data frame of the video file can be obtained.
Step S202, the playing information of the video file is detected to obtain the target information.
The server is provided with a detection module, and the target video player unpacks the video file of the video to be detected to obtain the playing information of the video file, and then can transmit the playing information of the video file into the detection module in a dotting mode. The detection module can detect the playing information of the video file to obtain target information which is used for indicating that the playing information of the video file is unmatched with the target video player. The dotting mode is to input the playing information of the video file into the detection module according to a certain time interval.
Step S203, based on the target information, determining a compatibility evaluation result of the target video player to the video to be detected.
The information types corresponding to the prompt information contained in the target information can be determined, and then the value of the compatibility evaluation result of the target video player to be detected can be determined according to the number of the obtained information types. And determining the value of the compatibility evaluation result of the target video player to be detected according to the number of the prompt messages corresponding to each message type.
Because the target information includes information used for indicating that the playing information of the video file is unmatched with the target video player, a compatible evaluation result of the target video player for the video to be detected can be determined according to the target information. When the unmatched information in the target information is less, the compatible evaluation result is better; when the mismatch information in the target information is more, the compatibility evaluation result is worse. For example, the determined compatibility evaluation result may be as shown in fig. 4, where fig. 4 shows that the video to be detected has a problem that the PTS of the xx frame of the video has a 3s jump and the score of the video is 8, and according to the compatibility evaluation result, it may be determined that the target information has less mismatch information and the compatibility evaluation result is better.
And step S204, determining a processing strategy for the video to be detected according to the compatibility evaluation result.
After determining the compatible evaluation result of the target video player for the video to be detected, the processing strategy for the video to be detected can be determined according to the compatible evaluation result.
In an embodiment, the server may determine whether to distribute the video to be detected to the video platform corresponding to the target video player according to the compatibility evaluation result. When the compatibility evaluation result meets the set requirement, the server can issue the video to be detected to the video platform corresponding to the target video player, and when the compatibility evaluation result does not meet the set requirement, the server can output target information, namely information unmatched with the target video player exists in the playing information of the output video file.
In another embodiment, the server may further determine whether to use the target video player to play the video to be detected or to start the standby video player to play the video to be detected according to the compatibility evaluation result. When the compatibility evaluation result meets the set requirement, the server can inform the terminal device to play the video to be detected by using the target video player, and when the compatibility evaluation result does not meet the set requirement, the server can inform the terminal device to start the standby video player to play the video to be detected.
According to the video detection method provided by the embodiment of the application, the target video player can be adopted to obtain the playing information of the video file from the video file of the video to be detected, the target information can be obtained by detecting the playing information of the video file, the target information comprises information used for indicating that the playing information is unmatched with the target video player, and based on the target information, the compatibility evaluation result of the target video player to be detected can be determined. Before the video to be detected is played, whether the target video player is used for playing the video to be detected is determined according to the determined compatibility evaluation result of the video to be detected, and when the compatibility evaluation result meets the requirement, the target video player is used for playing the video to be detected, so that the playing quality of the video player to the video can be improved.
In an embodiment, the playing information of the video file may include timestamp information of each data frame of the video file, and in the step S202, the target information may be obtained as follows: the PTS and DTS of each data frame of the video file are detected, and when the target information is detected to meet the first set condition, first prompt information used for representing the error of the time stamp information can be recorded in the target information. The first setting condition includes at least one of:
the PTS of any two adjacent data frames in the video file generates the jump of first set time;
the DTS of any two adjacent data frames in the video file generates jumping of a second set time;
any data frame in the video file does not contain PTS or DTS;
any one data frame in the video file does not contain PTS and DTS.
For example, when the PTS of any two adjacent data frames in the video file makes a jump of 1s or 2s or more, a PTS error of the video file may be recorded in the target information.
When a 100ms jump occurs in the DTS of any two adjacent data frames in a video file, a PTS error of the video file can be recorded in the target information. As shown in fig. 5, the DTS of the nth frame of the video may be 300ms, and the DTS of the (n + 1) th frame of the video may be 400ms, and then the transition of 100ms occurs between the DTSs of the nth frame and the DTS of the (n + 1) th frame of the video.
In another embodiment, the playing information of the video file may include the encoding type of the video file, and in step S202, the target information may be obtained as follows: detecting the coding type of the video file, and if the coding type is not detected to include a network abstraction layer unit, recording second prompt information for representing the lack of the network abstraction layer unit in the target information; and if the detected network abstraction layer unit in the coding type does not accord with the second set condition, recording third prompt information for representing the network abstraction layer unit error in the target information. Wherein the second setting condition at least comprises one of the following conditions:
the sequence parameter set, the image parameter set or the video parameter set contained in the network abstraction layer unit are not located at the set position;
the network abstraction layer unit includes only the specific information.
Specifically, each data frame of the video file may be parsed, and only the data frames in the H264 and H265 formats may be parsed, and if the NALU is not parsed, the second hint information for indicating the lack of the NALU may be recorded in the target information. When it is detected that a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), or a Video Parameter Set (VPS) included in the NALU is not located at a Set position, or only specific information is included in the NALU, third hint information for characterizing a NALU error may be recorded in the target information.
Among them, H264 and H265 are both video encoding formats, that is, video compression methods, and since the code stream of the video itself is too large, the video needs to be compressed and then transmitted through a network. H264 is a compression method which is currently the mainstream, and is generally adopted by video conference equipment. H265 may also be referred to as High Efficiency Video Coding (HEVC), which is an upgraded version of H264, and can further improve the compression ratio of the Video, and has outstanding performance in terms of improving the Video quality and reducing the capacity, i.e., saving the bandwidth, in the aspect of low-bit-rate Video compression.
For example, NALU errors of a video file may be recorded in the target Information when it is detected that the SPS/PPS/VPS is not in the packet header, or when it is detected that the SPS/PPS/VPS is not followed by an I-frame, or when it is detected that only Supplemental Enhancement Information (SEI) is included in the packet of the NALU.
In another embodiment, the playing information of the video file may include an audio playing time, a video playing time, and a total playing time of the video file, and in the step S202, the target information may be obtained as follows: and detecting the audio playing time, the video playing time and the total playing time of the video file, and recording fourth prompt information for representing that the playing time information is wrong in the target information when the target information is detected to meet the third set condition. The third setting condition includes at least one of:
the audio playing time is not equal to the video playing time;
the audio playing time is greater than the total playing time;
the video playing time is greater than the total playing time.
In another embodiment, the playing information of the video file may include playing control parameters, and in step S202, the target information may be obtained as follows: and detecting the playing control parameter, and if the playing control parameter does not accord with a fourth set condition, recording fifth prompt information for representing the error of the playing control parameter in the target information. Wherein the fourth setting condition includes at least one of:
determining that the total playing time of the video file is less than a set threshold value according to the playing control parameters;
determining that the playing time lengths of the audio data and the video data separated slices of the video file are not aligned according to the playing control parameters;
determining that the video file lacks a set initialization fragment according to the playing control parameter; the initialization fragment is used for initializing a video file when the resolution of the video to be detected is switched.
For example, the playback control parameter may be M3U8 content, the M3U8 content is detected, and if the M3U8 content is not standardized, fifth prompting information for indicating that the playback control parameter is incorrect is recorded in the target information. The method specifically comprises the following steps: when it is detected that the total playing time of the video file is less than the set threshold, or when it is detected that the playing time lengths of the audio data and the video data of the video file are not aligned, or when it is detected that fmp4 lacks initialization fragmentation, fifth prompt information for indicating an error of the playing control parameter may be recorded in the target information. fmp4 initialization slices are used to initialize video files when the resolution of the video to be detected is switched, and different resolutions require different initialization files. The fmp4 initialization segment can also be used for replacing other film sources after inserting advertisements in the M3U8 content, and initializing video files when videos to be detected of different film sources are spliced into the M3U8 content.
The M3U8 file refers to an M3U file in Universal Character Set Transformation Format (UTF) -8 encoding Format. The M3U file is a plain text file for recording index, when the M3U file is opened, the playing software does not play the file, but finds out the network address of the corresponding audio/video file according to the index for online playing.
In some embodiments, the server transmits the playing information of the video file to the detection module for detection, and after the target information is obtained, a compatibility evaluation result of the target video player for the video to be detected can be determined according to the target information, and the compatibility evaluation result can be represented in a score form. For example, when the target information indicates that there is no error in the playing information of the video file, it may be determined that the value of the compatibility evaluation result of the video to be detected by the target video player is 10 points full. When the target information indicates that a slight error exists in the playing information of the video file but does not affect the target video player to play the video file, it may be determined that the value of the compatibility evaluation result of the target video player to the video to be detected is 9 points. When the target information indicates that a slight error which can be compatible with the target video player exists in the playing information of the video file, the value of the compatibility evaluation result of the target video player for the video to be detected can be determined to be 8 points. When the target information indicates that a relatively serious error that the target video player can be compatible exists in the playing information of the video file, the value of the compatibility evaluation result of the target video player for the video to be detected can be determined to be 7 points. When the target information indicates that an error affecting the viewing experience of the user exists in the playing information of the video file, the value of the compatibility evaluation result of the target video player to be detected video can be determined to be 6 points. When the target information indicates that an error that the target video player reports an error to exit exists in the playing information of the video file, the value of the compatibility evaluation result of the target video player for the video to be detected can be determined to be 5 points.
Illustratively, this may be shown in the following table:
score of | Description of the invention |
10 (score) | Without error |
9 | Slight error does not affect |
8 | Light minor errors that a player can be compatible with |
7 | More serious errors that a player can be compatible with |
6 | Affecting the viewing experience |
5 | Player error reporting exit |
Specifically, in some embodiments, after the server obtains the target information, a value of a compatibility evaluation result of the target video player for the video to be detected may be determined according to the number of information types included in the target information. Illustratively, the information types included in the target information for indicating that the playing information of the video file is unmatched with the target video player are five, namely first prompt information for representing a timestamp information error, second prompt information for representing that a network abstraction layer unit is absent, third prompt information for representing a network abstraction layer unit error, fourth prompt information for representing a playing time information error and fifth prompt information for representing a playing control parameter error. If the target information obtained by detecting the video to be detected only comprises one of the five information types, the compatibility evaluation result can be determined to be 9 points, if the obtained target information comprises two of the five information types, the compatibility evaluation result can be determined to be 8 points, if the obtained target information comprises three of the five information types, the compatibility evaluation result can be determined to be 7 points, if the obtained target information comprises four of the five information types, the compatibility evaluation result can be determined to be 6 points, and if the obtained target information comprises all the five information types, the compatibility evaluation result can be determined to be 5 points.
In other embodiments, after the server obtains the target information, the value of the compatibility evaluation result of the target video player for the video to be detected may be determined according to the number of the prompt messages of each information type included in the target information. Specifically, a score may be set for each information type, and the information type may be deducted according to the number of detection errors of a certain information type included in the target information. The number of detection errors is the number of the prompt messages. For example, the score of each information type may be set to 10 points, the score of the information type may be decremented by 2 when 1 detection error exists in a certain information type, the score of the information type may be decremented by 4 when 2 detection errors exist in a certain information type, and the score of the information type may be decremented by 6 when 3 detection errors exist in a certain information type. And finally, determining the value of the compatible evaluation result according to the scores of all information types included in the target information.
In other embodiments, the server may also determine, according to the total amount of the prompt information included in the target information, a value of a compatibility evaluation result of the target video player for the video to be detected. The more the total number of the prompt messages contained in the target message, the lower the value of the compatible evaluation result, and the less the total number of the prompt messages contained in the target message, the higher the value of the compatible evaluation result. For example, if the total number of the types of prompt information included in the target information is lower than a first number threshold, the compatibility evaluation result may be determined to be 10 points, and if the total number of the types of prompt information included in the target information is lower than a second number threshold, the compatibility evaluation result may be determined to be 8 points. Wherein the second number threshold is greater than the first number threshold.
In other embodiments, after the server obtains the target information, the server may further determine a severity of the detection error according to the detection error included in the target information, determine the compatibility evaluation result according to the severity of the detection error, and determine a value of the compatibility evaluation result. For example, after the server detects the video to be detected, the obtained target information includes a detection error that is a jump of display timestamp information of any two adjacent data frames in the video file within a first set time, according to the detection error, the severity of the detection error can be determined to be very slight, then the compatibility evaluation result is determined to be that a slight error exists in the playing information but the playing of the video to be detected by the target video player is not affected, and the value of the compatibility evaluation result can be 9 minutes. For another example, after the server detects the video to be detected, the detection error included in the obtained target information is that the network abstraction layer unit only includes the specified information, according to the detection error, it may be determined that the severity of the detection error is severe, and then it is determined that the compatibility evaluation result is that the playing information has a severe error but does not affect the compatibility of the target video player with the video to be detected, and the value of the compatibility evaluation result may be 7 minutes.
In an embodiment, after determining a compatibility evaluation result of a video to be detected by a target video player, the compatibility evaluation result may be displayed to a technician, and the technician may determine whether to issue the video to be detected to a video platform corresponding to the target video player according to a value of the compatibility evaluation result. And when the value of the compatibility evaluation result meets the set threshold range, the video to be detected can be issued to the video platform corresponding to the target video player. And when the value of the compatible evaluation result does not meet the set threshold range, target information can be output. For example, the set threshold range may be 7 minutes, when the value of the compatibility evaluation result is greater than 7 minutes, the video to be detected may be issued to the video platform corresponding to the target video player, and when the value of the compatibility evaluation result is less than or equal to 7 minutes, the corresponding error existing in the video to be detected or the target video player may be output.
When the value of the compatible evaluation result is determined not to meet the set threshold range, the video to be detected cannot be issued to the video platform corresponding to the target video player, and the technical personnel can re-encode the video file of the video to be detected according to the output target information to solve the problem and then issue the video to be detected to the video platform corresponding to the target video player.
In some embodiments, the server may be provided with a detection tool for detecting whether the target video player is compatible with a certain video to be detected, where the detection tool may include the target video player, a detection module, a problem reporting module, and a report generating module, and all the modules cooperate with each other to complete the video detection method described above.
In particular, fig. 6 shows a detailed process for detecting whether a target video player is compatible with a video to be detected by using a detection tool. As shown in fig. 6, the process may include the steps of:
step S601, the target video player obtains playing information of the video file from the video file of the video to be detected.
The detection tool starts a target video player without synchronization through configuration parameters, in order to improve detection efficiency, shield a decoding process and only carry out decapsulation operation, the playing information such as PTS information and DTS information of each data frame of a video file of a video to be detected, the coding type of the video file, the audio playing time, the video playing time, the total playing time and the playing control parameters of the video file can be obtained.
Step S602, the target video player sends the playing information of the video file to the detection module.
In each frame cycle of decapsulating a video file of a video to be detected, a target video player may transmit playing information of each frame of the video file to a detection module in a dotting manner.
Step S603, the detection module detects the playing information of the video file to obtain the target information.
The detection module can detect the playing information of the video file to obtain target information which is used for indicating that the playing information of the video file is unmatched with the target video player.
Step S604, the detection module sends the target information to the problem reporting module.
Step S605, the detection module determines the score of the compatibility evaluation result of the video file according to the target information.
In step S606, the problem reporting module sends the target information and the score of the compatible evaluation result to the report generating module.
After receiving the target information, the problem reporting module can determine the qualitative score of the video file according to the target information and transmit the score of the target information and the compatible evaluation result to the report generating module.
And step S607, the report generating module classifies and sorts the scores of the target information and the compatible evaluation result and generates a report file.
After the video to be detected is played, the report generation module can summarize and sort the received target information and the score of the compatible evaluation result to generate a report file. The server can determine whether the target video player is compatible with the video to be detected according to the report file generated by the report generation module.
In another embodiment, the terminal device or a target video player installed on the terminal device may independently complete decapsulation of the video file, detection of playing information of the video file, and determination of a compatibility evaluation result, that is, the video detection method provided in this embodiment of the present application may be executed by the terminal device or the target video player installed on the terminal device. Before the target video player is used for playing the video to be detected, the terminal equipment can adopt the target video player to obtain playing information of the video file from the video file of the video to be detected, detect the playing information of the video file to obtain target information, and determine a compatibility evaluation result of the target video player on the video to be detected based on the target information. If the value of the compatibility evaluation result meets the set threshold range, a target video player is adopted to play the video to be detected; and if the value of the compatibility evaluation result does not meet the set threshold range, starting a standby video player to play the video to be detected.
Based on the same inventive concept as the above embodiments, the embodiments of the present application further provide a video playing control method, which can be executed by a terminal device. The method may comprise the steps of: and responding to the playing operation triggered by the target video player aiming at the target video, starting a standby video player, and playing the target video through the standby video player. The standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting the playing information of the video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video.
On the basis of the foregoing embodiments, fig. 7 shows a flowchart of a video playing control method provided in an embodiment of the present application, where the method may be executed by the terminal device 300 in fig. 1, or may be executed by both the server 100 and the terminal device 300. Illustratively, the following describes a specific implementation procedure of the video playback control method according to the embodiment of the present application, with a terminal device for controlling video playback as an execution subject. Are not described in detail herein.
As shown in fig. 7, the video playback control method includes the following steps:
step S701, in response to a play operation triggered by the target video player for the target video, determining a compatibility evaluation result of the target video player for the target video.
In an embodiment, in response to a play operation triggered by a user for a target video through a target video player on a terminal device, the terminal device may first invoke a decapsulation module of the target video player to perform decapsulation operation on a video file of the target video, so as to obtain play information of the video file. And then, the playing information of the video file can be detected, target information used for indicating that the playing information is unmatched with the target video player is obtained, and a compatibility evaluation result of the target video player for the target video is determined based on the target information. The specific implementation manner in the process may be executed by referring to the steps described above, and will not be described herein again.
In another embodiment, in response to a play operation triggered by a user for a target video through a target video player on a terminal device, the terminal device may first invoke a decapsulation module of the target video player to perform decapsulation operation on a video file of the target video, so as to obtain play information of the video file. And then sending the playing information of the video file to a server. After receiving the playing information of the video file, the server can detect the playing information to obtain target information and send the target information to the terminal equipment. After receiving the target information, the terminal device can determine a compatibility evaluation result of the target video player on the target video.
Step S702, determining whether the value of the compatibility evaluation result meets a set threshold range; if not, executing step S703; if so, step S704 is performed.
Step S703, outputting a prompt message for starting the standby video player to play the target video.
Step S704, the target video is played by the target video player.
After the terminal device determines the compatibility evaluation result of the target video player on the target video, when the value of the compatibility evaluation result meets the set threshold range, the terminal device can directly play the target video through the target video player. When the value of the compatibility evaluation result does not meet the set threshold range, the terminal device may output prompt information for starting the standby video player to play the target video to the user.
Step S705, determining whether to start a standby video player to play the target video; if not, executing step S706; if so, step S707 is executed.
Step S706, quitting playing.
In step S707, the standby video player is started.
The terminal equipment can determine whether to start the standby video player to play the target video according to the selection of the user. If the user selects not to start the standby video player, the terminal equipment responds to the operation of not starting the standby video player to play the target video and quits playing; and if the user selects to start the standby video player, the terminal equipment responds to the operation of starting the standby video player to play the target video, and starts the standby video player.
In some embodiments, when the value of the compatibility evaluation result of the target video player for the target video does not satisfy the set threshold range, the terminal device may search and determine a plurality of standby video players capable of playing the target video. The terminal equipment can display prompt information that the target video player is not suitable for playing the target video on the display interface, and display the identifiers of the standby video players on the display interface, so that a user can select any one video player from the standby video players to play the target video according to own preference, and personalized requirements of the user are met.
In step S708, the target video is played by the standby video player.
When the user determines to start the standby video player to play the target video, the terminal device may start the standby video player and play the target video through the standby video player in response to an operation of starting the standby video player to play the target video. When the user determines that the standby video player is not started to play the target video, the terminal device can quit the target video player and no longer play the target video in response to the operation that the standby video player is not started to play the target video.
For example, after receiving an operation of a user to play a target video through a target video player, the terminal device may determine a compatibility evaluation result of the target video player for the target video, and may output the prompt information shown in fig. 8 when determining that a value of the compatibility evaluation result does not satisfy a set threshold range. In fig. 8, if the user selects the "ok" button, the terminal device starts the standby video player in response to an operation of the user starting the standby video player, and plays the target video through the standby video player. If the user selects the "cancel" button, the terminal device exits the target video player in response to the user not initiating operation of the standby video player.
In the video detection method provided by the above embodiment, the target video player may be adopted to obtain the playing information of the video file from the video file of the video to be detected, and the target information may be obtained by detecting the playing information of the video file, where the target information includes information used to indicate that the playing information is not matched with the target video player, and based on the target information, a compatibility evaluation result of the target video player with the video to be detected may be determined. And when the target video player is determined to be incompatible with the video to be detected according to the compatibility evaluation result, the video to be detected can be played without adopting the target video player, so that the playing quality of the video player can be improved, and the film watching experience of a user when the user watches the video by adopting the video player is increased.
In other embodiments, when it is determined that the value of the compatibility evaluation result of the target video player for the target video does not satisfy the set threshold range, the terminal device may first obtain the playing information of the video file from the video file of the target video by using the standby video player, detect the playing information of the video file, determine the compatibility evaluation result of the standby video player for the target video, and then determine whether to use the standby video player to play the target video according to the compatibility evaluation result. The process of determining the compatibility evaluation result of the target video by the standby video player is similar to the process of determining the compatibility evaluation result of the target video by the target video player, and is not repeated here. If the value of the compatibility evaluation result of the standby video player on the target video does not meet the set threshold range, other standby video players are continuously searched; when the value of the compatibility evaluation result of the standby video player on the target video meets the set threshold range, the terminal device can output prompt information for starting the standby video player to play the target video. By the method, the phenomena of blocking or frame skipping and the like when the target video is played by the standby video player can be avoided, the playing quality of the target video is further ensured, and the watching experience of a user is improved.
In other embodiments, when it is determined that the value of the target video player with respect to the compatibility evaluation result of the target video does not satisfy the set threshold range, the terminal device may search and determine a plurality of standby video players capable of playing the target video, and display the identifiers of the plurality of standby video players on the display interface, so that a user may select any one of the plurality of standby video players to play the target video. After the terminal device determines the target standby video player selected by the user, the terminal device may first determine a result of the compatibility evaluation of the target standby video player on the target video, and a process of determining the result of the compatibility evaluation of the target standby video player on the target video is similar to a process of determining the result of the compatibility evaluation of the target video player on the target video, and is not repeated here. If the value of the compatibility evaluation result of the target video by the target standby video player meets the set threshold range, the terminal equipment can start the target standby video player to play the target video. By the method, the phenomena of pause or frame skipping and the like when the target video is played by the target standby video player can be avoided, and the playing quality of the target video is further ensured. And if the value of the compatibility evaluation result of the target video player to the target video does not meet the set threshold range, outputting prompt information and recommending the user to select other standby video players to play the target video.
The video detection method shown in fig. 2 is based on the same inventive concept, and the embodiment of the present application further provides a video detection device, which may be disposed in a server. Because the device is a device corresponding to the video detection method of the present application, and the principle of the device for solving the problem is similar to that of the method, the implementation of the device can refer to the implementation of the above method, and repeated details are not repeated.
Fig. 9 shows a schematic structural diagram of a video detection apparatus provided in an embodiment of the present application, and as shown in fig. 9, the video detection apparatus includes a play information determination unit 901, a target information determination unit 902, a compatibility evaluation result determination unit 903, and a processing policy determination unit 904.
The playing information determining unit 901 is configured to obtain playing information of a video file from the video file of the video to be detected by using a target video player;
a target information determining unit 902, configured to detect playing information of a video file to obtain target information; the target information comprises information for indicating that the playing information has mismatch with the target video player;
an evaluation result determining unit 903, configured to determine, based on the target information, a compatible evaluation result of the target video player for the video to be detected;
and a processing policy determining unit 904, configured to determine a processing policy for the video to be detected according to the compatibility evaluation result.
In an alternative embodiment, the playing information of the video file at least comprises timestamp information of each data frame of the video file; the target information determining unit 902 is specifically configured to:
detecting timestamp information of each data frame of a video file;
if the timestamp information of any data frame is detected to be not in accordance with the first set condition, first prompt information used for representing timestamp information errors is recorded in the target information.
In an alternative embodiment, the time stamp information includes display time stamp information and decoding time stamp information; the first setting condition includes at least one of:
jumping of first set time occurs in the display timestamp information of any two adjacent data frames in the video file;
the decoding time stamp information of any two adjacent data frames in the video file has jumping of a second set time;
any data frame in the video file does not contain display time stamp information or decoding time stamp information;
any one data frame in the video file does not contain display time stamp information and decoding time stamp information.
In an alternative embodiment, the playing information at least includes the encoding type of the video file; the target information determining unit 902 is specifically configured to:
detecting the encoding type of the video file;
if the coding type is not detected to include the network abstraction layer unit, second prompt information used for representing the lack of the network abstraction layer unit is recorded in the target information; or,
and if the detected network abstraction layer unit in the coding type does not accord with the second set condition, recording third prompt information for representing the network abstraction layer unit error in the target information.
In an alternative embodiment, the second set condition includes at least one of:
the sequence parameter set, the image parameter set or the video parameter set contained in the network abstraction layer unit are not located at the set position;
the network abstraction layer unit includes only the specific information.
In an alternative embodiment, the playing information at least includes the audio playing time, the video playing time and the total playing time of the video file; the target information determining unit 902 is specifically configured to:
detecting the audio playing time, the video playing time and the total playing time of the video file;
if the audio playing time is not equal to the video playing time, or the audio playing time is greater than the total playing time, or the video playing time is greater than the total playing time, fourth prompt information used for representing that the playing time information is wrong is recorded in the target information.
In an optional embodiment, the playing information further includes a playing control parameter; the target information determining unit 902 is specifically configured to:
detecting the playing control parameters;
if the playing control parameter does not accord with the third set condition, recording fifth prompt information for representing the playing control parameter error in the target information; the third setting condition includes at least one of:
determining that the total playing time of the video file is less than a set threshold value according to the playing control parameters;
determining that the playing time lengths of the audio data and the video data separated slices of the video file are not aligned according to the playing control parameters;
determining that the video file lacks a set initialization fragment according to the playing control parameter; the initialization fragment is used for initializing a video file when the resolution of the video to be detected is switched.
In an alternative embodiment, the evaluation result determining unit 903 is specifically configured to:
determining information types corresponding to all prompt information contained in the target information;
determining the value of the compatibility evaluation result of the target video player to-be-detected video according to the number of the obtained information types; or, according to the number of the prompt messages corresponding to each message type, determining the value of the compatibility evaluation result of the target video player to be detected.
In an alternative embodiment, the processing policy determining unit 904 is specifically configured to:
if the value of the compatible evaluation result meets the set threshold range, the video to be detected is issued to a video platform corresponding to the target video player;
and if the value of the compatible evaluation result does not meet the set threshold range, outputting the target information.
In an alternative embodiment, the processing policy determining unit 904 is further configured to:
if the value of the compatible evaluation result meets the set threshold range, a target video player is adopted to play the video to be detected;
and if the value of the compatibility evaluation result does not meet the set threshold range, starting a standby video player to play the video to be detected.
The video playing control method shown in fig. 7 is based on the same inventive concept, and the embodiment of the present application further provides a video playing control device, which can be arranged in a terminal device. Because the device is a device corresponding to the video playing control method of the present application, and the principle of the device for solving the problem is similar to that of the method, the implementation of the device can refer to the implementation of the above method, and repeated details are not repeated.
Fig. 10 is a schematic structural diagram of a video playback control apparatus according to an embodiment of the present application, and as shown in fig. 10, the video playback control apparatus includes a player startup unit 1001 and a video playback unit 1002.
The player starting unit 1001 is configured to start a standby video player in response to a play operation triggered by a target video player for a target video; the standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting the playing information of the video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video;
and a video playing unit 1002, configured to play the target video through the standby video player.
The embodiment of the method and the embodiment of the device are based on the same inventive concept, and the embodiment of the application also provides electronic equipment. The electronic device may be a server, such as server 100 shown in FIG. 1. In this embodiment, the electronic device may be configured as shown in fig. 11, and include a memory 111, a communication module 113, and one or more processors 112.
A memory 111 for storing computer programs executed by the processor 112. The memory 111 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a program required for running an instant messaging function, and the like; the storage data area can store various instant messaging information, operation instruction sets and the like.
The memory 111 may be a volatile memory (volatile memory), such as a random-access memory (RAM); the memory 111 may also be a non-volatile memory (non-volatile memory) such as, but not limited to, a read-only memory (rom), a flash memory (flash memory), a Hard Disk Drive (HDD) or a solid-state drive (SSD), or the memory 111 may be any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 111 may be a combination of the above memories.
The processor 112 may include one or more Central Processing Units (CPUs), or be a digital processing unit, etc. A processor 112 for implementing the above-mentioned video detection method when calling the computer program stored in the memory 111.
The communication module 113 is used for communicating with terminal devices and other electronic devices. If the electronic device is a server, the server may receive the video file sent by the terminal device through the communication module 113.
The specific connection medium among the memory 111, the communication module 113, and the processor 112 is not limited in the embodiments of the present application. In fig. 11, the memory 111 and the processor 112 are connected by a bus 114, the bus 114 is represented by a thick line in fig. 11, and the connection manner between other components is merely illustrative and not limited. The bus 114 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 11, but this is not intended to represent only one bus or type of bus.
In another embodiment, the electronic device may be any electronic device such as a mobile phone, a tablet computer, a Point of sale (POS), a vehicle-mounted computer, a smart wearable device, a PC, and the like, and may also be the terminal device 300 shown in fig. 1 by way of example.
Fig. 12 shows a block diagram of an electronic device according to an embodiment of the present application. As shown in fig. 12, the electronic apparatus includes: radio Frequency (RF) circuit 1210, memory 1220, input unit 1230, display unit 1240, sensor 1250, audio circuit 1260, wireless fidelity (WiFi) module 1270, processor 1280, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 12 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the electronic device in detail with reference to fig. 12:
the RF circuit 1210 is configured to receive and transmit signals during information transmission and reception or during a call, and in particular, receive downlink information of a base station and then process the received downlink information to the processor 1280; in addition, the data for designing uplink is transmitted to the base station.
The memory 1220 may be used for storing software programs and modules, such as program instructions/modules corresponding to the video detection method and apparatus or the video playing control method and apparatus in the embodiment of the present application, and the processor 1280 executes various functional applications and data processing of the electronic device, such as the video detection method or the video playing control method provided in the embodiment of the present application, by running the software programs and modules stored in the memory 1220. The memory 1220 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program of at least one application, and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 1220 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The input unit 1230 may be used to receive numeric or character information input by a user and generate key signal inputs related to user settings and function control of the terminal.
Optionally, the input unit 1230 may include a touch panel 1231 and other input devices 1232.
The touch panel 1231, also referred to as a touch screen, may collect touch operations performed by a user on or near the touch panel 1231 (e.g., operations performed by the user on or near the touch panel 1231 using any suitable object or accessory such as a finger or a stylus), and implement corresponding operations according to a preset program, such as an operation performed by the user to click a shortcut identifier of a function module. Alternatively, the touch panel 1231 may include two portions, i.e., a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 1280, and can receive and execute commands sent by the processor 1280. In addition, the touch panel 1231 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave.
Optionally, other input devices 1232 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 1240 may be used to display information input by a user or interface information presented to the user, as well as various menus of the electronic device. The display unit 1240 is a display system of the terminal device, and is used for presenting an interface, such as a display desktop, an operation interface of an application, or an operation interface of a live application.
Further, touch panel 1231 can overlay display panel 1241, and when touch panel 331 detects a touch operation thereon or nearby, the touch panel can transmit the touch operation to processor 1280 to determine the type of the touch event, and then processor 1280 can provide a corresponding interface output on display panel 1241 according to the type of the touch event.
Although in fig. 12, the touch panel 1231 and the display panel 1241 are implemented as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 1231 and the display panel 1241 may be integrated to implement the input and output functions of the terminal.
The electronic device may also include at least one sensor 1250, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1241 according to the brightness of ambient light, and the proximity sensor may turn off the backlight of the display panel 1241 when the electronic device is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the electronic device, vibration recognition related functions (such as pedometer, tapping) and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured to the electronic device, detailed descriptions thereof are omitted.
WiFi belongs to short-distance wireless transmission technology, and the electronic device can help the user send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 1270, which provides the user with wireless broadband internet access. Although fig. 12 shows the WiFi module 1270, it is understood that it does not belong to the essential constitution of the electronic device, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 1280 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 1220 and calling data stored in the memory 1220, thereby integrally monitoring the electronic device. Optionally, processor 1280 may include one or more processing units; optionally, the processor 1280 may integrate an application processor and a modem processor, where the application processor mainly processes software programs such as an operating system, an application, and a functional module inside the application, for example, a video detection method or a video playing control method provided in this embodiment of the present application. The modem processor handles primarily wireless communications. It is to be appreciated that the modem processor described above may not be integrated into the processor 1280.
It will be appreciated that the configuration shown in fig. 12 is merely illustrative and that the electronic device may include more or fewer components than shown in fig. 12 or have a different configuration than shown in fig. 12. The components shown in fig. 12 may be implemented in hardware, software, or a combination thereof.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the video detection method or the video playback control method in the above-described embodiments. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.
Claims (15)
1. A method for video detection, the method comprising:
acquiring playing information of a video file from the video file of a video to be detected by adopting a target video player;
detecting the playing information of the video file to obtain target information; the target information comprises information for indicating that the playing information has a mismatch with the target video player;
determining a compatibility evaluation result of the target video player on the video to be detected based on the target information;
and determining a processing strategy aiming at the video to be detected according to the compatibility evaluation result.
2. The method according to claim 1, wherein the playing information of the video file at least comprises time stamp information of each data frame of the video file;
the detecting the playing information of the video file to obtain the target information includes:
detecting timestamp information of each data frame of the video file;
if the timestamp information of any data frame is detected to be not in accordance with the first set condition, first prompt information used for representing timestamp information errors is recorded in the target information.
3. The method of claim 2, wherein the time stamp information comprises display time stamp information and decoding time stamp information; the first setting condition includes at least one of:
jumping of first set time occurs in the display timestamp information of any two adjacent data frames in the video file;
the decoding time stamp information of any two adjacent data frames in the video file has jumping of a second set time;
any data frame in the video file does not contain the display timestamp information or the decoding timestamp information;
any one data frame in the video file does not contain the display time stamp information and the decoding time stamp information.
4. The method according to claim 1, wherein the playback information at least includes an encoding type of the video file;
the detecting the playing information of the video file to obtain the target information includes:
detecting the encoding type of the video file;
if the coding type is not detected to include the network abstraction layer unit, recording second prompt information for representing that the network abstraction layer unit is lacked in the target information; or,
and if the detected network abstraction layer unit in the coding type does not accord with a second set condition, recording third prompt information for representing the error of the network abstraction layer unit in the target information.
5. The method according to claim 4, wherein the second set condition includes at least one of:
a sequence parameter set, a picture parameter set, or a video parameter set included in the network abstraction layer unit is not located at a set position;
the network abstraction layer unit only contains specified information.
6. The method of claim 1, wherein the playback information at least comprises an audio playback time, a video playback time, and a total playback time of the video file;
the detecting the playing information of the video file to obtain the target information includes:
detecting the audio playing time, the video playing time and the total playing time of the video file;
if the audio playing time is not equal to the video playing time, or the audio playing time is greater than the total playing time, or the video playing time is greater than the total playing time, fourth prompt information used for representing that the playing time information is wrong is recorded in the target information.
7. The method of claim 1, wherein the playback information further comprises playback control parameters;
the detecting the playing information of the video file to obtain the target information includes:
detecting the playing control parameters;
if the playing control parameter does not accord with a third set condition, recording fifth prompt information for representing the playing control parameter error in the target information; the third setting condition includes at least one of:
determining that the total playing time of the video file is less than a set threshold value according to the playing control parameter;
determining that the playing time lengths of the audio data and the video data separated slices of the video file are not aligned according to the playing control parameters;
determining that the video file lacks a set initialization fragment according to the playing control parameter; the initialization fragment is used for initializing the video file when the resolution of the video to be detected is switched.
8. The method according to claim 1, wherein the determining, based on the target information, a compatibility evaluation result of the target video player for the video to be detected comprises:
determining information types corresponding to all prompt information contained in the target information;
determining the value of the target video player on the compatibility evaluation result of the video to be detected according to the obtained number of the information types; or determining the value of the target video player for the compatibility evaluation result of the video to be detected according to the number of the prompt messages corresponding to each information type.
9. The method according to any one of claims 1 to 8, wherein the determining a processing strategy for the video to be detected according to the compatibility evaluation result comprises:
if the value of the compatibility evaluation result meets a set threshold range, the video to be detected is issued to a video platform corresponding to the target video player;
and if the value of the compatibility evaluation result does not meet the set threshold range, outputting the target information.
10. The method according to any one of claims 1 to 8, wherein the determining a processing strategy for the video to be detected according to the compatibility evaluation result comprises:
if the value of the compatibility evaluation result meets a set threshold range, playing the video to be detected by using the target video player;
and if the value of the compatibility evaluation result does not meet the set threshold range, starting a standby video player to play the video to be detected.
11. A video playback control method, the method comprising:
starting a standby video player in response to a play operation triggered by the target video player for the target video; the standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting playing information of a video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video;
and playing the target video through the standby video player.
12. A video detection apparatus, comprising:
the device comprises a playing information determining unit, a playing information determining unit and a playing information determining unit, wherein the playing information determining unit is used for acquiring playing information of a video file from the video file of a video to be detected by adopting a target video player;
the target information determining unit is used for detecting the playing information of the video file to obtain target information; the target information comprises information for indicating that the playing information has a mismatch with the target video player;
the evaluation result determining unit is used for determining a compatible evaluation result of the target video player on the video to be detected based on the target information;
and the processing strategy determining unit is used for determining the processing strategy aiming at the video to be detected according to the compatible evaluation result.
13. A video playback control apparatus, comprising:
a player starting unit for starting a standby video player in response to a play operation triggered for a target video by the target video player; the standby video player is started when the value of the target video player on the compatibility evaluation result of the target video is determined not to meet the set threshold range; the compatibility evaluation result is determined based on target information obtained by detecting playing information of a video file of the target video; the playing information of the video file is obtained by the target video player from the video file of the target video;
and the video playing unit is used for playing the target video through the standby video player.
14. A computer-readable storage medium having a computer program stored therein, the computer program characterized by: the computer program, when executed by a processor, implements the method of any one of claims 1 to 10 or the method of claim 11.
15. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the computer program, when executed by the processor, implementing the method of any of claims 1-10 or the method of claim 11.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110176453.XA CN113395585B (en) | 2021-02-09 | 2021-02-09 | Video detection method, video play control method, device and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110176453.XA CN113395585B (en) | 2021-02-09 | 2021-02-09 | Video detection method, video play control method, device and electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113395585A true CN113395585A (en) | 2021-09-14 |
CN113395585B CN113395585B (en) | 2024-05-31 |
Family
ID=77617170
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110176453.XA Active CN113395585B (en) | 2021-02-09 | 2021-02-09 | Video detection method, video play control method, device and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113395585B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110809189A (en) * | 2019-12-03 | 2020-02-18 | 北京字节跳动网络技术有限公司 | Video playing method and device, electronic equipment and computer readable medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104125478A (en) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | Cross-platform video playing method, device and system |
US20150082341A1 (en) * | 2013-09-13 | 2015-03-19 | Magnify Networks, Inc. d/b/a Waywire | Video curation platform with pre-roll advertisements for discovered content |
CN106101809A (en) * | 2016-07-15 | 2016-11-09 | 乐视控股(北京)有限公司 | A kind of in third party's player interpolation method of control, device and terminal |
CN107995522A (en) * | 2017-12-19 | 2018-05-04 | 深圳市沃特沃德股份有限公司 | Onboard system plays the method and device of video |
CN109257646A (en) * | 2018-10-15 | 2019-01-22 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
CN110557670A (en) * | 2019-09-17 | 2019-12-10 | 广州华多网络科技有限公司 | Method, device, terminal and storage medium for playing video in webpage |
-
2021
- 2021-02-09 CN CN202110176453.XA patent/CN113395585B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104125478A (en) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | Cross-platform video playing method, device and system |
US20150082341A1 (en) * | 2013-09-13 | 2015-03-19 | Magnify Networks, Inc. d/b/a Waywire | Video curation platform with pre-roll advertisements for discovered content |
CN106101809A (en) * | 2016-07-15 | 2016-11-09 | 乐视控股(北京)有限公司 | A kind of in third party's player interpolation method of control, device and terminal |
CN107995522A (en) * | 2017-12-19 | 2018-05-04 | 深圳市沃特沃德股份有限公司 | Onboard system plays the method and device of video |
CN109257646A (en) * | 2018-10-15 | 2019-01-22 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
CN110557670A (en) * | 2019-09-17 | 2019-12-10 | 广州华多网络科技有限公司 | Method, device, terminal and storage medium for playing video in webpage |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110809189A (en) * | 2019-12-03 | 2020-02-18 | 北京字节跳动网络技术有限公司 | Video playing method and device, electronic equipment and computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
CN113395585B (en) | 2024-05-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10200763B2 (en) | Video-based interaction method, terminal, server and system | |
JP6442076B2 (en) | Dialogue method, terminal and server based on recommended content | |
CN110221734B (en) | Information display method, graphical user interface and terminal | |
US11153620B2 (en) | Media broadcasting method, server, terminal device, and storage medium | |
CN106791958B (en) | Position mark information generation method and device | |
US11178450B2 (en) | Image processing method and apparatus in video live streaming process, and storage medium | |
WO2015188755A1 (en) | Video remote-commentary synchronization method and system, and terminal device | |
WO2016177287A1 (en) | Interaction information processing method, client terminal, service platform and storage medium | |
US20170324998A1 (en) | Method for playing video, client, and computer storage medium | |
CN110248245B (en) | Video positioning method and device, mobile terminal and storage medium | |
US20230285854A1 (en) | Live video-based interaction method and apparatus, device and storage medium | |
CN112188267B (en) | Video playing method, device and equipment and computer storage medium | |
WO2016150273A1 (en) | Video playing method, mobile terminal and system | |
JP2013537330A (en) | Content signature user interface | |
KR20160087649A (en) | User terminal apparatus, system and controlling method thereof | |
CN107071541A (en) | The method and apparatus managed for peripheral context | |
JP2013541274A (en) | Content signature ring | |
CN105929941B (en) | Information processing method and device and terminal equipment | |
CN114095793A (en) | Video playing method and device, computer equipment and storage medium | |
CN113395585B (en) | Video detection method, video play control method, device and electronic equipment | |
CN111770388B (en) | Content processing method, device, equipment and storage medium | |
CN110582024A (en) | method and device for playing video | |
CN115237314B (en) | Information recommendation method and device and electronic equipment | |
US11968481B2 (en) | Video playback method and terminal device | |
US20210392394A1 (en) | Method and apparatus for processing video, electronic device and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40052240 Country of ref document: HK |
|
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |