CN111698546B - Video structured result transmission method and device, terminal equipment and storage medium - Google Patents
Video structured result transmission method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN111698546B CN111698546B CN202010604435.2A CN202010604435A CN111698546B CN 111698546 B CN111698546 B CN 111698546B CN 202010604435 A CN202010604435 A CN 202010604435A CN 111698546 B CN111698546 B CN 111698546B
- Authority
- CN
- China
- Prior art keywords
- structural
- program
- video
- structured
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000005540 biological transmission Effects 0.000 title claims abstract description 45
- 238000004590 computer program Methods 0.000 claims description 14
- 238000004806 packaging method and process Methods 0.000 claims description 14
- 238000012856 packing Methods 0.000 claims description 12
- 238000012916 structural analysis Methods 0.000 claims description 12
- 230000001360 synchronised effect Effects 0.000 abstract description 8
- 238000013473 artificial intelligence Methods 0.000 abstract description 3
- 238000010276 construction Methods 0.000 abstract description 3
- 238000013461 design Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application is suitable for the technical field of artificial intelligence, and provides a video structured result transmission method, a device, a terminal device and a storage medium, wherein the video structured result transmission method is characterized in that a structured program unit is added in a target program mapping table corresponding to a target video stream, structured information is packaged into the structured program unit, the structured information can be effectively stored, a structured transport stream obtained by packaging program data in the structured program unit and the target video stream are combined, the structured information can be effectively embedded into the target video stream, synchronous transmission between the structured information and the target video stream is guaranteed, and accuracy of combined display between the structured information and the target video stream is improved. The video structured result transmission method is applied to smart traffic scenes, and accordingly construction of smart cities is promoted.
Description
Technical Field
The application relates to the technical field of artificial intelligence, in particular to a video structured result transmission method and device, terminal equipment and a storage medium.
Background
Nowadays, with the rapid development of artificial intelligence, the video processing technology is changing day by day, the video structuring technology is a technology for extracting key information and performing semantic description of text by performing intelligent analysis on an original video, and the main extracted information of the video structuring technology comprises: first, identification of moving objects, whether the identification is a person or a vehicle; the second type is to identify the characteristics of the moving object, i.e. the characteristics of the moving person, vehicle and object in the picture, such as the sex, age, color of clothes, wearing glasses, etc. of the person, and identify the license plate, vehicle type, vehicle body color, etc. of the moving vehicle; and in the third category, the track of the moving target is identified.
In the related technology, in the transmission process of the video structuring result, the structuring information of the video and the video stream are separated and transmitted based on an independent structuring information return interface, and the separated and transmitted structuring information and the video stream are displayed in a combined manner.
Therefore, the existing video structured result transmission method has the problem that the synchronous transmission of the original video and the structured information cannot be realized, and the accuracy of combined display between the structured information and the video stream is further reduced.
Disclosure of Invention
In view of this, embodiments of the present application provide a video structured result transmission method, an apparatus, a terminal device, and a storage medium, so as to solve the problem that the video structured result transmission method in the prior art cannot achieve accurate synchronization of an original video and structured information.
A first aspect of an embodiment of the present application provides a method for transmitting a video structured result, including:
performing video structural analysis on a target video stream to obtain structural information, and inquiring a target program mapping table corresponding to the target video stream;
adding a structural program unit in the target program mapping table, and packaging and adding the structural information into the structural program unit;
and performing data packing on the program data in the structural program unit after the information is added to obtain a structural transport stream, and combining the structural transport stream and the target video stream to obtain a target video transport stream.
Further, the adding of the structural program unit in the target program mapping table includes:
respectively acquiring PID identifiers of different program units in the target program mapping table, and deleting identifiers which are the same as the acquired PID identifiers in a preset identification table;
and setting any residual mark in the preset mark table as a structure PID mark, and constructing the structure program unit according to the program type corresponding to the structure PID mark.
Further, the adding the structured information package to the structured program unit includes:
packing the program data in the structural program unit into a structural PES packet, and inquiring a structural time stamp of the structural information;
and setting time of a time stamp parameter in a packet header in the structural PES packet according to the structural time stamp, and packaging the structural information to a payload of a payload in the structural PES packet.
Further, the querying the structural timestamp of the structured information includes:
inquiring a target video frame corresponding to the structural information, and inquiring a video PES packet corresponding to the target video frame in the target video stream;
and acquiring a display time stamp in a packet header in the video PES packet, and setting the display time stamp as the structure time stamp.
Further, said packing the program data in the structural program unit into structural PES packets includes:
and acquiring an original stream of the program data, and grouping, encapsulating and adding packet header information to the original stream to obtain the structured PES packet.
Further, after the merging the structure transport stream and the target video stream to obtain a target video transport stream, the method further includes:
when a display instruction of a user for the target video transport stream is received, unpacking the structural transport stream and the target video stream in the target video transport stream respectively to obtain the structural PES packet and the video PES packet;
matching the structural timestamp in the structured PES packet with a display timestamp in the video PES packet;
and synchronously displaying the structure information in the matched structured PES packet and the video frame corresponding to the video PES packet according to the sequence of the timestamps in the structured PES packet and the video PES packet.
Further, the method further comprises:
and uploading the target video transmission stream to a block chain.
A second aspect of the embodiments of the present application provides a video structured result transmission apparatus, including:
the system comprises a structural analysis unit, a target program mapping table generation unit and a target program mapping table generation unit, wherein the structural analysis unit is used for carrying out video structural analysis on a target video stream to obtain structural information and inquiring the target program mapping table corresponding to the target video stream;
a program adding unit, configured to add a structural program unit in the target program mapping table, and package and add the structural information to the structural program unit;
and the data merging unit is used for carrying out data packing on the program data in the structural program unit after the information is added to obtain a structural transport stream, and merging the structural transport stream and the target video stream to obtain a target video transport stream.
A fourth aspect of the embodiments of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the terminal device, where the processor implements the steps of the video structured result transmission method provided in the first aspect when executing the computer program.
A fifth aspect of embodiments of the present application provides a storage medium, which stores a computer program that, when being executed by a processor, implements the steps of the video structured result transmission method provided by the first aspect.
The method, the device, the terminal equipment and the storage medium for transmitting the video structured result have the following beneficial effects that:
according to the video structured result transmission method provided by the embodiment of the application, the structured program unit is added in the target program mapping table, and the structured information is packaged into the structured program unit, so that the structured information can be effectively stored, the structured information can be effectively embedded into the target video stream through the design of combining the structured transport stream and the target video stream, the synchronous transmission between the structured information and the target video stream is ensured, and the accuracy of combined display between the structured information and the target video stream is further improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a flowchart of an implementation of a video structured result transmission method according to an embodiment of the present application;
fig. 2 is a flowchart illustrating an implementation of a method for transmitting a video structured result according to another embodiment of the present application;
fig. 3 is a flowchart illustrating an implementation of a video structured result transmission method according to yet another embodiment of the present application;
fig. 4 is a flowchart illustrating an implementation of a video structured result transmission method according to still another embodiment of the present application;
fig. 5 is a block diagram illustrating a structure of a video structured result transmission apparatus according to an embodiment of the present application;
fig. 6 is a block diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.
The video structured result transmission method according to the embodiment of the present application may be executed by a control device or a terminal (hereinafter referred to as a "mobile terminal").
The video structured result transmission method is applied to intelligent traffic scenes, for example, in the processes of traffic accident processing and traffic transportation management, a traffic police can check structured information and video streams which are synchronously transmitted, the traffic police can conveniently process traffic accidents and manage traffic transportation, and accordingly construction of a smart city is promoted.
Referring to fig. 1, fig. 1 is a flowchart illustrating an implementation of a video structured result transmission method according to an embodiment of the present application, including:
step S10, carrying out video structural analysis on a target video stream to obtain structural information, and inquiring a target program mapping table corresponding to the target video stream;
when a video stream sent by a designated interface is received, the received video stream is set as the target video stream, and the designated interface can be set according to requirements, for example, the designated interface can be an RTSP interface, an HTTP interface, an FTP interface, or the like, and preferably, the format of the target video stream is a TS (transport stream) stream format.
In this step, video structural analysis may be performed on the target video stream based on a structural analysis model to obtain corresponding structural information, where the structural information includes a plurality of structural sub-information, and the structural sub-information is a structural result of a corresponding video frame in the target video stream.
In this step, the target Program Map Table (PMT-Program Map Table) is used to store the mapping between each Program unit in the target video stream and all the original code streams constituting the corresponding Program, specifically, in this step, the PID identifier specified in the Program Association Table is obtained by querying the Program Association Table (PAT-Program Association Table) corresponding to the target video stream, and the Program Association Table is subjected to information query based on the specified PID identifier to obtain the target Program Map Table.
Step S20, adding a structure program unit in the target program mapping table, and packaging and adding the structural information into the structure program unit;
the structure program unit is used for storing the packaged structure information, the program type and the data size in the structure program unit can be set according to the requirement, for example, the program type of the structure program unit can be a Media type (Media), and in the step, the storage of the structure information is effectively facilitated by adding the design of the structure program unit in the target program mapping table.
Specifically, in this step, the structured information may be packaged into the structural program unit in a format of PSI or SI, and the storage of the structured information is effectively ensured by a design of packaging the structured information into the structural program unit.
Step S30, data packaging is carried out on the program data in the structural program unit after the information is added to obtain a structural transport stream, and the structural transport stream and the target video stream are merged to obtain a target video transport stream;
the structure transport stream is obtained by packing the program data in the structure program unit into TS packets, and the structure transport stream and the target video stream are merged by using a video multiplexer, so as to obtain the target video transport stream.
Specifically, in this step, by the design of multiplexing the structural transport stream and the target video stream into one target video transport stream, the structural information is effectively embedded into the target video stream, thereby ensuring the synchronous transmission between the structural information and the target video stream.
As can be seen from the above, according to the video structured result transmission method provided by this embodiment, by adding the structural program unit in the target program mapping table and packaging the structured information into the structural program unit, the structured information can be effectively stored, and by combining the structural transport stream and the target video stream, the structured information can be effectively embedded into the target video stream, so that the synchronous transmission between the structured information and the target video stream is ensured, and the accuracy of the combined display between the structured information and the target video stream is further improved.
Referring to fig. 2, fig. 2 is a flowchart illustrating an implementation of a method for transmitting a video structured result according to another embodiment of the present disclosure. With respect to the embodiment corresponding to fig. 1, the video structured result transmission method provided in this embodiment is further refined in step S20 in the embodiment corresponding to fig. 1, and step S20 includes:
s21, respectively acquiring PID identifiers of different program units in the target program mapping table, and deleting identifiers which are the same as the acquired PID identifiers in a preset identification table;
the program units and the corresponding PID identifiers in the target program mapping table are stored in a one-to-one correspondence relationship, that is, PID identifiers corresponding to different program units are different, for example, when 3 different program units are stored in the target program mapping table, the number of the obtained PID identifiers is 3.
In this step, at least one preset identifier is stored in the preset identifier table, and the number and the identifier value of the preset identifier in the preset identifier table can be set according to requirements, for example, the number of the preset identifier in the preset identifier table can be 3, 5 or 10, and the identifier values between every two preset identifiers are different.
In addition, in this step, by the design of deleting the identifier in the preset identifier table that is the same as the obtained PID identifier, the PID identifier duplication phenomenon between the program unit in the target program mapping table and the subsequent structural program unit addition process is effectively prevented, for example, when the preset identifier table includes an identifier a, an identifier B, and an identifier C, and the PID identifier obtained in the target program mapping table includes an identifier a and an identifier D, the identifier a is deleted in the preset identifier table.
S22, setting any residual mark in the preset mark table as a structure PID mark, and constructing the structure program unit according to the program type corresponding to the structure PID mark;
the residual marks in the preset mark table are different from the PID marks of the program units in the target program mapping table, so that the phenomenon of PID mark repetition in the construction process of the structural program units is prevented.
Optionally, in this embodiment, a program construction mode for each structural PID identifier is prestored, and the structural program unit is constructed by querying the current structural PID identifier and based on the queried program construction mode.
S23, packaging the program data in the structural program unit into a structural PES packet, and inquiring a structural time stamp of the structural information;
the structural PES packet is obtained by packaging the program data in the structural program unit into the PES packet, and the accuracy of the subsequent setting of the timestamp parameter in the packet header in the structural PES packet is effectively guaranteed by inquiring the structural timestamp design of the structural information.
S24, setting time of a timestamp parameter in a packet header in the structural PES packet according to the structural timestamp, and packaging the structural information to a payload in the structural PES packet;
the time setting design is carried out on the time stamp parameter in the packet header of the structured PES packet according to the structured time stamp, so that the accuracy of the display time between each piece of structured sub-information in the structured information and the corresponding video frame in the target video stream is effectively guaranteed, and the accuracy of the combined display between the subsequent structured information and the target video stream is improved.
In this embodiment, by deleting the identifier in the preset identifier table that is the same as the obtained PID identifier, PID identifier duplication between the program unit in the target program mapping table and the subsequent process of adding the structural program unit is effectively prevented, and by designing to perform time setting on the timestamp parameter in the packet header in the structural PES packet according to the structural timestamp, the accuracy of the display time between each piece of structural sub-information in the structural information and the corresponding video frame in the target video stream is effectively ensured.
Referring to fig. 3, fig. 3 is a flowchart illustrating an implementation of a video structured result transmission method according to another embodiment of the present application. With respect to the embodiment corresponding to fig. 2, the video structured result transmission method provided in this embodiment is further refined in step S23 in the embodiment corresponding to fig. 2, and step S23 includes:
s230, acquiring an original stream of the program data, and grouping, encapsulating and adding packet header information to the original stream to obtain the structural PES packet;
optionally, in this step, a PES packetizer may be used to perform packetization, encapsulation and header information addition on the original stream, so as to obtain a corresponding structured PES packet.
S231, inquiring a target video frame corresponding to the structural information, and inquiring a video PES packet corresponding to the target video frame in the target video stream;
wherein, the target video frame corresponding to each piece of structured sub information in the structured information is respectively queried, for example, the structured information includes: structured sub-information d 1 Structured sub-information d 2 And structured sub-information d 3 Then, according to the video structural analysis result of the target video stream, the structural sub-information d is respectively inquired 1 Structured sub-information d 2 And a structured sub-information d 3 Corresponding target video frame to obtain video frame e 1 Video frame e 2 And video frame e 3 And respectively inquire the video frames e 1 Video frame e 2 And video frame e 3 Corresponding video PES packets in the target video stream.
S232, acquiring a display timestamp in a packet header in the video PES packet, and setting the display timestamp as a structural timestamp of the structural information;
in step S231, the display time stamp in the packet header of each queried video PES packet is respectively obtained according to the query result of the video PES packet in step S231, and the display time stamp is set as the structure time stamp of the structured sub-information corresponding to the target video frame corresponding to the video PES packet, so that the accuracy of the display time between each structured sub-information in the structured information and the corresponding video frame in the target video stream is ensured.
In this embodiment, by querying the target video frame corresponding to the structured information and querying the video PES packet corresponding to the target video frame in the target video stream, the accuracy of querying the structure timestamp of the structured sub-information in the structured information is effectively improved, so that the accuracy of the display time between each piece of structured sub-information in the structured information and the corresponding video frame in the target video stream is ensured, and the accuracy of the combined display between the subsequent piece of structured information and the target video stream is improved.
Referring to fig. 4, fig. 4 is a flowchart illustrating an implementation of a video structured result transmission method according to still another embodiment of the present application. With respect to the embodiment corresponding to fig. 2, the video structured result transmission method provided in this embodiment further includes step S40 to step S60 after step S30. The details are as follows:
s40, when a display instruction of a user for the target video transport stream is received, unpacking the structural transport stream and the target video stream in the target video transport stream respectively to obtain the structural PES packet and the video PES packet;
the target video transport stream may be unpacked by using a demultiplexer to obtain the structural transport stream and the target video stream, the packing manner of the program data in the structural program unit in step S23 is obtained, and the unpacking operation is performed on the structural transport stream based on the obtained packing manner to obtain the structured PES packet.
Optionally, in this step, the video PES packet is obtained by obtaining the packet header information of the PES packet in the target video stream, querying the packet format according to the packet header information, and performing an unpacking operation on the target video stream based on the queried packet format.
S50, matching a structure time stamp in the structured PES packet with a display time stamp in the video PES packet;
when the time values corresponding to any structural timestamp and the display timestamp are the same, the structural PES packet corresponding to the structural timestamp and the display timestamp is judged to be matched with the video PES packet.
S60, according to the sequence of the timestamps in the structured PES packet and the video PES packet, synchronously displaying the matched structural information in the structured PES packet and the video frame corresponding to the video PES packet;
for example, when unpacking in step S40, a structured PES packet f is obtained 1 Structured PES packet f 2 Structured PES packet f 3 Video PES packet g 1 Video PES packet g 2 And video PES packet g 3 The structured PES packet f 1 Structured PES packet f 2 And a structured PES packet f 3 The structured timestamp is timestamp h 1 Time stamp h 2 And a time stamp h 3 The video PES packet g 1 Video PES packet g 2 And video PES packet g 3 Is a time stamp h 4 Time stamp h 5 And a time stamp h 6 ；
If the timestamp h is detected 1 And a time stamp h 4 Identity, timestamp h 2 And a time stamp h 5 Identity, time stamp h 3 And a time stamp h 6 If they are the same, then according to the timestamp h 4 Time stamp h 5 And a time stamp h 6 Time stamp order in between, will structure PES packet f 1 Structured information and video PES packet g in (1) 1 Corresponding video frames are displayed synchronously, and a structured PES packet f is displayed 2 Structured information and video PES packet g in (1) 2 Corresponding video frames are displayed synchronously, and a structured PES packet f is displayed 3 Structured information and video PES packet g in (1) 3 And displaying the corresponding video frames synchronously.
In this embodiment, the structure information in the matched structured PES packet and the video frame corresponding to the video PES packet are synchronously displayed according to the sequence of the timestamps in the structured PES packet and the video PES packet, so that the synchronous display effect between the structure information and the corresponding video frame is effectively ensured.
In all embodiments of the present application, the corresponding target video transport stream is obtained based on the structure transport stream and the target video stream, and specifically, the target video transport stream is obtained by multiplexing the structure transport stream and the target video stream, for example, by using a video multiplexer. Uploading the target video transport stream to the blockchain can ensure the safety and the fair transparency of the target video transport stream to users. The user device may download the target video transport stream from the blockchain to verify whether the target video transport stream is tampered with. The blockchain referred to in this example is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, encryption algorithm, and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
Referring to fig. 5, fig. 5 is a block diagram illustrating a video structured result transmission apparatus 100 according to an embodiment of the present disclosure. The video structured result transmission apparatus 100 in this embodiment includes units for executing the steps in the embodiments corresponding to fig. 1 to fig. 4. Please specifically refer to fig. 1 to 4 and the related descriptions of the embodiments corresponding to fig. 1 to 4. For convenience of explanation, only the portions related to the present embodiment are shown. Referring to fig. 5, the video structured result transmitting apparatus 100 includes: structured analysis unit 10, program adding unit 11 and data merging unit 12, wherein:
the structure analysis unit 10 is configured to perform video structure analysis on a target video stream to obtain structure information, and query a target program mapping table corresponding to the target video stream;
a program adding unit 11, configured to add a structural program unit in the target program mapping table, and package and add the structural information to the structural program unit;
and the data merging unit 12 is configured to perform data packing on the program data in the structural program unit after the information is added, to obtain a structural transport stream, and merge the structural transport stream and the target video stream, to obtain a target video transport stream.
As an embodiment of the present application, the program adding unit 11 is further configured to: respectively acquiring PID identifiers of different program units in the target program mapping table, and deleting identifiers which are the same as the acquired PID identifiers in a preset identification table;
and setting any residual mark in the preset mark table as a structure PID mark, and constructing the structure program unit according to the program type corresponding to the structure PID mark.
As an embodiment of the present application, the program adding unit 11 is further configured to: packing the program data in the structural program unit into a structural PES packet, and inquiring a structural time stamp of the structural information;
and time setting is carried out on the time stamp parameter in the packet header in the structural PES packet according to the structural time stamp, and the structural information is packed to the net load of the net load in the structural PES packet.
As an embodiment of the present application, the program adding unit 11 is further configured to: inquiring a target video frame corresponding to the structural information, and inquiring a video PES packet corresponding to the target video frame in the target video stream;
and acquiring a display time stamp in a packet header in the video PES packet, and setting the display time stamp as the structure time stamp.
As an embodiment of the present application, the program adding unit 11 is further configured to: and acquiring an original stream of the program data, and grouping, encapsulating and adding packet header information to the original stream to obtain the structured PES packet.
As an embodiment of the present application, the video structured result transmission apparatus 100 further includes:
a synchronous display unit 13, configured to, when a display instruction of a user for the target video transport stream is received, perform a depacketization operation on the structured transport stream and the target video stream in the target video transport stream, respectively, to obtain the structured PES packet and the video PES packet;
matching the structural timestamp in the structured PES packet with a display timestamp in the video PES packet;
and according to the sequence of the timestamps in the structured PES packet and the video PES packet, synchronously displaying the structure information in the matched structured PES packet and the video frame corresponding to the video PES packet.
As can be seen from the above, according to the video structured result transmission apparatus 100 provided in this embodiment, by adding the structural program unit in the target program mapping table and packaging the structured information into the structural program unit, the structured information can be effectively stored, and by combining the structural transport stream and the target video stream, the structured information can be effectively embedded into the target video stream, so that the synchronous transmission between the structured information and the target video stream is ensured, and the accuracy of the combined display between the structured information and the target video stream is further improved.
Fig. 6 is a block diagram of a terminal device 2 according to another embodiment of the present application. As shown in fig. 6, the terminal device 2 of this embodiment includes: a processor 20, a memory 21 and a computer program 22, such as a program of a video structured result transmission method, stored in said memory 21 and executable on said processor 20. The processor 20, when executing the computer program 23, implements the steps in the various embodiments of the video structured result transmission method described above, such as S10 to S30 shown in fig. 1, or S21 to S24, S230 to S232, and S40 to S60 shown in fig. 2, fig. 3, and fig. 4. Alternatively, when the processor 20 executes the computer program 22, the functions of the units in the embodiment corresponding to fig. 5, for example, the functions of the units 10 to 13 shown in fig. 5, are implemented, for which reference is specifically made to the relevant description in the embodiment corresponding to fig. 6, which is not repeated herein.
Illustratively, the computer program 22 may be divided into one or more units, which are stored in the memory 21 and executed by the processor 20 to accomplish the present application. The unit or units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 22 in the terminal device 2. For example, the computer program 22 may be divided into a structured analysis unit 10, a program adding unit 11 and a data merging unit 12, and a synchronization display unit 13, each of which functions as described above.
The terminal device may include, but is not limited to, a processor 20, a memory 21. Those skilled in the art will appreciate that fig. 6 is merely an example of a terminal device 2 and does not constitute a limitation of terminal device 2 and may include more or fewer components than shown, or some components may be combined, or different components, e.g., the terminal device may also include input-output devices, network access devices, buses, etc.
The Processor 20 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 21 may be an internal storage unit of the terminal device 2, such as a hard disk or a memory of the terminal device 2. The memory 21 may also be an external storage device of the terminal device 2, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 2. Further, the memory 21 may also include both an internal storage unit and an external storage device of the terminal device 2. The memory 21 is used for storing the computer program and other programs and data required by the terminal device. The memory 21 may also be used to temporarily store data that has been output or is to be output.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (9)
1. A method for transmitting a video structured result, comprising:
performing video structural analysis on a target video stream to obtain structural information, and inquiring a target program mapping table corresponding to the target video stream;
adding a structural program unit in the target program mapping table, and packaging and adding the structural information into the structural program unit;
packaging the program data in the structural program unit after the information is added to obtain a structural transport stream, and combining the structural transport stream and the target video stream in a video multiplexer mode to obtain a target video transport stream;
the packaging and adding the structural information to the structural program unit comprises:
packing the program data in the structural program unit into a structural PES packet, and inquiring a structural time stamp of the structural information;
and time setting is carried out on the time stamp parameter in the packet header in the structural PES packet according to the structural time stamp, and the structural information is packed to the net load of the net load in the structural PES packet.
2. The video structured result transmission method according to claim 1, wherein said adding a structured program unit in said target program mapping table comprises:
respectively acquiring PID identifiers of different program units in the target program mapping table, and deleting identifiers which are the same as the acquired PID identifiers in a preset identification table;
and setting any residual mark in the preset mark table as a structure PID mark, and constructing the structure program unit according to the program type corresponding to the structure PID mark.
3. The method for transmitting video structured result according to claim 1, wherein said querying the structure timestamp of the structured information comprises:
inquiring a target video frame corresponding to the structural information, and inquiring a video PES packet corresponding to the target video frame in the target video stream;
and acquiring a display time stamp in a packet header in the video PES packet, and setting the display time stamp as the structure time stamp.
4. The video structured result transmission method according to claim 1, wherein said packetizing the program data in the structured program unit into structured PES packets comprises:
and acquiring an original stream of the program data, and grouping, encapsulating and adding packet header information to the original stream to obtain the structured PES packet.
5. The method of claim 3, wherein after combining the structured transport stream and the target video stream to obtain a target video transport stream, the method further comprises:
when a display instruction of a user for the target video transport stream is received, unpacking the structural transport stream and the target video stream in the target video transport stream respectively to obtain a structural PES packet and a video PES packet;
matching the structural timestamp in the structural PES packet with a display timestamp in the video PES packet;
and synchronously displaying the structural information in the matched structural PES packet and the video frame corresponding to the video PES packet according to the sequence of the timestamps in the structural PES packet and the video PES packet.
6. The method for transmitting video structured results according to claim 1, further comprising:
and uploading the target video transmission stream to a block chain.
7. A video structured result transmission apparatus, comprising:
the system comprises a structural analysis unit, a target program mapping table generation unit and a target program mapping table generation unit, wherein the structural analysis unit is used for carrying out video structural analysis on a target video stream to obtain structural information and inquiring the target program mapping table corresponding to the target video stream;
a program adding unit, configured to add a structural program unit in the target program mapping table, and package and add the structural information to the structural program unit;
the data merging unit is used for carrying out data packing on the program data in the structural program unit after the information is added to obtain a structural transport stream, and merging the structural transport stream and the target video stream in a video multiplexer mode to obtain a target video transport stream;
the program adding unit is further configured to:
packing the program data in the structural program unit into a structural PES packet, and inquiring a structural time stamp of the structural information;
and setting time of a time stamp parameter in a packet header in the structural PES packet according to the structural time stamp, and packaging the structural information to a payload of a payload in the structural PES packet.
8. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010604435.2A CN111698546B (en) | 2020-06-29 | 2020-06-29 | Video structured result transmission method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010604435.2A CN111698546B (en) | 2020-06-29 | 2020-06-29 | Video structured result transmission method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111698546A CN111698546A (en) | 2020-09-22 |
| CN111698546B true CN111698546B (en) | 2023-02-03 |
Family
ID=72484325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010604435.2A Active CN111698546B (en) | 2020-06-29 | 2020-06-29 | Video structured result transmission method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111698546B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112422510B (en) * | 2020-10-22 | 2023-01-20 | 山东浪潮通软信息科技有限公司 | Data transmission method and system based on DMZ zone |
| CN113114968A (en) * | 2021-04-13 | 2021-07-13 | 中国建设银行股份有限公司 | Video processing method, device, equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6404818B1 (en) * | 1998-01-20 | 2002-06-11 | Sony Corporation | Video transmission device and its method |
| US7603024B1 (en) * | 1999-11-20 | 2009-10-13 | Samsung Electronics Co., Ltd. | Apparatus for storing and searching audio/video data containing additional information |
| CN102256175A (en) * | 2011-07-21 | 2011-11-23 | 深圳市茁壮网络股份有限公司 | Method and system for inserting and presenting additional information in digital television program |
| CN106375793A (en) * | 2016-08-29 | 2017-02-01 | 东方网力科技股份有限公司 | Superposition method and superposition system of video structured information, and user terminal |
| CN108712677A (en) * | 2018-05-31 | 2018-10-26 | 杭州视在数科信息技术有限公司 | TS method for stream processing to intelligent algorithm close friend and application |
| CN109195006A (en) * | 2018-08-09 | 2019-01-11 | 广东省南方数字电视无线传播有限公司 | The Deplexing method and device of multi-program transmission stream |
| CN110418112A (en) * | 2019-08-09 | 2019-11-05 | 上海商汤智能科技有限公司 | A kind of method for processing video frequency and device, electronic equipment and storage medium |
| CN110661785A (en) * | 2019-09-02 | 2020-01-07 | 北京迈格威科技有限公司 | Video processing method, device and system, electronic equipment and readable storage medium |
| CN110874424A (en) * | 2019-09-23 | 2020-03-10 | 北京旷视科技有限公司 | Data processing method and device, computer equipment and readable storage medium |
| CN111092926A (en) * | 2019-08-28 | 2020-05-01 | 北京大学 | Digital retina multivariate data rapid association method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000197018A (en) * | 1998-12-25 | 2000-07-14 | Toshiba Corp | Method for inserting program relating information to mpeg transport stream in digital video contents, method for activating application software corresponding to program related information, and digital video contents transmission-reception system |
| CN100541635C (en) * | 1999-03-19 | 2009-09-16 | 索尼公司 | Generation is used for the apparatus and method of the admin table of data stream |
| US7349395B2 (en) * | 2003-06-23 | 2008-03-25 | Microsoft Corporation | System, method, and computer program product for parsing packetized, multi-program transport stream |
| KR20050036526A (en) * | 2003-10-16 | 2005-04-20 | 삼성전자주식회사 | Transport stream, apparatus and method for providing value added service during channel changing time in a digital multimedia broadcasting system and mobile terminal equipment capable of displaying the digital multimedia broadcasting |
| US8599932B2 (en) * | 2009-12-18 | 2013-12-03 | General Instrument Corporation | Carriage systems encoding or decoding JPEG 2000 video |
| US8713604B2 (en) * | 2010-06-23 | 2014-04-29 | Echostar Technologies L.L.C. | Systems and methods for processing supplemental information associated with media programming |
-
2020
- 2020-06-29 CN CN202010604435.2A patent/CN111698546B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6404818B1 (en) * | 1998-01-20 | 2002-06-11 | Sony Corporation | Video transmission device and its method |
| US7603024B1 (en) * | 1999-11-20 | 2009-10-13 | Samsung Electronics Co., Ltd. | Apparatus for storing and searching audio/video data containing additional information |
| CN102256175A (en) * | 2011-07-21 | 2011-11-23 | 深圳市茁壮网络股份有限公司 | Method and system for inserting and presenting additional information in digital television program |
| CN106375793A (en) * | 2016-08-29 | 2017-02-01 | 东方网力科技股份有限公司 | Superposition method and superposition system of video structured information, and user terminal |
| CN108712677A (en) * | 2018-05-31 | 2018-10-26 | 杭州视在数科信息技术有限公司 | TS method for stream processing to intelligent algorithm close friend and application |
| CN109195006A (en) * | 2018-08-09 | 2019-01-11 | 广东省南方数字电视无线传播有限公司 | The Deplexing method and device of multi-program transmission stream |
| CN110418112A (en) * | 2019-08-09 | 2019-11-05 | 上海商汤智能科技有限公司 | A kind of method for processing video frequency and device, electronic equipment and storage medium |
| CN111092926A (en) * | 2019-08-28 | 2020-05-01 | 北京大学 | Digital retina multivariate data rapid association method |
| CN110661785A (en) * | 2019-09-02 | 2020-01-07 | 北京迈格威科技有限公司 | Video processing method, device and system, electronic equipment and readable storage medium |
| CN110874424A (en) * | 2019-09-23 | 2020-03-10 | 北京旷视科技有限公司 | Data processing method and device, computer equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111698546A (en) | 2020-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111698546B (en) | Video structured result transmission method and device, terminal equipment and storage medium | |
| CN109067732B (en) | Internet of things equipment, data access system, method and computer readable storage medium | |
| CN108197891A (en) | A kind of electronic signature device and method based on block chain | |
| CN113342902A (en) | Data processing method and device for block chain network, computer equipment and medium | |
| CN110809191B (en) | Video tamper-proofing method and system based on index verification and real-time package conversion | |
| CN112671921A (en) | Data transmission method and device, electronic equipment and readable storage medium | |
| CN106657090B (en) | Multimedia stream processing method and device and embedded equipment | |
| CN111881209A (en) | Data synchronization method and device for heterogeneous database, electronic equipment and medium | |
| CN110597814A (en) | Structured data serialization and deserialization method and device | |
| CN111506931A (en) | Electronic evidence management method based on block chain and cloud computing platform | |
| CN115085909B (en) | Random number generation method, device, computer equipment and medium | |
| WO2023142385A1 (en) | Method and apparatus for multi-screen transmission between instrument system and entertainment host system, and vehicle | |
| CN115237853A (en) | Data query method and device, electronic equipment and storage medium | |
| CN114995862A (en) | Method, device and system for calling diagnosis module | |
| CN113051622B (en) | Index construction method, device, equipment and storage medium | |
| CN113626512A (en) | Data processing method, device, equipment and readable storage medium | |
| CN113806816A (en) | Electronic file management method and device based on block chain and electronic equipment | |
| CN108845995A (en) | Data processing method, device, storage medium and electronic device | |
| CN111625373A (en) | Function access method and device, electronic equipment and storage medium | |
| CN116974906A (en) | Code verification method, device, computer equipment and storage medium | |
| CN110472128A (en) | Webpage evidence collecting method, device, storage medium and server based on image recognition | |
| CN115909560A (en) | Data encryption method, data decryption method and door lock system | |
| CN114187580A (en) | Method for updating digital twin model state and related equipment | |
| CN108777601B (en) | Clock synchronization method, device and network equipment | |
| CN111221803A (en) | Characteristic library management method and coprocessor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |