CN109640162A - Code stream conversion method and system - Google Patents

Code stream conversion method and system Download PDF

Info

Publication number
CN109640162A
CN109640162A CN201811598561.0A CN201811598561A CN109640162A CN 109640162 A CN109640162 A CN 109640162A CN 201811598561 A CN201811598561 A CN 201811598561A CN 109640162 A CN109640162 A CN 109640162A
Authority
CN
China
Prior art keywords
data
video
audio
format
code stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811598561.0A
Other languages
Chinese (zh)
Other versions
CN109640162B (en
Inventor
李文岩
董兵
张刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sumavision Technologies Co Ltd
Original Assignee
Sumavision Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sumavision Technologies Co Ltd filed Critical Sumavision Technologies Co Ltd
Priority to CN201811598561.0A priority Critical patent/CN109640162B/en
Publication of CN109640162A publication Critical patent/CN109640162A/en
Application granted granted Critical
Publication of CN109640162B publication Critical patent/CN109640162B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614Multiplexing of additional data and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368Multiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4343Extraction or processing of packetized elementary streams [PES]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The disclosure provides a kind of code stream conversion method and system, is related to code stream switch technology field.This method and system, the code stream of input is received by arm processor, code stream is demultiplexed, obtain the first video ES data and the first audio ES data, and according to the first video ES data and the format of the first audio ES data, first video ES data and the first audio ES data are decoded, original yuv video data and original PCM audio data are obtained;Arm processor encodes original PCM audio data, obtain the second audio ES data, original yuv video data are pre-processed simultaneously, and pretreated original yuv video data are transmitted to system level chip, pretreated original yuv video data are encoded by system level chip, obtain the second video ES data, arm processor converges the second video ES data and the second audio ES data, it is multiplexed, code stream after being converted, realize the conversion of code stream, favorable expandability, power consumption and at low cost.

Description

Code stream conversion method and system
Technical field
This disclosure relates to code stream switch technology field, in particular to a kind of code stream conversion method and system.
Background technique
Code stream (Data Rate) refers to the data traffic that video file uses within the unit time, is also code rate, is video Image quality controls most important part in coding.Video code conversion (Video Transcoding) refers to compressed encoding Video code flow be converted into another video code flow, to adapt to different network bandwidths, different terminal processing capacity and difference User demand.Transcoding is substantially one and first decodes, the process of re-encoding.There are power consumption height, extension for current transcoding technology Property the difference and excessively high problem of cost.
Summary of the invention
In view of this, the disclosure provides a kind of code stream conversion method and system.
A kind of code stream conversion method that the disclosure provides, is applied to code stream converting system, and the code stream converting system includes Arm processor and system level chip, which comprises
The arm processor receives the code stream of input, is demultiplexed, is obtained to the code stream according to the format of the code stream To the first video ES data and the first audio ES data.
The arm processor solves first video ES data according to the format of first video ES data Code, obtains original yuv video data, and according to the format of the first audio ES data, to the first audio ES data It is decoded, obtains original PCM audio data.
The arm processor pre-processes the original yuv video data, and pretreated original YUV is regarded Frequency evidence is transmitted to the system level chip.
The system level chip encodes pretreated original yuv video data, obtains the second video ES data, And second video ES data is transmitted to the arm processor.
The arm processor encodes the original PCM audio data, obtains the second audio ES data.
The arm processor converges second video ES data and the second audio ES data, and is multiplexed, and obtains Code stream after conversion.
Further, after the code stream after being converted, the method also includes:
The arm processor exports the code stream after conversion according to preset format.
Further, the arm processor is prestored there are many first decoding library, and a variety of first decodings library respectively corresponds In the format of various video ES data, the arm processor is regarded according to the format of first video ES data to described first The step of frequency ES data are decoded, obtain original yuv video data include:
The arm processor calls the lattice of first video ES data according to the format of first video ES data Formula corresponding first decoding library.
First video ES data is carried out according to the format of first video ES data corresponding first decoding library Decoding, obtains original yuv video data.
Further, the arm processor is prestored there are many second decoding library, and a variety of second decodings library respectively corresponds The first audio ES data are carried out according to the format of the first audio ES data in the format of a variety of audio ES data Decoding, the step of obtaining original PCM audio data include:
The arm processor calls the lattice of the first audio ES data according to the format of the first audio ES data Formula corresponding second decoding library.
The first audio ES data are carried out according to the format of the first audio ES data corresponding second decoding library Decoding, obtains original PCM audio data.
Further, it includes to described original that the arm processor, which carries out pretreatment to the original yuv video data, Yuv video data zoom in and out and add subtitle.
A kind of code stream converting system that the disclosure provides, including arm processor and system level chip.
The arm processor code stream for receiving input, and the code stream is solved according to the format of the code stream Multiplexing, obtains the first video ES data and the first audio ES data.
The arm processor is used for according to the format of first video ES data, to first video ES data into Row decoding, obtains original yuv video data, and according to the format of the first audio ES data, to first audio ES Data are decoded, and obtain original PCM audio data.
The arm processor is used to pre-process the original yuv video data, and will be pretreated original Yuv video data are transmitted to the system level chip.
The system level chip obtains the second video ES for encoding to pretreated original yuv video data Data, and second video ES data is transmitted to the arm processor.
The arm processor obtains the second audio ES data for encoding to the original PCM audio data.
The arm processor is used to converge second video ES data and the second audio ES data, and is multiplexed, Code stream after being converted.
Further, the code stream after the arm processor is also used to convert is exported according to preset format.
Further, the arm processor is prestored there are many first decoding library, and a variety of first decodings library respectively corresponds In the format of various video ES data, the arm processor is used for the format according to first video ES data, described in calling The format of first video ES data corresponding first decoding library, and according to the format of first video ES data corresponding first Decoding library is decoded first video ES data, obtains original yuv video data.
Further, the arm processor is prestored there are many second decoding library, and a variety of second decodings library respectively corresponds In the format of a variety of audio ES data, the arm processor is used for the format according to the first audio ES data, described in calling The format of first audio ES data corresponding second decoding library;And according to the format of the first audio ES data corresponding second Decoding library is decoded the first audio ES data, obtains original PCM audio data.
Further, the arm processor is used to carry out the original yuv video data pretreatment to include to the original Beginning yuv video data zoom in and out and add subtitle.
The code stream conversion method and system that the disclosure provides, the code stream of input are received by arm processor, and according to code stream Format code stream is demultiplexed, obtain the first video ES data and the first audio ES data, obtaining the first video ES number According to after the first audio ES data, arm processor is according to the format of the first video ES data and the lattice of the first audio ES data Formula is decoded the first video ES data and the first audio ES data, obtains original yuv video data and original PCM audio Data;After obtaining original yuv video data and original PCM audio data, arm processor carries out original PCM audio data Coding, obtains the second audio ES data, and pre-process to original yuv video data, and by pretreated original YUV Video data transmission encodes pretreated original yuv video data by system level chip, obtains to system level chip Second video ES data, and the second video ES data is transmitted to arm processor, arm processor by the second video ES data and The convergence of second audio ES data, is multiplexed, the code stream after being converted realizes the conversion of code stream.
The disclosure provide code stream conversion method and system, by introduce arm processor, reduce code stream conversion at This, and by the combination of arm processor and system level chip, improve the scalability of code stream conversion;It is received by arm processor The code stream of input, and code stream is demultiplexed according to the format of code stream, obtain the first video ES data and the first audio ES number According to according to the format of the first video ES data and the format of the first audio ES data, to the first video ES data and the first sound Frequency ES data are decoded, and are encoded to decoded first audio ES data, while to decoded first video ES number According to, it is pre-processed, obtains pretreated video data, and by pretreated video data transmission to system level chip, Pretreated video data is encoded by system level chip, arm processor is to the video data and audio number after coding According to being multiplexed, the conversion to code stream is realized, not only favorable expandability and low in energy consumption.
To enable the above objects, features, and advantages of the disclosure to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate more clearly of the technical solution of the disclosure, letter will be made to attached drawing needed in the embodiment below It singly introduces, it should be understood that the following drawings illustrates only some embodiments of the disclosure, therefore is not construed as to range It limits, it for those of ordinary skill in the art, without creative efforts, can also be according to these attached drawings Obtain other relevant attached drawings.
Fig. 1 is a kind of block diagram of code stream converting system provided by the disclosure.
Fig. 2 is a kind of flow diagram of code stream conversion method provided by the disclosure.
Fig. 3 is the realization principle block diagram of code stream conversion method provided by the disclosure.
Fig. 4 is another flow diagram of code stream conversion method provided by the disclosure.
Fig. 5 is another flow diagram of code stream conversion method provided by the disclosure.
Fig. 6 is the realization principle block diagram of Application Example provided by the disclosure.
Fig. 7 is a kind of flow chart that table process is searched provided by the disclosure.
Fig. 8 is a kind of block diagram of PES data structure provided by the disclosure.
Icon: 100- code stream converting system;10-ARM processor;20- system level chip.
Specific embodiment
Below in conjunction with attached drawing in the disclosure, the technical solution in the disclosure is clearly and completely described, it is clear that Described embodiment is only disclosure a part of the embodiment, instead of all the embodiments.Usually retouched in attached drawing here The component for the disclosure stated and shown can be arranged and be designed with a variety of different configurations.Therefore, below to mentioning in the accompanying drawings The detailed description of the embodiment of the disclosure of confession is not intended to limit claimed the scope of the present disclosure, but is merely representative of this Disclosed selected embodiment.Based on embodiment of the disclosure, those skilled in the art are in the premise for not making creative work Under every other embodiment obtained, belong to the disclosure protection range.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.
Code stream (Data Rate) refers to the data traffic that video file uses within the unit time, is also code rate, is video Most important part in image quality control in coding.Video code conversion (Video Transcoding), which refers to, will compress volume The video code flow of code is converted into another video code flow, to adapt to different network bandwidths, different terminal processing capacity and not Same user demand.Transcoding is substantially one and first decodes, the process of re-encoding.
Currently, the first is to be carried out based on server architecture to code stream there are three types of the mainstream schemes converted to code stream Conversion, second is digital signal processor (Digital Signal Processing, DSP) and system level chip (System On Chip, SOC) assembled scheme code stream is converted, the third is that the association schemes of single SOC and double SOC carry out code stream Conversion.
For the first scheme, although server has flexible advantage, but power consumption and cost are excessively high, handles energy Power is weak;For second scheme, although there is flexible advantage, power consumption and cost are excessively high, and processing capacity is weak, algorithm It is high to develop complexity;For the third scheme, although there is advantage low in energy consumption, that performance is good, scalability is easy by manufacturer Function restriction is unfavorable for follow-up maintenance and Function Extension.
Based on the studies above, the disclosure provides a kind of code stream conversion method and system, to improve the above problem.
Fig. 1 is please referred to, the code stream conversion method that the disclosure provides is applied to code stream converting system 100 shown in FIG. 1, The code stream converting system 100 includes arm processor 10 and system level chip 20.
Fig. 2 and Fig. 3 are please referred to, Fig. 2 is the flow diagram of code stream conversion method provided by the disclosure, and Fig. 3 is The realization principle block diagram of code stream conversion method provided by the disclosure.Below to code stream conversion method shown in Fig. 2 Detailed process is described in detail.
Step S10: the arm processor 10 receives the code stream of input, according to the format of the code stream to the code stream into Row demultiplexing, obtains the first video ES data and the first audio ES data.
Wherein, the code stream format of input can there are many, including transport stream (Transport Stream, TS) code stream, base In the stream media network transport protocol (HTTP of hypertext transfer protocol (Hyper Text Transfer Protocol, HTTP) Live Streaming, HLS) code stream, real-time transport protocol (Real-time Transport Protocol, RTP) code stream with And real time streaming transport protocol (Real Time Streaming Protocol, RTSP) code stream etc., the disclosure is to input code flow Format is without limitation.The arm processor 10 is after receiving the code stream of input, according to the format of input code flow to the code stream It is demultiplexed, isolated first video ES data and the first audio ES data.Wherein, ES data are only comprising a kind of content Data flow, for example, the first video ES data is then only comprising the video data in input code flow, the first audio ES data are then only wrapped Containing the audio data in input code flow.
Step S20: the arm processor 10 is according to the format of first video ES data, to the first video ES Data are decoded, and original yuv video data are obtained, and according to the format of the first audio ES data, to described first Audio ES data are decoded, and obtain original PCM audio data.
Wherein, after obtaining the first video ES data and the first audio ES data, the arm processor 10 is according to demultiplexing The format of obtained first video ES data is decoded first video ES data, obtains original yuv video number According to, while the format of the first audio ES data obtained according to demultiplexing, the first audio ES data are decoded, Obtain original PCM audio data.The original yuv video data are original video data, i.e., uncoded video data is described Original PCM audio data are original audio data, i.e., uncoded audio data.
Step S30: the arm processor 10 pre-processes the original yuv video data, and will be pretreated Original yuv video data are transmitted to the system level chip 20.
Wherein, after obtaining the original yuv video data, the arm processor 10 is to the original yuv video data It is pre-processed, including zooms in and out and add the processing such as subtitle to the original yuv video data.Optionally, in the disclosure In, it can impose a condition and the original yuv video data are pre-processed, for example, imposing a condition to add subtitle, then obtain After the original yuv video data, need to only subtitle be added to the original yuv video data;For another example setting condition is Nothing, then after obtaining the original yuv video data, it is not necessary that the original yuv video data are carried out with the pre- place of any operation Reason, in another example, it imposes a condition to zoom in and out and adding subtitle, then after obtaining the original yuv video data, to the original Beginning yuv video data zoom in and out and add subtitle etc..
After being pre-processed to the original yuv video data, pretreated original yuv video data are transmitted to The system level chip 20.
Step S40: the system level chip 20 encodes pretreated original yuv video data, obtains second Video ES data, and second video ES data is transmitted to the arm processor 10.
Wherein, multiple types Video coding library is prestored in the system level chip 20, respectively corresponds various video coding Format, i.e., a type of Video coding library correspond to a kind of video code model.The system level chip 20 is receiving pre- place After original yuv video data after reason, according to the video code model of setting, call corresponding Video coding library to pretreatment after Original yuv video data encoded, obtain the second video ES data, after obtaining second video ES data, transmission To the arm processor 10.Second video ES data is the video ES data after coding.
Step S50: the arm processor 10 encodes the original PCM audio data, obtains the second audio ES number According to.
Wherein, multiple types audio coding library is prestored in the arm processor 10, respectively corresponds a variety of audio coding lattice Formula, i.e., a type of audio coding library correspond to a kind of audio coding formats.The arm processor 10 is to first audio ES The original PCM audio data that data decode are stored in inside the arm processor 10, therefore, are obtaining the original PCM After audio data, the arm processor 10 can call corresponding audio coding library to described according to the audio coding formats of setting Original PCM audio data are encoded, and the second audio ES data are obtained.Optionally, in the disclosure, the system level chip 20 The corresponding a variety of audio coding libraries of audio coding formats there are many prestoring, therefore, after obtaining the original PCM audio data, The original PCM audio data can also be transmitted to the system level chip 20, by the system level chip 20 to described original PCM audio data is encoded.For example, after decoding obtains the original PCM audio data, by the original PCM audio number According to the system level chip 20 is transmitted to, the system level chip 20 calls corresponding sound according to the audio coding formats of setting Frequency code database encodes the original PCM audio data.The second audio ES data are the audio ES data after coding.
Step S60: the arm processor 10 converges second video ES data and the second audio ES data, goes forward side by side Row multiplexing, the code stream after being converted.
Wherein, the arm processor 10 is after receiving second video ES data, by second video ES data Data convergence is completed in the arm processor 10 with the second audio ES data, and is multiplexed, and then the code after being converted Stream.
Step S70: the arm processor 10 exports the code stream after conversion according to preset format.
Wherein, after the code stream after being converted, the arm processor 10 will be after conversion according to preset format Code stream output.Preset format can there are many, including TS code stream, HLS code stream, RTP code stream and RTSP code stream etc..
Further, Fig. 4 is please referred to, the arm processor 10 is prestored there are many first decoding library, and described a variety of the One decoding library corresponds respectively to the format of various video ES data, and the arm processor 10 is according to first video ES data Format, the step of being decoded to first video ES data, obtain original yuv video data includes step S21 to walking Rapid S22.
Step S21: the arm processor 10 calls first video according to the format of first video ES data The format of ES data corresponding first decoding library.
Step S22: according to the format of first video ES data corresponding first decoding library to the first video ES Data are decoded, and obtain original yuv video data.
Wherein, a plurality of types of first decodings library is prestored in the arm processor 10, including AVS2, H.265 etc., point Not Dui Yingyu various video ES data format, i.e. a type of first decoding library corresponds to the format of video ES data a kind of. After obtaining first video ES data, the arm processor 10 calls institute according to the format of first video ES data The format corresponding first decoding library for stating the first video ES data is decoded first video ES data, obtains original Yuv video data.
Further, Fig. 5 is please referred to, the arm processor 10 is prestored there are many second decoding library, and described a variety of the Two decoding libraries correspond respectively to the format of a variety of first audio ES data, according to the format of the first audio ES data, to institute Stating the step of the first audio ES data are decoded, obtain original PCM audio data includes step S23 to step S24.
Step S23: the arm processor 10 calls first audio according to the format of the first audio ES data The format of ES data corresponding second decoding library.
Step S24: according to the format of the first audio ES data corresponding second decoding library to first audio ES Data are decoded, and obtain original PCM audio data.
Wherein, a plurality of types of second decodings library is prestored in the arm processor 10, corresponds respectively to a variety of first sounds The corresponding a kind of format of first audio ES data of the format of frequency ES data, i.e. a type of second decoding library.Described in obtaining After first audio ES data, the arm processor 10 calls first audio according to the format of the first audio ES data The format of ES data corresponding second decoding library is decoded the first audio ES data, obtains original PCM audio data.
The code stream conversion method that the disclosure provides introduces arm processor 10, passes through arm processor 10 and system level chip 20 combination is converted to code stream, favorable expandability, power consumption and cost is relatively low.
As a kind of optional specific embodiment, Fig. 6 is please referred to, the code stream conversion method that the disclosure provides can have The AVS that body is applied to CHINA RFTCOM Co Ltd turns code stream conversion H.265, and Fig. 6 is the realization principle block diagram of specific embodiment, should The detailed process of embodiment is as follows.
Process 10: the IP address and User Datagram Protocol port (User that configuration input parameter, i.e. setting receive code stream Datagram Protocol, UDP)
Process 11: by the IP address and udp port of setting, the code stream of input is received, the code stream of the input is transport stream (Transport Stream, TS).
TS stream application is mainly the digital video broadcasting of coaxial transmission, and supports a variety of basic Media Streams and media Coding standard (MPEG-2, MPEG-4, H.264, H.265, AVS etc.), facilitate extension.There are more than ten years actual extensive general All over property application, the approval consistent with internet industry of global broadcast industry is obtained.Mesh first three digital television standard: Advanced Television The standard committee (Advanced Television System CommiTTee, ATSC), digital video broadcasting (Digital Video Broadcasting, DVB) and Integrated Services Digital Broadcasting (Integrated Services Digital Broadcasting, ISDB) MPEG-TS is all based on as optimized integration.
TS specification uses TS encapsulation format, and single stream after view, audio stream multiplexing is transmitted.The basic composition unit of TS stream It is the TS packet that length is 188 bytes.
The packet length of TS packet is fixed as 188 bytes, 4, packet header byte, and the first byte is fixed as 0x47, loads as 184 bytes.
Process 12: the TS of input is flowed, processing is synchronized.I.e. according to long 188 words of the first byte 0x47 and packet of TS packet Section verifies the TS stream of input, to guarantee that TS stream can be identified.In the TS stream of input, if the TS packet of each input meets Long 188 bytes and the first byte 0x47, then data are synchronous.
Process 13: the TS stream after synchronization process is carried out to search table (PSI) processing, obtains video TS data packet and audio TS Data packet.
Program Specific Information table (Program Specific Information, PSI), PSI are defined in MPEG-TS Table is used to describe the composed structure of transport stream.Fig. 7 is please referred to, Fig. 7 is a kind of stream that table process is searched provided by the disclosure Cheng Tu.Program Association Table (Program Association Table, PAT) data packet that PID is identified as 0x00 is first looked for, After finding PAT data packet, PAT data packet is parsed, according to the rendition list that PAT data packet stores, program is searched and reflects The PID of firing table (Program Map Table, PMT);According to the PID of the PMT in PAT, pmt table is searched in search.Find PMT After table, pmt table is parsed, according to programme information, obtains video TS data packet, audio TS data packet and program clock reference (Program Clock Reference, PCR) data packet;It include the PID and Video Stream type of video in video TS data packet It (stream_type), include the PID and Audio Stream type (stream_type) of audio in audio TS data packet;In PCR number According to PID the and PCR stream type (stream_type) in packet including PCR, video TS data packet, audio TS data are being acquired After packet and PCR data packet, correspondence stores data.
Process 14: splitting the video TS data packet, the audio TS data packet that acquire, obtains video PES data Packet and audio PES data packet.
Wherein, process 14 includes sub-process 141 to sub-process 142.
Sub-process 141: video PID is determined according to the stream type in video TS data packet, and according to audio TS data packet In stream type determine Audio PID.
Sub-process 142: video TS data packet and audio TS data packet are torn open respectively according to video PID and Audio PID Point, to after fractionation video TS data packet and audio TS data packet splice, obtain video PES data packet and audio PES Data packet.
Wherein, to after fractionation video TS data packet and audio TS data packet splice when, mainly pass through TS code Pay_load_start_endicator (sync byte) in stream packets to audio TS data packet and video TS data packet into Row splicing, wherein the beginning of pay_load_start_endicator=1 expression PES data packet.In splicing audio PES data Bao Shi mainly judges whether it is complete PES data packet according to the length field of PES data packet, if imperfect, then it represents that also not It has been spliced that, then continue to split next sound view TS data packet, to splice to audio PES data packet, until splicing completion, I.e. splicing obtains a complete audio PES data packet.
Process 15: the head information of video PES data packet and audio PES data packet is deleted, video ES data and audio are obtained ES data.
Fig. 8 is please referred to, Fig. 8 is the structural schematic diagram of PES data structure packet.Wherein, packet start code Prefix is packet start code prefix;Stream id is stream id;PES packet length is PES packet length;optional PES HEADER is the PES head information of transmission;PES packet data bytes is PES bag data byte;PES Scrambling control is PES scrambling control;PES priority is PES priority;data alignment Indicator is data alignment indicator;Copyright is copyright;Original or copy is original or duplication; 7flags is 7 marks;PES header data length is PES number length;Optional fields is any word Section;Stuffing bytes is byte of padding.
After splicing obtains video PES data packet and audio PES data packet, so that it may primary to delete video PES data The head information of packet and audio PES data packet, i.e. deletion packet start code prefix, stream id, PES packet The part length and optional PES HEADER, respectively obtains video ES data and audio ES data.
The process of process 10 to process 15 corresponds to above-mentioned steps S10, i.e., according to the format of input code flow, carries out to code stream Demultiplexing, obtains the first video ES data and the first audio ES data.
After obtaining video ES data and audio ES data, into process 20.
Process 20: according to the format of video ES data, the decoding library AVS is called to decode video ES data, after obtaining decoding Video data, i.e., original yuv video data.Wherein, because H.265 the AVS that disclosure illustrated embodiment is CHINA RFTCOM Co Ltd turns Code stream conversion, in turn, the format of video ES data is AVS format, therefore, the decoding library AVS is called to carry out video ES data Decoding.
Process 30: pre-processing decoded video data, that is, adds subtitle and zoom in and out.
Process 40: pretreated video data is sent to system level chip 20 by PCIE data channel, by system Grade chip 20 calls corresponding code database (HEVC) to be encoded, video data (the video ES number after coding after exports coding According to).
Process 50: according to the format of audio ES data, decoding library (HE-AACV2) decoding is called, decoded audio is obtained Data, i.e. original PCM audio data.Wherein, the format of audio ES data is HE-AACV2, therefore, calls HE-AACV2 decoding Library is decoded audio ES data.
Process 60: to decoded audio data, corresponding code database (HE-AACV2) is called to be encoded, exports coding Audio data (the audio ES data after coding) afterwards.
Process 70: to after coding video data and audio data carry out multiplexing packing, and regenerate PCR data packet, TS stream after being converted.
Process 80: it is flowed according to the TS that the destination address of setting and port are sent after output conversion.
The process of process 20 to process 80 corresponds to above-mentioned steps S20 to step S70.
Further, turning back to combining refering to fig. 1, the disclosure provides a kind of code stream converting system 100, including ARM processing Device 10 and system level chip 20.
The arm processor 10 code stream for receiving input, and the code stream is carried out according to the format of the code stream Demultiplexing, obtains the first video ES data and the first audio ES data.
The arm processor 10 is used for the format according to first video ES data, to first video ES data It is decoded, original yuv video data is obtained, and according to the format of the first audio ES data, to first audio ES data are decoded, and obtain original PCM audio data.
The arm processor 10 is used to pre-process the original yuv video data, and will be pretreated original Yuv video data are transmitted to the system level chip 20.
The system level chip 20 obtains the second video for encoding to pretreated original yuv video data ES data, and second video ES data is transmitted to the arm processor 10.
The arm processor 10 obtains the second audio ES data for encoding to the original PCM audio data.
The arm processor 10 is used to converge second video ES data and the second audio ES data, and is answered With code stream after being converted.
Further, the code stream after the arm processor 10 is also used to convert is exported according to preset format.
Further, the arm processor 10 is prestored there are many first decoding library, and a variety of first decodings library is right respectively It should be used for the format according to first video ES data in the format of various video ES data, the arm processor 10, called The format of first video ES data corresponding first decoding library, and it is corresponding according to the format of first video ES data First decoding library is decoded first video ES data, obtains original yuv video data.
Further, the arm processor 10 is prestored there are many second decoding library, and a variety of second decodings library is right respectively It should be used for the format according to the first audio ES data in the format of a variety of audio ES data, the arm processor 10, called The format of the first audio ES data corresponding second decoding library;And it is corresponding according to the format of the first audio ES data Second decoding library is decoded the first audio ES data, obtains original PCM audio data.
Further, the arm processor 10 is used to carry out the original yuv video data pretreatment to include to described Original yuv video data zoom in and out and add subtitle.
It is apparent to those skilled in the art that for convenience and simplicity of description, the code stream of foregoing description The specific work process of converting system 100 no longer can excessively repeat herein with reference to the corresponding process in preceding method.
To sum up, the code stream conversion method and system that the disclosure provides reduce code stream conversion by introducing arm processor Cost provide the scalability of code stream conversion and by the combination of arm processor and system level chip;It is connect by arm processor The code stream of input is received, and code stream is demultiplexed according to the format of code stream, obtains the first video ES data and the first audio ES Data, after obtaining the first video ES data and the first audio ES data, arm processor is according to the format of the first video ES data And first audio ES data format, the first video ES data and the first audio ES data are decoded, original YUV is obtained Video data and original PCM audio data;After obtaining original yuv video data and original PCM audio data, arm processor Original PCM audio data are encoded, obtain the second audio ES data, and pre-process to original yuv video data, And pretreated original yuv video data are transmitted to system level chip, by system level chip to pretreated original YUV Video data is encoded, and obtains the second video ES data, and the second video ES data is transmitted to arm processor, ARM processing Device converges the second video ES data and the second audio ES data, is multiplexed, the code stream after being converted, and realizes to code stream Conversion, it is favorable expandability, low in energy consumption and at low cost.
In several embodiments provided by the disclosure, it should be understood that disclosed system and method can also pass through Other modes are realized.System and method embodiment described above is only schematical, for example, the flow chart in attached drawing The device of multiple embodiments according to the disclosure, the system in the cards of method and computer program product are shown with block diagram Framework, function and operation.In this regard, each box in flowchart or block diagram can represent a module, program segment or generation A part of code, a part of the module, section or code include one or more for realizing defined logic function Executable instruction.It should also be noted that function marked in the box can also be in some implementations as replacement Occur different from the sequence marked in attached drawing.For example, two continuous boxes can actually be basically executed in parallel, they Sometimes it can also execute in the opposite order, this depends on the function involved.It is also noted that block diagram and or flow chart In each box and the box in block diagram and or flow chart combination, can function or movement as defined in executing it is special Hardware based system is realized, or can be realized using a combination of dedicated hardware and computer instructions.
In addition, each functional module in each embodiment of the disclosure can integrate one independent portion of formation together Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the disclosure is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, electronic equipment or network equipment etc.) execute all or part of step of each embodiment the method for the disclosure Suddenly.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), deposits at random The various media that can store program code such as access to memory (RAM, Random Access Memory), magnetic or disk. It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.In addition, term " first ", " second " etc. are only used for Description is distinguished, relative importance is not understood to indicate or imply.
The foregoing is merely the alternative embodiments of the disclosure, are not limited to the disclosure, for the skill of this field For art personnel, the disclosure can have various modifications and variations.It is all within the spirit and principle of the disclosure, it is made any to repair Change, equivalent replacement, improvement etc., should be included within the protection scope of the disclosure.

Claims (10)

1. a kind of code stream conversion method, which is characterized in that be applied to code stream converting system, the code stream converting system includes ARM Processor and system level chip, which comprises
The arm processor receives the code stream of input, is demultiplexed according to the format of the code stream to the code stream, obtains the One video ES data and the first audio ES data;
The arm processor is decoded first video ES data, obtains according to the format of first video ES data To original yuv video data, and according to the format of the first audio ES data, the first audio ES data are solved Code, obtains original PCM audio data;
The arm processor pre-processes the original yuv video data, and by pretreated original yuv video number According to being transmitted to the system level chip;
The system level chip encodes pretreated original yuv video data, obtains the second video ES data, and will Second video ES data is transmitted to the arm processor;
The arm processor encodes the original PCM audio data, obtains the second audio ES data;
The arm processor converges second video ES data and the second audio ES data, and is multiplexed, and is converted Code stream afterwards.
2. code stream conversion method according to claim 1, which is characterized in that after the code stream after being converted, the side Method further include:
The arm processor exports the code stream after conversion according to preset format.
3. code stream conversion method according to claim 1, which is characterized in that the arm processor is prestored there are many first Library is decoded, a variety of first decodings library corresponds respectively to the format of various video ES data, and the arm processor is according to The format of first video ES data, the step of first video ES data is decoded, obtains original yuv video data packet It includes:
The arm processor calls the format pair of first video ES data according to the format of first video ES data The the first decoding library answered;
First video ES data is decoded according to the format of first video ES data corresponding first decoding library, Obtain original yuv video data.
4. code stream conversion method according to claim 1, which is characterized in that the arm processor is prestored there are many second Library is decoded, a variety of second decodings library corresponds respectively to the format of a variety of audio ES data, according to the first audio ES number According to format, the step of being decoded to the first audio ES data, obtain original PCM audio data includes:
The arm processor calls the format pair of the first audio ES data according to the format of the first audio ES data The the second decoding library answered;
The first audio ES data are decoded according to the format of the first audio ES data corresponding second decoding library, Obtain original PCM audio data.
5. code stream conversion method according to claim 1, which is characterized in that the arm processor regards the original YUV Frequency includes zooming in and out and adding subtitle to the original yuv video data according to pretreatment is carried out.
6. a kind of code stream converting system, which is characterized in that including arm processor and system level chip;
The arm processor code stream for receiving input, and the code stream is demultiplexed according to the format of the code stream, Obtain the first video ES data and the first audio ES data;
The arm processor is used for the format according to first video ES data, solves to first video ES data Code, obtains original yuv video data, and according to the format of the first audio ES data, to the first audio ES data It is decoded, obtains original PCM audio data;
The arm processor is regarded for pre-processing to the original yuv video data, and by pretreated original YUV Frequency evidence is transmitted to the system level chip;
The system level chip is used to encode pretreated original yuv video data, obtains the second video ES data, And second video ES data is transmitted to the arm processor;
The arm processor obtains the second audio ES data for encoding to the original PCM audio data;
The arm processor is used to converge second video ES data and the second audio ES data, and is multiplexed, and obtains Code stream after conversion.
7. code stream converting system according to claim 6, which is characterized in that after the arm processor is also used to convert Code stream exported according to preset format.
8. code stream converting system according to claim 6, which is characterized in that the arm processor is prestored there are many first Library is decoded, a variety of first decodings library corresponds respectively to the format of various video ES data, and the arm processor is used for basis The format of first video ES data, the format of calling first video ES data corresponding first decoding library, and according to The format of first video ES data corresponding first decoding library is decoded first video ES data, obtains original Yuv video data.
9. code stream converting system according to claim 6, which is characterized in that the arm processor is prestored there are many second Library is decoded, a variety of second decodings library corresponds respectively to the format of a variety of audio ES data, and the arm processor is used for basis The format of the first audio ES data calls the format of the first audio ES data corresponding second decoding library;And according to The format of the first audio ES data corresponding second decoding library is decoded the first audio ES data, obtains original PCM audio data.
10. code stream converting system according to claim 6, which is characterized in that the arm processor is used for described original It includes zooming in and out and adding subtitle to the original yuv video data that yuv video data, which carry out pretreatment,.
CN201811598561.0A 2018-12-25 2018-12-25 Code stream conversion method and system Active CN109640162B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811598561.0A CN109640162B (en) 2018-12-25 2018-12-25 Code stream conversion method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811598561.0A CN109640162B (en) 2018-12-25 2018-12-25 Code stream conversion method and system

Publications (2)

Publication Number Publication Date
CN109640162A true CN109640162A (en) 2019-04-16
CN109640162B CN109640162B (en) 2021-05-14

Family

ID=66077672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811598561.0A Active CN109640162B (en) 2018-12-25 2018-12-25 Code stream conversion method and system

Country Status (1)

Country Link
CN (1) CN109640162B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110753259A (en) * 2019-11-15 2020-02-04 北京字节跳动网络技术有限公司 Video data processing method and device, electronic equipment and computer readable medium
CN113596377A (en) * 2021-08-02 2021-11-02 北京数码视讯技术有限公司 Monitoring video conversion device and system for satellite communication
CN114143585A (en) * 2021-11-02 2022-03-04 深圳Tcl新技术有限公司 Data processing method and device, storage medium and terminal equipment
CN114339388A (en) * 2021-12-07 2022-04-12 海信视像科技股份有限公司 Control method and device for audio output mode

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102385864A (en) * 2010-08-31 2012-03-21 Tcl集团股份有限公司 Audio data decoding method, device and audio player
US20120287995A1 (en) * 2011-05-12 2012-11-15 Madhukar Budagavi Luma-Based Chroma Intra-Prediction for Video Coding
US20150281751A1 (en) * 2014-03-31 2015-10-01 Arris Enterprises, Inc. Adaptive streaming transcoder synchronization
CN105142037A (en) * 2015-09-10 2015-12-09 北京暴风科技股份有限公司 Distributed transcoded audio and video synthesis method and system
CN105163169A (en) * 2015-09-16 2015-12-16 北京暴风科技股份有限公司 Data package format method and system suitable for transmission
US20160309195A1 (en) * 2012-02-27 2016-10-20 Texas Instruments Incorporated Sample Adaptive Offset (SAO) Parameter Signaling
CN106470340A (en) * 2015-08-14 2017-03-01 华平智慧信息技术(深圳)有限公司 A kind of secondary video data-encoding scheme and system
CN206003000U (en) * 2016-06-22 2017-03-08 上海柏飞电子科技有限公司 Virtual desktop system circuit board terminal based on ARMSOC
CN107071449A (en) * 2017-05-18 2017-08-18 北京数码视讯科技股份有限公司 A kind of trans-coding system and method
CN107197287A (en) * 2017-05-24 2017-09-22 福州瑞芯微电子股份有限公司 A kind of video recorded broadcast method and apparatus based on arm processors
CN108881916A (en) * 2018-06-21 2018-11-23 深圳市斯迈龙科技有限公司 The video optimized processing method and processing device of remote desktop

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102385864A (en) * 2010-08-31 2012-03-21 Tcl集团股份有限公司 Audio data decoding method, device and audio player
US20120287995A1 (en) * 2011-05-12 2012-11-15 Madhukar Budagavi Luma-Based Chroma Intra-Prediction for Video Coding
US20160309195A1 (en) * 2012-02-27 2016-10-20 Texas Instruments Incorporated Sample Adaptive Offset (SAO) Parameter Signaling
US20150281751A1 (en) * 2014-03-31 2015-10-01 Arris Enterprises, Inc. Adaptive streaming transcoder synchronization
CN106470340A (en) * 2015-08-14 2017-03-01 华平智慧信息技术(深圳)有限公司 A kind of secondary video data-encoding scheme and system
CN105142037A (en) * 2015-09-10 2015-12-09 北京暴风科技股份有限公司 Distributed transcoded audio and video synthesis method and system
CN105163169A (en) * 2015-09-16 2015-12-16 北京暴风科技股份有限公司 Data package format method and system suitable for transmission
CN206003000U (en) * 2016-06-22 2017-03-08 上海柏飞电子科技有限公司 Virtual desktop system circuit board terminal based on ARMSOC
CN107071449A (en) * 2017-05-18 2017-08-18 北京数码视讯科技股份有限公司 A kind of trans-coding system and method
CN107197287A (en) * 2017-05-24 2017-09-22 福州瑞芯微电子股份有限公司 A kind of video recorded broadcast method and apparatus based on arm processors
CN108881916A (en) * 2018-06-21 2018-11-23 深圳市斯迈龙科技有限公司 The video optimized processing method and processing device of remote desktop

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FUJITSU: "Fujitsu announces new ARM Cortex-based Bridge SoC with 10 different interfaces for transcoder ICs and products requiring multiple interface control", 《HTTPS://WWW.FIJITSU.COM/CA/EN/ABOUT/RESOURCES/NEWS/PRESS-RELEASES/2012/FSA-20121031.HTML》 *
电子发烧友>产品频道>产品详情: "66AK2H14 多核DSP+ARM KeyStone Ⅱ片上***(SoC)", 《电子发烧友 WWW.ELECFANS.COM/P/733917.HTML》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110753259A (en) * 2019-11-15 2020-02-04 北京字节跳动网络技术有限公司 Video data processing method and device, electronic equipment and computer readable medium
CN113596377A (en) * 2021-08-02 2021-11-02 北京数码视讯技术有限公司 Monitoring video conversion device and system for satellite communication
CN114143585A (en) * 2021-11-02 2022-03-04 深圳Tcl新技术有限公司 Data processing method and device, storage medium and terminal equipment
CN114339388A (en) * 2021-12-07 2022-04-12 海信视像科技股份有限公司 Control method and device for audio output mode

Also Published As

Publication number Publication date
CN109640162B (en) 2021-05-14

Similar Documents

Publication Publication Date Title
US10397295B2 (en) Processing continuous multi-period content
US20230283863A1 (en) Retrieving and accessing segment chunks for media streaming
JP5596228B2 (en) Signaling a random access point for streaming video data
CN109640162A (en) Code stream conversion method and system
KR102076064B1 (en) Robust live operation of dash
US20150074129A1 (en) Augmenting media presentation description and index for metadata in a network environment
JP7171772B2 (en) Frame transform for adaptive streaming alignment
KR20150088899A (en) Network streaming of coded video data
CN109644282B (en) System level signaling of supplemental enhancement information tracks for media data streaming
EA035232B1 (en) Device and method for encoding and/or decoding video data
KR102137858B1 (en) Transmission device, transmission method, reception device, reception method, and program
US11184665B2 (en) Initialization set for network streaming of media data
JP2021197584A (en) Multiple signal conversion device and program thereof, and receiver
KR20220157957A (en) Determination of Availability of Chunks of Data for Network Streaming of Media Data
US11943501B2 (en) Dynamic resolution change hints for adaptive streaming
JP2011217246A (en) Apparatus for transmission of video/voice data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant