CN109743627B - Playing method of digital movie package based on AVS + video coding - Google Patents
Playing method of digital movie package based on AVS + video coding Download PDFInfo
- Publication number
- CN109743627B CN109743627B CN201910041489.XA CN201910041489A CN109743627B CN 109743627 B CN109743627 B CN 109743627B CN 201910041489 A CN201910041489 A CN 201910041489A CN 109743627 B CN109743627 B CN 109743627B
- Authority
- CN
- China
- Prior art keywords
- data
- video
- audio
- encryption
- packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a playing method of digital movie packages based on AVS + video coding, which comprises the following steps: s1), acquiring an AVS + video coding DCP-based digital cinema file package, and analyzing to obtain video data and audio data; s2) respectively storing the video data and the audio data into respective buffer areas; s3) reading the video data and the audio data from the buffer area, multiplexing into TS stream data, and storing into the TS buffer area; s4) an HTTP server is set up on the terminal, and when a playing request is made, data are read from the TS cache region and output through HTTP; s5) playing the TS stream data streamed by HTTP using a standard playing interface. The playing method based on the AVS + video coding digital movie package can conveniently play the AVS + coding DCP digital movie package on android, apples and common embedded equipment, and has the advantages of good picture quality, small capacity, selectable decryption difficulty and the like.
Description
Technical Field
The invention relates to a playing method of a digital movie package, in particular to a playing method of a digital movie package based on AVS + video coding.
Background
At present, the container packaging formats supported by media playing interfaces carried by various terminal equipment chips are very limited, and the common formats such as MP4/MKV/TS and the like are supported, but the container formats special for some industries cannot be played.
A DCP digital cinema package is a set of digital files used to store and convert audio, image and data streams of digital imagery. The term is defined by the Digital Cinema Initiative (DCI) in packaging recommendations for digital imagery. These packages are used to store audio and video streams, as well as auxiliary index files in XML format.
The equipment capable of playing DCP digital cinema packages is usually special customized equipment, such as Dolby, GDC, Sony cinema special equipment, and the equipment can only support MPEPG2 and JPEG2000 coded video MXF files. Android devices, apple devices and other embedded devices cannot play DCP digital movie packages coded by AVS + currently.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a playing method based on AVS + video coding digital film package, which can conveniently play AVS + coding DCP digital film package on android, apple and common embedded equipment, and has the advantages of good picture quality, small capacity, selectable decryption difficulty and the like.
The technical scheme adopted by the invention for solving the technical problems is to provide a playing method based on an AVS + video coding digital movie package, which comprises the following steps: s1), acquiring an AVS + video coding DCP-based digital cinema file package, and analyzing to obtain video data and audio data; s2) respectively storing the video data and the audio data into respective buffer areas; s3) reading the video data and the audio data from the buffer area, multiplexing into TS stream data, and storing into the TS buffer area; s4) an HTTP server is set up on the terminal, and when a playing request is made, data are read from the TS cache region and output through HTTP; s5) playing the TS stream data streamed by HTTP using a standard playing interface.
In the playing method based on the AVS + video coding digital cinema package, in step S1), the DCP digital cinema package is produced as follows: s11) obtaining an AVS + data source, and carrying out audio and video separation to obtain video stream ES data and audio stream ES data; s12) cutting the ES data of the video stream into frames, sealing the cut video data into MXF packets, connecting a series of adjacent MXF packets in series, and adding the head and the tail to generate a video MXF file; s13) equally dividing and cutting the ES data of the audio stream according to the video frame rate, sealing the cut audio data into MXF packets, connecting a series of adjacent MXF packets in series, and adding the head and the tail to generate an audio MXF file; s14) packing into digital cinema DCP packages according to the video MXF files and the audio MXF files.
In the playing method based on the AVS + video coding digital cinema package, step S12 includes extracting video stream information metadata, I frames, P frames, and B frames from the ES data of the video stream, and combining the video stream metadata and the I frames into one Packet, where the P frames are combined into one Packet separately, and the B frames are combined into one Packet separately.
In the playing method based on the AVS + video coding digital cinema package, in step S13, an MXF Packet is generated for each frame of audio data; the sequence number count of each audio Packet is consistent with the sequence number count of the video Packet corresponding to the audio Packet, so that jump synchronization is realized during decoding and playing.
The playing method based on the AVS + video coding digital movie package, wherein the step S12 further includes adding media information in the packaging process, the text content in the media information is realized by adding corresponding fields in the descriptive xml file, the picture content in the media information is realized by adding a picture relative path in the descriptive xml file, and the picture, the video MXF file and the audio MXF file are placed in the same directory; the media information includes a director, actors, movie vignettes, year, and/or poster pictures.
In the playing method based on the AVS + video coding digital cinema package, step S12 and step S13 further include setting an encryption flag bit and an encryption algorithm type for each Packet separately, and performing corresponding encryption processing on each Packet according to a set encryption mode, where the audio data encryption mode and the video data encryption mode are the same; said step S1 also includes the corresponding decryption of the encrypted audio data and video data.
The playing method based on the AVS + video coding digital movie packet is characterized in that the encryption algorithm is exclusive-or encryption, DES encryption or AES encryption.
In the playing method based on the AVS + video coding digital movie package, the video data and the audio data are set in the following three-level encryption manner:
the first-stage encryption mode carries out AES-128 full data encryption on each Packet of the video and each Packet of the audio, and different encryption keys are independently assigned to each Packet;
performing AES-128 full data encryption on each Packet of the video in a second-stage encryption mode, and directly packaging the audio into the Packet without encrypting the original data;
the third-level encryption mode only encrypts I frame data in the video in an exclusive-or mode, P frame B frame data is not encrypted, and audio data is not encrypted.
In the playing method based on the AVS + video coding digital cinema package, the first-stage encryption mode uses 5 encryption keys for video and 1 encryption key for audio, and a field is reserved in the video Packet to indicate which corresponding key is used by the current Packet for decryption; the second-level encryption mode uses 1 encryption key for the video; and when playing, different keys are selected for decryption according to the key characteristic field to obtain the bright stream for playing.
In the playing method based on the AVS + video coding digital cinema package, the steps S1 to S5 are executed in the same local playing program, and all data are only converted in the memory, and the pause and skip functions during playing are supported; when the pause function is executed, the HTTP keeps connection, the inside stops analyzing the video data and the audio data, and the thread is started again for analysis when the playing interface continues playing; when the skip function is executed, the original HTTP cache data is emptied, then the video position and the corresponding synchronous audio position of the nearby I frame are found according to the appointed time, and the video data and the audio data are analyzed and filled into the cache stream to be output as the HTTP.
Compared with the prior art, the invention has the following beneficial effects: according to the playing method based on the AVS + video coding digital film packet, HTTP streaming output operation is carried out on the AVS + coding DCP digital film packet, so that android, apples and common embedded equipment can conveniently play the AVS + coding DCP digital film packet, and the playing method has the advantages of good picture quality, small capacity, selectable decryption difficulty and the like.
Drawings
FIG. 1 is a schematic diagram of the present invention of digital cinema packaging based on AVS + encoding format;
FIG. 2 is a schematic diagram of the playing process of the AVS + video coding-based digital cinema package according to the present invention.
Detailed Description
The invention is further described below with reference to the figures and examples.
Fig. 1 is a schematic diagram of the digital cinema packaging process based on the AVS + encoding format according to the present invention.
Referring to fig. 1, in the Digital Cinema packaging method based on AVS + encoding format provided by the present invention, the whole packaging system is divided into 7 parts from the source file to the DCP Package (Digital Cinema Package) finished product:
1. performing Audio and Video separation on an AVS + (Audio Video coding Standard) data source to obtain Video stream ES data and Audio stream ES data (the ES stream is also called a basic code stream and contains continuous code streams of Video, Audio or data); the AVS + is used as a part of AVS series standards, and the video coding performance of the AVS + is equivalent to that of international similar standards, so the AVS + is adopted as the only video coding standard which must be adopted by high-definition broadcast television in China.
2. Extracting video stream information metadata, I frames, P frames and B frames from an AVS + video stream ES data stream; i-frames, P-frames, B-frames are used to represent transmitted video pictures in the h.264 compression standard.
The I frame is also called an intra-frame coded frame, and is an independent frame with all information, and can be independently decoded without referring to other images, and can be simply understood as a static picture. The first frame in a video sequence is always an I-frame because it is a key frame.
P-frames, also called inter-frame predictive coded frames, require reference to a previous I-frame for encoding. The difference between the current frame picture and the previous frame (which may be an I frame or a P frame) is shown. When decoding, the difference defined by the frame is superimposed on the picture buffered before, and the final picture is generated. P-frames generally occupy fewer data bits than I-frames, but are less sensitive to transmission errors due to their complex dependencies on previous P-and I-reference frames.
The B frame is also called bidirectional predictive coding frame, that is, the B frame records the difference between the current frame and the previous and next frames. That is, to decode a B frame, not only the previous buffer picture but also the decoded picture are acquired, and the final picture is acquired by superimposing the previous and subsequent pictures on the data of the current frame. The B frame compression rate is high, but the decoding performance is required to be high.
3. Cutting the ES data of the audio stream according to the video frame rate setting, and setting a synchronous packet header; the sequence number count of each audio Packet is consistent with the sequence number count of the video Packet corresponding to the audio Packet, so that jump synchronization is realized during decoding and playing.
4. And packaging the cut video data into MXF packets (Material eXchange Format), combining the video stream metadata and the I frames into one Packet, combining the P frames into one Packet, and combining the B frames into one Packet. And setting whether the flag bit is encrypted or not and which encryption mode is adopted for each Packet. The encryption mode adopts exclusive OR XOR encryption and AES-128 partial data encryption at present, and 3-clock modes of AES-128 full data encryption are adopted, and the complexity is increased in sequence.
The invention can independently set whether each video Packet or each audio Packet is encrypted or not and the encryption mode, can conveniently control the encryption percentage of the whole video or audio data, and finally can control the decryption complexity of the manufactured DCP film package by controlling the percentage of the encrypted data and the selection of the encryption algorithm, thereby finally making better compromise on the film safety protection and the terminal decryption complexity to ensure that the manufactured film can not only effectively protect the content from piracy, but also be compatible with more terminal equipment as far as possible.
Three application scenarios are given below:
i) the video content and the audio content have high safety protection requirements, and the playing equipment with excellent corresponding processing performance can decrypt all video and audio in real time without barriers
The invention carries out AES-128 full data encryption on each Packet of video and each Packet of audio, namely 100% audio and video data encryption, 5 encryption keys are used for video, 1 encryption key is used for audio, and a field is reserved in the video Packet to indicate which corresponding key is used for current Packet to carry out decryption.
ii) high requirements for video content security protection, no need for encryption of audio content, and corresponding playback devices with moderate processing performance
The invention carries out AES-128 full data encryption on each Packet of the video, the audio is that the original data is directly packed into the Packet without encryption, and the video uses 1 encryption key.
iii) the video and audio data is generally required to be protected, the video content is partially encrypted, the audio content is not encrypted, and the corresponding lower-end playing equipment is correspondingly compared
The processing method of the invention only encrypts I frame data in the video in an exclusive-OR mode, does not encrypt P frame B frame data, and does not encrypt audio data. Such an encryption packing method is not only aimed at protecting video data to a certain extent, but also cannot increase the playback processing burden of the playing device. Some playing device chips are dual-core, usually equipped with an ARM core with weak processing capacity, and then a core specially used for decoding video data, although the video processing core can play high-definition video data, the general CPU of the ARM core has weak computing capacity, and cannot decrypt a full data encryption mode such as AES-128 in real time, at this time, an XOR decryption mode with low computing requirement is used instead, because only I frame is encrypted, the total encrypted data amount does not exceed 10%, and decryption of P frame B frame data depends on the decrypted I frame, therefore, under the condition of greatly reducing decryption complexity of video data, data security is still well protected.
5. And sealing the cut audio data into MXF packets in the same encryption mode as the video.
6. And cascading the previously generated MXF Packet files together and adding a head Header part and a tail Footter part to generate a corresponding video MXF file and an audio MXF file.
7. Packing the video MXF and audio MXF files into a digital movie DCP package, and optionally adding media information such as a director, actors, movie introduction, year, poster and the like in the packing process; the character type media information is obtained by adding corresponding fields into a descriptive xml file, the picture type media information is obtained by adding picture relative paths into the descriptive xml file, and the picture, the video MXF file and the audio MXF file are placed in the same directory.
The invention can effectively combine the safe anti-piracy and the rapid distribution by introducing AVS + video coding and self-defined audio/video encryption modes and comprehensively considering the data volume of a film and the decryption capability of projection equipment, and simultaneously, because the encryption mode is selectable, the corresponding encryption mode can be selected according to the processing capability of the corresponding terminal when the distribution version is manufactured. The digital film DCP package packed by the AVS + coding format has the data size controlled in 5-10 Gbyte, and has the advantages of good picture quality, small capacity, selectable decryption difficulty, etc. the present invention can realize the selection of different encryption modes in the packing process, and can be conveniently connected with various projection equipment, thereby effectively solving the defects of large packing storage, slow transmission, expensive special projection equipment, etc. of the original JPEG2000 mode, and being suitable for projection in small and medium-sized projection places.
FIG. 2 is a schematic diagram of the playing process of the AVS + video coding-based digital cinema package according to the present invention.
Referring to fig. 2, the whole playing process of the playing method based on the AVS + video coding digital movie package provided by the present invention is divided into 5 parts:
1. analyzing the digital cinema file package based on AVS + video coding DCP according to a DCI standard protocol to obtain video data and audio data;
2. respectively storing the video data and the audio data into respective cache regions;
3. reading video data and audio data from the buffer area, multiplexing the video data and the audio data into TS stream data, and storing the TS stream data into the TS buffer area; the TS stream is also called transport stream, is composed of packets with fixed length of 188 bytes, contains one or more programs of independent time base, and is suitable for the environment with more error codes;
4. a smallest http server is set up on a terminal, and when a playing request exists, data are read from a TS cache region and sent through http;
5. and playing the TS stream data after the http streaming by using a standard playing interface.
The method solves the problem of playing AVS + video coding DCP digital cinema package, has good compatibility with android, apples and various embedded devices, can conveniently integrate the playing flow into various devices, and has the advantages of good picture quality, small capacity, selectable decryption difficulty and the like. The paths of the DCP- > TS- > HTTP- > PLAYER of the invention are all in the same local playing program, all data are only converted in the internal memory, external storage is not involved, the security of the data is protected, and the clear stream after decryption is not intercepted. The present invention includes but is not limited to playback in digital cinema DCP packet format, and other encrypted private media encapsulation methods can be streamed into HTTP output by this method so that the normal media player interface can support playback. The invention also supports pause and jump functions during playing. The pause function HTTP keeps connection, the inside stops analyzing the video data and the audio data, and the thread is started again to analyze when the playing interface continues playing; the skip function firstly clears the original HTTP cache data, then finds the video position of the nearby I frame and the corresponding synchronous audio position according to the designated time, and begins to analyze the video data and the audio data to fill in the cache stream to form HTTP output.
Although the present invention has been described with respect to the preferred embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (5)
1. A playing method based on AVS + video coding digital film package includes the following steps:
s1), acquiring an AVS + video coding DCP-based digital cinema file package, and analyzing to obtain video data and audio data;
s2) respectively storing the video data and the audio data into respective buffer areas;
s3) reading the video data and the audio data from the buffer area, multiplexing into TS stream data, and storing into the TS buffer area;
s4) an HTTP server is set up on the terminal, and when a playing request is made, data are read from the TS cache region and output through HTTP;
s5) playing the TS stream data after HTTP streaming by using a standard playing interface;
the manufacturing process of the DCP digital cinema package in the step S1) is as follows:
s11) obtaining an AVS + data source, and carrying out audio and video separation to obtain video stream ES data and audio stream ES data;
s12) cutting the ES data of the video stream into frames, sealing the cut video data into MXF packets, connecting a series of adjacent MXF packets in series, and adding the head and the tail to generate a video MXF file;
s13) equally dividing and cutting the ES data of the audio stream according to the video frame rate, sealing the cut audio data into MXF packets, connecting a series of adjacent MXF packets in series, and adding the head and the tail to generate an audio MXF file;
s14) packing the video MXF files and the audio MXF files into digital movie DCP packages;
the step S12 includes extracting video stream information metadata, I-frames, P-frames, and B-frames from the ES data of the video stream, and combining the video stream metadata and the I-frames into one Packet, where the P-frames are individually combined into one Packet, and the B-frames are individually combined into one Packet;
the step S13 generates an MXF Packet for each frame of audio data; the sequence number count of each audio Packet is consistent with the sequence number count of the video Packet corresponding to the audio Packet, so that jump synchronization is realized during decoding and playing;
the steps S12 and S13 further include setting a flag bit indicating whether to encrypt and a type of encryption algorithm for each Packet individually, and performing corresponding encryption processing on each Packet according to a set encryption method, where the audio data encryption method is the same as the video data encryption method; said step S1 further includes the corresponding decryption of the encrypted audio data and video data;
the steps S1-S5 are executed in the same local playing program, all data are only converted in the memory, and the pause and jump functions during playing are supported; when the pause function is executed, the HTTP keeps connection, the inside stops analyzing the video data and the audio data, and the thread is started again for analysis when the playing interface continues playing; when the skip function is executed, the original HTTP cache data is emptied, then the video position and the corresponding synchronous audio position of the nearby I frame are found according to the appointed time, and the video data and the audio data are analyzed and filled into the cache stream to be output as the HTTP.
2. The playing method of claim 1, wherein said step S12 further comprises adding media information during the packaging process, the text content in said media information is realized by adding corresponding fields in a descriptive xml file, the picture content in said media information is realized by adding picture relative path in a descriptive xml file, said picture, video MXF file and audio MXF file are placed in the same directory; the media information includes a director, actors, movie vignettes, year, and/or poster pictures.
3. The AVS + video encoded digital cinema package-based playback method of claim 1, wherein the encryption algorithm is xor encryption, DES encryption, or AES encryption.
4. The AVS + video encoded digital cinema package-based playback method of claim 3, characterized in that the video data and audio data are arranged in a three-level encryption manner as follows:
the first-stage encryption mode carries out AES-128 full data encryption on each Packet of the video and each Packet of the audio, and different encryption keys are independently assigned to each Packet;
performing AES-128 full data encryption on each Packet of the video in a second-stage encryption mode, and directly packaging the audio into the Packet without encrypting the original data;
the third-level encryption mode only encrypts I frame data in the video in an exclusive-or mode, P frame B frame data is not encrypted, and audio data is not encrypted.
5. The playing method of claim 4, wherein the first-level encryption mode uses 5 encryption keys for video and 1 encryption key for audio, and leaves a field in a video Packet to indicate which corresponding key is used by the current Packet for decryption; the second-level encryption mode uses 1 encryption key for the video; and when playing, different keys are selected for decryption according to the key characteristic field to obtain the bright stream for playing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910041489.XA CN109743627B (en) | 2019-01-16 | 2019-01-16 | Playing method of digital movie package based on AVS + video coding |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910041489.XA CN109743627B (en) | 2019-01-16 | 2019-01-16 | Playing method of digital movie package based on AVS + video coding |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109743627A CN109743627A (en) | 2019-05-10 |
| CN109743627B true CN109743627B (en) | 2021-11-09 |
Family
ID=66365098
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910041489.XA Active CN109743627B (en) | 2019-01-16 | 2019-01-16 | Playing method of digital movie package based on AVS + video coding |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109743627B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113973222A (en) * | 2021-12-02 | 2022-01-25 | 成都统信软件技术有限公司 | Video playing method and device and computing equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104698857A (en) * | 2015-02-09 | 2015-06-10 | 深圳市环球数码科技有限公司 | Digital Cinema Initiatives (DCI) private cinema system and smart home integrated implementation method and system |
| CN105979298A (en) * | 2016-06-22 | 2016-09-28 | 上海文广科技（集团）有限公司 | Video file full-link safe management and distribution method and system based on cloud technology |
| CN106454271A (en) * | 2016-11-21 | 2017-02-22 | 环球大数据科技有限公司 | Video processing system and method |
| CN106507135A (en) * | 2016-10-28 | 2017-03-15 | 上海文广科技（集团）有限公司 | The order system and booking method of two G-film G cinemas |
| CN108206022A (en) * | 2016-12-16 | 2018-06-26 | 南京青衿信息科技有限公司 | Utilize the codec and its decoding method of AES/EBU transmission three-dimensional acoustical signals |
| CN109104636A (en) * | 2017-06-20 | 2018-12-28 | 中国电影科学技术研究所 | A kind of digital movie playing device and playback method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150378804A1 (en) * | 2014-05-20 | 2015-12-31 | Thomson Licensing | Digital cinema package test |
-
2019
- 2019-01-16 CN CN201910041489.XA patent/CN109743627B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104698857A (en) * | 2015-02-09 | 2015-06-10 | 深圳市环球数码科技有限公司 | Digital Cinema Initiatives (DCI) private cinema system and smart home integrated implementation method and system |
| CN105979298A (en) * | 2016-06-22 | 2016-09-28 | 上海文广科技（集团）有限公司 | Video file full-link safe management and distribution method and system based on cloud technology |
| CN106507135A (en) * | 2016-10-28 | 2017-03-15 | 上海文广科技（集团）有限公司 | The order system and booking method of two G-film G cinemas |
| CN106454271A (en) * | 2016-11-21 | 2017-02-22 | 环球大数据科技有限公司 | Video processing system and method |
| CN108206022A (en) * | 2016-12-16 | 2018-06-26 | 南京青衿信息科技有限公司 | Utilize the codec and its decoding method of AES/EBU transmission three-dimensional acoustical signals |
| CN109104636A (en) * | 2017-06-20 | 2018-12-28 | 中国电影科学技术研究所 | A kind of digital movie playing device and playback method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109743627A (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9641322B2 (en) | Container agnostic decryption device and methods for use therewith | |
| JP7418533B2 (en) | System and method for protecting elementary bitstreams incorporating independently encoded tiles | |
| CN101867750B (en) | OSD information processing method and device for video monitoring system | |
| US20080291999A1 (en) | Method and apparatus for video frame marking | |
| US11606576B2 (en) | Method and apparatus for generating media file comprising 3-dimensional video content, and method and apparatus for replaying 3-dimensional video content | |
| CN102474588B (en) | Transmission control device, receiving control device, sending control method, acceptance control method | |
| CN111031353A (en) | Video encryption method and device | |
| US20180302674A1 (en) | File generating method and file generating apparatus | |
| KR101343527B1 (en) | Method for Producing and playing Digital Cinema Contents and Apparatus for producing and playing digital cinema contents using the method | |
| CN109743627B (en) | Playing method of digital movie package based on AVS + video coding | |
| KR100840200B1 (en) | Apparatus and method of packaging/unpackaging h.264 movie file streamed or downloaded | |
| KR102348633B1 (en) | Video encryption and decryption method and apparatus | |
| CN109561345B (en) | Digital movie packaging method based on AVS + coding format | |
| WO2015083354A1 (en) | File generation method, playback method, file generation device, playback device, and recording medium | |
| WO2015072127A1 (en) | File generation method and file generation apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |