EP3079363A1 - Encoding and decoding video sequences comprising reference picture sets - Google Patents
Encoding and decoding video sequences comprising reference picture sets Download PDFInfo
- Publication number
- EP3079363A1 EP3079363A1 EP16169607.5A EP16169607A EP3079363A1 EP 3079363 A1 EP3079363 A1 EP 3079363A1 EP 16169607 A EP16169607 A EP 16169607A EP 3079363 A1 EP3079363 A1 EP 3079363A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- rps
- sps
- inter
- current
- rpss
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000004590 computer program Methods 0.000 claims abstract description 23
- 238000013469 resistive pulse sensing Methods 0.000 claims 98
- 230000005540 biological transmission Effects 0.000 abstract description 89
- 230000011664 signaling Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 4
- 230000007774 longterm Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 241001207999 Notaris Species 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 102100037812 Medium-wave-sensitive opsin 1 Human genes 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920000069 polyphenylene sulfide Polymers 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/58—Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Definitions
- the invention relates to a method of encoding a video sequence comprising Reference Picture Sets (RPSs), a method of decoding a video sequence comprising RPSs, corresponding computer programs and computer program products, a corresponding encoder, and a corresponding decoder.
- RPSs Reference Picture Sets
- High Efficiency Video Coding is a new video coding standard currently being developed in the Joint Collaborative Team - Video Coding (JCT-VC).
- JCT-VC is a collaborative project between the Moving Picture Experts Group (MPEG) and the Telecommunication Standardization Sector of the International Telecommunication Union (ITU-T).
- MPEG Moving Picture Experts Group
- ITU-T International Telecommunication Union
- a committee draft is defined that includes a number of new tools which makes HEVC considerably more efficient than prior art video coding standards, in particular H.264/AVC.
- HEVC is a hybrid codec that uses multiple reference pictures for inter-prediction. It includes a picture marking process in which reference pictures can be marked as "used for short-term reference", “used for long-term reference”, or “unused for reference”. If marked "unused for reference”, the reference picture is turned into a non-reference picture and cannot be used for inter-prediction any more. A picture marked "unused for reference” cannot be re-marked later to be used for short-term or long-term reference.
- RPS Decoder Picture Buffer
- the RPS information may contain the values "-4, -6, 4". This means that the current picture can predict from, i.e., copy pixels from, the picture four frames back (in display order) since the figure -4 is present. It will also be able to predict from the picture six frames back and even from the picture four frames in the future.
- the decoder can discard all the images in its buffer except for the three described above. This is a robust way for the decoder to discard pictures. In practice, the decoder may have to keep these images until they are displayed, but they will not be used for inter-prediction again. For simplicity, in the remainder of this disclosure this situation will be considered as if the decoder can discard these images.
- RPS information comprised in an RPS can be rather lengthy.
- the following RPS is used for test purposes during HEVC standardization: "-3, -2, 1, 2, 5, 6".
- Encoding this example RPS may require up to 33 bits, which is a noticeable amount, in particular at very low bit rates and small image sizes.
- RPSs are typically not completely random. Rather, they can be reused over and over again.
- Picture Order Count POC
- POC Picture Order Count
- SPSs Sequence Parameter Sets
- a Clean Random Access (CRA) picture or an Instantaneous Decoding Refresh (IDR) picture
- a CRA picture is a picture that is not predicted from any previous picture, and no picture which follows the CRA picture in output order predicts from any picture that precedes the CRA picture in output order.
- An IDR picture is a CRA for which no picture which follows the IDR in decoding order may refer to any picture that precedes the IDR in decoding order.
- every RPS in Fig. 1 can be predicted from another RPS. This leads to the following way of describing RPS data in an SPS, e.g., the RPS data in Fig. 1 :
- the amount of saved bits is about 50% of the bits used for sending RPSs in the SPS, measured for an older version of the configuration files used for testing HEVC reference picture structures. Since SPS data is a very small part of the total video bit stream data, the overall effect is less than 50%, but compressing data efficiently is still important.
- an RPS is sent once, in an SPS, and subsequent slices simply indicate which RPS should be used, by using an RPS index.
- the encoder may want to use an RPS which is not in the SPS.
- the encoder has then the option of sending the RPS explicitly, i.e., in a slice, as is described above.
- inter-prediction is used or the RPS is encoded value-by-value is signaled for each RPS using the parameter inter_ref_pic_set_prediction_flag, which is part of the short-term RPS shown in Fig. 4 . If inter_ref_pic_set_prediction_flag is equal to zero, then the value-by-value method of transmitting RPSs is used, otherwise inter-prediction is used for signaling RPSs.
- a method of encoding a video sequence comprises RPSs, in particular short-term RPSs.
- the method comprises arranging the RPSs in transmission order in a data structure, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- a computer program comprises computer program code.
- the computer program code is adapted, if executed on a processor, to implement the method according to the first aspect of the invention.
- a computer program product comprises a computer readable storage medium.
- the computer readable storage medium has the computer program according to the second aspect of the invention embodied therein.
- a method of decoding a video sequence comprises RPSs, in particular short-term RPSs.
- the method comprises receiving a data structure comprising the RPSs arranged in transmission order, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- a computer program comprises computer program code.
- the computer program code is adapted, if executed on a processor, to implement the method according to the fourth aspect of the invention.
- a computer program product comprises a computer readable storage medium.
- the computer readable storage medium has the computer program according to the fifth aspect of the invention embodied therein.
- an encoder for encoding a video sequence comprises RPSs, in particular short-term RPSs.
- the encoder comprises a processor and a memory.
- the memory comprises instructions executable by the processor, whereby the encoder is operative to arrange the RPSs in transmission order in a data structure, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encode information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- a decoder for decoding a video sequence comprises RPSs, in particular short-term RPSs.
- the decoder comprises a processor and a memory.
- the memory comprises instructions executable by the processor, whereby the decoder is operative to receive a data structure comprising the RPSs arranged in transmission order, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receive information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- the invention makes use of an understanding that coding and signaling of RPSs, in particular short-term RPSs, can be performed more efficiently by using inter-prediction of RPSs.
- the RPSs are arranged in transmission order in a data structure, such an SPS. Only if explicit transmission is used for an RPS of a current picture, information indicating which of the RPSs comprised in the data structure is used for predicting the RPS of the current picture is signaled from the encoder to the decoder by encoding such information. In other words, the information which describes which RPS of the RPSs arranged in transmission order should be used for prediction is only signaled if it is required for decoding the video sequence.
- the information may be encoded into an RPS, in particular a short-term RPS, of the current picture.
- RPS in particular a short-term RPS
- Embodiments of the invention are advantageous in that the RPS of the current picture can be predicted from RPSs signaled in an SPS, thereby reducing the number of bits required for signaling RPSs and, consequently, the bitrate of the encoded video sequence.
- the proposed way of encoding and signaling RPSs is less complex than what is known in the art.
- information such as information elements, parameters, values, and the like, which is encoded and signaled, or transmitted, from an encoder to a decoder over a communications network. Such information is consequently received at the decoder and may decoded and subsequently be used in the decoding process.
- the method further comprises determining whether inter-prediction is used for the RPS of the current picture, and wherein the information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture is only encoded if explicit RPS transmission and inter-prediction are used. That is, information specifying which RPS comprised in the data structure is used for inter-prediction is signaled to the decoder only if inter-prediction is used for an explicitly transmitted RPS. In the event that en explicitly transmitted RPS is encoded value-by-value, i.e., not using inter-prediction, that information is not encoded and signaled.
- inter-prediction may, e.g., be signaled from the encoder to the decoder by means of a parameter. This is advantageous in that all alternatives for signaling RPSs are taken into consideration, and the number of bits required for signaling RPSs is reduced.
- the encoding the data structure comprises predicting at least one RPS from an RPS which is directly preceding the at least one RPS in transmission order. In particular, this applies if explicit RPS transmission is not used. Predicting an RPS comprised in the data structure from another RPS comprised in the data structure, such as an RPS preceding the RPS in transmission order, is advantageous in that the number of bits required for signaling RPSs is reduced. It will be appreciated that inter-prediction cannot be used for the first RPS in transmission order. As an alternative to using inter-prediction, RPSs may be encoded value-by-value.
- the method further comprises assigning an index to each RPS comprised in the data structure, and wherein the information indicating an RPS to be used for predicting the RPS of the current picture specifies the difference between an index of the RPS of the current picture and an index of the RPS used for prediction.
- VLC Variable Length Coding
- the information may be encoded using the HEVC parameter delta_idx_minus1 which is part of the short-term RPS syntax shown in Fig. 4 .
- the data structure is an SPS.
- the determining whether explicit RPS transmission is used comprises determining whether an index of the RPS of the current picture is equal to a number of RPSs comprised in the SPS. This is an efficient way of determining whether explicit RPS transmission is used, since the number of RPSs, in particular short-term RPSs, comprised in the SPS is signaled in the SPS and therefore known at both encoder and decoder.
- the determining whether explicit RPS transmission is used comprises determining whether the RPS of the current picture is encoded in a slice header of the current picture. This is an alternative way of determining whether explicit RPS transmission is used. To this end, the slice header is inspected to check whether en RPS is encoded into the slice header.
- the proposed way of signaling RPSs is based on arranging the RPSs into a data structure, such as an SPS, in transmission order.
- a data structure such as an SPS
- Different types of transmission order exits, in particular strict transmission order, Group Of Picture (GOP)-wise transmission order, and general transmission order.
- strict transmission order is described with reference to Fig. 5 , which shows a sequence of 16 pictures.
- An alternative definition of transmission in transmission order is the following: An RPS A is said to be transmitted in transmission order relative an RPS B if RPS B is transmitted next after A and there exist a picture X that uses RPS A and a picture Y that uses RPS B, and picture Y is the picture that follows picture X in decoding order.
- An RPS A is said to be stored in transmission order relative an RPS B if the index of RPS B is equal to the index of RPS A plus one, and there exists a picture X that uses RPS A and a picture Y that uses RPS B, and picture Y is the picture that follows picture X in decoding order.
- each slice which in most cases refers to a frame, can refer to an RPS row, i.e., an RPS index, in the SPS. This is referred to as implicit RPS transmission.
- RPSs directly in the slice header. This is referred to as explicit RPS transmission and can be used in situations when the decoder cannot use an RPS in the SPS, or, wants to use an RPS which is not comprised in the active SPS.
- inter-prediction it is important to specify which RPS, or row in the list of RPSs in the data structure, to predict from. Since the encoder can choose to explicitly encode the RPS for any frame, the decoder cannot know which row is more likely. Therefore, if inter-prediction is used for explicit RPS transmission, information identifying the one of the RPS comprised in the data structure, i.e., the SPS, is required. That information may be signaled in the parameter delta_idx_minus1.
- the parameter delta_idx_minus1 may be omitted, saving both complexity and bits.
- the RPS to predict from is signaled using delta_idx_minus1. Therefore, it is proposed to check whether explicit RPS transmission is used in connection with inter-prediction or not. If explicit RPS transmission is used, and inter-prediction is performed, delta_idx_minus1 will be transmitted, otherwise it is omitted.
- processing in accordance with the syntax shown in Fig. 8 is performed both when the SPS is created, e.g., once per sequence or once per second, and, optionally for a slice header of the current picture in the event that the encoder employs explicit RPS transmission.
- the value of idx will vary from 0 to the value of num_short_term_ref_pic_sets - 1, i.e., the number of short-term RPSs signaled in the SPS, minus one.
- the value of idx will be equal to num_short_term_ref_pic_set.
- one function for creating the short-term RPS may be executed when the SPS is created, and another function when the slice header is created.
- the first function would not transmit/receive the parameter delta_idx_minus1, but the second function would transmit/receive the parameter delta_idx_minus1.
- Fig. 9 depicts a bit stream 900 comprising an SPS 901 and three slices, "slice 2" 902, “slice 3" 903, and “slice 4" 904.
- the bit stream 900 may comprise additional elements which are omitted in Fig. 9 .
- the SPS 901 comprises, among other data, five RPSs 905.
- An RPS can be transmitted in an SPS by means of value-by-value coding, which in many cases is the most efficient way if the number of values in the RPS is small.
- the first RPS in the list of RPSs 905 ( ⁇ -8 ⁇ ) can be sent value-by-value as:
- an RPS comprises in an SPS can also be transmitted using inter-prediction, e.g., the second RPS in the list of RPSs 905 ( ⁇ -4, 4 ⁇ ). Since the RPS is signaled in the SPS 901, i.e., not explicitly, no information describing which RPS to predict from needs to be signaled, since inter-prediction is performed from the previous row, which in the present example comprises only a single value ⁇ -8 ⁇ . Hence, the second RPS is transmitted as:
- the decoder will be able to reconstruct the second RPS as follows.
- delta_idx_minus1 is not transmitted for the second RPS since it is inferred to be equal to zero.
- the remaining RPSs in the list of RPSs 905 in the SPS 901 can be sent either value-by-value or using inter-prediction, as is described hereinbefore.
- the third RPS ⁇ -2, -4, -6, 2 ⁇ may be signaled using inter-prediction whereas the fourth RPS ⁇ -1, 1, 3, 5, 7 ⁇ may be signaled value-by-value.
- slice 2 902 illustrates implicit transmission of an RPS.
- slice 2 902 comprises information indicating 909 which RPS in the list 905 of RPSs to use, such as an RPS index "#1".
- the encoder transmits:
- slice 3 903 which is transmitted in the bitstream 900, cannot use any RPS from the list 905 of RPSs signaled in the SPS 901, but instead signals an RPS 907 explicitly.
- RPS 907 There are two ways of signaling explicitly, and in the present example slice 3 903 uses value-by-value coding.
- the encoder transmits:
- slice 4 904 uses inter-prediction, but since the RPS it is transmitted explicitly, information 908 indicating 910 from which RPS in the list 905 of RPSs to predict from must be provided. In the present example, this is indicated by RPS index "#2" 908. Thus, the following is transmitted in slice 4 904:
- the list 905 of RPSs in the SPS 901 comprises five RPSs.
- delta_idx_minus1 must be sent in order to indicate which RPS to predict from.
- information describing how to predict is signaled ("prediction data" 908).
- the decoder first receives the SPS 901 comprising a list 905 of RPSs.
- the RPSs comprised in list 905 can either be received value-by-value or using inter- prediction.
- the first RPS ( ⁇ -8 ⁇ ) is received value-by-value by receiving
- the second RPS ( ⁇ -4, 4 ⁇ ) may be received using inter-prediction.
- the RPS since the RPS is comprised in the SPS 901, the RPS is not received explicitly, and delta_idx_minus1 is therefore not received.
- the decoder for the second RPS is not received.
- the second value of the second RPS is the delta_rps-value itself (4), and the RPS is therefore predicted as ⁇ -4, 4 ⁇ .
- the other RPSs signaled in the SPS 901 are received value-by-value or using inter-prediction, as is described above.
- the RPS is received implicitly by receiving an RPS index 906 ("#1") which points 909 to the second RPS in the list 905 of RPSs in the SPS 901.
- Slice 3 903 transmits its RPS 907 explicitly, coded value-by-value.
- the RPS for slice 4 904 is received explicitly using inter-prediction. Therefore, information 908 indicating an RPS in the list 905 of RPSs to be used for inter-prediction (RPS index "#2") is received, in addition to information describing how to predict ("prediction data" 908). In this case, it is necessary to receive delta_idx_minus1, and the following information is received by the decoder:
- Fig. 10 an embodiment of the method of encoding a video sequence comprising RPSs is shown.
- the method 1000 starts with arranging 1001 the RPSs in transmission order in a data structure, such as an SPS, and sending 1001 the data structure.
- a data structure such as an SPS
- inter-prediction is used. This may, e.g., be achieved by using inter_ref_set_prediction_flag, as is described hereinbefore and as is known in the art. If inter-prediction is used ("YES" in Fig. 10 ), it is determined 1002 whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture.
- embodiments of the invention may be envisaged which first determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture, and subsequently determine whether inter-prediction is used.
- Fig. 11 an embodiment of the method of decoding a video sequence comprising RPSs is shown.
- the method 1100 comprises receiving 1101 a data structure comprising the RPSs arranged in transmission order and determining 1102 whether inter-prediction is used. This may, e.g., be achieved by inspecting inter_ref_set_prediction_flag, as is described hereinbefore. If inter-prediction is used ("YES" in Fig. 11 ), it is determined 1103 whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture.
- delta_idx_minus1 information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1 is received 1104. The information is only received 1104 if explicit RPS transmission is used, otherwise it is not received 1105. If the information is delta_idx_minus1, specifying the difference between an index of the RPS of the current picture and an index of the RPS used for prediction, delta_idx_minus1 is instead interpreted 1105 to be equal to zero, i.e., the preceding RPS is used for inter-prediction. If inter-prediction is not used 1102 ("NO" in Fig.
- embodiments of the invention are not limited to the exact order of steps shown in Fig. 11 .
- embodiments of the invention may be envisaged which first determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture, and subsequently determine whether inter-prediction is used.
- Fig. 12 embodiments of an encoder for encoding a video sequence comprising RPSs and embodiments of a decoder for decoding a video sequence comprising RPSs are shown.
- the encoder 1200 comprises a processor 1201 and a memory 1202 comprising instructions 1203 executable by the processor 1201, whereby the encoder 1200 is operative to arrange the RPSs in transmission order in a data structure, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encode information 1220 indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- the decoder 1210 comprises a processor 1211 and a memory 1212 comprising instructions 1213 executable by the processor 1211, whereby the decoder 1210 is operative to receive a data structure comprising the RPSs arranged in transmission order, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receive information 1220 indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- Embodiments of the encoder and the decoder can be implemented in devices such as video cameras, displays, tablets, digital television receivers, network nodes, and so forth.
- the parameter delta_idx_minus1 is sent, it is to be understood that delta_idx_minus1 is only sent only if explicit RPS transmission is used, in accordance with embodiments of the invention.
- delta_idx_minus1 throughout this document it is only an example for how to indicate which RPS should be used for inter-prediction, and it should be obvious the reader that other signaling schemes can be used. In this respect, any reference to delta_idx_minus1 should be understood as an indicator of which RPS to predict from.
- RPSs may also be included in other data structures, e.g., PPSs or any other parameter set.
- an embodiment of the encoder may also comprise means being configured for arranging the RPSs in transmission order in a data structure, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- an embodiment of the encoder may also comprise means for arranging the RPSs in transmission order in a data structure, means for determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and means for encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- an embodiment of the decoder may also comprise means being configured for receiving a data structure comprising the RPSs arranged in transmission order, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- an embodiment of the decoder may also comprise means for receiving a data structure comprising the RPSs arranged in transmission order, means for determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and means for receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
- The invention relates to a method of encoding a video sequence comprising Reference Picture Sets (RPSs), a method of decoding a video sequence comprising RPSs, corresponding computer programs and computer program products, a corresponding encoder, and a corresponding decoder.
- High Efficiency Video Coding (HEVC) is a new video coding standard currently being developed in the Joint Collaborative Team - Video Coding (JCT-VC). JCT-VC is a collaborative project between the Moving Picture Experts Group (MPEG) and the Telecommunication Standardization Sector of the International Telecommunication Union (ITU-T). Currently, a committee draft is defined that includes a number of new tools which makes HEVC considerably more efficient than prior art video coding standards, in particular H.264/AVC.
- HEVC is a hybrid codec that uses multiple reference pictures for inter-prediction. It includes a picture marking process in which reference pictures can be marked as "used for short-term reference", "used for long-term reference", or "unused for reference". If marked "unused for reference", the reference picture is turned into a non-reference picture and cannot be used for inter-prediction any more. A picture marked "unused for reference" cannot be re-marked later to be used for short-term or long-term reference.
- The marking process in HEVC is controlled by RPSs. An RPS is a set of picture identifiers which identify reference pictures. The RPS is sent in each slice, and reference pictures which are indicated in the RPS will be kept in the Decoder Picture Buffer (DPB) and marked as "used for short-term reference" or "used for long-term reference".
- As an example, the RPS information may contain the values "-4, -6, 4". This means that the current picture can predict from, i.e., copy pixels from, the picture four frames back (in display order) since the figure -4 is present. It will also be able to predict from the picture six frames back and even from the picture four frames in the future. Thus, the decoder can discard all the images in its buffer except for the three described above. This is a robust way for the decoder to discard pictures. In practice, the decoder may have to keep these images until they are displayed, but they will not be used for inter-prediction again. For simplicity, in the remainder of this disclosure this situation will be considered as if the decoder can discard these images.
- Sometimes the information comprised in an RPS can be rather lengthy. As an example, the following RPS is used for test purposes during HEVC standardization: "-3, -2, 1, 2, 5, 6". Encoding this example RPS may require up to 33 bits, which is a noticeable amount, in particular at very low bit rates and small image sizes.
- One key observation is that the RPSs are typically not completely random. Rather, they can be reused over and over again. As an example, we consider a sequence of 18 images from a configuration file used for test purposes in HEVC standardization.
- Pictures in HEVC are identified by their Picture Order Count (POC) values (PicOrderCntVal), also known as full POC values. These numbers represent the output order, also referred to as the display order, of the pictures. That is, a picture with POC = 57 will be displayed directly after a picture with POC = 56. However, the images are not always transmitted in the order they are displayed. For instance, the encoder may first transmit the picture with POC = 0, followed by POC = 8, followed by POC = 4, and so forth. The decoder has to keep track of the pictures and display them in the correct order. In the example from HEVC standardization, the 18 pictures will be transmitted in the order indicated in
Fig. 1 . - As can be seen in
Fig. 1 , some RPSs are sent several times. For instance, the RPS sent for POC=6 (-2, -4, -6, 2) is the same as for POC=14. Therefore, the standard allows RPSs to be sent in Sequence Parameter Sets (SPSs) in addition to sending RPSs in slice headers. SPSs comprise data which does not need to be sent for every slice. Typically, SPSs are sent only once per sequence, or as often as the possibility of random access is desired. For instance, if the bit stream is broadcasted, it may be sufficient to send the SPS every second, since this would make it possible to switch channel every second. It should be noted that, for it to be possible to switch channel every second, a Clean Random Access (CRA) picture, or an Instantaneous Decoding Refresh (IDR) picture, also needs to be sent every second. A CRA picture is a picture that is not predicted from any previous picture, and no picture which follows the CRA picture in output order predicts from any picture that precedes the CRA picture in output order. An IDR picture is a CRA for which no picture which follows the IDR in decoding order may refer to any picture that precedes the IDR in decoding order. - In the SPS it is possible to specify the eight recurring RPSs of the example shown in
Fig. 1 and assign indices to them, as is shown inFig. 2 . The information sent in the slice header now only has to refer to an RPS index in the SPS, as is illustrated inFig. 3 . Using RPS indices requires fewer bits than sending the RPSs themselves. - To this end, using RPS indices, as is illustrated in
Fig. 3 , considerably reduces the amount of bits required for sending RPSs since the bulk of the data is sent in the SPS instead, which is sent less frequently. Still, it turns out that it is possible to compress the RPS information even further. By comparing two rows inFig. 1 one can notice a similarity between them. For instance, every number in the RPS for POC=1 is equal to a corresponding number in the RPS for POC=6 if "5" is added to it. That is the first value "-1" in the RPS for POC=1 is equal to -6 + 5. The second value "1" is equal to -4 + 5. The third value "3" is equal to -2 + 5. The only exception to this rule is the second to last number "5" in the RPS for POC=1. It would need a "0" in the RPS for POC=6, but an image cannot predict from itself. - As it turns out, every RPS in
Fig. 1 can be predicted from another RPS. This leads to the following way of describing RPS data in an SPS, e.g., the RPS data inFig. 1 : - For each row, i.e., RPS, it is specified from which other RPS inter-prediction should be made. For instance, predicting from the preceding RPS is indicated by sending the value "-1" in delta_idx_minus1, which is a parameter in the SPS (see short-term RPS syntax
Fig. 4 ). - Then, the value to add, "5" in the example, is transmitted using the values delta_rps_sign and abs_delta_rps_minus1, which are parameters in the SPS (see short-term RPS syntax
Fig. 4 ). - By sending RPS information in this way a lot of bits can be saved. The amount of saved bits is about 50% of the bits used for sending RPSs in the SPS, measured for an older version of the configuration files used for testing HEVC reference picture structures. Since SPS data is a very small part of the total video bit stream data, the overall effect is less than 50%, but compressing data efficiently is still important.
- Typically, an RPS is sent once, in an SPS, and subsequent slices simply indicate which RPS should be used, by using an RPS index. In some situations, however, the encoder may want to use an RPS which is not in the SPS. The encoder has then the option of sending the RPS explicitly, i.e., in a slice, as is described above. Whether inter-prediction is used or the RPS is encoded value-by-value is signaled for each RPS using the parameter inter_ref_pic_set_prediction_flag, which is part of the short-term RPS shown in
Fig. 4 . If inter_ref_pic_set_prediction_flag is equal to zero, then the value-by-value method of transmitting RPSs is used, otherwise inter-prediction is used for signaling RPSs. - It is an object of the invention to provide an improved alternative to the above techniques and prior art.
- More specifically, it is an object of the invention to provide an improved way of signaling RPSs.
- These and other objects of the invention are achieved by means of different aspects of the invention, as defined by the independent claims. Embodiments of the invention are characterized by the dependent claims.
- According to a first aspect of the invention, a method of encoding a video sequence is provided. The video sequence comprises RPSs, in particular short-term RPSs. The method comprises arranging the RPSs in transmission order in a data structure, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- According to a second aspect of the invention, a computer program is provided. The computer program comprises computer program code. The computer program code is adapted, if executed on a processor, to implement the method according to the first aspect of the invention.
- According to a third aspect of the invention, a computer program product is provided. The computer program product comprises a computer readable storage medium. The computer readable storage medium has the computer program according to the second aspect of the invention embodied therein.
- According to a fourth aspect of the invention, a method of decoding a video sequence is provided. The video sequence comprises RPSs, in particular short-term RPSs. The method comprises receiving a data structure comprising the RPSs arranged in transmission order, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- According to a fifth aspect of the invention, a computer program is provided. The computer program comprises computer program code. The computer program code is adapted, if executed on a processor, to implement the method according to the fourth aspect of the invention.
- According to a sixth aspect of the invention, a computer program product is provided. The computer program product comprises a computer readable storage medium. The computer readable storage medium has the computer program according to the fifth aspect of the invention embodied therein.
- According to a seventh aspect of the invention, an encoder for encoding a video sequence is provided. The video sequence comprises RPSs, in particular short-term RPSs. The encoder comprises a processor and a memory. The memory comprises instructions executable by the processor, whereby the encoder is operative to arrange the RPSs in transmission order in a data structure, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encode information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- According to an eighth aspect of the invention, a decoder for decoding a video sequence is provided. The video sequence comprises RPSs, in particular short-term RPSs. The decoder comprises a processor and a memory. The memory comprises instructions executable by the processor, whereby the decoder is operative to receive a data structure comprising the RPSs arranged in transmission order, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receive information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture only if explicit RPS transmission is used.
- The invention makes use of an understanding that coding and signaling of RPSs, in particular short-term RPSs, can be performed more efficiently by using inter-prediction of RPSs. To this end, the RPSs are arranged in transmission order in a data structure, such an SPS. Only if explicit transmission is used for an RPS of a current picture, information indicating which of the RPSs comprised in the data structure is used for predicting the RPS of the current picture is signaled from the encoder to the decoder by encoding such information. In other words, the information which describes which RPS of the RPSs arranged in transmission order should be used for prediction is only signaled if it is required for decoding the video sequence. The information may be encoded into an RPS, in particular a short-term RPS, of the current picture. Embodiments of the invention are advantageous in that the RPS of the current picture can be predicted from RPSs signaled in an SPS, thereby reducing the number of bits required for signaling RPSs and, consequently, the bitrate of the encoded video sequence. In addition, the proposed way of encoding and signaling RPSs is less complex than what is known in the art.
- Throughout this disclosure, it is to be understood that information, such as information elements, parameters, values, and the like, which is encoded and signaled, or transmitted, from an encoder to a decoder over a communications network. Such information is consequently received at the decoder and may decoded and subsequently be used in the decoding process.
- According to an embodiment of the invention, the method further comprises determining whether inter-prediction is used for the RPS of the current picture, and wherein the information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture is only encoded if explicit RPS transmission and inter-prediction are used. That is, information specifying which RPS comprised in the data structure is used for inter-prediction is signaled to the decoder only if inter-prediction is used for an explicitly transmitted RPS. In the event that en explicitly transmitted RPS is encoded value-by-value, i.e., not using inter-prediction, that information is not encoded and signaled. Whether or not inter-prediction is used may, e.g., be signaled from the encoder to the decoder by means of a parameter. This is advantageous in that all alternatives for signaling RPSs are taken into consideration, and the number of bits required for signaling RPSs is reduced.
- According to an embodiment of the invention, the encoding the data structure comprises predicting at least one RPS from an RPS which is directly preceding the at least one RPS in transmission order. In particular, this applies if explicit RPS transmission is not used. Predicting an RPS comprised in the data structure from another RPS comprised in the data structure, such as an RPS preceding the RPS in transmission order, is advantageous in that the number of bits required for signaling RPSs is reduced. It will be appreciated that inter-prediction cannot be used for the first RPS in transmission order. As an alternative to using inter-prediction, RPSs may be encoded value-by-value.
- According to an embodiment of the invention, the method further comprises assigning an index to each RPS comprised in the data structure, and wherein the information indicating an RPS to be used for predicting the RPS of the current picture specifies the difference between an index of the RPS of the current picture and an index of the RPS used for prediction. This way of coding the information indicating which RPS to use for inter-prediction is advantageous in that the number of bits required for conveying that information is reduced, in particular if Variable Length Coding (VLC) is employed. For instance, the information may be encoded using the HEVC parameter delta_idx_minus1 which is part of the short-term RPS syntax shown in
Fig. 4 . - According to an embodiment of the invention, the data structure is an SPS.
- According to an embodiment of the invention, the determining whether explicit RPS transmission is used comprises determining whether an index of the RPS of the current picture is equal to a number of RPSs comprised in the SPS. This is an efficient way of determining whether explicit RPS transmission is used, since the number of RPSs, in particular short-term RPSs, comprised in the SPS is signaled in the SPS and therefore known at both encoder and decoder.
- According to an embodiment of the invention, the determining whether explicit RPS transmission is used comprises determining whether the RPS of the current picture is encoded in a slice header of the current picture. This is an alternative way of determining whether explicit RPS transmission is used. To this end, the slice header is inspected to check whether en RPS is encoded into the slice header.
- Even though advantages of the invention have in some cases been described with reference to embodiments of the first or fourth aspects of the invention, corresponding reasoning applies to embodiments of other aspects of the invention.
- Further objectives of, features of, and advantages with, the invention will become apparent when studying the following detailed disclosure, the drawings and the appended claims. Those skilled in the art realize that different features of the invention can be combined to create embodiments other than those described in the following.
- The above, as well as additional objects, features and advantages of the invention, will be better understood through the following illustrative and non-limiting detailed description of embodiments of the invention, with reference to the appended drawings, in which:
-
Fig. 1 is an example of RPSs. -
Fig. 2 illustrates coding the example RPSs in an SPS. -
Fig. 3 illustrates coding the example RPSs in a slice header. -
Fig. 4 shows the known syntax of a short-term RPS. -
Fig. 5 shows an example sequence of pictures in strict transmission order, in accordance with an embodiment of the invention. -
Fig. 6 shows the example sequence of pictures in less strict transmission order, in accordance with an embodiment of the invention. -
Fig. 7 illustrates coding the example RPSs in an SPS in transmission order, in accordance with an embodiment of the invention. -
Fig. 8 shows the proposed short-term RPS syntax, in accordance with an embodiment of the invention. -
Fig. 9 shows a bitstream, in accordance with an embodiment of the invention. -
Fig. 10 shows a method of encoding RPSs, in accordance with an embodiment of the invention. -
Fig. 11 shows a method of decoding RPSs, in accordance with an embodiment of the invention. -
Fig. 12 shows an encoder and a decoder, in accordance with embodiments of the invention. - All the figures are schematic, not necessarily to scale, and generally only show parts which are necessary in order to elucidate the invention, wherein other parts may be omitted or merely suggested.
- The invention will now be described more fully herein after with reference to the accompanying drawings, in which certain embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
- The proposed way of signaling RPSs is based on arranging the RPSs into a data structure, such as an SPS, in transmission order. Different types of transmission order exits, in particular strict transmission order, Group Of Picture (GOP)-wise transmission order, and general transmission order. In the following, strict transmission order is described with reference to
Fig. 5 , which shows a sequence of 16 pictures. - In strict transmission order, the RPSs are encoded in exactly the same order as they are be used, i.e., in the order shown in
Fig. 5 , which is the order in which the images are decoded, i.e., decoding order, until there are no more RPSs to send (the picture with POC=17 will reuse the RPS inrow 12, POC=18 will reuse the RPS inrow 13, POC=19 will reuse the RPS inrow 14, POC=20 will reuse the RPS inrow 15, POC=21 will reuse the RPS inrow 12, and so forth). In this case we are guaranteed that the prediction from the preceding row, i.e., RPS, will work. - However, this is a sufficient, but not a necessary condition. There are other, less strict, transmission orders which also allow prediction from the preceding RPS row. One way is to permute the GOPs. Since the pictures available for prediction are mainly determined by the position within a GOP, it is sometimes possible to predict the first RPS of a certain GOP from the last RPS of a preceding GOP. For instance, the order illustrated in
Fig. 6 would be possible. InFig. 6 , the second GOP group in the SPS has a lower GOP number than the preceding (first) GOP group, and the row with index 4 (GOP=0) can therefore predict from the row withindex 3. - An alternative definition of transmission in transmission order is the following: An RPS A is said to be transmitted in transmission order relative an RPS B if RPS B is transmitted next after A and there exist a picture X that uses RPS A and a picture Y that uses RPS B, and picture Y is the picture that follows picture X in decoding order.
- A similar definition, but of storage in transmission order is the following: An RPS A is said to be stored in transmission order relative an RPS B if the index of RPS B is equal to the index of RPS A plus one, and there exists a picture X that uses RPS A and a picture Y that uses RPS B, and picture Y is the picture that follows picture X in decoding order.
- Further, the process of encoding and signaling RPSs is dependent on if the RPS is sent explicitly or implicitly. If the RPSs are sent once per sequence or once per second in a data structure such as an SPS, then each slice, which in most cases refers to a frame, can refer to an RPS row, i.e., an RPS index, in the SPS. This is referred to as implicit RPS transmission.
- An alternative is to transmit the RPSs directly in the slice header. This is referred to as explicit RPS transmission and can be used in situations when the decoder cannot use an RPS in the SPS, or, wants to use an RPS which is not comprised in the active SPS.
- As is described hereinbefore, there are two alternatives for encoding an RPS if explicit RPS transmission is used, encoding using inter-prediction or the value-by-value approach. If inter-prediction is used, it is important to specify which RPS, or row in the list of RPSs in the data structure, to predict from. Since the encoder can choose to explicitly encode the RPS for any frame, the decoder cannot know which row is more likely. Therefore, if inter-prediction is used for explicit RPS transmission, information identifying the one of the RPS comprised in the data structure, i.e., the SPS, is required. That information may be signaled in the parameter delta_idx_minus1.
- However, a non-obvious observation is that this is not the case for encoding RPSs in an SPS. Under the condition that RPSs are sent in transmission order, for each RPS, apart from the first RPS in the SPS, an RPS directly preceding the RPS must include all images which can be used for the RPS, except for the previous frame itself. Consequently, when encoding RPSs in an SPS, the variable delta_idx_minus1 is equal to zero and does not need to be transmitted.
- To elucidate this observation further, the RPSs of
Fig. 2 are again shown inFig. 7 , albeit with the POC numbers written out, as well as the delta POC, i.e., the difference between the previous and the current POC number. - With reference to
Fig. 7 , the encoder would first have to send the first picture with POC=0, an intra-picture which cannot predict from any previous picture. The second picture, i.e., the first row inFig. 7 , would have POC=8 and deltaPOC=0-8 = -8. Since there is no other picture transmitted than POC=0, the only picture that POC=8 can refer to is POC=0. Hence, -8 is the only possible value in the RPS. - Now, considering the second transmitted picture with POC=4. The only two pictures which are available are the previous image POC=8, represented by deltaPOC=4, and the first image with POC=0. If it is not the previous picture, it must be available in the preceding RPS, otherwise the decoder would have discarded it. The second picture must therefore have a POC value which is derivable from the preceding RPS, which only contained -8. Adding deltaPOC=4 to that value yields -4, which is the second value in the RPS.
- Hence, it should be clear that if the RPSs are stored in transmission order, then all the RPSs must either a) be reconstructable, or predictable, from the preceding RPS adding deltaPOC to the values in the preceding RPS, or b) it must be deltaPOC itself.
- If this is not the case, i.e., if a value is neither a) nor b), the value is not predictable from any value in the preceding RPS and the decoder has discarded the picture and it cannot be referenced. The only exceptions are the preceding picture, which is not in the preceding RPS since the picture does not predict from itself, and that is exactly b).
- Based on this reasoning it should be clear that, if RPSs are arranged and encoded in transmission order in an SPS, the parameter delta_idx_minus1 may be omitted, saving both complexity and bits. However, when transmitting RPSs explicitly, access to any RPS in the SPS is desirable in order to use that RPS for inter-prediction. In this case, the RPS to predict from is signaled using delta_idx_minus1. Therefore, it is proposed to check whether explicit RPS transmission is used in connection with inter-prediction or not. If explicit RPS transmission is used, and inter-prediction is performed, delta_idx_minus1 will be transmitted, otherwise it is omitted.
- It is noted that the issue of whether to signal delta_idx_minus1 or not arises only if inter-prediction is utilized, as can be seen from the short-term RPS syntax shown in
Fig. 4 . The if-statement inrow 3, - if(inter_reCpic_set_prediction_flag )
- The proposed way of encoding and signaling RPSs, in particular with respect to explicit or implicit transmission, is reflected in the proposed short-term RPS syntax shown in
Fig. 8 . - In the short-term RPS syntax shown in
Fig. 8 , a new if-statement is introduced: - if(idx == num_short_term_ref_pic_sets)
- If this statement evaluates to "true", explicit RPS transmission is used for the current picture, and the decoder needs to decode delta_idx_minus1. Otherwise, if the statement evaluated to false, the RPS is one of the RPSs signaled in the SPS, and delta_idx_minus1 is inferred to be equal to 0, i.e., inter-prediction from the directly preceding RPS is performed. In correspondence with the known short-term RPS shown in
Fig. 4 , the issue of whether to signal delta_idx_minus1 or not arises only if inter-prediction is used. This can be seen from the if-statement inrow 3 of the proposed short-term RPS shown inFig. 8 , which is identical to the if-statement of the known short-term RPS shown inFig. 4 . - More specifically, processing in accordance with the syntax shown in
Fig. 8 is performed both when the SPS is created, e.g., once per sequence or once per second, and, optionally for a slice header of the current picture in the event that the encoder employs explicit RPS transmission. In the first case, the value of idx will vary from 0 to the value of num_short_term_ref_pic_sets - 1, i.e., the number of short-term RPSs signaled in the SPS, minus one. In the second case, when explicit RPS transmission is used, the value of idx will be equal to num_short_term_ref_pic_set. Thus, one can determine whether explicit RPS transmission is used by comparing idx to num_short_term_ref_pic_set, as is done by the if-statement. - As an alternative, one may envisage embodiments of the invention which are based on another parameter other_parameter which is equal to 0 when called during the SPS creation, i.e., the first case described above, and equal to 1 when called during creation of a slice header. In such case, the corresponding if-statement reads
- if(other_parameter).
- As yet a further alternative, one function for creating the short-term RPS may be executed when the SPS is created, and another function when the slice header is created. To this end, the first function would not transmit/receive the parameter delta_idx_minus1, but the second function would transmit/receive the parameter delta_idx_minus1.
- At first glance, the proposed short-term RPS syntax shown in
Fig. 8 appears to have increased complexity as compared to the current standard shown inFig. 4 , partly due to extra if-statement onrow 4. However, it should be noted that decoding the value delta_idx_minus1 is more complex than just evaluating the if-statement. Also, since non-explicit RPS transmission is used for most of the pictures, the additional if-statement is rarely executed. - In order to elucidate the invention even further, an illustrative example of an embodiment of the invention is now described with reference to
Fig. 9 , which depicts abit stream 900 comprising anSPS 901 and three slices, "slice 2" 902, "slice 3" 903, and "slice 4" 904. Thebit stream 900 may comprise additional elements which are omitted inFig. 9 . - The
SPS 901 comprises, among other data, fiveRPSs 905. An RPS can be transmitted in an SPS by means of value-by-value coding, which in many cases is the most efficient way if the number of values in the RPS is small. For instance, the first RPS in the list of RPSs 905 ({-8}) can be sent value-by-value as: - inter_ref_set_prediction_flag = 0
- num_negative_pics = 1
- num_positive_pics = 0
- delta_poc_s0_minus1[0] = 8
- used_by_cur_flag[0] = 1
- As an alternative, an RPS comprises in an SPS can also be transmitted using inter-prediction, e.g., the second RPS in the list of RPSs 905 ({-4, 4}). Since the RPS is signaled in the
SPS 901, i.e., not explicitly, no information describing which RPS to predict from needs to be signaled, since inter-prediction is performed from the previous row, which in the present example comprises only a single value {-8}. Hence, the second RPS is transmitted as: - inter_ref_set_prediction_flag = 1
- delta_rps_sign = 0
- abs_delta_rps_minus1 = 3
- The decoder will be able to reconstruct the second RPS as follows. First, deltaRps = (1 - 2 * delta_rps_sign) * (abs_delta_rps_minus1 + 1) = 4 is caluclated and added to the value {-8} (first RPS), resulting in -4, which is the first value of the second RPS. The second value of the second RPS is the delta_rps-value itself (delta_rps = 4). Thus, the second RPS is reconstructed as {-4, 4}. It is emphasized here that delta_idx_minus1 is not transmitted for the second RPS since it is inferred to be equal to zero.
- Correspondingly, the remaining RPSs in the list of
RPSs 905 in theSPS 901 can be sent either value-by-value or using inter-prediction, as is described hereinbefore. For instance, the third RPS {-2, -4, -6, 2} may be signaled using inter-prediction whereas the fourth RPS {-1, 1, 3, 5, 7} may be signaled value-by-value. - Further with reference to the
bitstream 900 illustrated inFig. 9 ,slice 2 902 illustrates implicit transmission of an RPS. To this end,slice 2 902 comprises information indicating 909 which RPS in thelist 905 of RPSs to use, such as an RPS index "#1". Thus, forslice 2 902 the encoder transmits: - short_term_ref_pic_set_sps_flag = 1
- short_term_ref_pic_set_idx = 1
- As a further example, it is assumed that
slice 3 903, which is transmitted in thebitstream 900, cannot use any RPS from thelist 905 of RPSs signaled in theSPS 901, but instead signals anRPS 907 explicitly. There are two ways of signaling explicitly, and in thepresent example slice 3 903 uses value-by-value coding. Thus, the encoder transmits: - inter_ref_set_prediction_flag = 0
- num_negative_pics = 1
- num_positive_pics = 2
- delta_poc_s0_minus1[0] = 1
- used_by_cur_flag[0] = 1
- delta_poc_s1_minus1[0] = 1
- used_by_cur_flag[0] = 1
- delta_poc_s1_minus1[1] = 3
- used_by_cur_flag[1] = 1
- The other way of encoding explicitly is illustrated with reference to slice 4 904 of the
bitstream 900.Slice 4 904 uses inter-prediction, but since the RPS it is transmitted explicitly,information 908 indicating 910 from which RPS in thelist 905 of RPSs to predict from must be provided. In the present example, this is indicated by RPS index "#2" 908. Thus, the following is transmitted inslice 4 904: - inter_ref_set_prediction_flag = 1
- delta_idx_minus1 = 2
- num_negative_pics = 1
- num_positive_pics = 0
- delta_poc_s0_minus1[0] = 8
- used_by_cur_flag[0] = 1
- In the present example, the
list 905 of RPSs in theSPS 901 comprises five RPSs. Thus, stRpsldx will be equal to five, and RefRPSldx is evaluated to 5 - (2 + 1) = 2, which is the index of the third RPS ({-2, -4, -6, 2}). In the case ofslice 4 904, delta_idx_minus1 must be sent in order to indicate which RPS to predict from. In addition to theRPS index 908, information describing how to predict is signaled ("prediction data" 908). - In the following, the example shown in
Fig. 9 is described for a decoder. The decoder first receives theSPS 901 comprising alist 905 of RPSs. The RPSs comprised inlist 905 can either be received value-by-value or using inter- prediction. For instance, the first RPS ({-8}) is received value-by-value by receiving - inter_ref_set_prediction_flag = 0
- num_negative_pics = 1
- num_positive_pics = 0
- delta_poc_s0_minus1[0] = 8
- used_by_cur_flag[0] = 1
- On the other hand, the second RPS ({-4, 4}) may be received using inter-prediction. However, since the RPS is comprised in the
SPS 901, the RPS is not received explicitly, and delta_idx_minus1 is therefore not received. Hence, the following is received by the decoder for the second RPS: - inter_ref_set_prediction_flag = 1
- delta_rps_sign = 0
- abs_delta_rps_minus1 = 3
- The decoder will be able to reconstruct deltaRps = (1 - 2*delta_rps_sign) * (abs_delta_rps_minus1 + 1) = 4. deltaRps is then added to the value {-8} (from the first RPS), resulting in -4, which is the first value of the second RPS. The second value of the second RPS is the delta_rps-value itself (4), and the RPS is therefore predicted as {-4, 4}. The other RPSs signaled in the
SPS 901 are received value-by-value or using inter-prediction, as is described above. - For
slice 2 902, the RPS is received implicitly by receiving an RPS index 906 ("#1") which points 909 to the second RPS in thelist 905 of RPSs in theSPS 901.Slice 3 903 transmits itsRPS 907 explicitly, coded value-by-value. - The RPS for
slice 4 904 is received explicitly using inter-prediction. Therefore,information 908 indicating an RPS in thelist 905 of RPSs to be used for inter-prediction (RPS index "#2") is received, in addition to information describing how to predict ("prediction data" 908). In this case, it is necessary to receive delta_idx_minus1, and the following information is received by the decoder: - inter_ref_set_prediction_flag = 1
- delta_idx_minus1 = 2
- num_negative_pics = 1
- num_positive_pics = 0
- delta_poc_s0_minus1[0] = 8
- used_by_cur_flag[0] = 1
- It is emphasized here that, in order to receive the RPS of
slice 4 904 explicitly, using inter-prediction, it is necessary to receive delta_idx_minus1. - In
Fig. 10 an embodiment of the method of encoding a video sequence comprising RPSs is shown. Themethod 1000 starts with arranging 1001 the RPSs in transmission order in a data structure, such as an SPS, and sending 1001 the data structure. Subsequently, it is determined 1002 whether inter-prediction is used. This may, e.g., be achieved by using inter_ref_set_prediction_flag, as is described hereinbefore and as is known in the art. If inter-prediction is used ("YES" inFig. 10 ), it is determined 1002 whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture. If explicit transmission is used, i.e., if the RPS is signaled in a slice header of the current picture, information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, is encoded and sent 1004. The information is only transmitted 1004 if explicit RPS transmission is used, otherwise it is not transmitted 1005. Likewise, if inter-prediction is not used 1002 ("NO" inFig. 10 ), information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, is not signaled. It will be appreciated that embodiments of the invention are not limited to the exact order of steps shown inFig. 10 . For instance, embodiments of the invention may be envisaged which first determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture, and subsequently determine whether inter-prediction is used. - In
Fig. 11 an embodiment of the method of decoding a video sequence comprising RPSs is shown. Themethod 1100 comprises receiving 1101 a data structure comprising the RPSs arranged in transmission order and determining 1102 whether inter-prediction is used. This may, e.g., be achieved by inspecting inter_ref_set_prediction_flag, as is described hereinbefore. If inter-prediction is used ("YES" inFig. 11 ), it is determined 1103 whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture. If explicit transmission is used, i.e., if the RPS is signaled in a slice header of the current picture, information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, is received 1104. The information is only received 1104 if explicit RPS transmission is used, otherwise it is not received 1105. If the information is delta_idx_minus1, specifying the difference between an index of the RPS of the current picture and an index of the RPS used for prediction, delta_idx_minus1 is instead interpreted 1105 to be equal to zero, i.e., the preceding RPS is used for inter-prediction. If inter-prediction is not used 1102 ("NO" inFig. 10 ), information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, is not received. It will be appreciated that embodiments of the invention are not limited to the exact order of steps shown inFig. 11 . For instance, embodiments of the invention may be envisaged which first determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, i.e., whether the RPS is signaled in a slice header of the current picture, and subsequently determine whether inter-prediction is used. - In
Fig. 12 embodiments of an encoder for encoding a video sequence comprising RPSs and embodiments of a decoder for decoding a video sequence comprising RPSs are shown. - The
encoder 1200 comprises aprocessor 1201 and amemory 1202 comprisinginstructions 1203 executable by theprocessor 1201, whereby theencoder 1200 is operative to arrange the RPSs in transmission order in a data structure, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encodeinformation 1220 indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used. - The
decoder 1210 comprises aprocessor 1211 and a memory 1212 comprising instructions 1213 executable by theprocessor 1211, whereby thedecoder 1210 is operative to receive a data structure comprising the RPSs arranged in transmission order, determine whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receiveinformation 1220 indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used. - It should be noted that the embodiments described herein relate to video encoders and decoders, as well as bitstream parsers, transcoders, network nodes, and so forth. Embodiments of the encoder and the decoder can be implemented in devices such as video cameras, displays, tablets, digital television receivers, network nodes, and so forth. Although it is shown in
Fig. 12 that the parameter delta_idx_minus1 is sent, it is to be understood that delta_idx_minus1 is only sent only if explicit RPS transmission is used, in accordance with embodiments of the invention. - It will also be appreciated that the use of delta_idx_minus1 throughout this document it is only an example for how to indicate which RPS should be used for inter-prediction, and it should be obvious the reader that other signaling schemes can be used. In this respect, any reference to delta_idx_minus1 should be understood as an indicator of which RPS to predict from.
- It should further be noted that, although the embodiments herein describe RPSs to be part of an SPS, RPSs may also be included in other data structures, e.g., PPSs or any other parameter set.
- As an alternative to the
encoder 1200 described with reference toFig. 12 , an embodiment of the encoder may also comprise means being configured for arranging the RPSs in transmission order in a data structure, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used. - As yet a further alternative, an embodiment of the encoder may also comprise means for arranging the RPSs in transmission order in a data structure, means for determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and means for encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- As an alternative to the
decoder 1210 described with reference toFig. 12 , an embodiment of the decoder may also comprise means being configured for receiving a data structure comprising the RPSs arranged in transmission order, determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used. - As yet a further alternative, an embodiment of the decoder may also comprise means for receiving a data structure comprising the RPSs arranged in transmission order, means for determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and means for receiving information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used.
- The person skilled in the art realizes that the invention by no means is limited to the embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims.
Claims (18)
- A method of encoding Reference Picture Sets, RPSs, in a High Efficiency Video Coding, HEVC, video sequence, the method comprising:determining whether a current RPS is sent explicitly, in a slice header of a current picture, or implicitly, in a Sequence Parameter Set, SPS,if the current RPS is sent implicitly:arranging the current RPS in decoding order in the SPS, andif RPS inter-prediction is used, inferring that the current RPS is inter-predicted from an RPS comprised in the SPS and directly preceding the current RPS in decoding order, andif the current RPS is sent explicitly, and if RPS inter-prediction is used, encoding information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS.
- The method according to claim 1, wherein at least one RPS of the RPSs arranged in the SPS is inter-predicted from an RPS which is directly preceding the at least one RPS in decoding order.
- The method according to claims 1 or 2, wherein the current RPS is sent explicitly if an index of the current RPS is equal to a number of RPSs comprised in the SPS.
- The method according to any one of claims 1 to 3, further comprising assigning an index to each RPS comprised in the SPS, the index ranging from 0 to a number of RPSs comprised in the SPS minus one, wherein the information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS specifies the difference between an index of the current RPS and an index of the RPS used for inter-prediction.
- A method of decoding a High Efficiency Video Coding, HEVC, video sequence comprising Reference Picture Sets, RPSs, the method comprising:determining whether a current RPS is sent explicitly, in a slice header of a current picture, or implicitly, arranged in decoding order in a Sequence Parameter Set, SPS,if the current RPS is sent implicitly, and if RPS inter-prediction is used, inferring that the current RPS is inter-predicted from an RPS comprised in the SPS and directly preceding the current RPS in decoding order, andif the current RPS is sent explicitly, and if RPS inter-prediction is used, receiving information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS.
- The method according to claim 5, wherein at least one RPS of the RPSs arranged in the SPS is inter-predicted from an RPS which is directly preceding the at least one RPS in decoding order.
- The method according to claims 5 or 6, wherein the current RPS is sent explicitly if an index of the current RPS is equal to a number of RPSs comprised in the SPS.
- The method according to any one of claims 5 to 7, further comprising assigning an index to each RPS comprised in the SPS, the index ranging from 0 to a number of RPSs comprised in the SPS minus one, wherein the information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS specifies the difference between an index of the current RPS and an index of the RPS used for inter-prediction.
- A computer program (1203, 1213) comprising computer program code, the computer program code being adapted, if executed on a processor (1201, 1211), to implement the method according to claims 1 to 8.
- A computer program product comprising a computer readable storage medium (1202, 1212), the computer readable storage medium having the computer program (1203, 1213) according to claim 9 embodied therein.
- An encoder for encoding Reference Picture Sets, RPSs, in a High Efficiency Video Coding, HEVC, video sequence, the encoder comprising a processor (1201) and a memory (1202) comprising instructions executable by the processor, whereby the encoder is operative to:determine whether a current RPS is sent explicitly, in a slice header of a current picture, or implicitly, in a Sequence Parameter Set, SPS,if the current RPS is sent implicitly:arrange the current RPS in decoding order in the SPS, andif RPS inter-prediction is used, infer that the current RPS is inter-predicted from an RPS comprised in the SPS and directly preceding the current RPS in decoding order, andif the current RPS is sent explicitly, and if RPS inter-prediction is used, encode information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS.
- The encoder according to claim 11, wherein at least one RPS of the RPSs arranged in the SPS is inter-predicted from an RPS which is directly preceding the at least one RPS in decoding order.
- The encoder according to claims 11 or 12, wherein the current RPS is sent explicitly if an index of the current RPS is equal to a number of RPSs comprised in the SPS.
- The encoder according to any one of claims 11 to 13, being further operative to assign an index to each RPS comprised in the SPS, the index ranging from 0 to a number of RPSs comprised in the SPS minus one, wherein the information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS specifies the difference between an index of the current RPS and an index of the RPS used for inter-prediction.
- A decoder for decoding a High Efficiency Video Coding, HEVC, video sequence comprising Reference Picture Sets, RPSs, the decoder comprising a processor (1211) and a memory (1212) comprising instructions executable by the processor, whereby the decoder is operative to:determine whether a current RPS is sent explicitly, in a slice header of a current picture, or implicitly, arranged in decoding order in a Sequence Parameter Set, SPS,if the current RPS is sent implicitly, and if RPS inter-prediction is used, infer that the current RPS is inter-predicted from an RPS comprised in the SPS and directly preceding the current RPS in decoding order, andif the current RPS is sent explicitly, and if RPS inter-prediction is used, receive information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS.
- The decoder according to claim 15, wherein at least one RPS of the RPSs arranged in the SPS is inter-predicted from an RPS which is directly preceding the at least one RPS in decoding order.
- The decoder according to claims 15 or 16, wherein the current RPS is sent explicitly if an index of the current RPS is equal to a number of RPSs comprised in the SPS.
- The decoder according to any one of claims 15 to 17, being further operative to assign an index to each RPS comprised in the SPS, the index ranging from 0 to a number of RPSs comprised in the SPS minus one, wherein the information indicating an RPS comprised in the SPS to be used for inter-predicting the current RPS specifies the difference between an index of the current RPS and an index of the RPS used for inter-prediction.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261666235P | 2012-06-29 | 2012-06-29 | |
EP13737454.2A EP2868082B1 (en) | 2012-06-29 | 2013-07-01 | Encoding and decoding video sequences comprising reference picture sets |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13737454.2A Division EP2868082B1 (en) | 2012-06-29 | 2013-07-01 | Encoding and decoding video sequences comprising reference picture sets |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3079363A1 true EP3079363A1 (en) | 2016-10-12 |
EP3079363B1 EP3079363B1 (en) | 2017-09-27 |
Family
ID=48793514
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16169607.5A Active EP3079363B1 (en) | 2012-06-29 | 2013-07-01 | Encoding and decoding video sequences comprising reference picture sets |
EP13737454.2A Active EP2868082B1 (en) | 2012-06-29 | 2013-07-01 | Encoding and decoding video sequences comprising reference picture sets |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13737454.2A Active EP2868082B1 (en) | 2012-06-29 | 2013-07-01 | Encoding and decoding video sequences comprising reference picture sets |
Country Status (14)
Country | Link |
---|---|
US (2) | US9438900B2 (en) |
EP (2) | EP3079363B1 (en) |
JP (1) | JP5872739B2 (en) |
CN (1) | CN104396242B (en) |
AU (2) | AU2013281243C1 (en) |
BR (1) | BR112014032585B1 (en) |
DK (2) | DK3079363T3 (en) |
ES (2) | ES2650995T3 (en) |
IN (1) | IN2014DN10978A (en) |
MA (1) | MA37697B1 (en) |
MY (1) | MY167687A (en) |
RU (1) | RU2602345C2 (en) |
SG (1) | SG11201408320WA (en) |
WO (1) | WO2014003682A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210047945A (en) * | 2018-09-04 | 2021-04-30 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Method and apparatus for obtaining a reference frame applied to bidirectional inter prediction |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI644564B (en) * | 2012-06-29 | 2018-12-11 | 維洛思媒介國際公司 | Information processing apparatus and information processing method |
EP3079363B1 (en) * | 2012-06-29 | 2017-09-27 | Telefonaktiebolaget LM Ericsson (publ) | Encoding and decoding video sequences comprising reference picture sets |
GB2531271A (en) * | 2014-10-14 | 2016-04-20 | Nokia Technologies Oy | An apparatus, a method and a computer program for image sequence coding and decoding |
WO2019234609A1 (en) * | 2018-06-05 | 2019-12-12 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between ibc and bio |
US11184607B2 (en) * | 2019-06-13 | 2021-11-23 | Qualcomm Incorporated | Same picture order count (POC) numbering for scalability support |
AR121127A1 (en) | 2020-02-29 | 2022-04-20 | Beijing Bytedance Network Tech Co Ltd | SIGNALING OF REFERENCE IMAGE INFORMATION IN A VIDEO BITSTREAM |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6067417A (en) * | 1992-06-30 | 2000-05-23 | Discovision Associates | Picture start token |
US7015351B2 (en) * | 2000-05-22 | 2006-03-21 | Monsanto Technology Llc | Reaction systems for making N-(phosphonomethyl) glycine compounds |
MY134659A (en) * | 2002-11-06 | 2007-12-31 | Nokia Corp | Picture buffering for prediction references and display |
JP4002878B2 (en) * | 2003-01-17 | 2007-11-07 | 松下電器産業株式会社 | Image coding method |
JP4570532B2 (en) | 2005-08-02 | 2010-10-27 | パナソニック株式会社 | Motion detection device, motion detection method, integrated circuit, and program |
CN101036986B (en) * | 2007-03-30 | 2010-11-10 | 北京交通大学 | Novel 3-DOF parallel manipulator having two-rotating and one-moving |
US8416858B2 (en) * | 2008-02-29 | 2013-04-09 | Cisco Technology, Inc. | Signalling picture encoding schemes and associated picture properties |
US8133154B2 (en) * | 2008-03-17 | 2012-03-13 | GM Global Technology Operations LLC | Control system and method for accelerator pedal based shift point stabilization for an automatic transmission |
US8363721B2 (en) | 2009-03-26 | 2013-01-29 | Cisco Technology, Inc. | Reference picture prediction for video coding |
CN102435375B (en) * | 2011-09-19 | 2013-06-05 | 燕山大学 | Triple-parallel legged decoupling six-dimensional force measurement sensor comprising elastic mass motion pairs |
US8805098B2 (en) * | 2012-01-19 | 2014-08-12 | Sharp Laboratories Of America, Inc. | Inter reference picture set signaling and prediction on an electronic device |
US8867852B2 (en) * | 2012-01-19 | 2014-10-21 | Sharp Kabushiki Kaisha | Decoding a picture based on a reference picture set on an electronic device |
US20130272398A1 (en) * | 2012-01-25 | 2013-10-17 | Sharp Laboratories Of America, Inc. | Long term picture signaling |
JP5947405B2 (en) * | 2012-02-01 | 2016-07-06 | ノキア テクノロジーズ オーユー | Video encoding method and apparatus |
US9532046B2 (en) * | 2012-04-16 | 2016-12-27 | Qualcomm Incorporated | Reference picture set prediction for video coding |
HUE052896T2 (en) * | 2012-04-16 | 2021-05-28 | Samsung Electronics Co Ltd | Method and apparatus for determining reference picture set of image |
US9736476B2 (en) * | 2012-04-27 | 2017-08-15 | Qualcomm Incorporated | Full random access from clean random access pictures in video coding |
EP3079363B1 (en) * | 2012-06-29 | 2017-09-27 | Telefonaktiebolaget LM Ericsson (publ) | Encoding and decoding video sequences comprising reference picture sets |
TWI644564B (en) * | 2012-06-29 | 2018-12-11 | 維洛思媒介國際公司 | Information processing apparatus and information processing method |
-
2013
- 2013-07-01 EP EP16169607.5A patent/EP3079363B1/en active Active
- 2013-07-01 MY MYPI2014703747A patent/MY167687A/en unknown
- 2013-07-01 EP EP13737454.2A patent/EP2868082B1/en active Active
- 2013-07-01 IN IN10978DEN2014 patent/IN2014DN10978A/en unknown
- 2013-07-01 US US14/000,506 patent/US9438900B2/en active Active
- 2013-07-01 BR BR112014032585-5A patent/BR112014032585B1/en active IP Right Grant
- 2013-07-01 SG SG11201408320WA patent/SG11201408320WA/en unknown
- 2013-07-01 MA MA37697A patent/MA37697B1/en unknown
- 2013-07-01 JP JP2015520125A patent/JP5872739B2/en active Active
- 2013-07-01 WO PCT/SE2013/050835 patent/WO2014003682A1/en active Application Filing
- 2013-07-01 ES ES16169607.5T patent/ES2650995T3/en active Active
- 2013-07-01 RU RU2015102756/08A patent/RU2602345C2/en active
- 2013-07-01 AU AU2013281243A patent/AU2013281243C1/en active Active
- 2013-07-01 CN CN201380034621.5A patent/CN104396242B/en active Active
- 2013-07-01 ES ES13737454.2T patent/ES2587744T3/en active Active
- 2013-07-01 DK DK16169607.5T patent/DK3079363T3/en active
- 2013-07-01 DK DK13737454.2T patent/DK2868082T3/en active
-
2015
- 2015-12-10 AU AU2015268651A patent/AU2015268651B2/en active Active
-
2016
- 2016-07-27 US US15/220,512 patent/US9769495B2/en active Active
Non-Patent Citations (6)
Title |
---|
FLYNN D ET AL: "JCT-VC AHG report: Reference picture buffering and list construction (AHG21)", 7. JCT-VC MEETING; 98. MPEG MEETING; 21-11-2011 - 30-11-2011; GENEVA; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-G021, 21 November 2011 (2011-11-21), XP030110020 * |
HANNUKSELA M M ET AL: "AHG21: Removal of reference picture list modification", 8. JCT-VC MEETING; 99. MPEG MEETING; 1-2-2012 - 10-2-2012; SAN JOSE; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-H0426, 20 January 2012 (2012-01-20), XP030111453 * |
QIU SHEN ET AL: "Buffer requirement analysis and reference picture marking for temporal scalable video coding", PACKET VIDEO 2007, IEEE, PI, 1 November 2007 (2007-11-01), pages 91 - 97, XP031170603, ISBN: 978-1-4244-0980-8 * |
SJÖBERG R ET AL: "Absolute signaling of reference pictures", 6. JCT-VC MEETING; 97. MPEG MEETING; 14-7-2011 - 22-7-2011; TORINO; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-F493, 22 July 2011 (2011-07-22), XP030009516 * |
ZHAO J ET AL: "AHG15: Parameterized RPS Models", 9. JCT-VC MEETING; 100. MPEG MEETING; 27-4-2012 - 7-5-2012; GENEVA; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-I0388, 17 April 2012 (2012-04-17), XP030112151 * |
ZHAO J ET AL: "AHG21: Parameterized RPS Models", 8. JCT-VC MEETING; 99. MPEG MEETING; 1-2-2012 - 10-2-2012; SAN JOSE; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-H0551, 21 January 2012 (2012-01-21), XP030111578 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210047945A (en) * | 2018-09-04 | 2021-04-30 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Method and apparatus for obtaining a reference frame applied to bidirectional inter prediction |
EP3840386A4 (en) * | 2018-09-04 | 2021-09-22 | Huawei Technologies Co., Ltd. | Method and apparatus for acquiring reference frame applied to bidirectional inter-frame prediction |
US11659161B2 (en) | 2018-09-04 | 2023-05-23 | Huawei Technologies Co., Ltd. | Reference frame obtaining method and apparatus applied to bidirectional inter prediction |
KR102602827B1 (en) | 2018-09-04 | 2023-11-15 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Reference frame acquisition method and device applied to two-way inter prediction |
Also Published As
Publication number | Publication date |
---|---|
EP3079363B1 (en) | 2017-09-27 |
AU2015268651B2 (en) | 2017-03-16 |
JP5872739B2 (en) | 2016-03-01 |
AU2013281243B2 (en) | 2015-09-17 |
ES2650995T3 (en) | 2018-01-23 |
DK3079363T3 (en) | 2017-12-04 |
US9438900B2 (en) | 2016-09-06 |
AU2015268651A1 (en) | 2016-01-07 |
MA37697B1 (en) | 2017-03-31 |
RU2015102756A (en) | 2016-08-20 |
JP2015526021A (en) | 2015-09-07 |
DK2868082T3 (en) | 2016-09-12 |
MY167687A (en) | 2018-09-21 |
CN104396242B (en) | 2017-12-19 |
US9769495B2 (en) | 2017-09-19 |
ES2587744T3 (en) | 2016-10-26 |
IN2014DN10978A (en) | 2015-09-18 |
EP2868082A1 (en) | 2015-05-06 |
US20160337663A1 (en) | 2016-11-17 |
BR112014032585A2 (en) | 2017-06-27 |
SG11201408320WA (en) | 2015-01-29 |
AU2013281243C1 (en) | 2016-01-21 |
WO2014003682A1 (en) | 2014-01-03 |
MA37697A1 (en) | 2016-06-30 |
CN104396242A (en) | 2015-03-04 |
BR112014032585B1 (en) | 2022-10-04 |
US20140079115A1 (en) | 2014-03-20 |
RU2602345C2 (en) | 2016-11-20 |
AU2013281243A1 (en) | 2015-01-22 |
EP2868082B1 (en) | 2016-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2015268651B2 (en) | Encoding and decoding video sequences comprising reference picture sets | |
US11943480B2 (en) | Constraints and unit types to simplify video random access | |
KR101895176B1 (en) | Dependent random access point pictures | |
JP2023175040A (en) | Supplemental enhancement information including reliability level and mixed content information | |
US11297335B2 (en) | Arrangements and methods of encoding picture belonging to a temporal level | |
JP7414856B2 (en) | Video coding layer upswitching instructions |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20160628 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2868082 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20161219 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170524 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2868082 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 933009 Country of ref document: AT Kind code of ref document: T Effective date: 20171015 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013027359 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20171127 |
|
REG | Reference to a national code |
Ref country code: RO Ref legal event code: EPE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2650995 Country of ref document: ES Kind code of ref document: T3 Effective date: 20180123 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171227 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 933009 Country of ref document: AT Kind code of ref document: T Effective date: 20170927 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171227 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: GR Ref legal event code: EP Ref document number: 20170403100 Country of ref document: GR Effective date: 20180420 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180127 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013027359 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
26N | No opposition filed |
Effective date: 20180628 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20190131 AND 20190206 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20190207 AND 20190213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180701 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602013027359 Country of ref document: DE Representative=s name: BURCHARDI, THOMAS, DIPL.-ING. UNIV., DE Ref country code: DE Ref legal event code: R081 Ref document number: 602013027359 Country of ref document: DE Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), SE Free format text: FORMER OWNER: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), STOCKHOLM, SE Ref country code: DE Ref legal event code: R082 Ref document number: 602013027359 Country of ref document: DE Representative=s name: DEHNS, DE Ref country code: DE Ref legal event code: R081 Ref document number: 602013027359 Country of ref document: DE Owner name: VELOS MEDIA INTERNATIONAL LIMITED, IE Free format text: FORMER OWNER: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), STOCKHOLM, SE Ref country code: DE Ref legal event code: R082 Ref document number: 602013027359 Country of ref document: DE Representative=s name: DEHNS PATENT AND TRADEMARK ATTORNEYS, DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: VELOS MEDIA INTERNATIONAL LIMITED; IE Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), ASSIGNMENT; FORMER OWNER NAME: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL) Effective date: 20191213 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: PC2A Owner name: VELOS MEDIA INTERNATIONAL LIMITED Effective date: 20191230 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130701 Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170927 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170927 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20220106 AND 20220112 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL); SE Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), ASSIGNMENT; FORMER OWNER NAME: VELOS MEDIA INTERNATIONAL LIMITED Effective date: 20220428 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: RO Payment date: 20230623 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: TR Payment date: 20230622 Year of fee payment: 11 Ref country code: NL Payment date: 20230726 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602013027359 Country of ref document: DE Representative=s name: BURCHARDI, THOMAS, DIPL.-ING. UNIV., DE Ref country code: DE Ref legal event code: R081 Ref document number: 602013027359 Country of ref document: DE Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), SE Free format text: FORMER OWNER: VELOS MEDIA INTERNATIONAL LIMITED, DUBLIN, IE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20230720 Year of fee payment: 11 Ref country code: IE Payment date: 20230727 Year of fee payment: 11 Ref country code: GB Payment date: 20230727 Year of fee payment: 11 Ref country code: ES Payment date: 20230804 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20230727 Year of fee payment: 11 Ref country code: GR Payment date: 20230727 Year of fee payment: 11 Ref country code: FR Payment date: 20230725 Year of fee payment: 11 Ref country code: DK Payment date: 20230727 Year of fee payment: 11 Ref country code: DE Payment date: 20230727 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: PC2A Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL) Effective date: 20240409 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CZ Payment date: 20240621 Year of fee payment: 12 |