WO2013161442A1 - 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 - Google Patents
画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 Download PDFInfo
- Publication number
- WO2013161442A1 WO2013161442A1 PCT/JP2013/057559 JP2013057559W WO2013161442A1 WO 2013161442 A1 WO2013161442 A1 WO 2013161442A1 JP 2013057559 W JP2013057559 W JP 2013057559W WO 2013161442 A1 WO2013161442 A1 WO 2013161442A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image data
- information
- container
- video stream
- stream
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
Definitions
- the present technology relates to an image data transmission device, an image data transmission method, an image data reception device, and an image data reception method, and in particular, an image data transmission device that transmits image data for stereoscopic image display, scalable encoded image data, and the like.
- an image data transmission device that transmits image data for stereoscopic image display, scalable encoded image data, and the like.
- H.264 has been used as a video encoding method.
- H.264 / AVC Advanced Video Video Coding
- H.264 H.264 / MVC Multi-view Video Coding
- MVC employs a mechanism that encodes multi-view image data together.
- multi-view image data is encoded as one base-view image data and one or more non-baseview image data.
- H.264 H.264 / SVC Scalable Video Coding
- SVC Scalable Video Coding
- a base video stream obtained by encoding base view image data as one picture and a predetermined number of extended video streams each obtained by obtaining non-base view image data as one picture are transcoded. It is known to transmit in a port stream. Further, in the case of this MVC, it is also known that a base video stream obtained by encoding base view image data and a predetermined number of non-base view image data as one stream is transmitted as a transport stream as a container. It has been.
- the bit rate varies independently for each video stream, but the entire transport stream is required to perform rate control according to system requirements such as a constant bit rate or a variable bit rate.
- the encoded data of the image data of each view is, for example, an access unit (access unit).
- access unit access unit
- the purpose of this technology is to make it possible to reliably and easily identify the case where the substream structure is composed of a single video stream and the case where the substream structure is composed of a plurality of streams before decoding on the reception side. This is for the convenience of the processing on the side.
- a container of a predetermined format having a base video stream including first image data and a predetermined number of second image data related to the first image data is transmitted by the transmission unit.
- the container may be a transport stream (MPEG-2 TS) adopted in the digital broadcasting standard.
- the container may be MP4 used for Internet distribution or the like, or a container of other formats.
- the information insertion unit inserts specific information at an arrangement position of information related to the base video stream of the container layer.
- the specific information may be a descriptor having information of the first image data and a predetermined number of second image data.
- the container is a transport stream
- the information insertion unit inserts the descriptor into the descriptor portion of the video elementary loop corresponding to the base video stream under the program map table. , May be.
- the first image data is image data of a base view for displaying a stereoscopic image
- the second image data is image data of a view other than the base view for displaying a stereoscopic image.
- the descriptor may be an MVC extension descriptor having information on each view.
- the first image data is image data of the lowest hierarchy constituting the scalable coded image data
- the second image data is the lowest hierarchy constituting the scalable encoded image data.
- the descriptor may be an SVC extension descriptor having image data information of each layer.
- the container when transmitting a container of a predetermined format having a base video stream including the first image data and a predetermined number of second image data related to the first image data, the container The specific information is inserted into the arrangement position of the information related to the base video stream of the layer.
- this container has a base video stream that includes the first image data and a predetermined number of second image data associated with the first image data. It becomes possible. On the receiving side, it is possible to accurately determine the configuration, decoding, and display mode of the buffer memory at the time of decoding before decoding.
- a transmitting unit that transmits a container of a predetermined format including a base video stream including first image data and a predetermined number of extended video streams each including a predetermined number of second image data related to the first image data.
- the image data transmitting apparatus includes an information insertion unit that inserts specific information at an arrangement position of information related to the predetermined number of extended video streams in the container layer.
- a container having a predetermined format including a base video stream including first image data and a predetermined number of extended video streams each including a predetermined number of second image data related to the first image data is transmitted.
- the container may be a transport stream (MPEG-2 TS) adopted in the digital broadcasting standard.
- the container may be MP4 used for Internet distribution or the like, or a container of other formats.
- the information insertion unit inserts specific information at an arrangement position of information related to the base video stream of the container layer.
- the specific information may be a descriptor having information on the first image data and a predetermined number of second image data.
- the container is a transport stream
- the information insertion unit inserts the descriptor into the descriptor portion of the video elementary loop corresponding to the base video stream under the program map table. , May be.
- the first image data is image data of a base view for displaying a stereoscopic image
- the second image data is image data of a view other than the base view for displaying a stereoscopic image.
- the descriptor may be an MVC extension descriptor having information on each view.
- the first image data is image data of the lowest hierarchy constituting the scalable coded image data
- the second image data is the lowest hierarchy constituting the scalable encoded image data.
- the descriptor may be an SVC extension descriptor having image data information of each layer.
- a predetermined video stream including a base video stream including first image data and a predetermined number of extended video streams each including a predetermined number of second image data related to the first image data.
- specific information is inserted into the arrangement positions of information related to a predetermined number of extended video streams in the container layer.
- the container includes a base video stream including the first image data and a predetermined number of extended video streams each including a predetermined number of second image data related to the first image data. It is possible to reliably and easily identify having a base video stream including. On the receiving side, it is possible to accurately determine the configuration, decoding, and display mode of the buffer memory at the time of decoding before decoding.
- a receiving unit for receiving a container in a predetermined format comprising: a processing unit that processes a video stream included in the container based on the presence and insertion position of specific information in the container layer and acquires a predetermined number of image data associated with each other .
- a container of a predetermined format is received by the receiving unit. Then, based on the presence and insertion position of specific information in the container layer, the processing unit processes the video stream included in the container, and acquires a predetermined number of image data related to each other.
- the predetermined number of image data may constitute image data for stereoscopic image display or scalable encoded data image data.
- the processing unit processes the base video stream to perform predetermined processing.
- a number of image data may be acquired.
- the processing unit includes the extended video stream and the container. The base video stream may be processed to obtain a predetermined number of image data.
- the video stream included in the container is processed based on the presence and insertion position of specific information in the container layer, and a predetermined number of image data associated with each other is obtained.
- the configuration, decoding, and display mode of the buffer memory at the time of decoding can be accurately determined before decoding, and image data can be acquired satisfactorily.
- the present technology it is possible to reliably and easily identify the case where the substream configuration includes a single video stream and the case where the substream configuration includes a plurality of streams before decoding on the reception side.
- 2D two-dimensional
- Embodiment 2 modes for carrying out the present technology (hereinafter referred to as “embodiments”) will be described. The description will be given in the following order. 1. Embodiment 2. FIG. Modified example
- FIG. 1 shows a configuration example of an image transmission / reception system 10 as an embodiment.
- the image transmission / reception system 10 includes a broadcasting station 100 and a receiver 200.
- the broadcasting station 100 transmits a transport stream TS as a container on a broadcast wave.
- the transport stream TS When transmitting a two-dimensional (2D) image, the transport stream TS includes a video stream including two-dimensional image data.
- the video stream is transmitted as an AVC (2D) video elementary stream, for example.
- the transport stream TS may include one video stream including base view image data for displaying a stereoscopic image and image data of a predetermined number of views other than the base view. is there. That is, this is a case where the substream configuration forms a single video stream.
- a video stream obtained by encoding image data of a base view and a predetermined number of non-base views as one picture is transmitted as an MVC video elementary stream (base video stream).
- a descriptor having specific information for example, information of image data of each view, is inserted into an arrangement position of information related to the base video stream in the layer of the transport stream TS.
- an MVC extension descriptor (MVC_extension_descriptor) is inserted into the descriptor portion of the video elementary loop corresponding to the base video stream under the program map table.
- the receiving side is a case of transmitting a stereoscopic (3D) image and the substream configuration is a single video stream. That is, on the receiving side, it can be seen that the transport stream TS has a base video stream including base view image data for stereoscopic image display and image data of a predetermined number of views other than the base view. .
- the transport stream TS When transmitting a stereoscopic (3D) image, the transport stream TS includes a base video stream including base view image data for displaying a stereoscopic image and a predetermined number of image data of a predetermined number of views other than the base view. Number of extended video streams may be included. That is, this is a case where the substream configuration is composed of multiple streams.
- a video stream obtained by encoding the image data of the base view as one picture is transmitted as a video elementary stream (base video stream) of the MVC base view.
- a predetermined number of video streams obtained by encoding a predetermined number of non-base view image data as one picture are transmitted as MVC non-base view video elementary streams (enhanced video streams).
- a descriptor having specific information for example, image data information of each view, is inserted into the arrangement position of information related to the predetermined number of extended video streams in the layer of the transport stream TS.
- an MVC extension descriptor (MVC_extension_descriptor) is inserted into the descriptor part of the video elementary loop corresponding to the extended video stream under the program map table.
- the receiving side is a case of transmitting a stereoscopic (3D) image and the substream configuration is composed of a plurality of streams. That is, on the receiving side, the transport stream TS includes a base video stream including base view image data for displaying a stereoscopic image and a predetermined number of extended videos including image data of a predetermined number of views other than the base view. It can be seen that it has a stream.
- FIG. 2 shows a structural example (Syntax) of this MVC extension descriptor.
- “View order index_start” indicates the number of the first view
- “view order index_end” indicates the number of the last view
- the total number of views can be known from these pieces of information.
- “view_id” indicates the number of the view (non-base view) corresponding to this descriptor. This “view_id” specifies the same content as “view_id” described in “NAL unit header” described later, and may be omitted as a reserved bit.
- the receiver 200 receives the transport stream TS transmitted from the broadcasting station 100 on a broadcast wave.
- the transport stream TS includes an AVC (2D) video elementary stream including two-dimensional image data when transmitting a two-dimensional (2D) image.
- the transport stream TS includes only the MVC base video stream or a predetermined number of extended video streams together with a stereoscopic (3D) image transmission.
- the receiver 200 processes a video stream included in the transport stream TS based on the presence and insertion position of the specific information in the layer of the transport stream TS. That is, the configuration, decoding, and display mode of the buffer memory at the time of decoding are determined.
- the receiver 200 acquires image data for displaying a two-dimensional (2D) image or image data of a predetermined number of views for displaying a stereoscopic (3D) image, and obtains a two-dimensional (2D) image or (3D ) Display images.
- the receiver 200 has the MVC extension descriptor in the descriptor portion of the video elementary loop (first ES loop) corresponding to the base video stream under the program map table.
- the receiver 200 transmits a stereoscopic (3D) image when the descriptor is present in the first ES loop, and the video stream includes a base view for displaying a stereoscopic image and other predetermined number of views. It is recognized that the image data is included.
- the receiver 200 decodes the corresponding video stream included in the transport stream TS, acquires a plurality of image data for stereoscopic image display, and performs three-dimensional image display.
- the receiver 200 determines whether or not the extended video stream is included in the transport stream TS. Then, when the extended video stream is included, the receiver 200 sets the MVC • in the descriptor portion of the video elementary loop (second ES loop) corresponding to the extended video stream under the program map table. Determine if an extension descriptor exists.
- the receiver 200 transmits a stereoscopic (3D) image when a descriptor is present in the second ES loop, and the extended video stream and the base video stream are displayed as a base view for displaying a stereoscopic image and others. It is recognized that the image data of a predetermined number of views is included. In this case, the receiver 200 decodes a plurality of video streams included in the transport stream TS, acquires a plurality of image data for stereoscopic image display, and performs three-dimensional image display.
- 3D stereoscopic
- the receiver 200 recognizes that a two-dimensional (2D) image is being transmitted when the transport stream TS does not include an extended video stream or when there is no descriptor in the second ES loop. In this case, the receiver 200 decodes the video stream included in the transport stream TS, acquires two-dimensional image data, and performs basic conventional two-dimensional image display.
- 2D two-dimensional
- FIG. 3 shows a configuration example of the transmission data generation unit 110 that generates the above-described transport stream in the broadcast station 100.
- the transmission data generation unit 110 includes a data extraction unit (archive unit) 111, a video encoder 112, a parallax encoder 113, and an audio encoder 114.
- the transmission data generation unit 110 includes a graphics generation unit 115, a graphics encoder 116, and a multiplexer 117.
- a data recording medium 111a is detachably attached to the data extraction unit 111, for example.
- audio data corresponding to the image data is recorded along with the image data of the program to be transmitted.
- the image data is switched to image data for stereoscopic (3D) image display or image data for two-dimensional (2D) image display in accordance with the program.
- the image data is switched to image data for displaying a stereoscopic image or image data for displaying a two-dimensional image in the program depending on the contents of the main story and commercials.
- the plurality of pieces of image data for displaying the stereoscopic image includes base view image data and a predetermined number of non-base view image data.
- parallax information may also be recorded on the data recording medium 111a.
- the disparity information is disparity information (disparity vector) indicating disparity between the base view and each non-base view, or depth data. Depth data can be handled as parallax information by predetermined conversion.
- the disparity information is, for example, disparity information for each pixel (pixel) or disparity information of each divided region obtained by dividing a view (image) into a predetermined number.
- this parallax information is used on the receiving side to adjust the position of the same superimposition information (graphics information or the like) to be superimposed on the images of the base view and each non-base view to give parallax.
- the disparity information is used on the reception side to obtain display image data of a predetermined number of views by performing interpolation processing (post processing) on the image data of the base view and each non-base view.
- the data recording medium 111a is a disk-shaped recording medium, a semiconductor memory, or the like.
- the data extraction unit 111 extracts and outputs image data, audio data, parallax information, and the like from the data recording medium 111a.
- the video encoder 112 performs encoding such as MPEG2 video, MPEG4-AVC (MVC), or HEVC on the image data output from the data extracting unit 111 to obtain encoded video data. Further, the video encoder 112 generates a video elementary stream by a stream formatter (not shown) provided in the subsequent stage.
- encoding such as MPEG2 video, MPEG4-AVC (MVC), or HEVC
- the video encoder 112 when the image data is two-dimensional (2D) image data, the video encoder 112 generates an AVC (2D) video elementary stream including the two-dimensional image data.
- the video encoder 112 when the image data is image data of a plurality of views for displaying a stereoscopic (3D) image, the video encoder 112 generates one or a plurality of video elementary streams including the image data of the plurality of views.
- the substream configuration forms a single video stream
- the image data of the base view and a predetermined number of non-base views are encoded as one picture, and an MVC video elementary stream (base video stream) is encoded. Is generated.
- the base view image data is encoded as one video elementary stream, and the video elementary stream (base video stream) of the MVC base view is encoded. Is generated.
- a predetermined number of non-base view image data is encoded as independent video elementary streams, and a predetermined number of MVC non-base view video elementary streams (enhanced video streams) are further encoded.
- the audio encoder 114 performs encoding such as MPEG2 Audio AAC on the audio data output from the data extraction unit 111 to generate an audio elementary stream.
- the disparity encoder 113 performs predetermined encoding on the disparity information output from the data extraction unit 111, and generates an elementary stream of disparity information.
- the disparity information is disparity information for each pixel (pixel) as described above, the disparity information can be handled like pixel data.
- the disparity encoder 113 can encode the disparity information using the same encoding method as that of the above-described image data to generate a disparity information elementary stream.
- a configuration in which the video encoder 112 encodes the disparity information output from the data extraction unit 111 is also conceivable. In this case, the disparity information encoder 113 is not necessary.
- the graphics generation unit 115 generates data (graphics data) of graphics information (including subtitle information) to be superimposed on an image.
- the graphics encoder 116 generates a graphics elementary stream including the graphics data generated by the graphics generating unit 115.
- the graphics information is, for example, a logo.
- the subtitle information is, for example, a caption.
- This graphics data is bitmap data. Offset information indicating the superimposed position on the image is added to the graphics data. This offset information indicates, for example, offset values in the vertical and horizontal directions from the upper left origin of the image to the upper left pixel of the superimposed position of graphics information.
- the standard for transmitting caption data as bitmap data is standardized and operated as “DVB_Subtitling” in DVB, which is a European digital broadcasting standard.
- the multiplexer 117 packetizes and multiplexes the elementary streams generated by the video encoder 112, the parallax encoder 113, the audio encoder 114, and the graphics encoder 116, and generates a transport stream TS.
- the transport stream TS includes an AVC (2D) video elementary stream including two-dimensional image data when transmitting a two-dimensional (2D) image.
- the transport stream TS includes an MVC base substream and a predetermined number of extended substreams together with a stereoscopic (3D) image transmission.
- the multiplexer 117 inserts specific information at a specific position in the layer of the transport stream TS when transmitting a stereoscopic (3D) image.
- the specific position is changed depending on whether the substream configuration is a single stream or a plurality of streams.
- the transport stream TS layer has specific information, for example, image data information of each view, at the arrangement position of the information related to the above-described base video stream. Insert a descriptor.
- the multiplexer 117 inserts an MVC extension descriptor (see FIG. 2) into the descriptor portion of the video elementary loop corresponding to the base video stream under the program map table.
- FIG. 4 (a) schematically shows that the MVC extension descriptor (MVC_extension_descriptor) is inserted in association with the base video stream in this way.
- the base video stream whose stream type (Stream type) is “0 ⁇ 1B” includes encoded data of base view image data and encoded data of one non-base view image data.
- the encoded data of the base-view image data is composed of “SPS ⁇ Coded Slice”, and the encoded data of the non-base view image data is comprised of “Subset SPS ⁇ Coded Slice”.
- the substream configuration is composed of a plurality of streams
- specific information for example, images of each view
- Insert descriptor with data information In this embodiment, the MVC extension descriptor (see FIG. 2) is inserted into the descriptor portion of the video elementary loop corresponding to the extended video stream under the program map table.
- FIG. 4B schematically shows that the MVC extension descriptor (MVC_extension_descriptor) is inserted in correspondence with the extended video stream.
- the base video stream whose stream type (Stream type) is “0 ⁇ 1B” includes only encoded data of base view image data.
- the encoded data of the image data of the base view is composed of “SPS ⁇ Coded Slice”.
- the extended video stream having a stream type (Stream type) of “0 ⁇ 20” includes only encoded data of non-base view image data.
- the encoded data of the non-base view image data is composed of “Subset SPS ⁇ Coded Slice”.
- FIG. 5 shows a configuration example (Syntax) of the NAL unit header (NAL unit header MVC extension).
- the field “view_id” indicates the number of the corresponding view. That is, at the time of decoding, on the receiving side, it is possible to recognize which view data packet each encoded data is based on the field information of “view_id”.
- Image data (one image data for displaying a two-dimensional image or image data of a plurality of views for displaying a stereoscopic image) output from the data extraction unit 111 is supplied to the video encoder 112.
- the image data is subjected to an encoding process such as MPEG2 video, MPEG4-AVC (MVC) or HEVC, for example, and a video elementary stream including the encoded video data is generated. Supplied.
- the video encoder 112 when it is image data for displaying a two-dimensional image, for example, an AVC (2D) video elementary stream including the image data is generated.
- the video encoder 112 generates one or more video elementary streams including the image data of the plurality of views when the image data is a plurality of views for stereoscopic image display.
- an MVC video elementary stream including image data of a base view and a predetermined number of non-base views is generated.
- base video stream including image data of a base view and a predetermined number of non-base views is generated.
- base video stream including base-view image data is generated.
- an MVC non-base view video elementary stream that includes a predetermined number of non-base view image data is generated.
- parallax information corresponding to the image data of each view is also output from the data extraction unit 111.
- This parallax information is supplied to the parallax encoder 113.
- a predetermined encoding process is performed on the parallax information, and a parallax elementary stream including encoded data is generated.
- This parallax elementary stream is supplied to the multiplexer 117.
- audio data corresponding to the image data is also output from the data extracting unit 111.
- This audio data is supplied to the audio encoder 114.
- the audio encoder 114 performs encoding processing such as MPEG2Audio AAC on the audio data, and an audio elementary stream including the encoded audio data is generated. This audio elementary stream is supplied to the multiplexer 117.
- the graphics generation unit 115 in response to the image data output from the data extraction unit 111, the graphics generation unit 115 generates data (graphics data) of graphics information (including subtitle information) to be superimposed on the image (view).
- This graphics data is supplied to the graphics encoder 116.
- the graphics encoder 116 a predetermined encoding process is performed on the graphics data to generate a graphics elementary stream including the encoded data. This graphics elementary stream is supplied to the multiplexer 117.
- the transport stream TS includes an AVC (2D) video elementary stream including two-dimensional image data when transmitting a two-dimensional (2D) image.
- the transport stream TS includes an MVC base substream and a predetermined number of extension substreams together with a stereoscopic (3D) image transmission.
- the multiplexer 117 when transmitting a stereoscopic (3D) image, if the substream configuration forms a single video stream, the video elementary loop corresponding to the base video stream under the program map table is transmitted.
- the MVC extension descriptor (see FIG. 2) is inserted into the descriptor portion.
- the multiplexer 117 when a stereoscopic (3D) image is transmitted, if the substream configuration is composed of a plurality of streams, the video elementary loop descriptor corresponding to the extended video stream under the program map table is used.
- the MVC extension descriptor (see FIG. 2) is inserted into the portion.
- FIG. 6 shows a configuration example of the transport stream TS at the time of two-dimensional (2D) image transmission.
- the transport stream TS includes a PES packet “Video ⁇ ⁇ ⁇ ⁇ PES1” of a video elementary stream including image data for two-dimensional (2D) image display.
- illustration of other PES packets is omitted for simplification of the drawing.
- the transport stream TS includes a PMT (Program Map Table) as PSI (Program Specific Information).
- PSI Program Specific Information
- This PSI is information describing to which program each elementary stream included in the transport stream TS belongs.
- the transport stream TS includes an EIT (Event Information Table) as SI (Serviced Information) for managing each event.
- the PMT includes a program descriptor (Program Descriptor) that describes information related to the entire program.
- the PMT includes an elementary loop having information related to each elementary stream.
- information such as the packet identifier (PID) and stream type (Stream_Type) of the video elementary stream is arranged, and information related to the video elementary stream is not shown.
- a descriptor to be described is also arranged.
- FIG. 7 shows a configuration example of the transport stream TS when transmitting a stereoscopic (3D) image.
- This configuration example shows a case where the substream configuration forms a single video stream (1-PID case).
- the transport stream TS includes a PES packet “Video (PES1” of an MVC video elementary stream (base video stream) including image data of a base view and a predetermined number of non-base views.
- PES1 Video
- base video stream base video stream
- Video PES1 there is a video elementary loop corresponding to the PES packet “Video PES1”.
- information such as a packet identifier (PID) and a stream type (Stream_Type) of the video elementary stream is arranged.
- PID packet identifier
- Stream_Type stream type of the video elementary stream
- MVC extension descriptor MVC_extension_descriptor
- FIG. 8 shows a configuration example of the transport stream TS when transmitting a stereoscopic (3D) image.
- This configuration example shows a case where the substream configuration is composed of a plurality of streams, here, a case where it is composed of two streams (2-PID2-case).
- the transport stream TS includes an MVC video elementary stream (base substream) PES packet “Video PES1” including base-view image data.
- the transport stream TS includes a PES packet “Video PES2” of an MVC video elementary stream (enhanced substream) including non-base view image data.
- illustration of other PES packets is omitted for simplification of the drawing.
- the PMT there is a video elementary loop corresponding to the PES packet “Video PES1”.
- information such as the packet identifier (PID) and stream type (Stream_Type) of the video elementary stream is arranged, and information related to the video elementary stream is not shown.
- a descriptor to be described is also arranged.
- the PMT has a video elementary loop corresponding to the PES packet “Video PES2”.
- information such as a packet identifier (PID) and a stream type (Stream_Type) of the video elementary stream is arranged.
- PID packet identifier
- Stream_Type stream type of the video elementary stream
- MVC extension descriptor MVC_extension_descriptor
- FIG. 9 shows a configuration example of the receiver 200.
- the receiver 200 includes a CPU 201, a flash ROM 202, a DRAM 203, an internal bus 204, a remote control receiver 205, and a remote controller transmitter 206.
- the receiver 200 includes a container buffer 213, a demultiplexer 214, a coded buffer 215, a video decoder 216, substream video buffers 217-1, ..., 217-N, a scaler 218-1, ..., 218-N and a 3D view display processing unit 219.
- the receiver 200 includes a coded buffer 221, a parallax decoder 222, a parallax buffer 223, and a parallax information conversion unit 224.
- the receiver 200 also includes a coded buffer 225, a graphics decoder 226, a pixel buffer 227, a scaler 228, and a graphics shifter 229. Further, the receiver 200 includes a coded buffer 230, an audio decoder 231, and a channel mixing unit 232.
- the CPU 201 controls the operation of each unit of receiver 200.
- the flash ROM 202 stores control software and data.
- the DRAM 203 constitutes a work area for the CPU 201.
- the CPU 201 develops software and data read from the flash ROM 202 on the DRAM 203 and activates the software to control each unit of the receiver 200.
- the remote control receiving unit 205 receives a remote control signal (remote control code) transmitted from the remote control transmitter 206 and supplies it to the CPU 201.
- CPU201 controls each part of receiver 200 based on this remote control code.
- the CPU 201, flash ROM 202 and DRAM 203 are connected to the internal bus 204.
- the container buffer 213 temporarily stores the transport stream TS received by a digital tuner or the like.
- the transport stream TS includes, for example, an AVC (2D) video elementary stream. This stream includes image data for displaying a two-dimensional image.
- this transport stream TS has an MVC base substream and a predetermined number of extended substreams together with this.
- one video stream of MVC includes base view image data and a predetermined number of non-base view image data.
- the base view image data is included in the MVC base substream, and the non-baseview image data is included in each of the predetermined number of extended substreams. .
- the MVC extension descriptor is inserted in the descriptor portion of the video elementary loop corresponding to the base video stream under the PMT.
- the MVC extension descriptor is inserted in the descriptor portion of the video elementary loop corresponding to the extended video stream under the PMT.
- the demultiplexer 214 extracts video, parallax, and audio streams from the transport stream TS temporarily stored in the container buffer 213. Further, the demultiplexer 214 extracts the above-mentioned MVC extension descriptor from the transport stream TS and transmits the same to the CPU 201 when transmitting a stereoscopic (3D) image.
- the CPU 201 knows whether it is a stereoscopic (3D) image transmission time or a two-dimensional (2D) image transmission time based on the presence / absence of the MVC / extension / descriptor. Further, when the MVC extension descriptor is inserted in the video elementary loop corresponding to the MVC base video stream, the CPU 201 can determine that the substream configuration forms a single video stream. Further, when the MVC extension descriptor is inserted in the video elementary loop corresponding to the MVC extended video stream, the CPU 201 can determine that the substream configuration is composed of a plurality of streams.
- the CPU 201 controls the management of the coded buffer 215 and further the operation of the video decoder 216 so as to be in a state corresponding to the received image data based on the presence and insertion position of the MVC extension descriptor described above. .
- the coded buffer 215 temporarily stores one or a plurality of video streams extracted by the demultiplexer 214.
- the coded buffer 215 has different buffer management configuration methods for two-dimensional (2D) image transmission and three-dimensional (3D) image transmission.
- the coded buffer 215 includes a case where the substream configuration includes a single stream and a case where the substream configuration includes a plurality of streams even when transmitting a stereoscopic (3D) image. Buffer management configuration method is different.
- the video decoder 216 performs decoding processing on the video elementary stream stored in the coded buffer 215 to obtain image data.
- a single decoder performs decoding processing on the AVC (2D) video elementary stream to obtain image data for two-dimensional (2D) image display. .
- the decoding process is performed as follows. That is, for one video stream of MVC including encoded data of image data of a plurality of views, the packet to be processed is switched from the buffer 215 to the decoder 216 by “view_id” of “NALNunit header”. After that, the decoder 216 performs each decoding process. Thereby, image data of a plurality of views for displaying a stereoscopic (3D) image is acquired.
- the decoding process is performed as follows. That is, the data stored in the buffer 215 is switched according to “view_id” in “NAL unit header” of the NAL packet received from the demultiplexer 214. Thereafter, the reading of the compressed data from the buffer 215 and the processing up to the decoder 216 are performed in the same manner as the decoding of a single view. Decoding processing is performed by a decoder corresponding to each of an MVC base substream including encoded data of base view image data and a predetermined number of MVC extended substreams including encoded data of non-base view image data. I do. Thereby, image data of a plurality of views for displaying a stereoscopic (3D) image is acquired.
- the substream video buffers 217-1,..., 217-N are respectively image data for two-dimensional (2D) image display acquired by the video decoder 216 or three-dimensional (3D) image display.
- the image data of a plurality of views is temporarily stored.
- the minimum value of N is 2.
- the scalers 218-1,..., 218-N have a predetermined resolution for the output resolution of the image data of each view output from the substream video buffers 217-1,. Adjust as follows.
- the coded buffer 221 temporarily stores the parallax stream extracted by the demultiplexer 214.
- the parallax decoder 222 performs processing opposite to that of the parallax encoder 113 (see FIG. 3) of the transmission data generation unit 110 described above. That is, the parallax decoder 222 performs a decoding process on the parallax stream stored in the coded buffer 221 to obtain parallax information corresponding to the image data of each view.
- the parallax buffer 223 temporarily stores the parallax information acquired by the parallax decoder 222.
- the disparity information conversion unit 224 generates disparity information in pixel units that matches the size of the scaled image data based on the disparity information stored in the disparity buffer 223. For example, when the transmitted disparity information is in units of blocks, the information is converted into disparity information in units of pixels. For example, when the transmitted disparity information is in units of pixels but does not match the size of the scaled image data, the information is scaled appropriately. Or, when superimposing graphics or the like in the receiver, disparity information of the block corresponding to the superimposition position is applied.
- the coded buffer 225 temporarily stores the graphics stream extracted by the demultiplexer 214.
- the graphics decoder 226 performs processing opposite to that of the graphics encoder 116 (see FIG. 3) of the transmission data generation unit 110 described above. That is, the graphics decoder 226 performs a decoding process on the graphics stream stored in the coded buffer 225 to obtain graphics data (including subtitle data).
- the graphics decoder 226 generates graphics bitmap data to be superimposed on the view (image) based on the graphics data.
- the pixel buffer 227 temporarily stores graphics bitmap data generated by the graphics decoder 226.
- the scaler 228 adjusts the size of the graphics bitmap data stored in the pixel buffer 227 so as to correspond to the size of the scaled image data.
- the graphics shifter 229 performs a shift process on the bitmap data of the size-adjusted graphics based on the disparity information obtained by the disparity information conversion unit 224.
- the graphics shifter 229 generates graphics bitmap data to be superimposed on the image data of each view output from the 3D view display processing unit 219.
- the 3D view display processing unit 219 is, for example, a two-dimensional (2D) image after scaling input through the scaler 218-1 when the two-dimensional (2D) image display is performed at the time of two-dimensional (2D) image transmission.
- the graphics bitmap data output from the graphics shifter 229 is superimposed on the image data for image display and output to the display.
- the 3D view display processing unit 219 when transmitting a stereoscopic (3D) image and displaying a stereoscopic stereoscopic image, for example, the scaled left eye input through the scalers 218-1 and 218-2.
- the bitmap data of the shifted graphics output from the graphics shifter 229 is superimposed on the image data and the right eye image data, respectively, and output to the display.
- the 3D view display processing unit 219 is a stereoscopic (3D) image transmission unit and performs multi-view stereoscopic image display.
- each 3D view display processing unit 219 inputs each of the scaled images input through the scalers 218-1 to 218-N.
- the image data of a predetermined number of views between the views is interpolated and synthesized.
- the bitmap data of the shifted graphics output from the graphics shifter 229 is further superimposed on the image data of each view after the interpolation synthesis, and is output to the display.
- the coded buffer 230 temporarily stores the audio stream extracted by the demultiplexer 214.
- the audio decoder 231 performs a process opposite to that of the audio encoder 114 (see FIG. 3) of the transmission data generation unit 110 described above. That is, the audio decoder 231 performs audio stream decoding processing stored in the coded buffer 230 to obtain audio data.
- the channel mixing unit 232 generates and outputs audio data of each channel for realizing 5.1 channel surround, for example, with respect to the audio data obtained by the audio decoder 231.
- the transport stream TS received by a digital tuner or the like is temporarily stored in the container buffer 213.
- the transport stream TS includes, for example, an AVC (2D) video elementary stream when transmitting a two-dimensional (2D) image.
- the transport stream TS includes, for example, only an MVC base video stream or a predetermined number of extended video streams together with a stereoscopic (3D) image transmission.
- the demultiplexer 214 video, parallax, and audio streams are extracted from the transport stream TS temporarily stored in the container buffer 213. Also, the demultiplexer 214 extracts the MVC / extension / descriptor from the transport stream TS and transmits it to the CPU 201 when transmitting a stereoscopic (3D) image.
- the CPU 201 manages the coded buffer 215 and the operation of the video decoder 216 based on the presence and insertion position of the MVC / extension / descriptor at the time of two-dimensional (2D) image transmission or stereoscopic (3D) image transmission Control is performed so as to be in a state corresponding to each time.
- One or more video elementary streams extracted by the demultiplexer 214 are supplied to the coded buffer 215 and temporarily stored.
- the video decoder 216 the video elementary stream stored in the coded buffer 215 is decoded to acquire image data.
- the video decoder 216 when transmitting a two-dimensional (2D) image, the video decoder 216 performs a decoding process on one AVC (2D) video elementary stream and displays the two-dimensional (2D) image. Image data is acquired.
- the decoding process is performed as follows to display a stereoscopic (3D) image.
- Image data of a plurality of views for is acquired. That is, the packet to be processed from the buffer 215 to the decoder 216 is switched by the “view_id” of “NAL unit header” for the MVC base video stream including the encoded data of the image data of multiple views. Thereafter, the decoder 216 performs each decoding process.
- decoding processing is performed as follows to display a stereoscopic (3D) image.
- the image data of a plurality of views is acquired. That is, the data stored in the buffer 215 is switched according to “view_id” in “NAL unit header” of the NAL packet received from the demultiplexer 214. Thereafter, the reading of the compressed data from the buffer 215 and the processing up to the decoder 216 are performed in the same manner as the decoding of a single view.
- Decoding processing is performed by a decoder corresponding to each of an MVC base substream including encoded data of base view image data and a predetermined number of MVC extended substreams including encoded data of non-base view image data. Is done.
- Image data for two-dimensional (2D) image display acquired by the video decoder 216, or image data of a plurality of views for stereoscopic (3D) image display, are substream video buffers 217-1,. , 217-N and temporarily stored. Then, after the scalers 218-1,..., 218-N are adjusted to have a predetermined resolution, they are supplied to the 3D view display processing unit 219.
- the disparity data stream extracted by the demultiplexer 214 is supplied to the coded buffer 221 and temporarily stored.
- the parallax decoder 222 the parallax data stream is decoded, and parallax information corresponding to the image data of each view is obtained.
- the parallax information is supplied to the parallax buffer 223 and temporarily stored.
- parallax information conversion unit 224 based on the parallax data stored in the parallax buffer 223, parallax data in units of pixels matching the size of the scaled image data is generated.
- the disparity information obtained by the disparity decoder 222 is in units of blocks, the information is converted into disparity information in units of pixels.
- the disparity information obtained by the disparity decoder 222 is in units of pixels, but is appropriately scaled when it does not match the size of the image data after scaling. This disparity information is supplied to the 3D view display processing unit 219 and the graphics shifter 229.
- the graphics stream extracted by the demultiplexer 214 is supplied to the coded buffer 225 and temporarily accumulated.
- the graphics decoder 226, the graphics stream stored in the coded buffer 225 is decoded, and graphics data (including subtitle data) is obtained. Also, the graphics decoder 226 generates graphics bitmap data to be superimposed on the view (image) based on the graphics data.
- the bitmap data of this graphics is supplied to the pixel buffer 227 and temporarily stored.
- the size of the graphics bitmap data stored in the pixel buffer 227 is adjusted to correspond to the size of the scaled image data.
- the graphics shifter 229 a shift process is performed on the bitmap data of the graphics after the size adjustment based on the disparity information obtained by the disparity information conversion unit 224.
- the graphics shifter 229 generates graphics bitmap data to be superimposed on the image data of each view output from the 3D view display processing unit 219. This bitmap data is supplied to the 3D view display processing unit 219.
- the following processing is performed. That is, for example, graphics bitmap data output from the graphics shifter 229 is superimposed on image data for displaying a two-dimensional (2D) image after scaling input through the scaler 218-1, and is displayed on the display. Is output.
- the 3D view display processing unit 219 when a stereoscopic (3D) image is transmitted and a stereoscopic stereoscopic image is displayed, the following processing is performed. That is, for example, the shifted graphics bitmap data output from the graphics shifter 229 is superimposed on the scaled left-eye image data and right-eye image data input through the scalers 218-1 and 218-2, respectively. And output to the display.
- the 3D view display processing unit 219 when a stereoscopic (3D) image is transmitted and multi-view stereoscopic image display is performed, the following processing is performed. That is, for example, based on the disparity data between the views obtained by the disparity information conversion unit 224 from the image data of each view after scaling input through the scalers 218-1 to 218-N, the predetermined values between the views are determined. The image data of several views are interpolated and synthesized. In this case, the bitmap data of the shifted graphics output from the graphics shifter 229 is further superimposed on the image data of each view after the interpolation synthesis, and is output to the display.
- the audio stream extracted by the demultiplexer 214 is supplied to the coded buffer 230 and temporarily accumulated.
- the audio decoder 231 the audio stream stored in the coded buffer 230 is decoded, and decoded audio data is obtained.
- This audio data is supplied to the channel mixing unit 232.
- the channel mixing unit 232 generates audio data of each channel for realizing, for example, 5.1 channel surround with respect to the audio data.
- This audio data is supplied to, for example, a speaker, and audio output is performed in accordance with image display.
- the CPU 201 performs management of the coded buffer 215 and the operation of the video decoder 216 based on the presence and insertion position of the MVC / extension / descriptor at the time of two-dimensional (2D) image transmission or stereoscopic ( 3D) Control is performed so as to be in a corresponding state at the time of image transmission.
- 2D two-dimensional
- 3D stereoscopic
- the flowchart in FIG. 10 shows an example of the control process of the CPU 201.
- the CPU 201 executes the control process according to this flowchart at a timing when a service such as channel switching is changed.
- step ST2 the CPU 201 starts a process in step ST1, and moves to the process of step ST2 after that.
- the CPU 201 is a case of transmitting a stereoscopic (3D) image and a case where the substream configuration forms a single video stream. Identify. That is, it is identified as a service with one elementary stream (elementary stream). Then, the CPU 201 performs control so that encoded data of all substreams (Substream) proceeds to decoding processing via a common buffer.
- 3D stereoscopic
- FIG. 11B schematically shows an example of the processing flow in the receiver 200 in this case.
- the base video stream whose stream type (Stream type) is “0 ⁇ 1B” includes encoded data of base view image data and encoded data of one non-base view image data. This is an example. Further, this example is an example in the case where the encoded data of each view is decoded by a separate decoder.
- a solid line a indicates the flow of processing of base view image data, and a broken line b indicates the flow of processing of non-base view image data.
- rendering means processing in the scaler and the 3D view display processing unit 219.
- the CPU 201 includes the MVC extension descriptor in the descriptor portion of the video elementary loop (second ES loop) corresponding to the extended video stream under the PMT.
- the CPU 201 identifies that it is a case where a stereoscopic (3D) image is transmitted and the substream configuration includes a plurality of streams. To do. That is, it is identified as a service with a plurality of elementary streams (elementary streams). Then, the CPU 201 performs control so that the buffer management of the encoded data is performed for each substream (Substream) and the process proceeds to the decoding process.
- a stereoscopic (3D) image is transmitted and the substream configuration includes a plurality of streams. To do. That is, it is identified as a service with a plurality of elementary streams (elementary streams).
- the CPU 201 performs control so that the buffer management of the encoded data is performed for each substream (Substream) and the process proceeds to the decoding process.
- FIG. 11C schematically shows an example of the processing flow in the receiver 200 in this case.
- the base video stream including the encoded data of the base view image data whose stream type (Stream type) is “0 ⁇ 1B” and the non-base whose stream type (Stream type) is “0 ⁇ 20”
- a solid line a indicates the flow of processing of base view image data
- a broken line b indicates the flow of processing of non-base view image data.
- rendering means processing in the scaler and the 3D view display processing unit 219.
- FIG. 11A schematically shows an example of the flow of processing in the receiver 200 in this case.
- a solid line a indicates the flow of processing of two-dimensional image data. Note that rendering means processing in the scaler and the 3D view display processing unit 219.
- the video elementary loop descriptor corresponding to the base video stream under the PMT is used.
- MVC extension descriptor is inserted.
- the substream configuration is composed of a plurality of streams
- the MVC extension descriptor is inserted into the descriptor portion of the video elementary loop corresponding to the extended video stream under the PMT.
- the configuration, decoding, and display mode of the buffer memory at the time of decoding can be accurately determined before decoding, and image data can be acquired satisfactorily.
- the SVC stream includes a video elementary stream of the image data of the lowest layer constituting the scalable encoded image data. Further, the SVC stream includes video elementary streams of a predetermined number of upper layer image data other than the lowest layer constituting the scalable encoded image data.
- the first image data is the image data of the lowest hierarchy constituting the scalable encoded image data
- the second image data is a hierarchy other than the lowest hierarchy constituting the scalable encoded image data. It becomes image data.
- the case where the substream configuration forms a single video stream see FIG. 4A
- the case where the substream configuration includes a plurality of streams See FIG. 4B).
- the video stream obtained by encoding the image data of the lowest layer and the other layers as one picture is transmitted as the base video stream of SVC.
- the SVC extension descriptor is inserted into the descriptor portion of the video elementary loop corresponding to the base video stream under the PMT.
- the receiving side is a case where the SVC stream is transmitted and the substream configuration forms a single video stream. That is, on the receiving side, it can be seen that the transport stream TS has a base video stream obtained by encoding image data of the lowest layer and other layers as one picture.
- an elementary video stream obtained by encoding the lowest layer image data as one picture is transmitted as an SVC base video stream.
- An elementary video stream obtained by encoding image data of each layer other than the lowest layer as one picture is transmitted as an extended video stream.
- the SVC extension descriptor is inserted into the descriptor portion of the video elementary loop corresponding to the extended video stream under the PMT.
- the receiving side is a case where the SVC stream is transmitted and the substream configuration is composed of a plurality of streams. That is, on the receiving side, it can be seen that the transport stream TS has a base video stream including image data of the lowest layer and an extended video stream including image data of each layer other than the lowest layer. .
- FIG. 12 shows a structural example (Syntax) of the SVC extension descriptor.
- “View order index_start” indicates the number of the lowest layer
- “view order index_end” indicates the number of the highest layer, and the number of the entire layers can be known from these pieces of information.
- “dependency_id” indicates what level the hierarchy corresponding to this descriptor is.
- FIG. 13 shows a configuration example (Syntax) of the NAL unit header (NAL unit header SVC extension).
- the field of “dependency_id” indicates what level the corresponding hierarchy is. That is, on the receiving side, at the time of decoding, based on the field information of “dependency_id”, it is possible to recognize which level of image data each encoded data is.
- FIG. 14 shows a configuration example of the receiver 200A that handles the above-described SVC stream.
- parts corresponding to those in FIG. 9 described above are denoted by the same reference numerals, and detailed description thereof is omitted as appropriate.
- the receiver 200A receives the transport stream TS transmitted from the broadcasting station 100 on a broadcast wave.
- the transport stream TS includes an AVC (2D) video elementary stream during normal image transmission.
- the transport stream TS includes only the SVC base video stream or a predetermined number of extended video streams together with the SVC stream when transmitting the SVC stream.
- the 200 A of receivers process the video stream which this transport stream TS has based on the presence and insertion position of the specific information in the layer of the transport stream TS. That is, the configuration, decoding, and display mode of the buffer memory at the time of decoding are determined.
- the receiver 200A obtains image data for displaying a normal image, or image data of the lowest layer and its upper layer, and performs normal image display or high-quality image display.
- the receiver 200A determines whether the SVC extension descriptor exists in the descriptor part of the video elementary loop (first ES loop) corresponding to the base video stream under the PMT. Then, when the descriptor is present in the first ES loop, the receiver 200A is at the time of transmitting the SVC stream, and the base video stream includes the image data of each layer of the lowest layer and the upper layer. Recognize that In this case, the receiver 200A decodes the base video stream included in the transport stream TS, acquires image data of each layer for performing high-quality image display, and performs high-quality image display.
- the receiver 200A determines whether or not the extended video stream is included in the transport stream TS.
- the receiver 200A includes an SVC extension descriptor in the descriptor portion of the video elementary loop (second ES loop) corresponding to the extended video stream under the PMT. Determine if it exists.
- the receiver 200A when the descriptor is present in the second ES loop, the receiver 200A is at the time of transmission of the SVC stream, and the extended video stream and the base video stream are transmitted from the lowest layer and the upper layers. Recognize that it contains image data. In this case, the receiver 200A decodes a plurality of video streams included in the transport stream TS, acquires image data of each layer for performing high-quality image display, and performs high-quality image display.
- the receiver 200A recognizes that it is a normal image transmission time when the extended video stream is not included in the transport stream TS or when the SVC extension descriptor does not exist in the second ES loop. In this case, the receiver 200A decodes the video stream included in the transport stream TS, acquires normal image data, and performs normal image display.
- the SVC extension descriptor is extracted from the transport stream TS and sent to the CPU 201. Based on the presence and insertion position of the SVC extension descriptor, the CPU 201 manages the coded buffer 215 and the operation of the video decoder 216 in a state corresponding to normal image transmission or SVC stream transmission. It is controlled to become.
- One or more video elementary streams extracted by the demultiplexer 214 are supplied to the coded buffer 215 and temporarily stored.
- the video decoder 216 the video elementary stream stored in the coded buffer 215 is decoded to acquire image data.
- the video decoder 216 performs decoding processing on the AVC video elementary stream by one decoder to obtain image data for displaying a normal image.
- the decoding process is performed as follows, and a plurality of hierarchies for high-quality image display are performed. Image data is acquired. That is, after switching the packet to be processed from the buffer 215 to the decoder 216 with the dependency_id of NAL unit header for the SVC base video stream including the encoded data of the image data of multiple layers, The decoder 216 performs the decoding process.
- the decoding process is performed as follows, and a plurality of hierarchies for high-quality image display are performed.
- Image data is acquired. That is, the data stored in the buffer 215 is switched by the dependency_id in the NAL unit header of the NAL unit packet received from the demultiplexer 214. Thereafter, the reading of the compressed data from the buffer 215 and the processing up to the decoder 216 are performed in the same manner as the single stream decoding. In this way, for each of the SVC base video stream including the encoded data of the lowest layer image data and the predetermined number of SVC extended video streams including the encoded data of the image data of the upper layer, respectively. Decoding processing is performed by a corresponding decoder.
- the high image quality processing unit 233 performs the following processing when normal image transmission is performed and normal image display is performed. That is, for example, the bitmap data of graphics output from the graphics shifter 229 is superimposed on the scaled image data input through the scaler 218-1 and output to the display.
- the image quality improvement processing unit 233 performs the following processing when the SVC stream is transmitted and high quality image display is performed. That is, for example, image data for high-quality image display is generated from the scaled image data input through the scalers 218-1 to 218-N, and the shift processing output from the graphics shifter 229 is performed. Graphics bitmap data is superimposed and output to the display.
- the case where the substream configuration includes a single video stream and the case where the substream configuration includes a plurality of streams are determined on the reception side. It is possible to reliably and easily identify before decoding. Therefore, on the receiving side, the configuration, decoding, and display mode of the buffer memory at the time of decoding can be accurately determined before decoding, and image data can be acquired satisfactorily.
- the transport stream TS is distributed over a broadcast wave.
- the present technology also applies to a case where the transport stream TS is distributed through a network such as the Internet. Applicable.
- the present technology can also be applied to Internet distribution in a container file format other than the transport stream TS.
- this technique can also take the following structures.
- An image data transmission apparatus comprising: an information insertion unit that inserts specific information at an arrangement position of information related to the base video stream in the container layer.
- the image data transmitting device according to (1) wherein the specific information is a descriptor having information on the first image data and the predetermined number of second image data.
- the container is a transport stream, The information insertion part The image data transmitting apparatus according to (2), wherein the descriptor is inserted into a descriptor portion of a video elementary loop corresponding to the base video stream under the program map table.
- the first image data is image data of a base view for displaying a stereoscopic image
- the second image data is image data of a view other than the base view for displaying the stereoscopic image
- the first image data is image data of the lowest hierarchy constituting the scalable encoded image data
- the second image data is image data of a layer other than the lowest layer constituting the scalable encoded image data
- a container of a predetermined format having a base video stream including first image data and a predetermined number of second image data related to the first image data is transmitted.
- a transmitter to An image data transmitting apparatus comprising: an information insertion unit that inserts specific information at an arrangement position of information associated with each of the predetermined number of extended video streams in the container layer.
- the image data transmitting device according to (7), wherein the specific information is a descriptor having information on the first image data and the predetermined number of second image data.
- the container is a transport stream, The information insertion part The image data transmitting apparatus according to (8), wherein the descriptor is inserted into a descriptor portion of a video elementary loop corresponding to each of the predetermined number of extended video streams under the program map table.
- the first image data is image data of a base view for displaying a stereoscopic image
- the second image data is image data of a view other than the base view for displaying the stereoscopic image
- the image data transmitting apparatus according to (8) or (9), wherein the specific information is an MVC extension descriptor having information on each view.
- the first image data is image data of the lowest hierarchy constituting the scalable encoded image data
- the second image data is image data of a layer other than the lowest layer constituting the scalable encoded image data
- the image data transmitting apparatus according to (8) or (9), wherein the specific information is an SVC extension descriptor having image data information of each layer.
- a container having a predetermined format including a base video stream including first image data and a predetermined number of extended video streams each including a predetermined number of second image data related to the first image data is transmitted.
- specific information is inserted into arrangement positions of information respectively associated with the predetermined number of extended video streams in the container layer.
- An image data receiving apparatus comprising: a processing unit that processes a video stream included in the container based on the presence and insertion position of specific information in the container layer and acquires a predetermined number of image data associated with each other.
- the processing unit When the specific information is inserted at an arrangement position of information related to the base video stream included in the container in the container layer, the base video stream is processed to obtain the predetermined number of image data.
- the image data receiving device according to (13).
- the processing unit When the specific information is inserted at an arrangement position of information related to the extended video stream included in the container of the container layer, the extended video stream and the base video stream included in the container are processed to perform the predetermined The image data receiving device according to (13) or (14), wherein a plurality of pieces of image data are acquired. (16) The image data receiving device according to any one of (13) to (15), wherein the predetermined number of image data constitutes image data for displaying a stereoscopic image or scalable encoded data image data.
- An image data receiving method comprising: processing a video stream included in the container based on the presence and insertion position of specific information in a layer of the container to obtain a predetermined number of image data associated with each other.
- the main feature of this technology is that the MVC extension descriptor is inserted into the descriptor part of the video elementary loop corresponding to the base video stream or extended video stream of the MVC under the PMT, so that the substream configuration is simple.
- the case where a single video stream is configured and the case where a substream configuration is composed of a plurality of streams can be reliably and easily identified on the receiving side before decoding (FIGS. 5, 7, and 8). reference).
- DESCRIPTION OF SYMBOLS 10 ... Image transmission / reception system 100 ... Broadcasting station 110 ... Transmission data generation part 111 ... Data extraction part 111a ... Data recording medium 112 ... Video encoder 113 ... Parallax encoder 114 ... Audio encoder 115 ... Graphics generator 116 ... Graphics encoder 117 ... Multiplexer 200, 200A ... Receiver 201 ... CPU 213 ... Container buffer 214 ... Demultiplexer 215 ... Coded buffer 216 ... Video decoder 217-1 to 217-N ... Substream buffer 218-1 to 218-N ... Scaler 219 .. 3D view display processing unit 221: Coded buffer 222 ...
- Parallax decoder 223 ... Video decoder 224 ... Parallax information converter 225 ... Coded buffer 226 ... Graphics decoder 227 ... Pixel Buffer 228 ... Scaler 229 ... Graphics shifter 230 ... Coded buffer 231 ... Audio decoder 232 ... Channel mixing unit 233 ... High image quality processing unit
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
第1の画像データと該第1の画像データに関連した所定数の第2の画像データを含むベースビデオストリームを有する所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記ベースビデオストリームに関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置にある。
第1の画像データを含むベースビデオストリームと上記第1の画像データに関連した所定数の第2の画像データのそれぞれを含む所定数の拡張ビデオストリームとを含む所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記所定数の拡張ビデオストリームにそれぞれ関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置にある。
所定フォーマットのコンテナを受信する受信部と、
上記コンテナのレイヤにおける特定の情報の存在および挿入位置に基づいて、上記コンテナが有するビデオストリームを処理して、互いに関連した所定数の画像データを取得する処理部とを備える
画像データ受信装置にある。
1.実施の形態
2.変形例
[画像送受信システム]
図1は、実施の形態としての画像送受信システム10の構成例を示している。この画像送受信システム10は、放送局100および受信機200により構成されている。放送局100は、コンテナとしてのトランスポートストリームTSを放送波に載せて送信する。
図3は、放送局100において、上述したトランスポートストリームを生成する送信データ生成部110の構成例を示している。この送信データ生成部110は、データ取り出し部(アーカイブ部)111と、ビデオエンコーダ112と、視差エンコーダ113と、オーディオエンコーダ114を有している。また、この送信データ生成部110は、グラフィクス発生部115と、グラフィクスエンコーダ116と、マルチプレクサ117を有している。
図9は、受信機200の構成例を示している。この受信機200は、CPU201と、フラッシュROM202と、DRAM203と、内部バス204と、リモコン受信部205と、リモコン送信機206を有している。また、この受信機200は、コンテナバッファ213と、デマルチプレクサ214と、コーデッドバッファ215と、ビデオデコーダ216と、サブストリームビデオバッファ217-1,・・・,217-Nと、スケーラ218-1,・・・,218-Nと、3Dビュー表示処理部219を有している。
なお、上述実施の形態においては、本技術をMVCストリームに適用した例を示した。すなわち、第1の画像データが立体(3D)画像表示のためのベースビューの画像データであり、第2の画像データが立体(3D)画像表示のためのノンベースビューの画像データである例を示した。
(1)第1の画像データと該第1の画像データに関連した所定数の第2の画像データを含むベースビデオストリームを有する所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記ベースビデオストリームに関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置。
(2)上記特定の情報は、上記第1の画像データおよび上記所定数の第2の画像データの情報を持つデスクリプタである
前記(1)に記載の画像データ送信装置。
(3)上記コンテナは、トランスポートストリームであり、
上記情報挿入部は、
上記デスクリプタを、プログラム・マップ・テーブルの配下の上記ベースビデオストリームに対応したビデオ・エレメンタリ・ループのデスクリプタ部分に挿入する
前記(2)に記載の画像データ送信装置。
(4)上記第1の画像データは、立体画像表示のためのベースビューの画像データであり、
上記第2の画像データは、上記立体画像表示のための上記ベースビュー以外のビューの画像データであり、
上記デスクリプタは、上記各ビューの情報を持つMVC・エクテンション・デスクリプタである
前記(2)または(3)に記載の画像データ送信装置。
(5)上記第1の画像データは、スケーラブル符号化画像データを構成する最下位階層の画像データであり、
上記第2の画像データは、上記スケーラブル符号化画像データを構成する上記最下位階層以外の階層の画像データであり、
上記デスクリプタは、上記各階層の画像データの情報を持つSVC・エクステンション・デスクリプタである
前記(2)または(3)に記載の画像データ送信装置。
(6)第1の画像データと該第1の画像データに関連した所定数の第2の画像データを含むベースビデオストリームを有する所定フォーマットのコンテナを送信する際に、上記コンテナのレイヤの上記ベースビデオストリームに関連した情報の配置位置に特定の情報を挿入する
画像データ送信方法。
(7)第1の画像データを含むベースビデオストリームと上記第1の画像データに関連した所定数の第2の画像データのそれぞれを含む所定数の拡張ビデオストリームとを含む所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記所定数の拡張ビデオストリームにそれぞれ関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置。
(8)上記特定の情報は、上記第1の画像データおよび上記所定数の第2の画像データの情報を持つデスクリプタである
前記(7)に記載の画像データ送信装置。
(9)上記コンテナは、トランスポートストリームであり、
上記情報挿入部は、
上記デスクリプタを、プログラム・マップ・テーブルの配下の上記所定数の拡張ビデオストリームにそれぞれ対応したビデオ・エレメンタリ・ループのデスクリプタ部分に挿入する
前記(8)に記載の画像データ送信装置。
(10)上記第1の画像データは、立体画像表示のためのベースビューの画像データであり、
上記第2の画像データは、上記立体画像表示のための上記ベースビュー以外のビューの画像データであり、
上記特定の情報は、上記各ビューの情報を持つMVC・エクテンション・デスクリプタである
前記(8)または(9)に記載の画像データ送信装置。
(11)上記第1の画像データは、スケーラブル符号化画像データを構成する最下位階層の画像データであり、
上記第2の画像データは、上記スケーラブル符号化画像データを構成する上記最下位階層以外の階層の画像データであり、
上記特定の情報は、上記各階層の画像データの情報を持つSVC・エクステンション・デスクリプタである
前記(8)または(9)に記載の画像データ送信装置。
(12)第1の画像データを含むベースビデオストリームと上記第1の画像データに関連した所定数の第2の画像データのそれぞれを含む所定数の拡張ビデオストリームとを含む所定フォーマットのコンテナを送信する際に、上記コンテナのレイヤの上記所定数の拡張ビデオストリームにそれぞれ関連した情報の配置位置に特定の情報を挿入する
画像データ送信方法。
(13)所定フォーマットのコンテナを受信する受信部と、
上記コンテナのレイヤにおける特定の情報の存在および挿入位置に基づいて、上記コンテナが有するビデオストリームを処理して、互いに関連した所定数の画像データを取得する処理部とを備える
画像データ受信装置。
(14)上記処理部は、
上記コンテナのレイヤの、該コンテナに含まれるベースビデオストリームに関連した情報の配置位置に上記特定の情報の挿入があるとき、該ベースビデオストリームを処理して上記所定数の画像データを取得する
前記(13)に記載の画像データ受信装置。
(15)上記処理部は、
上記コンテナのレイヤの該コンテナに含まれる拡張ビデオストリームに関連した情報の配置位置に上記特定の情報の挿入があるとき、該拡張ビデオストリームおよび上記コンテナに含まれるベースビデオストリームを処理して上記所定数の画像データを取得する
前記(13)または(14)に記載の画像データ受信装置。
(16)上記所定数の画像データは、立体画像表示のための画像データ、またはスケーラブル符号化データ画像データを構成する
前記(13)から(15)のいずれかに記載の画像データ受信装置。
(17)所定フォーマットのコンテナを受信するステップと、
上記コンテナのレイヤにおける特定の情報の存在および挿入位置に基づいて、上記コンテナが有するビデオストリームを処理して、互いに関連した所定数の画像データを取得するステップとを備える
画像データ受信方法。
100・・・放送局
110・・・送信データ生成部
111・・・データ取り出し部
111a・・・データ記録媒体
112・・・ビデオエンコーダ
113・・・視差エンコーダ
114・・・オーディオエンコーダ
115・・・グラフィクス発生部
116・・・グラフィクスエンコーダ
117・・・マルチプレクサ
200,200A・・・受信機
201・・・CPU
213・・・コンテナバッファ
214・・・デマルチプレクサ
215・・・コーデッドバッファ
216・・・ビデオデコーダ
217-1~217-N・・・サブストリームバッファ
218-1~218-N・・・スケーラ
219・・・3Dビュー表示処理部
221・・・コーデッドバッファ
222・・・視差デコーダ
223・・・ビデオデコーダ
224・・・視差情報変換部
225・・・コーデッドバッファ
226・・・グラフィクスデコーダ
227・・・ピクセルバッファ
228・・・スケーラ
229・・・グラフィクスシフタ
230・・・コーデッドバッファ
231・・・オーディオデコーダ
232・・・チャネルミキシング部
233・・・高画質化処理部
Claims (17)
- 第1の画像データと該第1の画像データに関連した所定数の第2の画像データを含むベースビデオストリームを有する所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記ベースビデオストリームに関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置。 - 上記特定の情報は、上記第1の画像データおよび上記所定数の第2の画像データの情報を持つデスクリプタである
請求項1に記載の画像データ送信装置。 - 上記コンテナは、トランスポートストリームであり、
上記情報挿入部は、
上記デスクリプタを、プログラム・マップ・テーブルの配下の上記ベースビデオストリームに対応したビデオ・エレメンタリ・ループのデスクリプタ部分に挿入する
請求項2に記載の画像データ送信装置。 - 上記第1の画像データは、立体画像表示のためのベースビューの画像データであり、
上記第2の画像データは、上記立体画像表示のための上記ベースビュー以外のビューの画像データであり、
上記デスクリプタは、上記各ビューの情報を持つMVC・エクテンション・デスクリプタである
請求項2に記載の画像データ送信装置。 - 上記第1の画像データは、スケーラブル符号化画像データを構成する最下位階層の画像データであり、
上記第2の画像データは、上記スケーラブル符号化画像データを構成する上記最下位階層以外の階層の画像データであり、
上記デスクリプタは、上記各階層の画像データの情報を持つSVC・エクステンション・デスクリプタである
請求項2に記載の画像データ送信装置。 - 第1の画像データと該第1の画像データに関連した所定数の第2の画像データを含むベースビデオストリームを有する所定フォーマットのコンテナを送信する際に、上記コンテナのレイヤの上記ベースビデオストリームに関連した情報の配置位置に特定の情報を挿入する
画像データ送信方法。 - 第1の画像データを含むベースビデオストリームと上記第1の画像データに関連した所定数の第2の画像データのそれぞれを含む所定数の拡張ビデオストリームとを含む所定フォーマットのコンテナを送信する送信部と、
上記コンテナのレイヤの上記所定数の拡張ビデオストリームにそれぞれ関連した情報の配置位置に特定の情報を挿入する情報挿入部とを備える
画像データ送信装置。 - 上記特定の情報は、上記第1の画像データおよび上記所定数の第2の画像データの情報を持つデスクリプタである
請求項7に記載の画像データ送信装置。 - 上記コンテナは、トランスポートストリームであり、
上記情報挿入部は、
上記デスクリプタを、プログラム・マップ・テーブルの配下の上記所定数の拡張ビデオストリームにそれぞれ対応したビデオ・エレメンタリ・ループのデスクリプタ部分に挿入する
請求項8に記載の画像データ送信装置。 - 上記第1の画像データは、立体画像表示のためのベースビューの画像データであり、
上記第2の画像データは、上記立体画像表示のための上記ベースビュー以外のビューの画像データであり、
上記特定の情報は、上記各ビューの情報を持つMVC・エクテンション・デスクリプタである
請求項8に記載の画像データ送信装置。 - 上記第1の画像データは、スケーラブル符号化画像データを構成する最下位階層の画像データであり、
上記第2の画像データは、上記スケーラブル符号化画像データを構成する上記最下位階層以外の階層の画像データであり、
上記特定の情報は、上記各階層の画像データの情報を持つSVC・エクステンション・デスクリプタである
請求項8に記載の画像データ送信装置。 - 第1の画像データを含むベースビデオストリームと上記第1の画像データに関連した所定数の第2の画像データのそれぞれを含む所定数の拡張ビデオストリームとを含む所定フォーマットのコンテナを送信する際に、上記コンテナのレイヤの上記所定数の拡張ビデオストリームにそれぞれ関連した情報の配置位置に特定の情報を挿入する
画像データ送信方法。 - 所定フォーマットのコンテナを受信する受信部と、
上記コンテナのレイヤにおける特定の情報の存在および挿入位置に基づいて、上記コンテナが有するビデオストリームを処理して、互いに関連した所定数の画像データを取得する処理部とを備える
画像データ受信装置。 - 上記処理部は、
上記コンテナのレイヤの、該コンテナに含まれるベースビデオストリームに関連した情報の配置位置に上記特定の情報の挿入があるとき、該ベースビデオストリームを処理して上記所定数の画像データを取得する
請求項13に記載の画像データ受信装置。 - 上記処理部は、
上記コンテナのレイヤの該コンテナに含まれる拡張ビデオストリームに関連した情報の配置位置に上記特定の情報の挿入があるとき、該拡張ビデオストリームおよび上記コンテナに含まれるベースビデオストリームを処理して上記所定数の画像データを取得する
請求項13に記載の画像データ受信装置。 - 上記所定数の画像データは、立体画像表示のための画像データ、またはスケーラブル符号化データ画像データを構成する
請求項13に記載の画像データ受信装置。 - 所定フォーマットのコンテナを受信するステップと、
上記コンテナのレイヤにおける特定の情報の存在および挿入位置に基づいて、上記コンテナが有するビデオストリームを処理して、互いに関連した所定数の画像データを取得するステップとを備える
画像データ受信方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13782073.4A EP2725804A4 (en) | 2012-04-24 | 2013-03-15 | IMAGE DATA TRANSMISSION DEVICE, IMAGE DATA TRANSMISSION METHOD, IMAGE DATA RECEIVING DEVICE, AND IMAGE DATA RECEIVING METHOD |
US14/126,995 US20140111612A1 (en) | 2012-04-24 | 2013-03-15 | Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, and image data receiving method |
CN201380001729.4A CN103621075A (zh) | 2012-04-24 | 2013-03-15 | 图像数据发送装置、图像数据发送方法、图像数据接收装置和图像数据接收方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012-099316 | 2012-04-24 | ||
JP2012099316 | 2012-04-24 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013161442A1 true WO2013161442A1 (ja) | 2013-10-31 |
Family
ID=49482779
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/057559 WO2013161442A1 (ja) | 2012-04-24 | 2013-03-15 | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20140111612A1 (ja) |
EP (1) | EP2725804A4 (ja) |
JP (1) | JPWO2013161442A1 (ja) |
CN (1) | CN103621075A (ja) |
WO (1) | WO2013161442A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2688668C2 (ru) * | 2014-04-14 | 2019-05-22 | Сони Корпорейшн | Передающее устройство, способ передачи, приёмное устройство и способ приёма |
JP2021093772A (ja) * | 2014-08-07 | 2021-06-17 | ソニーグループ株式会社 | 送信方法および送信装置 |
JP2021101566A (ja) * | 2014-07-31 | 2021-07-08 | ソニーグループ株式会社 | 送信方法および送信装置 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016035731A1 (ja) * | 2014-09-04 | 2016-03-10 | ソニー株式会社 | 送信装置、送信方法、受信装置および受信方法 |
KR102643537B1 (ko) * | 2014-09-12 | 2024-03-06 | 소니그룹주식회사 | 송신 장치, 송신 방법, 수신 장치 및 수신 방법 |
KR102423610B1 (ko) * | 2015-02-27 | 2022-07-22 | 소니그룹주식회사 | 송신 장치, 송신 방법, 수신 장치 및 수신 방법 |
CN107925767A (zh) * | 2015-09-10 | 2018-04-17 | 索尼公司 | 发送设备、发送方法,接收设备和接收方法 |
WO2020255799A1 (ja) * | 2019-06-18 | 2020-12-24 | ソニーセミコンダクタソリューションズ株式会社 | 送信装置、受信装置、および通信システム |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005006114A (ja) * | 2003-06-12 | 2005-01-06 | Sharp Corp | 放送データ送信装置、放送データ送信方法および放送データ受信装置 |
JP2011234336A (ja) * | 2010-04-06 | 2011-11-17 | Sony Corp | 画像データ送信装置、画像データ送信方法および画像データ受信装置 |
WO2012020555A1 (ja) * | 2010-08-09 | 2012-02-16 | パナソニック株式会社 | 画像符号化方法、画像復号方法、画像符号化装置および画像復号装置 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101372376B1 (ko) * | 2009-07-07 | 2014-03-14 | 경희대학교 산학협력단 | 디지털 방송 시스템의 스테레오스코픽 비디오 수신 방법 |
JP2013126048A (ja) * | 2011-12-13 | 2013-06-24 | Sony Corp | 送信装置、送信方法、受信装置および受信方法 |
CN103416069A (zh) * | 2012-01-13 | 2013-11-27 | 索尼公司 | 发送设备、发送方法、接收设备以及接收方法 |
-
2013
- 2013-03-15 WO PCT/JP2013/057559 patent/WO2013161442A1/ja active Application Filing
- 2013-03-15 JP JP2014512420A patent/JPWO2013161442A1/ja active Pending
- 2013-03-15 CN CN201380001729.4A patent/CN103621075A/zh active Pending
- 2013-03-15 EP EP13782073.4A patent/EP2725804A4/en not_active Withdrawn
- 2013-03-15 US US14/126,995 patent/US20140111612A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005006114A (ja) * | 2003-06-12 | 2005-01-06 | Sharp Corp | 放送データ送信装置、放送データ送信方法および放送データ受信装置 |
JP2011234336A (ja) * | 2010-04-06 | 2011-11-17 | Sony Corp | 画像データ送信装置、画像データ送信方法および画像データ受信装置 |
WO2012020555A1 (ja) * | 2010-08-09 | 2012-02-16 | パナソニック株式会社 | 画像符号化方法、画像復号方法、画像符号化装置および画像復号装置 |
Non-Patent Citations (4)
Title |
---|
"Joint Draft 4.0 on MultiviewVideo Coding, Joint Video Team of ISO/IEC MPEG & ITU-T VCEG", JVT-X209, July 2007 (2007-07-01) |
HEIKO SCHWARZ; DETLEV MARPE; THOMAS WIEGAND: "Overview of the Scalable Video CodingExtension of the H. 264/AVC Standard", IEEETRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, vol. 17, no. 9, September 2007 (2007-09-01), pages 1103 - 1120 |
See also references of EP2725804A4 * |
THOMAS WIEGAND ET AL.: "Draft Errata List withRevision-Marked Corrections for H. 264/AVC", JVT-1050, 2003 |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2688668C2 (ru) * | 2014-04-14 | 2019-05-22 | Сони Корпорейшн | Передающее устройство, способ передачи, приёмное устройство и способ приёма |
JP2021101566A (ja) * | 2014-07-31 | 2021-07-08 | ソニーグループ株式会社 | 送信方法および送信装置 |
JP7147902B2 (ja) | 2014-07-31 | 2022-10-05 | ソニーグループ株式会社 | 送信方法および送信装置 |
JP2022177214A (ja) * | 2014-07-31 | 2022-11-30 | ソニーグループ株式会社 | 送信方法、送信装置、受信装置および受信方法 |
JP7380796B2 (ja) | 2014-07-31 | 2023-11-15 | ソニーグループ株式会社 | 送信方法、送信装置、受信装置および受信方法 |
JP2021093772A (ja) * | 2014-08-07 | 2021-06-17 | ソニーグループ株式会社 | 送信方法および送信装置 |
JP7147903B2 (ja) | 2014-08-07 | 2022-10-05 | ソニーグループ株式会社 | 送信方法および送信装置 |
JP7416164B2 (ja) | 2014-08-07 | 2024-01-17 | ソニーグループ株式会社 | 送信方法、送信装置、受信装置および受信方法 |
Also Published As
Publication number | Publication date |
---|---|
EP2725804A1 (en) | 2014-04-30 |
EP2725804A4 (en) | 2015-02-25 |
CN103621075A (zh) | 2014-03-05 |
JPWO2013161442A1 (ja) | 2015-12-24 |
US20140111612A1 (en) | 2014-04-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5594002B2 (ja) | 画像データ送信装置、画像データ送信方法および画像データ受信装置 | |
JP5577823B2 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
WO2013161442A1 (ja) | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 | |
JP6192902B2 (ja) | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 | |
WO2013105401A1 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
US8953019B2 (en) | Method and apparatus for generating stream and method and apparatus for processing stream | |
WO2013073455A1 (ja) | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 | |
WO2012070364A1 (ja) | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 | |
KR102009049B1 (ko) | 송신 장치, 송신 방법, 수신 장치 및 수신 방법 | |
WO2013054775A1 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
JP5928118B2 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
WO2012147596A1 (ja) | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2014512420 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013782073 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14126995 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13782073 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |