WO2011155776A2 - 프래그먼트 기반의 멀티미디어 스트리밍 서비스 제공 방법과 그 장치, 그리고 프래그먼트 기반의 멀티미디어 스트리밍 서비스 수신 방법과 그 장치 - Google Patents
프래그먼트 기반의 멀티미디어 스트리밍 서비스 제공 방법과 그 장치, 그리고 프래그먼트 기반의 멀티미디어 스트리밍 서비스 수신 방법과 그 장치 Download PDFInfo
- Publication number
- WO2011155776A2 WO2011155776A2 PCT/KR2011/004230 KR2011004230W WO2011155776A2 WO 2011155776 A2 WO2011155776 A2 WO 2011155776A2 KR 2011004230 W KR2011004230 W KR 2011004230W WO 2011155776 A2 WO2011155776 A2 WO 2011155776A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- information
- fragment
- current
- stereoscopic
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23614—Multiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/178—Metadata, e.g. disparity information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4348—Demultiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
Definitions
- the present invention relates to the generation and reception of data streams for transmitting multimedia content.
- one multimedia content is composed of a set of elements having different attributes such as audio, video, image, metadata, and the like.
- Such data is encoded and used in a data structure for multimedia content, together with information on the relationship between elements and information for decoding and reproducing each element.
- the international standard organization MPEG Moving Picture Experts Group
- MPEG Motion Picture Experts Group
- auxiliary data such as encoded elements of multimedia content and configuration information related to the elements are stored hierarchically in a plurality of containers.
- ISO-based media file format defines a basic structure for efficiently storing each multimedia element in a single multimedia file.
- the present invention discloses a method and apparatus for providing a multimedia streaming service for transmitting two-dimensional video or three-dimensional video, a method for receiving a multimedia streaming service, and a device thereof.
- a streaming service providing method for transmitting multimedia using a network comprising: dividing encoded data of a video including at least one of two-dimensional video and three-dimensional video by fragment units; Determining attribute information including at least one of three-dimensional signaling information including information for two-dimensional reproduction or three-dimensional reproduction of the current video for each fragment and relationship information for referring to the one or more other videos. ; And continuously transmitting fragments including an auxiliary data area including attribute information about the fragment and a media data area including the encoded video data.
- FIG. 1 is a block diagram of an apparatus for providing a multimedia streaming service, according to an exemplary embodiment.
- FIG. 2 is a block diagram of an apparatus for receiving a multimedia streaming service, according to an exemplary embodiment.
- FIG. 3 illustrates a mfsi box including a streaming file format transmitted in units of fragments and three-dimensional signaling information transmitted for each fragment according to an embodiment.
- FIG. 4 illustrates syntax of 3D signaling information included in an mfsi box and an scdi box according to an embodiment.
- FIG. 5 illustrates an svfi box including a streaming file format transmitted in units of fragments and three-dimensional signaling information transmitted for each fragment according to an embodiment.
- 6 and 7 illustrate syntax of 3D signaling information included in an svfi box according to an embodiment.
- FIG. 8 illustrates syntax of 3D signaling information configured for a file in a streaming file format transmitted in units of fragments, according to an embodiment.
- FIG. 9 illustrates syntax of 3D signaling information configured for a sample in a streaming file format transmitted in units of fragments according to an embodiment.
- FIG. 10 illustrates two streaming file formats for transmitting left view video and right view video of stereoscopic video, respectively, according to one embodiment.
- FIG. 11 illustrates reference information set for stereoscopic video included in a file according to an embodiment.
- FIG. 12 illustrates one relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- FIG. 13 illustrates a plurality of relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- FIG. 14 illustrates syntax of track information including relationship information on a plurality of reference videos when transmitting stereoscopic video in two streaming files according to an embodiment.
- FIG. 15 illustrates the syntax of relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- FIG. 16 illustrates relationship information set by using an index file outside of a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- 17 and 18 illustrate one streaming file format for transmitting left view video and right view video of stereoscopic video, according to one embodiment.
- 19 and 20 illustrate a method of determining a reference video using an index file outside of a file when transmitting stereoscopic video in one streaming file according to an embodiment.
- FIG. 21 illustrates syntax of an afgp box including relationship information of a multichannel video group according to an embodiment, for an adaptive streaming service.
- FIG. 22 illustrates a case of setting relationship information between multichannel video groups according to an embodiment by using an index file external to a file for an adaptive streaming service.
- FIG. 23 is a flowchart of a method of providing a multimedia streaming service, according to an embodiment.
- 24 is a flowchart of a method of receiving a multimedia streaming service according to an embodiment.
- a streaming service providing method for transmitting multimedia using a network comprising: dividing encoded data of a video including at least one of two-dimensional video and three-dimensional video by fragment units; Determining attribute information including at least one of three-dimensional signaling information including information for two-dimensional reproduction or three-dimensional reproduction of the current video for each fragment and relationship information for referring to the one or more other videos. ; And continuously transmitting fragments including an auxiliary data area including attribute information about the fragment and a media data area including the encoded video data.
- a streaming service receiving method for receiving multimedia using a network includes: continuously receiving a plurality of fragments; Extracting encoded data of a video including at least one of two-dimensional video and three-dimensional video in a fragmented form in fragment units from the media data region for each fragment; Parsing attribute information from an auxiliary data area for each of the fragments, and performing at least one of three-dimensional signaling information for two-dimensional or three-dimensional reproduction of a video of the fragment and relationship information for the video to refer to one or more other videos. Extracting and reading; And reconstructing the encoded data of the fragments into a two-dimensional video or a three-dimensional video based on the information read from the attribute information for each of the fragments.
- a streaming service providing apparatus for transmitting multimedia using a network may include: a fragment video data generation unit configured to divide encoded data of a video including at least one of two-dimensional video and three-dimensional video into fragment units; A fragment for determining attribute information including at least one of three-dimensional signaling information including information for two-dimensional reproduction or three-dimensional reproduction of the current video for each fragment and relationship information for referring to the one or more other videos. An attribute information determination unit; And a streaming unit for continuously transmitting fragments including an auxiliary data area including attribute information of the fragment and a media data area including the encoded video data.
- a fragment attribute information extraction unit for extracting and reading; And a reconstruction unit for reconstructing the encoded data of the fragments into a 2D video or a 3D video based on the information read from the attribute information for each of the fragments.
- the present invention includes a computer-readable recording medium having recorded thereon a program for implementing a method for providing a multimedia streaming service according to an embodiment with a computing processor.
- the present invention includes a computer-readable recording medium having recorded thereon a program for implementing a method for receiving a multimedia streaming service according to an embodiment with a computing processor.
- FIG. 1 is a block diagram of an apparatus for providing a multimedia streaming service, according to an exemplary embodiment.
- the apparatus 100 for providing a multimedia streaming service may use two-dimensional video, three-dimensional video, or two-dimensional video and three-dimensional data using a network by using a streaming file format transmitted in units of fragments. While transmitting video data of a mixed video of video, attribute information including at least one of three-dimensional signaling information of the corresponding video data and relation information of a reference relationship between the plurality of videos may be transmitted for each file, fragment, and sample. .
- the apparatus 100 for providing a multimedia streaming service includes a fragment video data generator 110, a fragment attribute information determiner 120, and a streaming unit 130.
- the fragment video data generating unit 110, the fragment attribute information determining unit 120, and the streaming unit 130 may include a central computing device or a processor located inside or outside the multimedia streaming service providing apparatus 100. By control, data can be exchanged and operated organically.
- at least one component of the fragment video data generating unit 110, the fragment attribute information determining unit 120, and the streaming unit 130 may be operated by a processor mounted on its own and may be configured as another component. It can be controlled to work organically with the element.
- the fragment video data generator 110 divides the video data including at least one of two-dimensional video data and three-dimensional video data into fragment video data to transmit the fragment data in fragment units.
- Fragments are packet units for streaming data using a network.
- the fragment is composed of a media data area for transmitting the media data, and an auxiliary data area for transmitting fast-path information such as information on the content of the media data in the media data area and structure-related information.
- streaming data may be transmitted.
- the fragment is composed of an mdat area including media data and a moof area including various attribute information about media data of the mdat area.
- the apparatus 100 for providing a multimedia streaming service may receive compression-coded video data and split the fragment into units of fragments for streaming.
- the multimedia streaming service providing apparatus 100 may receive uncompressed video data, encode the video data using an encoder installed therein, and divide the video data into fragments.
- the fragment attribute information determiner 120 determines three-dimensional signaling information including information for two-dimensional or three-dimensional reproduction of a video for each fragment.
- the fragment attribute information determiner 120 may determine 3D signaling information to be transmitted through an auxiliary data area of the fragment.
- the 3D signaling information includes various pieces of information set according to whether the current video is a 2D video or a 3D video.
- the 3D signaling information may include various pieces of information necessary for the decoder to reconstruct the video to perform 2D or 3D playback.
- 2D video / 3D video related information about the current video may be transmitted for each fragment.
- the fragment attribute information determiner 120 determines relationship information for cross-reference among a plurality of videos including the current video. As the relationship information, reference information and location information about another video currently located in the file may be transmitted. In addition, as the relationship information, location information and index information for referring to one or more other videos located in an external file of the current file may be transmitted.
- the streaming unit 130 may include fragment information including attribute information including at least one of three-dimensional signaling information and relationship information determined by the fragment attribute information determining unit 120 and video data divided into fragments. Send them continuously. As the fragments are continuously transmitted, video data and three-dimensional signaling information or relationship information may be streamed.
- three-dimensional signaling information and relationship information about the video of the current fragment may be transmitted through the auxiliary data region, and encoded video data of the current fragment may be transmitted through the media data region.
- the fragment attribute information determiner 120 may determine 3D configuration information and left / right order information of the current video for each fragment.
- the 3D configuration information represents a form in which the left view image and the right view image compose a stereoscopic image of the current video.
- Left and right order information according to an embodiment indicates a sequence of a left view image and a right view image in the stereoscopic image.
- the fragment attribute information determiner 120 may determine stereo mono interval change count information indicating a change count of a monoscopic video interval and a stereoscopic video interval for the current video for each fragment.
- the fragment may include a monoscopic video section composed of a monoscopic video sequence or a stereoscopic video section composed of a stereoscopic video sequence.
- the fragment may include a mixed video section of the monoscopic video section and the stereoscopic video section.
- the fragment attribute information determiner 120 may determine stereo identification information indicating whether a current section is a monoscopic video section or a stereoscopic video section.
- a sample is a unit of data representing each frame in a series of discontinuous video frames or a section of contiguous compressed audio. That is, in the multimedia streaming service providing apparatus 100 according to an embodiment, a sample of a fragment may be used in a similar term as a video frame.
- the fragment attribute information determiner 120 may determine interval sample number information indicating the number of samples constituting the current interval.
- the fragment attribute information determiner 120 may determine 3D configuration information and left / right order information for samples constituting the current stereoscopic video section for each stereoscopic video section of the current fragment.
- the fragment attribute information determiner 120 may determine at least one of stereoscopic camera information and stereoscopic display information for each stereoscopic video section of the current fragment.
- the stereoscopic camera information includes information on the stereoscopic camera that has obtained samples constituting the current stereoscopic video section.
- the stereoscopic display information according to an embodiment includes information about a display specification for safely three-dimensional reproduction of samples.
- the fragment attribute information determiner 120 may determine information indicating the number of items to which stereoscopic camera display information is applied, in a current stereoscopic video section of the current fragment.
- the fragment attribute information determiner 120 may include at least one of identification information of current stereoscopic camera display information referred to each item and information on a length of a section to which the current stereoscopic camera display information is applied. You can also decide one.
- the information on the length of the section to which the current stereoscopic camera display information is applied may be expressed by the number of samples constituting the current item to which the current stereoscopic camera display information is referred.
- the fragment attribute information determiner 120 may determine 3D signaling information on a file basis.
- the fragment attribute information determiner 120 may determine 3D configuration information and left and right order information with respect to the stereoscopic video of the current file.
- the fragment attribute information determiner 120 may include stereo mono fragment change count information indicating a change count of a mono fragment consisting of a monoscopic video section and a stereo fragment consisting of a stereoscopic video section among the video of the current file. You can decide.
- the streaming unit 130 transmits three-dimensional configuration information, left and right order information, and stereo mono fragment change count information of the current file, and for each fragment of the current file, stereo mono interval change count information and interval sample count. At least one of the information and the stereo identification information may be further transmitted.
- the fragment attribute information determiner 120 may determine identification information on each stereoscopic video section from one or more stereoscopic video sections of the current fragment.
- the fragment attribute information determiner 120 may determine relationship information for referring to a plurality of videos when constructing a cross-reference relationship between a plurality of videos including the current video.
- the relationship information may include index information and location information of the reference video.
- the fragment attribute information determiner 120 may determine the position information of the reference video referenced to configure the stereoscopic video with respect to the video of the current file.
- the location information of the reference video may include at least one of reference video identification information in the current file, remote location information other than the current file, Uniform Resource Locator (URL) information, and Uniform Resource Name (URN) information. Can be determined using.
- URL Uniform Resource Locator
- UPN Uniform Resource Name
- the fragment attribute information determiner 120 may determine the number information of the reference video when the video of the current file refers to the plurality of videos.
- the fragment attribute information determiner 120 may further determine at least one of reference index information for identifying a plurality of reference videos and position information for each reference video.
- the apparatus 100 for providing a multimedia streaming service may provide a differentially encoded video according to video quality in order to safely transmit multimedia content according to a network state.
- the apparatus 100 for providing a multimedia streaming service according to an embodiment may generate a multichannel video group including a plurality of channels by encoding the same video to be differentially encoded according to video quality.
- the fragment attribute information determiner 120 may determine the multichannel number information indicating the number of videos of another channel that can replace the video of the current file. Also, the fragment attribute information determiner 120 according to an embodiment may determine reference information indicating the position of a video of another channel in the multichannel video group.
- FIG. 2 is a block diagram of an apparatus for receiving a multimedia streaming service, according to an exemplary embodiment.
- the multimedia streaming service receiving apparatus 200 receives a fragment of streaming data using a network, and extracts attribute information including at least one of three-dimensional signaling information and relationship information for each file, fragment, and sample.
- the video data can be extracted to reconstruct the two-dimensional video, the three-dimensional video, or the mixed video of the two-dimensional video and the three-dimensional video.
- the multimedia streaming service receiving apparatus 200 includes a receiver 210, a video data extractor 220, a fragment attribute information extractor 230, and a restorer 240.
- the receiver 210, the video data extractor 220, the fragment attribute information extractor 230, and the restorer 240 may perform central operations located inside or outside the multimedia streaming service receiver 200. Controlled by the device or processor, data can be exchanged and operated organically. Alternatively, at least one component of the receiver 210, the video data extractor 220, the fragment attribute information extractor 230, and the reconstructor 240 according to an embodiment may be operated by a processor mounted therein. And may be controlled to work organically with other components.
- the receiver 210 continuously receives a plurality of fragments through network streaming.
- the video data extractor 220 may perform unit-coded encoding of video including at least one of two-dimensional video and three-dimensional video from the media data region for each fragment received by the receiver 210. Extracted in divided form.
- the fragment attribute information extractor 230 parses the attribute information from the auxiliary data area for each fragment received by the receiver 210.
- the fragment attribute information extractor 230 may include information for reproducing a video of a fragment in two or three dimensions from the parsed attribute information, content related characteristics, a data structure, relationship information between a plurality of videos, and the like. The attribute information of can be read.
- the reconstructor 240 decodes the encoded video data of the fragments based on the 3D signaling information or the relationship information read from the attribute information for each fragment in the fragment attribute information extractor 230, Restore to 2D video or 3D video.
- the fragment attribute information extractor 230 may extract at least one of 3D configuration information, left and right order information, and stereo mono interval change count information set for the current video for each fragment.
- the fragment attribute information extractor 230 may read a form in which the left view image and the right view image form a stereoscopic image of the current fragment, from the 3D configuration information of the current fragment.
- the fragment attribute information extractor 230 may read an order of a left view image and a right view image from the stereoscopic image of the current fragment from the left and right order information of the current fragment.
- the fragment attribute information extractor 230 may read the number of change of the monoscopic video section and the stereoscopic video section of the current fragment from the information on the number of change of the stereo mono section of the current fragment.
- the monoscopic video section or the stereoscopic video section of the current fragment may be detected using the number of samples constituting each section.
- the fragment attribute information extractor 230 may extract at least one of stereo identification information and interval sample number information for each fragment.
- the fragment attribute information extractor 230 may read, from the stereo identification information of the current fragment, whether the current section is a monoscopic video section or a stereoscopic video section among the current fragments.
- the fragment attribute information extractor 230 may read the number of samples constituting the current interval from the interval sample number information of the current fragment.
- the fragment attribute information extractor 230 may extract at least one of 3D configuration information and left and right order information for each stereoscopic video section of the current fragment.
- the fragment attribute information extractor 230 may read 3D configuration information of samples constituting the current stereoscopic video section from the 3D configuration information of the current stereoscopic video section of the fragment. .
- the fragment attribute information extractor 230 may read left and right order information of samples constituting the current stereoscopic video section from the left and right order information of the current stereoscopic video section of the fragment.
- the fragment attribute information extractor 230 may extract stereoscopic camera display information for each stereoscopic video section of the current fragment video data.
- the fragment attribute information extractor 230 may include information on the stereoscopic camera that has obtained the samples constituting the current stereoscopic video section from the stereoscopic camera display information of the current stereoscopic video section, and the samples. Can be used to read information about a display specification for safe three-dimensional playback.
- the fragment attribute information extractor 230 may detect an item to which stereoscopic camera display information is applied using the number of samples constituting each item in the stereoscopic video section.
- the fragment attribute information extractor 230 may include information indicating the number of items to which stereoscopic camera display information is applied among the current stereoscopic video sections of the current fragment, and a current stereoscopic camera referenced in each item. At least one of identification information of the display information and information on the length of the section to which the current stereoscopic camera display information is applied may be extracted and read.
- the fragment attribute information extractor 230 may detect an item to which the current stereoscopic camera display information is applied in the current stereoscopic video section by using the extracted information.
- the fragment attribute information extractor 230 may extract at least one of three-dimensional configuration information, left and right order information, and stereo mono fragment change information about the video of the current file.
- the fragment attribute information extracting unit 230 reads a form in which a left view image and a right view image form a stereoscopic image of the current file from the 3D configuration information of the current file, from the video of the current file. can do.
- the fragment attribute information extractor 230 may read an order of a left view image and a right view image constituting a stereoscopic image of the current file from the left and right order information on the video of the current file.
- the fragment attribute information extracting unit 230 may change the stereo fragment including the mono fragment consisting of the monoscopic video interval and the stereoscopic video interval among the video of the current file from the stereo mono fragment change count information of the current file. The number of times can be read.
- the fragment attribute information extractor 230 extracts at least one of three-dimensional configuration information, left and right order information, and stereo mono fragment change information about the video of the current file, and for each fragment of the current file, At least one of stereo mono interval change count information, interval sample count information, and stereo confirmation information about the video of the fragment may be extracted and read.
- the fragment attribute information extractor 230 may extract and read identification information of each stereoscopic video section from one or more stereoscopic video sections of the current fragment video data. Using the identification information on the read stereoscopic video interval, the current stereoscopic video interval may be detected.
- the fragment attribute information extractor 230 may extract and read relationship information indicating a reference relationship between a plurality of videos when the video of the current file refers to one or more videos.
- the fragment attribute information extracting unit 230 may include information about the position of the reference video, reference video identification information, and the current file with respect to another video to be referred to for configuring the stereoscopic video of the current file. At least one of remote location information, URL information, and URN information may be extracted and read.
- the reconstructor 240 may reconstruct the stereoscopic image of the current file by detecting another video referenced by using the read information.
- the fragment attribute information extractor 230 may include information about the number of reference videos from the current file, reference index information for identifying the plurality of reference videos, In addition, at least one of position information of each reference video may be extracted and read.
- the reconstruction unit 240 may selectively reconstruct the video of the current file to a desired form by selectively detecting the referenced video using the read information.
- the multimedia string service receiving apparatus 200 may include multi-channel video including video of a plurality of channels differentially encoded according to video quality in order to safely receive multimedia content according to a network state.
- An adaptive streaming service based on a group may be provided.
- the multimedia string service receiving apparatus 200 according to an exemplary embodiment may selectively receive a video of a predetermined channel according to a network state among videos that are differentiated into a plurality of channels according to video quality.
- the fragment attribute information extractor 230 extracts at least one of multi-channel number information indicating the number of videos of another channel of video of the current file and reference information indicating the position of video of another channel. Can be read.
- the reconstruction unit 240 may reconstruct the video by combining the videos of other channels which are selectively received using the extracted multichannel number information and reference information.
- the apparatus 200 for receiving a multimedia streaming service may reconstruct a 2D video or 3D video reconstructed by the reconstructor 240 based on information read from 3D signaling information or relationship information for each fragment. Can be reproduced in two or three dimensions.
- FIG. 3 illustrates a mfsi box including a streaming file format transmitted in units of fragments and three-dimensional signaling information transmitted for each fragment according to an embodiment.
- the multimedia streaming service transmission apparatus 100 may stream auxiliary data including encoded video data of 2D video or 3D video and various characteristic information about the transmitted video, according to an embodiment.
- a data stream conforming to the file format 300 may be recorded and transmitted.
- the streaming file format 300 includes an ftyp box, a moov box 350, a sidx box, and a plurality of fragments 310, 312, and 314.
- Each fragment 310, 320, 330 is composed of moof boxes 320, 340, 360 and mdat boxes 330, 350, 370.
- encoded video data of stereoscopic content may be included and transmitted.
- the ftyp box includes file type information of a current file according to the streaming file format 300 according to an embodiment.
- the sidx box includes segment index information for searching each segment in the current file.
- the moov box 350 may include temporal and spatial information about the video of the current file, information about a data structure, and the like.
- the moov box 350 of the streaming file format 300 includes an svmi box 360 and a scdi box 370.
- the svmi box 360 includes various information such as stereoscopic visual type information of stereoscopic video, mixed content of 2D and 3D contents, fragment related information, and the like, transmitted through the current file according to the streaming file format 300. can do.
- the fragment related information may include information about the number of fragments, the number of consecutive samples, whether the current sample is stereoscopic data, and the like.
- the scdi box 370 may include a stereoscopic camera related to stereoscopic video transmitted through a current file according to the streaming file format 300, display specifications, and various kinds of information for visual stability.
- the apparatus 100 for providing a multimedia streaming service may divide and transmit encoded data of a current video in fragment units according to the streaming file format 300.
- the mdat boxes 330, 350, and 370 of the fragments 310, 312, and 314 may include video data divided in units of fragments.
- mdat box 330 includes segmented data of two-dimensional video 335
- mdat box 350 contains segmented data of mixed video of two-dimensional video 352 and three-dimensional video 354.
- the mdat box 350 may include segmented data of the mixed video of the 3D video 372 and the 2D video 374.
- the moof box 340 may include three-dimensional signaling information for the current video 352, 354 inserted into the mdat box 340 of the current fragment 312.
- moof box 340 may include mfsi box 380 and scdi box 390.
- the mfsi box 380 and the scdi box 390 may include three-dimensional signaling information about the current video 352 and 354 inserted into the mdat box 340 of the current fragment 312. .
- the multimedia streaming service receiving apparatus 200 receives and parses a data stream according to the streaming file format 300 according to an embodiment, thereby receiving encoded video data of 2D video or 3D video.
- Ancillary data including various characteristic information about the extracted video may be extracted.
- the apparatus 200 for receiving a multimedia streaming service may include three-dimensional signaling information about video from a mfsi box 380 and a scdi box 390 of a data stream according to the streaming file format 300 according to an embodiment. By extracting the two-dimensional video or three-dimensional video can be reconstructed.
- FIG. 4 illustrates syntax of 3D signaling information included in an mfsi box and an scdi box according to an embodiment.
- the mfsi box may include stereoscopic visual type information as 3D signaling information about a video inserted into a current fragment.
- the stereoscopic visual type information may include 3D configuration information 'stereoscopic_composition_type', left and right order information 'is_left_first', and stereo mono section change count information 'stereo_mono_change_count' with respect to the video of the current fragment.
- 3D configuration information 'stereoscopic_composition_type' represents a form in which a left view image and a right view image form a stereoscopic image in a video of a current fragment.
- a stereoscopic image type identified by three-dimensional configuration information of a stereoscopic image may include a side-by-side in which a left view image and a right view image are arranged left and right within a single stereoscopic image.
- side type, top-and-bottom type arranged vertically, field (frame) sequential type in which left view images and right view images are transmitted one by one, and left view images
- Left and right order information 'is_left_first' indicates an order in which a left view image and a right view image are arranged in the stereoscopic image of the current fragment. For example, using left-right order information 'is_left_first', the left-right image and the right-view image or the right-view image and the left-view image are arranged in the left / right area inside the stereoscopic image that is the side-by-side type. Whether the left view image and the right view image or the right view image and the left view image are arranged in the top / bottom area inside the stereoscopic image of the top and bottom type.
- the stereo mono interval change count information 'stereo_mono_change_count' includes a monoscopic video interval and a stereoscopic video interval when the current fragment includes a video composed of consecutive sections of a monoscopic video section or a stereoscopic video section. It can represent the number of changes of.
- stereo confirmation information 'stereo_flag' indicating whether it is monoscopic video or stereoscopic video may be transmitted.
- the stereoscopic visual type information may include stereo identification information 'stereo_flag' for indicating whether the video segment of the current fragment is a monoscopic video section or a stereoscopic video section.
- the stereoscopic visual type information may include interval sample number information 'sample_count' indicating the number of samples constituting the current interval for each video interval of the current fragment.
- the stereoscopic visual type information may include three-dimensional configuration information 'stereoscopic_composition_type' information for the stereoscopic video section among the current fragments and left and right order information 'is_left_first'.
- three-dimensional configuration information on the form in which the left view image and the right view image constitute a stereoscopic image for each stereoscopic video section among the current fragments, and left and right order information on the order in which the left view image and the right view image are arranged. Can be transmitted.
- a scdi box including at least one of stereoscopic camera information and stereoscopic display information may be transmitted for each stereoscopic video section of the current fragment.
- the scdi box according to an embodiment may be included in the mfsi box according to an embodiment and transmitted. As illustrated in FIG. 3, the mfsi box 380 and the scdi box 390 for the current fragment video data may be transmitted.
- the stereoscopic visual type information may include 'scdi_item_count' information on a stereoscopic video interval in the current fragment.
- the 'scdi_item_count' information may indicate the number of items to which the stereoscopic camera display information is applied.
- an item to which stereoscopic camera display information is applied refers to a section including 3D video data.
- the 'scdi_item_count' information may indicate the number of items or samples that are 3D video data sections included in the current fragment.
- the scdi box may include identification information 'scdi_ID' of current stereoscopic camera display information.
- the stereoscopic camera display information may include stereoscopic camera display information of the scdi box 370 of the moov box 350, or stereoscopic camera display information of other scdi boxes of the moof boxes 320, 340, and 360. Since reference may be made, the scdi box to be referred to may be searched using 'scdi_ID'.
- 'scdi_ID' information and 'scdi_duration' information may be transmitted.
- the 'scdi_duration' information may indicate a length of an item or a sample to which current stereoscopic camera display information is applied. Accordingly, current stereoscopic camera display information on the current fragment may be transmitted in units of items or samples constituting the stereoscopic video section.
- video including monoscopic video or stereoscopic video is transmitted and received in units of fragments. For each fragment, 3D signaling information of a video may be transmitted and received.
- stereoscopic video section in the fragment information indicating the number of samples constituting each section may be transmitted and received.
- stereoscopic camera display information about the video of the fragment may be transmitted in units of items or samples.
- FIG. 5 illustrates an svfi box including a streaming file format transmitted in units of fragments and three-dimensional signaling information transmitted for each fragment according to an embodiment.
- the multimedia streaming service transmission apparatus 100 may include auxiliary data including encoded video data of two-dimensional or three-dimensional video and various characteristic information about the transmitted video, and the streaming file according to one embodiment.
- the data stream according to the format 500 may be recorded and transmitted.
- the streaming file format 500 may include a plurality of fragments 501 and 502 including a ftyp box and a moov box 510, and a moof box 520 and 540 and a mdat box 530 and 550. It consists of an mfra box.
- the trak box included in the moov box 510 includes information for searching for one track among presentations.
- a presentation refers to one or more motion sequences that can be combined with audio
- a track refers to a set of interrelated samples, for example an image sequence in video.
- the tkhd box included in the trak box is a track header including all information about the current track, and the mdia box includes declaration information about the media of the current track.
- the minf box included in the mdia box includes all objects that declare characteristic information about the current media, and the stbl box includes indexing information such as time, data, and location of a sample for retrieving samples of the current track.
- the svmi box of the stbl box may contain information about stereoscopic video for the current media of the current track.
- the mvex box included in the moov box 510 includes information indicating that the fragment of the video is transmitted through the current file.
- the trex box included in the mvex box contains default information related to the samples used in the fragments 501 and 502.
- Coded data of monoscopic video, stereoscopic video, or mixed video may be transmitted through the mdat boxes 530, 550 of the fragments 501, 502.
- the mfhd box included in moof boxes 530 and 550 contains information about the serial number for each fragment in the current file.
- the traf box included in the moof boxes 530 and 550 includes one or more track fragments constituting each track among the current fragments.
- Each track fragment includes one or more track runs that describe a series of samples.
- the trun box contained in the traf box contains information about the current track run.
- the mfra box contains random access point information to randomly access each fragment.
- the trfa box includes position information and reproduction time information of samples that can be randomly accessed.
- the apparatus 100 for providing a multimedia streaming service may transmit svfi boxes 525 and 545 including 3D signaling information transmitted for each fragment through a streaming file format 500 transmitted in units of fragments. have.
- three-dimensional signaling information about the video 535 and 555 inserted into the mdat boxes 530 and 550 of the current fragment 501 and 502 may be stored.
- the apparatus 100 for providing a multimedia streaming service may insert and transmit an svfi box into a traf box that is a lower box of the moof boxes 530 and 550.
- the multimedia streaming service receiving apparatus 200 receives and parses a data stream according to the streaming file format 500 according to an embodiment, thereby receiving encoded video data of 2D video or 3D video.
- Ancillary data including various characteristic information about the extracted video data may be extracted.
- the apparatus 200 for receiving a multimedia streaming service may include three-dimensional signaling of video data from svfi boxes 525 and 545 and a svmi box of a data stream according to the streaming file format 500 according to an embodiment.
- the information may be extracted to reconstruct the two-dimensional video or the three-dimensional video.
- 6 and 7 illustrate syntax of 3D signaling information included in an svfi box according to an embodiment.
- 3D signaling information about a video transmitted through a current fragment may be transmitted and received.
- the 3D signaling information of the svfi boxes illustrated in FIGS. 6 and 7 may include 'stereo_mono_change_count' information on the number of stereo mono interval changes for the video of the current fragment.
- the monoscopic video section and the stereoscopic video section may be searched in the current fragment through the stereo mono section change count information 'stereo_mono_change_count'.
- the 3D signaling information of the svfi box may include interval sample number information 'sample_count' and stereo identification information 'stereo_flag' for the stereoscopic video interval in the current fragment.
- 3D signaling information of the svfi box illustrated in FIG. 7 may further include information 'stereo_section_ID' for identifying a stereoscopic video section.
- each stereoscopic video section may be distinguished using stereo section identification information 'stereo_section_ID'.
- FIG. 8 illustrates syntax of 3D signaling information configured for a file in a streaming file format transmitted in units of fragments, according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service may transmit 3D configuration information and left and right order information in a file channel of the streaming file format 500.
- the 3D configuration information 'stereoscopic_composition_type' and the left and right order information 'is_left_first' for the video of the current file may be inserted into the svmi box included in the moov box.
- the multimedia streaming service receiving apparatus 200 parses an svmi box included in a moov box of the streaming file format 500, extracts a 'stereoscopic_composition_type' field and an 'is_left_first' field, and outputs a streaming file format ( The configuration of the stereoscopic image with respect to the video of the current file received through 500 and information about the order of the left view image and the right view image from the stereoscopic image may be read.
- FIG. 9 illustrates syntax of 3D signaling information configured for a sample in a streaming file format transmitted in units of fragments according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service may transmit stereo identification information on a track, a fragment, or a sample channel of the streaming file format 500.
- the syntax of FIG. 9 is a form in which stereo confirmation information 'stereo_flag' is added to a syntax of a trex box included in a moov box, a tfhd box included in a moof box, or a trun box.
- stereo confirmation information 'stereo_flag' regarding the video of the current track may be inserted into the trex box included in the moov box and transmitted.
- Stereo confirmation information 'stereo_flag' regarding the video of the current fragment is inserted into the tfhd box included in the moof box and transmitted.
- stereo confirmation information 'stereo_flag' for a video of a sample constituting the current fragment may be inserted into the trun box included in the moof box and transmitted.
- the multimedia streaming service receiving apparatus 200 parses a trex box, a tfhd box, or a trun box included in a moov box of the streaming file format 500, and extracts 'stereo_flag'.
- the video of the current track, the current fragment, or the current sample received through the streaming file format 500 may be read as a monoscopic type or a stereoscopic type.
- FIG. 10 illustrates two streaming file formats for transmitting left view video and right view video of stereoscopic video, respectively, according to one embodiment.
- the apparatus 100 for providing a multimedia streaming service may transmit a left view ES stream and an right view ES stream each including a left view video and a right view video constituting stereoscopic video.
- the apparatus 100 for providing a multimedia streaming service 100 inserts a left view ES stream into a left view video file 'test_1644_L.mp4' 1010 based on the streaming file format 500, and a right view ES stream.
- the right view ES stream may be inserted into the right view video file 'test_1644_R.mp4' 1020 and transmitted.
- the apparatus 100 for providing a multimedia streaming service 100 may transmit two ES streams through streaming two files in order to transmit stereoscopic video.
- the apparatus 100 for providing a multimedia streaming service may transmit relationship information including reference information and position information about another video referred to for configuring a stereoscopic video of a current file.
- the apparatus 100 for providing a multimedia streaming service may insert and transmit a reference type, location information, and the like for a reference video to a trak box 1040 that is a lower box of the moov box 1030. .
- the apparatus 100 for providing a multimedia streaming service parses a received left view video file, extracts and reads reference type and position information about another video to refer to to construct a stereoscopic video of a current file. can do.
- the multimedia streaming service receiving apparatus 200 detects a streaming file from which another video referred to by using the read information is received, and combines the video extracted from the two streaming files to generate a stereoscopic image. Can be restored
- FIG. 11 illustrates relationship information configured for stereoscopic video included in a file according to an embodiment.
- the multimedia streaming service providing apparatus 100 configures stereoscopic video in a tref box 1110 included in a trak box that is a lower box of a moov box of the streaming file format 500 according to an embodiment. For example, relationship information for searching for another video may be inserted.
- the track reference type box 1120 included in the trak box may include reference track identification information 'track_ID' for indicating a track including a reference video for the video of the current track, for each track of the file. Can be.
- the track reference type URL box 1130 included in the trak box may include information 'entry_count indicating the number of reference videos in order to indicate positions of a plurality of reference videos for the current track for each track of the file. And location information 'location' for each reference video.
- the location information 'location' may indicate a remote location of the reference video as a character string encoded in a language such as UTF-8. Accordingly, the multimedia streaming service receiving apparatus 200 according to an embodiment parses the moov box, the trak box, and the tref box 1110 sequentially from the received streaming file, and thus, from the track reference type URL box 1130, Video located in an external file of the file may be detected and referred to.
- FIG. 12 illustrates one relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- the multimedia streaming service providing apparatus 100 may include a trak box 1040 included in a moov box 1030 of a left view video file 'test_1644_L.mp4' 1010 based on a streaming file format 500.
- a trak box 1040 included in a moov box 1030 of a left view video file 'test_1644_L.mp4' 1010 based on a streaming file format 500.
- dinf box 1060 which is a lower box of the minf box 1050, relationship information about one video referenced by the video of the current track may be inserted and transmitted.
- the dinf box 1060 includes a dref box 1070 for transmitting relationship information, and the dref box 1070 includes reference URL information 1080 indicating remote location information of a reference track of the current track. It may include.
- the reference URL information 1080 may include the reference flag 'flags' as well as the URL information 'location'.
- the current video is a left view video or a base view video among stereoscopic videos and is included in a current file, and a right view video or an additional view video to which reference is referred is 'location' It may be described that it is included in the position pointed to.
- the URL information 'location' of the reference URL information 1080 may indicate a remote location of the right view video file 'test_1644_R.mp4' 1020.
- 'Flags' of the reference URL information 1080 is transmitted through the current left view video file 'test_1644_L.mp4' (1010), and the reference video of the current video is the right view video file whose location is indicated by 'location'. It may indicate that it is being transmitted through 'test_1644_R.mp4' 1020.
- the relationship information when the relationship information is included only in the left view video file 'test_1644_L.mp4' 1010, when a fragment of the left view video file 'test_1644_L.mp4' 1010 in which the reference view video is located is requested.
- the corresponding fragment may also be recognized as being requested from among the right-view video file 'test_1644_R.mp4' 1020 in which the additional view video is located.
- FIG. 13 illustrates a plurality of relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service may include a dinf box 1360 included in a moov box 1310 of a left view video file 'test_1644_L.mp4' 1010 based on a streaming file format 500.
- reference information about a plurality of videos referenced by the current video may be inserted and transmitted.
- the dref box 1370 of the dinf box 1360 may include two reference URL information 1380 and 1390 indicating remote location information of two reference videos of the current video.
- the first reference URL information 1380 included in the dref box 1370 may be referred to by the first fragment 1320 of the current video of the left view video file 'test_1644_L.mp4' 1010.
- Information indicating the third fragment 1340 of the viewpoint video file 'test_1644_R.mp4' 1020 is included.
- the second reference URL information 1390 included in the dref box 1370 may include the second fragment 1330 of the current video of the left view video file 'test_1644_L.mp4' 1010.
- Reference information includes information for pointing to the fourth fragment 1350 of the right view video file 'test_1644_R.mp4' 1020.
- the multimedia streaming service receiving apparatus 200 receives the left view video file 'test_1644_L.mp4' 1010, and sequentially rotates the moov box 1310, the dinf box 1360, and the dref box 1370. By parsing, the first reference URL information 1380 and the second reference URL information 1390 may be extracted.
- the apparatus 200 for receiving a multimedia streaming service may include the first fragment 1320 of the current track based on the 'flags' of the first reference URL information 1380, and the current left view video file 'test_1644_L.mp4'.
- the reference track of the first fragment 1320 of the current track is transmitted through '1010, and the third fragment 1340 of the right view video file' test_1644_R.mp4 '1020, which is a location indicated by URL information of' location '. It can be read that it is being transmitted through).
- the apparatus 200 for receiving a multimedia streaming service may be configured to determine that the second fragment 1330 of the current track is the current left view video file based on 'flags' of the second reference URL information 1390.
- the reference track of the second fragment 1330 of the current track is transmitted through 'test_1644_L.mp4' 1010 and the first track of the right-view video file 'test_1644_R.mp4' 1010, which is a location indicated by URL information of 'location'. It can be read that it is being transmitted over four fragments 1350.
- FIG. 14 illustrates syntax of track information including relationship information on a plurality of reference videos when transmitting stereoscopic video in two streaming files according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service associates the number of reference videos with the location of each reference video when there are a plurality of reference videos for a current track of a file, thereby indexing the location information of the reference video.
- Information indicating can be transmitted.
- 'data_reference_index' indicating the index of the location information of the reference video by linking the information 'entry_count' indicating the number of reference videos and the location information 'location' of each reference video among the dref boxes which is a lower box of the dinf box.
- Information can be sent via the dref box.
- FIG. 15 illustrates the syntax of relationship information set inside a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- the apparatus 200 for providing a multimedia streaming service may use the reference video location box 1510, the reference video name box 1520, and the reference entry box 1530 to inform the reference video of the current video. .
- the reference video location box 1510 may be location information 'location' of the reference video and may include http and ftp based location information.
- the reference video name box 1520 may include URN information 'name' and location information 'location' of the reference video.
- reference information 'data_entry' determined based on the number information 'entry_count' of the reference entry and the information 'entry_flags' indicating the entry type for each reference entry may be transmitted. .
- entry_flags 0x000002 '
- the current video is a left view video or a base view video among stereoscopic videos and is included in the current file. It can be described that it is included in the location pointed to by 'location'.
- FIG. 16 illustrates relationship information set by using an index file outside of a file when transmitting stereoscopic video in two streaming files according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service may transmit relationship information for indicating a reference video of the current video by using an external index file describing index information of the external file.
- the external index file SMIL may include both index information 1010 for the current file and index information 1020 for the reference file of the current file.
- the apparatus 200 for receiving a multimedia streaming service extracts, from a received streaming file, relationship information about a reference video that a video of a current file refers to to configure stereoscopic video, and thus, the number of reference videos, Reference indexes for identifying a plurality of reference videos, positions for each reference video, and the like may be read.
- the multimedia streaming service receiving apparatus 200 may detect the reference video and combine it with the current video to restore the stereoscopic video.
- the multimedia streaming service receiving apparatus 200 may detect the reference video for the current video and combine the current video with the external index file to restore the stereoscopic video.
- 17 and 18 illustrate one streaming file format for transmitting left view video and right view video of stereoscopic video, according to one embodiment.
- the apparatus 100 for providing a multimedia streaming service may transmit a left view ES stream and a right view ES stream for stereoscopic video through one fragment-based streaming file.
- the multimedia streaming service providing apparatus 100 may insert and transmit both a left view ES stream and a right view ES stream into the streaming files 1700 and 1800 based on the streaming file format 500 according to an embodiment. Can be.
- the apparatus 100 for providing a multimedia streaming service may transmit relationship information about another video referred to to configure stereoscopic video of a current file.
- the apparatus 100 for providing a multimedia streaming service according to an embodiment may insert and transmit relationship information into trak boxes 1712, 1714, 1812, and 1814, which are lower boxes of the moov boxes 1710 and 1810. .
- the apparatus 100 for providing a multimedia streaming service may parse the received left view video file and extract and read relationship information about another video referred to to construct a stereoscopic video of the current file. .
- the multimedia streaming service receiving apparatus 200 detects a streaming file including the other video referenced by using the read relationship information, and then combines the video extracted from the two streaming files to generate a stereoscopic image. Can be restored.
- each fragment of the streaming file 1700 may include both a left view video as a first track and a right view video as a second track. That is, the left view video 1722 and the right view video 1724 are transmitted through the first fragment 1720, and the left view video 1732 and the right view video 1734 are transmitted through the second fragment 1730. Can be.
- the moov box 1710 includes, for each track, a first trak box 1712 for the first track and a second trak box 1714 for the second track.
- the relationship information may be inserted into the tref box 1715 in the second trak box 1714 for the second track through which the right-view video for the additional view video is transmitted.
- the tref box 1715 may include reference type information 'reference_type' and baseline track identification information 'track_ID'.
- a left view video that is a first track and a right view video that is a second track may be inserted separately. That is, the left view video 1822 is transmitted through the first fragment 1820, the right view video 1832 is transmitted through the second fragment 1830, and the left view video (1840) is transmitted through the third fragment 1840. 1842 may be transmitted, and a right view video 1852 may be transmitted through the fourth fragment 1850.
- the relationship information may include offset information about a fragment including a right view video referenced by the left view video.
- the fragments 1820 and 1840 of the corresponding left view video and the fragments 1830 and 1850 of the right view video are the streaming files 1800.
- the multimedia streaming service receiving apparatus 200 receives the streaming file 1800 and immediately after the fragments 1820 and 1840 of the left view video, the fragment 1830 of the corresponding right view video. 1850).
- the moov box 1710 includes, for each track, a first trak box 1712 for the first track and a second trak box 1714 for the second track.
- the relationship information may be inserted into the tref box 1715 in the second trak box 1714 for the second track through which the right-view video for the additional view video is transmitted.
- the tref box 1715 may include reference type information 'reference_type' and baseline track identification information 'track_ID'.
- the multimedia streaming service receiving apparatus 200 parses the moov boxes 1710 and 1810 and the trak boxes 1712, 1714, 1812, and 1814 of the received streaming files 1700 and 1800 in order. It can be read that the second track corresponding to the second trak boxes 1714 and 1814 from which the tref boxes 1715 and 1815 are extracted includes the right view video which is the additional view video.
- the second track is dependent on the first track, so that the first trak box 1712.
- the left view video may be extracted from the fragments of the first track corresponding to 1812, and the right view video may be extracted from the fragments of the second track corresponding to the second trak boxes 1714 and 1814.
- the tfra boxes 1762 and 1862 which are lower boxes of the mfra boxes 1760 and 1860, may include fragment offset information indicating a distance from a presentation time of the stereoscopic video to the fragment. Since the presentation time for the left view video and the right view video of the stereoscopic video is the same, only the tfra boxes 1762 and 1862 for the first track can be used to extract stereoscopic video of the streaming file 1700. Fragment offset information may be provided.
- 19 and 20 illustrate a method of determining a reference video using an index file outside of a file when transmitting stereoscopic video in one streaming file.
- the apparatus for providing multimedia streaming service 100 may transmit relationship information for indicating a reference video of the current video by using an external index file.
- the external index file SMIL may include both index information for the left view video track and the right view video track transmitted through the current file “test_1644.mp4”.
- an index file external to a file may include track identification information 'trackID' and a stereoscopic type 'stereotype' to identify a left view video track and a right view video track included in the current streaming file. have.
- a reference video may be searched using an index file outside a file and a tref box inside the file.
- the index file outside the file may include only track identification information 'trackID' and stereoscopic type 'stereotype' for identifying the base view video track included in the current streaming file.
- the multimedia streaming service receiving apparatus 200 may include a tref box, among the trak boxes of a moov box of a received streaming file. It can be read that the track corresponding to the trak box including the video track is an additional view video track. Accordingly, the base view video may be extracted from fragments of the track indicated by the index file outside the file, and the additional view video may be extracted from the fragments of the track corresponding to the trak box including the tref box.
- the multimedia streaming service receiving apparatus 200 extracts a base view video and an additional view video constituting the stereoscopic video from the received streaming file, and extracts the base view video and the additional view video of the current streaming file. By extracting the index information, the reference relationship between the base view video and the additional view video can be read.
- the multimedia streaming service receiving apparatus 200 may restore the stereoscopic video by combining the base view video and the additional view video extracted from the current streaming file.
- the multimedia streaming service receiving apparatus 200 reads the relationship between the base view video and the additional view video of the current streaming file using an external index file, and combines the base view video and the additional view video. To restore stereoscopic video.
- the left view video and the right view video should be synchronized.
- the left view video and the right view video may be synchronized by having the same presentation time and the same sample duration between the corresponding left view sample and the right view sample.
- a multichannel video group may be provided to provide video encoded differentially according to video quality or bitrate. Coded video data of a channel selected from a multichannel video group may be transmitted and received.
- the multimedia streaming service receiving apparatus 200 may request the multimedia streaming service providing apparatus 100 for a video of a predetermined channel from a multichannel video group in consideration of a network environment, a current state, and a capability. .
- the multimedia streaming service providing apparatus 100 may provide relationship information of video constituting the multichannel video group so that the multimedia streaming service receiving apparatus 100 may select a video having a desired format from among the multichannel video group. Can transmit
- the apparatus 200 for receiving a multimedia streaming service may select and request and receive a video of a desired channel by using relationship information of a multichannel video group according to an embodiment.
- the multimedia streaming service receiving apparatus 200 may restore the video using the received video of the predetermined channel.
- FIG. 21 illustrates syntax of an afgp box including relationship information of a multichannel video group according to an embodiment, for an adaptive streaming service.
- the apparatus 100 for providing a multimedia streaming service adds an afgp box to the multimedia streaming file formats 300 and 500 so as to relate information about a multichannel video group related to a video currently transmitted through the streaming file. Can be transmitted.
- the afgp box may be configured in the same channel as the ftyp box, the moov box, and the like.
- the afgp box may include relationship information about another video that can replace the current video among the multichannel video groups related to the current video.
- the afgp box may include the number information 'entry_count' of video constituting the multichannel video group and the location information 'file_location' of another video.
- Location information 'file_location' of an afgp box may indicate a remote location, URL, etc. of another video. That is, the afgp box according to an embodiment may transmit not only the current streaming file but also location information about a video located in an external file.
- the location information 'file_location' may be a string encoded in a language such as UTF-8.
- the substitution relationship between the current file and the external file can be expressed by sharing the value of the multichannel video group name information 'alternate_group' to indicate that the current file is the same multichannel video group. have.
- the video of the current file and the video of a predetermined external file may represent mutually replaceable videos constituting the multichannel video group.
- the apparatus 200 for receiving a multimedia streaming service may parse the afgp box according to an embodiment from the received streaming file, and read the number and location information of the videos constituting the multichannel video group.
- the multimedia streaming service receiving apparatus 200 selects a video of a desired channel from video constituting a multichannel video group read from an afgp box, requests a video located in a currently received file or an external file, and Can be received.
- FIG. 22 illustrates a case of setting relationship information between multichannel video groups according to an embodiment by using an index file external to a file for an adaptive streaming service.
- the apparatus 100 for providing a multimedia streaming service may transmit relationship information between a plurality of videos configuring a multichannel video group using an external index file.
- the external index file SMIL may include both index information 2210 for the first file and index information 2220 for the second file for each video of the multichannel video group.
- the external index file SMIL identifies video position information (test_1644.mp4, test_3288.mp4), bit rate information (1644000 or 3288000), and the current multichannel video group for each video constituting the multichannel video group. It may include group name information (alternate_group).
- the external index file may be location information on video data included in a multi-channel video group, and may include remote location information or URL information of a currently received file or an external file.
- the external index file SMIL may further include track identification information trackID.
- the apparatus 200 for receiving a multimedia streaming service may read location information and characteristic information of a video of a multichannel video group to which a current video belongs, from an external index file of the received streaming file. According to an embodiment, the apparatus 200 for receiving a multimedia streaming service may select a substitute video from a multichannel video group read from an external index file, and request and receive a video located in a currently received file or an external file.
- FIG. 23 is a flowchart of a method of providing a multimedia streaming service, according to an embodiment.
- encoded data of a video including at least one of two-dimensional video data and three-dimensional video data is divided in units of fragments.
- the fragment may include one of a monoscopic video section, a stereoscopic video section, and a mixed video section of the monoscopic video section and the stereoscopic video section.
- attribute information including at least one of three-dimensional signaling information and relationship information is determined for each fragment.
- At least one of three-dimensional configuration information, left and right order information, and stereo mono period change count information may be determined for each fragment.
- At least one of stereo identification information and interval sample number information may be determined for each segment of the fragment.
- 3D configuration information and left and right order information of samples may be determined.
- stereoscopic camera display information on a sample may be determined for each stereoscopic video section of the fragment.
- the stereoscopic camera display information according to an embodiment may be expressed using an item to which the stereoscopic camera display information is applied.
- At least one of 3D configuration information, left and right order information, and stereo mono fragment change information may be determined for the video of the current file.
- At least one of stereo mono interval change count information, interval sample count information, and stereo identification information may be further determined for each fragment, together with 3D configuration information, left and right order information, and stereo mono fragment change information about the file.
- stereoscopic video section identification information may be determined for each stereoscopic video section of the current fragment.
- the video of the current file is relationship information for retrieving reference video constituting stereoscopic video. At least one of information, URL information, and URN information may be used.
- the video of the current file refers to the plurality of videos
- at least one of the number information of the reference video, reference index information for identifying the plurality of reference videos, and position information may be determined.
- a multichannel video group may be created that provides a plurality of channels of video to be differentially determined according to video quality.
- at least one of information on the number of videos constituting the multichannel video group and reference information indicating the position of the video of another channel may be determined.
- the position information of the video constituting the multichannel video group may indicate the position of the video existing in the file outside the current file.
- fragments including attribute information about the fragmented video of the fragment and the encoded video data are continuously transmitted.
- the attribute information of the fragment may be inserted into the auxiliary data area of the fragment and transmitted, and the encoded video data divided into fragments may be inserted into the fragment's media data area and transmitted.
- 24 is a flowchart of a method of receiving a multimedia streaming service according to an embodiment.
- step 2410 a plurality of fragments are received consecutively.
- encoded video data of a fragment configured as a 2D video segment or a 3D video segment is extracted from the media data region for each fragment.
- attribute information is parsed from the auxiliary data region for each fragment, and at least one of three-dimensional signaling information for two-dimensional reproduction or three-dimensional reproduction of fragment video data and relationship information for reference between the plurality of videos is extracted. Is read.
- the 3D configuration information of the fragment may be extracted, and the form in which the left view image and the right view image constitute a stereoscopic image of the current fragment may be read.
- left and right order information of a fragment may be extracted, and an order of a left view image and a right view image may be read from the stereoscopic image of the current fragment.
- the information on the number of change of the stereo mono section of the fragment may be extracted, and the number of changes of the monoscopic video section and the stereoscopic video section of the current fragment may be read.
- At least one of stereo identification information and interval sample number information of a fragment may be extracted, and a monoscopic video section or a stereoscopic video section of the fragment may be distinguished.
- At least one of the 3D configuration information and the left and right order information is extracted for each stereoscopic video section of the fragment, so that the 3D configuration information of the samples constituting the current stereoscopic video section is read and the left and right order are read. Information can be read.
- stereoscopic camera display information may be extracted for each stereoscopic video section of the fragment, and information about the stereoscopic camera and the display specification that have obtained samples constituting the current stereoscopic video section may be read.
- the stereoscopic camera display information according to an embodiment may be read based on the applied target items.
- At least one of three-dimensional configuration information, left and right order information, and stereo mono fragment change information about video data of the current file is extracted, and for each fragment of the current file, the number of stereo mono interval changes for the video of the fragment is extracted.
- At least one of the information, the interval sample number information, and the stereo identification information may be further extracted and read.
- identification information for each stereoscopic video section may be extracted from one or more stereoscopic video sections of the fragment to distinguish the stereoscopic video sections.
- At least one of the location information of the reference video, the reference video identification information, the remote location information of the reference video located outside the current file, the URL information, and the URN information is extracted and read, thereby being referred to the video data of the current file. Another video may be retrieved.
- a video of a current file refers to a plurality of videos
- at least one of the number of reference videos, a reference index, and a position may be read, and the referenced video may be selectively detected.
- relationship information about a multi-channel video group that provides a video encoded with a plurality of channels differentially encoded according to video quality may be received.
- relationship information about a multichannel video group may be received, and a desired substitute video may be selectively requested and received based on the relationship information and position information about the replacement video.
- the location information for the replacement video may include location information of the video existing outside the current file, as well as identification information for the video inside the current file.
- the extracted video data for each fragment may be decoded and combined to restore a 2D video or 3D video.
- the reconstructed video may be reproduced in 2D or 3D by using 3D signaling information or relationship information according to an embodiment.
- the apparatus 100 for providing a multimedia streaming service 100 and the apparatus for receiving a multimedia streaming service 200 according to an embodiment may be provided in a file unit, a fragment unit, or a sample through a fragment-based streaming file format according to an embodiment.
- a file unit a fragment unit, or a sample through a fragment-based streaming file format according to an embodiment.
- three-dimensional signaling information of the stereoscopic video is transmitted and received.
- relationship information such as reference information and characteristic information between a plurality of videos, such as a stereoscopic base view video and an additional view video, may be provided. Can be sent and received.
- a multimedia service that can regenerate a file for transmitting a reference video or associate or combine a plurality of videos without physical constraints can be referred to because a file generated in the existing location or a file existing in another location can be referred to. Can be.
- the stereoscopic video is configured in a unified form to be compatible with the ISO-based media file format using the streaming file format according to an embodiment. Relationship information and three-dimensional signaling information between a plurality of videos may be provided. Stereoscopic multimedia, as well as multimedia such as video and audio encoded in multiple channel quality, are provided in one or more multimedia files, and adaptively variable quality multimedia is interrupted to the user according to the transmission bandwidth or the performance of the terminal device. Can be provided without.
- any flow chart, flow chart, state diagram, pseudocode, etc. may be substantially represented on a computer readable medium, such that the computer or processor may be executed by such a computer or processor whether or not it is explicitly shown. It will be appreciated by those skilled in the art to represent the process. Therefore, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer which operates the program using a computer-readable recording medium.
- the computer-readable recording medium may include a storage medium such as a magnetic storage medium (eg, a ROM, a floppy disk, a hard disk, etc.) and an optical reading medium (eg, a CD-ROM, a DVD, etc.).
- a storage medium such as a magnetic storage medium (eg, a ROM, a floppy disk, a hard disk, etc.) and an optical reading medium (eg, a CD-ROM, a DVD, etc.).
- processor or “control unit” should not be construed as exclusively referring to hardware capable of executing software, and without limitation, digital signal processor (DSP) hardware, read-only for storing software. Memory (ROM), random access memory (RAM), and non-volatile storage.
- DSP digital signal processor
- an element represented as a means for performing a specific function encompasses any way of performing a specific function, and the element may be a combination of circuit elements performing a specific function, or performing a specific function. It may include any form of software, including firmware, microcode, etc., coupled with suitable circuitry to carry out the software for.
- the expression 'at least one of' means only the selection of the first option (A), or only the selection of the second listed option (B), or both. It is used to cover the selection of options (A and B).
- the expression 'at least one of' means only the selection of the first option (A), or only the selection of the second listed option (B), or both. It is used to cover the selection of options (A and B).
- only the selection of the first listed option (A), or the selection of the second listed option (B), or the third listed option (C ) Only the selection of the first and second listed options (A and B), only the selection of the second and third listed options (B and C), or the selection of all three options ( A, B, and C) may be encompassed. Even if more items are enumerated, it may be obviously extended to those skilled in the art.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Library & Information Science (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (15)
- 네트워크를 이용하여 멀티미디어를 전송하는 스트리밍 서비스 제공 방법에 있어서,2차원 비디오 및 3차원 비디오 중 적어도 하나를 포함하는 비디오의 부호화된 데이터를 프래그먼트 단위로 분할하는 단계;상기 프래그먼트마다 현재 비디오를 2차원 재생 또는 3차원 재생을 위한 정보를 포함하는 3차원 시그널링 정보와, 상기 비디오가 하나 이상의 다른 비디오를 참조하기 위한 관계 정보 중 적어도 하나를 포함하는 속성 정보를 결정하는 단계; 및상기 프래그먼트에 대한 속성 정보를 포함하는 보조 데이터 영역과 상기 부호화된 비디오 데이터를 포함하는 미디어 데이터 영역으로 구성된 프래그먼트들을 연속적으로 전송하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 방법.
- 제 1 항에 있어서, 상기 프래그먼트마다 속성 정보 결정 단계는,상기 프래그먼트마다, 좌시점 영상 및 우시점 영상이 스테레오스코픽 영상을 구성하는 형태를 나타내는 3차원 구성 정보, 상기 스테레오스코픽 영상에서 상기 좌시점 영상 및 상기 우시점 영상의 순서를 나타내는 좌우 순서 정보, 및 모노스코픽 비디오 구간과 스테레오스코픽 비디오 구간의 변경 횟수를 나타내는 스테레오 모노 구간 변경 횟수 정보 중 적어도 하나를 결정하는 단계; 및현재 구간이 상기 모노스코픽 비디오 구간 또는 상기 스테레오스코픽 비디오 구간인지 나타내는 스테레오 확인 정보 및 상기 현재 구간을 구성하는 샘플들의 개수를 나타내는 구간 샘플 개수 정보 중 적어도 하나를 결정하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 방법.
- 제 2 항에 있어서, 상기 프래그먼트마다 속성 정보 결정 단계는,현재 프래그먼트의 스테레오스코픽 비디오 구간마다, 현재 스테레오스코픽 비디오 구간을 구성하는 샘플들에 대한 상기 3차원 구성 정보, 상기 좌우 순서 정보, 상기 현재 프래그먼트의 하나 이상의 스테레오스코픽 비디오 구간 중에서 각각의 스테레오스코픽 비디오 구간에 대한 식별 정보, 및현재 스테레오스코픽 비디오 구간을 구성하는 샘플들을 획득한 스테레오스코픽 카메라에 대한 정보와 상기 샘플들을 이용하여 안전하게 3차원 재생하기 위한 디스플레이 규격에 대한 정보를 포함하는 스테레오스코픽 카메라 디스플레이 정보 중 적어도 하나를 결정하는 단계를 포함하고,상기 스테레오스코픽 카메라 디스플레이 정보는, 현재 프래그먼트의 현재 스테레오스코픽 비디오 구간 중에서, 상기 스테레오스코픽 카메라 디스플레이 정보가 적용되는 아이템들의 개수를 나타내는 정보, 각각의 아이템에서 참조되는 현재 스테레오스코픽 카메라 디스플레이 정보의 식별 정보 및 상기 현재 스테레오스코픽 카메라 디스플레이 정보가 적용되는 구간의 길이에 대한 정보 중 적어도 하나를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 방법.
- 제 1 항에 있어서, 상기 프래그먼트마다 속성 정보 결정 단계는,현재 파일의 비디오에 대해, 스테레오스코픽 비디오를 구성하기 위해 참조하는 참조 비디오의 위치 정보를, 상기 현재 파일 내에서의 상기 참조 비디오 식별 정보, 상기 현재 파일 외부의 원격 위치 정보, URL(Uniform Resource Locator) 정보, URN(Uniform Resource Name) 정보 중 적어도 하나를 이용하여 결정하는 단계; 및상기 현재 파일의 비디오가 복수 개의 비디오들을 참조하는 경우, 상기 참조 비디오의 개수 정보, 복수 개의 참조 비디오를 식별하기 위한 참조 인덱스 정보 및 각각의 참조 비디오에 대한 상기 위치 정보 중 적어도 하나를 결정하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 방법.
- 제 1 항에 있어서, 상기 멀티미디어 스트링 서비스 제공 방법은,비디오를 비디오 화질에 따라 차등되도록 부호화한, 복수 채널의 비디오들을 생성하는 단계를 더 포함하고,상기 프래그먼트마다 속성 정보 결정 단계는, 현재 파일의 비디오의 다른 채널의 비디오의 개수를 나타내는 멀티채널 개수 정보 및 상기 다른 채널의 비디오의 위치를 나타내는 참조 정보 중 적어도 하나를 결정하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 방법.
- 네트워크를 이용하여 멀티미디어를 수신하는 스트리밍 서비스 수신 방법에 있어서,복수 개의 프래그먼트들을 연속적으로 수신하는 단계;상기 프래그먼트들마다 미디어 데이터 영역으로부터, 2차원 비디오 및 3차원 비디오 중 적어도 하나를 포함하는 비디오의 부호화된 데이터를 프래그먼트 단위로 분할된 형태로 추출하는 단계;상기 프래그먼트들마다 보조 데이터 영역으로부터 속성 정보를 파싱하고, 상기 프래그먼트의 비디오의 2차원 재생 또는 3차원 재생을 위한 3차원 시그널링 정보와 상기 비디오가 하나 이상의 다른 비디오를 참조하기 위한 관계 정보 중 적어도 하나를 추출하여 판독하는 단계; 및상기 프래그먼트들마다 상기 속성 정보로부터 판독된 정보에 기초하여, 상기 프래그먼트들의 상기 부호화된 데이터를 2차원 비디오 또는 3차원 비디오로 복원하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 제 6 항에 있어서, 상기 속성 정보 추출 단계는,상기 프래그먼트들마다 상기 프래그먼트 비디오 데이터에 대하여 설정된, 좌시점 영상 및 우시점 영상이 스테레오스코픽 영상을 구성하는 형태를 나타내는 3차원 구성 정보, 상기 스테레오스코픽 영상에서 상기 좌시점 영상 및 상기 우시점 영상의 순서를 나타내는 좌우 순서 정보, 및 상기 모노스코픽 비디오 구간과 상기 스테레오스코픽 비디오 구간의 변경 횟수를 나타내는 스테레오 모노 구간 변경 횟수 정보 중 적어도 하나를 추출하여 판독하는 단계; 및상기 프래그먼트들마다, 현재 구간이 상기 모노스코픽 비디오 구간 또는 상기 스테레오스코픽 비디오 구간인지 나타내는 스테레오 확인 정보 및 상기 현재 구간을 구성하는 샘플들의 개수를 나타내는 구간 샘플 개수 정보 중 적어도 하나를 추출하여 판독하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 제 7 항에 있어서, 상기 속성 정보 추출 단계는,현재 프래그먼트의 스테레오스코픽 비디오 구간마다 설정된, 현재 스테레오스코픽 비디오 구간을 구성하는 샘플들에 대한 상기 3차원 구성 정보, 상기 좌우 순서 정보, 상기 현재 프래그먼트의 하나 이상의 스테레오스코픽 비디오 구간 중에서 각각의 스테레오스코픽 비디오 구간에 대한 식별 정보 및 현재 스테레오스코픽 비디오 구간을 구성하는 샘플들을 획득한 스테레오스코픽 카메라에 대한 정보와 상기 샘플들을 이용하여 안전하게 3차원 재생하기 위한 디스플레이 규격에 대한 정보를 포함하는 스테레오스코픽 카메라 디스플레이 정보 중 적어도 하나를 추출하여 판독하는 단계를 포함하고,상기 스테레오스코픽 카메라 디스플레이 정보는, 현재 프래그먼트의 현재 스테레오스코픽 비디오 구간 중에서, 상기 스테레오스코픽 카메라 디스플레이 정보가 적용되는 아이템들의 개수를 나타내는 정보, 각각의 아이템에서 참조되는 현재 스테레오스코픽 카메라 디스플레이 정보의 식별 정보 및 상기 현재 스테레오스코픽 카메라 디스플레이 정보가 적용되는 구간의 길이에 대한 정보 중 적어도 하나를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 제 6 항에 있어서, 상기 속성 정보 추출 단계는,현재 파일의 비디오에 대해 설정된, 스테레오스코픽 비디오를 구성하기 위해 참조하는 참조 비디오의 위치 정보를 추출하여, 상기 현재 파일 내에서의 상기 참조 비디오 식별 정보, 상기 현재 파일 외부의 원격 위치 정보, URL 정보, URN 정보 중 적어도 하나를 판독하는 단계; 및상기 현재 파일의 비디오가 복수 개의 비디오들를 참조하는 경우, 상기 참조비디오의 개수 정보, 복수 개의 참조 비디오들을 식별하기 위한 참조 인덱스 정보 및 각각의 참조 비디오에 대한 상기 위치 정보 중 적어도 하나를 추출하여 판독하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 제 6 항에 있어서, 상기 멀티미디어 스트링 서비스 수신 방법은,비디오 화질에 따라 차등되어 부호화된 복수 개의 채널의 비디오 중에서, 선택적으로 소정 채널의 비디오를 수신하는 단계를 더 포함하고,상기 속성 정보 추출 단계는, 현재 파일의 비디오의 다른 채널의 비디오의 개수를 나타내는 멀티채널 개수 정보 및 상기 다른 채널의 비디오의 위치를 나타내는 참조 정보 중 적어도 하나를 추출하여 판독하는 단계를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 제 6 항에 있어서, 상기 멀티미디어 스트링 서비스 수신 방법은,상기 프래그먼트들마다 상기 3차원 시그널링 정보로부터 판독된 정보에 기초하여, 상기 복원된 2차원 비디오 또는 3차원 비디오를 재생하는 단계를 더 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 방법.
- 네트워크를 이용하여 멀티미디어를 전송하는 스트리밍 서비스 제공 장치에 있어서,2차원 비디오 및 3차원 비디오 중 적어도 하나를 포함하는 비디오의 부호화된 데이터를 프래그먼트 단위로 분할하는 프래그먼트 비디오 데이터 생성부;상기 프래그먼트마다 현재 비디오를 2차원 재생 또는 3차원 재생을 위한 정보를 포함하는 3차원 시그널링 정보와, 상기 비디오가 하나 이상의 다른 비디오를 참조하기 위한 관계 정보 중 적어도 하나를 포함하는 속성 정보를 결정하는 프래그먼트 속성 정보 결정부; 및상기 프래그먼트에 대한 속성 정보를 포함하는 보조 데이터 영역과 상기 부호화된 비디오 데이터를 포함하는 미디어 데이터 영역으로 구성된 프래그먼트들을 연속적으로 전송하는 스트리밍부를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 제공 장치.
- 네트워크를 이용하여 멀티미디어를 수신하는 스트리밍 서비스 수신 장치에 있어서,복수 개의 프래그먼트들을 연속적으로 수신하는 수신부;상기 프래그먼트들마다 미디어 데이터 영역으로부터, 2차원 비디오 및 3차원 비디오 중 적어도 하나를 포함하는 비디오의 부호화된 데이터를 프래그먼트 단위로 분할된 형태로 추출하는 프래그먼트 비디오 데이터 추출부;상기 프래그먼트들마다 보조 데이터 영역으로부터 속성 정보를 파싱하고, 상기 프래그먼트의 비디오의 2차원 재생 또는 3차원 재생을 위한 3차원 시그널링 정보와 상기 비디오가 하나 이상의 다른 비디오를 참조하기 위한 관계 정보 중 적어도 하나를 추출하여 판독하는 프래그먼트 속성 정보 추출부; 및상기 프래그먼트들마다 상기 속성 정보로부터 판독된 정보에 기초하여, 상기 프래그먼트들의 상기 부호화된 데이터를 2차원 비디오 또는 3차원 비디오로 복원하는 복원부를 포함하는 것을 특징으로 하는 멀티미디어 스트리밍 서비스 수신 장치.
- 제 1 항의 멀티미디어 스트리밍 서비스 제공 방법을 연산 프로세서로 구현하기 위한 프로그램이 기록된 컴퓨터로 판독 가능한 기록매체.
- 제 6 항의 멀티미디어 스트리밍 서비스 수신 방법을 연산 프로세서로 구현하기 위한 프로그램이 기록된 컴퓨터로 판독 가능한 기록매체.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013514117A JP6088968B2 (ja) | 2010-06-09 | 2011-06-09 | フラグメント基盤のマルチメディアストリーミングサービス提供方法とその装置、並びにフラグメント基盤のマルチメディアストリーミングサービス受信方法とその装置 |
BR112012031218-9A BR112012031218B1 (pt) | 2010-06-09 | 2011-06-09 | Método de fornecer um serviço de fluxo contínuo de multimídia por intermédio de uma rede, método de receber um serviço de fluxo contínuo para receber multimídia por intermédio de uma rede, equipamento para fornecer um serviço de fluxo contínuo de multimídia por intermédio de uma rede, equipamento para receber um serviço de fluxo contínuo para receber multimídia por intermédio de uma rede, e meio de gravação legível por computador |
US13/703,286 US9674502B2 (en) | 2010-06-09 | 2011-06-09 | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
EP11792687.3A EP2582142B1 (en) | 2010-06-09 | 2011-06-09 | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
CN201180039011.5A CN103069812B (zh) | 2010-06-09 | 2011-06-09 | 提供基于分段的多媒体流服务的方法及装置、接收基于分段的多媒体流服务的方法及装置 |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US35289510P | 2010-06-09 | 2010-06-09 | |
US61/352,895 | 2010-06-09 | ||
US36627910P | 2010-07-21 | 2010-07-21 | |
US61/366,279 | 2010-07-21 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2011155776A2 true WO2011155776A2 (ko) | 2011-12-15 |
WO2011155776A3 WO2011155776A3 (ko) | 2012-03-15 |
Family
ID=45098538
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2011/004230 WO2011155776A2 (ko) | 2010-06-09 | 2011-06-09 | 프래그먼트 기반의 멀티미디어 스트리밍 서비스 제공 방법과 그 장치, 그리고 프래그먼트 기반의 멀티미디어 스트리밍 서비스 수신 방법과 그 장치 |
Country Status (7)
Country | Link |
---|---|
US (1) | US9674502B2 (ko) |
EP (1) | EP2582142B1 (ko) |
JP (1) | JP6088968B2 (ko) |
KR (1) | KR101830881B1 (ko) |
CN (1) | CN103069812B (ko) |
BR (1) | BR112012031218B1 (ko) |
WO (1) | WO2011155776A2 (ko) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103428462A (zh) * | 2013-08-29 | 2013-12-04 | 中安消技术有限公司 | 一种多通道音视频处理方法和装置 |
CN103916440A (zh) * | 2013-01-05 | 2014-07-09 | 尼尔森网联媒介数据服务有限公司 | 一种远程升级的方法及其装置 |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9716920B2 (en) | 2010-08-05 | 2017-07-25 | Qualcomm Incorporated | Signaling attributes for network-streamed video data |
US9219929B2 (en) * | 2012-02-27 | 2015-12-22 | Fritz Barnes | Enhanced startup and channel change for fragmented media stream delivery |
CN104219537B (zh) * | 2013-05-31 | 2018-11-06 | 腾讯科技(北京)有限公司 | 视频数据处理的方法、装置及*** |
EP2890075B1 (en) * | 2013-12-26 | 2016-12-14 | Telefonica Digital España, S.L.U. | A method and a system for smooth streaming of media content in a distributed content delivery network |
CN104980712A (zh) * | 2015-07-14 | 2015-10-14 | 济南中维世纪科技有限公司 | 视频监控数据恢复后的智能索引方法 |
CN105451073B (zh) * | 2015-11-16 | 2018-11-02 | 深圳Tcl数字技术有限公司 | Mp4视频源的传送方法和装置 |
CN105447168B (zh) * | 2015-12-04 | 2019-03-22 | 四川效率源信息安全技术股份有限公司 | Mp4格式的碎片文件恢复与重组的方法 |
KR102553886B1 (ko) | 2015-12-24 | 2023-07-11 | 삼성전자주식회사 | 전자 장치 및 전자 장치의 이미지 제어 방법 |
TWI559753B (zh) * | 2016-03-16 | 2016-11-21 | 晶睿通訊股份有限公司 | 傳輸隨選影音檔案的方法 |
US10567461B2 (en) * | 2016-08-04 | 2020-02-18 | Twitter, Inc. | Low-latency HTTP live streaming |
KR102546152B1 (ko) * | 2017-02-15 | 2023-06-22 | 한국전자통신연구원 | 고정/이동방송 융합형 3DTV에서 화질 개선을 위한 부가 데이터(Video Enhancement Information, VEI) 시그널링 방법 및 장치 |
US10992961B2 (en) * | 2017-05-25 | 2021-04-27 | Qualcomm Incorporated | High-level signaling for fisheye video data |
GB2567624B (en) * | 2017-10-12 | 2021-05-26 | Canon Kk | Method, device and computer program for transmitting media content |
CN115643442A (zh) * | 2022-10-25 | 2023-01-24 | 广州市保伦电子有限公司 | 一种音视频合流录制播放方法、装置、设备及存储介质 |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100397511B1 (ko) * | 2001-11-21 | 2003-09-13 | 한국전자통신연구원 | 양안식/다시점 3차원 동영상 처리 시스템 및 그 방법 |
EP1574066A1 (en) * | 2002-12-13 | 2005-09-14 | Koninklijke Philips Electronics N.V. | Switching method for mdc/scalable coding |
JP2004228743A (ja) | 2003-01-21 | 2004-08-12 | Nec Fielding Ltd | 立体画像システム |
MXPA05008404A (es) * | 2003-02-18 | 2005-10-05 | Nokia Corp | Metodo de codificacion de imagen. |
KR100987775B1 (ko) * | 2004-01-20 | 2010-10-13 | 삼성전자주식회사 | 영상의 3차원 부호화 방법 |
KR100585966B1 (ko) | 2004-05-21 | 2006-06-01 | 한국전자통신연구원 | 3차원 입체 영상 부가 데이터를 이용한 3차원 입체 디지털방송 송/수신 장치 및 그 방법 |
WO2006087676A2 (en) | 2005-02-18 | 2006-08-24 | Koninklijke Philips Electronics N.V. | Method of multiplexing auxiliary data in an audio/video stream |
EP1713285B1 (en) * | 2005-04-15 | 2015-09-09 | Thomson Licensing | Method and device for recording digital data |
KR100657322B1 (ko) | 2005-07-02 | 2006-12-14 | 삼성전자주식회사 | 로컬 3차원 비디오를 구현하기 위한 인코딩/디코딩 방법 및장치 |
WO2008054100A1 (en) | 2006-11-01 | 2008-05-08 | Electronics And Telecommunications Research Institute | Method and apparatus for decoding metadata used for playing stereoscopic contents |
KR100962696B1 (ko) | 2007-06-07 | 2010-06-11 | 주식회사 이시티 | 부호화된 스테레오스코픽 영상 데이터 파일의 구성방법 |
US20100161686A1 (en) | 2007-06-19 | 2010-06-24 | Electronic And Telecommunications Research Institute | Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata |
KR101506217B1 (ko) * | 2008-01-31 | 2015-03-26 | 삼성전자주식회사 | 스테레오스코픽 영상의 부분 데이터 구간 재생을 위한스테레오스코픽 영상 데이터스트림 생성 방법과 장치, 및스테레오스코픽 영상의 부분 데이터 구간 재생 방법과 장치 |
KR100972792B1 (ko) | 2008-11-04 | 2010-07-29 | 한국전자통신연구원 | 스테레오스코픽 영상을 동기화하는 장치 및 방법과 이를 이용한 스테레오스코픽 영상 제공 장치 및 방법 |
JP2011082666A (ja) | 2009-10-05 | 2011-04-21 | Sony Corp | 信号伝送方法、信号送信装置及び信号受信装置 |
-
2011
- 2011-06-09 BR BR112012031218-9A patent/BR112012031218B1/pt active IP Right Grant
- 2011-06-09 JP JP2013514117A patent/JP6088968B2/ja not_active Expired - Fee Related
- 2011-06-09 WO PCT/KR2011/004230 patent/WO2011155776A2/ko active Application Filing
- 2011-06-09 CN CN201180039011.5A patent/CN103069812B/zh active Active
- 2011-06-09 KR KR1020110055741A patent/KR101830881B1/ko active IP Right Grant
- 2011-06-09 US US13/703,286 patent/US9674502B2/en active Active
- 2011-06-09 EP EP11792687.3A patent/EP2582142B1/en active Active
Non-Patent Citations (2)
Title |
---|
None |
See also references of EP2582142A4 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103916440A (zh) * | 2013-01-05 | 2014-07-09 | 尼尔森网联媒介数据服务有限公司 | 一种远程升级的方法及其装置 |
CN103428462A (zh) * | 2013-08-29 | 2013-12-04 | 中安消技术有限公司 | 一种多通道音视频处理方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
US20130147914A1 (en) | 2013-06-13 |
JP6088968B2 (ja) | 2017-03-01 |
CN103069812A (zh) | 2013-04-24 |
BR112012031218B1 (pt) | 2021-11-23 |
EP2582142A4 (en) | 2014-04-02 |
JP2013534747A (ja) | 2013-09-05 |
CN103069812B (zh) | 2015-12-16 |
EP2582142B1 (en) | 2017-03-15 |
BR112012031218A2 (pt) | 2016-10-25 |
EP2582142A2 (en) | 2013-04-17 |
US9674502B2 (en) | 2017-06-06 |
KR20110134857A (ko) | 2011-12-15 |
KR101830881B1 (ko) | 2018-04-05 |
WO2011155776A3 (ko) | 2012-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2011155776A2 (ko) | 프래그먼트 기반의 멀티미디어 스트리밍 서비스 제공 방법과 그 장치, 그리고 프래그먼트 기반의 멀티미디어 스트리밍 서비스 수신 방법과 그 장치 | |
WO2015002500A1 (ko) | 실시간 전송 프로토콜 기반의 방송 시스템에서 미디어 방송 신호의 송수신 방법 및 장치 | |
WO2011105811A2 (en) | Method and apparatus for transmitting and receiving data | |
WO2012011724A2 (ko) | 미디어 파일 송수신 방법 및 그를 이용한 송수신 장치 | |
WO2013157828A1 (ko) | 복수의 계층을 지원하는 비트스트림의 디코딩 방법 및 이를 이용하는 장치 | |
WO2015012605A1 (ko) | 3차원 콘텐츠의 부호화 방법 및 장치 | |
WO2009145426A1 (en) | Method and apparatus for generating stereoscopic image data stream by using camera parameter, and method and apparatus for restoring stereoscopic image by using camera parameter | |
WO2011059291A2 (en) | Method and apparatus for transmitting and receiving data | |
WO2020076058A1 (ko) | 3차원 비디오 컨텐츠를 포함하는 미디어 파일을 생성하는 방법 및 장치 및 3차원 비디오 컨텐츠를 재생하는 방법 및 장치 | |
WO2011013995A2 (en) | Method and apparatus for generating 3-dimensional image datastream including additional information for reproducing 3-dimensional image, and method and apparatus for receiving the 3-dimensional image datastream | |
WO2013048148A2 (en) | Method and apparatus for transmitting and receiving content | |
WO2012047028A2 (ko) | 스트리밍 컨텐츠 제공 장치 및 방법 | |
WO2015126117A1 (ko) | 방송 신호 송수신 방법 및 장치 | |
WO2014025239A1 (ko) | 3d 영상을 위한 영상 컴포넌트 송수신 처리 방법 및 장치 | |
WO2018004317A1 (ko) | 고해상도 영상 스트리밍을 위한 영상 비트스트림 생성방법 및 장치 | |
WO2014010920A1 (ko) | 인핸스드 3d 오디오/비디오 처리 장치 및 방법 | |
WO2019203627A1 (ko) | 트랜지션 이펙트에 관한 오디오 데이터를 송수신하는 방법 및 그 장치 | |
WO2019194571A1 (en) | Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, and apparatus for receiving 360-degree video | |
WO2021132963A1 (ko) | 슬라이스 또는 픽처에 대한 nal 유닛 타입 기반 영상 또는 비디오 코딩 | |
WO2022131870A1 (ko) | Nal 유닛 어레이 정보를 포함하는 미디어 파일 생성/수신 방법, 장치 및 미디어 파일 전송 방법 | |
WO2022139260A1 (ko) | 미디어 파일을 생성하고 처리하는 방법 및 장치 | |
WO2022060113A1 (ko) | 미디어 파일 처리 방법 및 그 장치 | |
WO2016159636A1 (ko) | 방송 신호 송수신 방법 및 장치 | |
WO2022065893A1 (ko) | 미디어 파일 처리 방법 및 그 장치 | |
WO2022131845A1 (ko) | Nal 유닛 정보를 포함하는 미디어 파일 생성/수신 방법, 장치 및 미디어 파일 전송 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180039011.5 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11792687 Country of ref document: EP Kind code of ref document: A2 |
|
ENP | Entry into the national phase |
Ref document number: 2013514117 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2011792687 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011792687 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13703286 Country of ref document: US |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112012031218 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112012031218 Country of ref document: BR Kind code of ref document: A2 Effective date: 20121207 |