WO2010022672A1 - 码流转换***及方法、码流识别单元和方案确定单元 - Google Patents
码流转换***及方法、码流识别单元和方案确定单元 Download PDFInfo
- Publication number
- WO2010022672A1 WO2010022672A1 PCT/CN2009/073612 CN2009073612W WO2010022672A1 WO 2010022672 A1 WO2010022672 A1 WO 2010022672A1 CN 2009073612 W CN2009073612 W CN 2009073612W WO 2010022672 A1 WO2010022672 A1 WO 2010022672A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- code stream
- stream
- video
- format
- original
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the embodiments of the present invention relate to the field of video technologies, and in particular, to a code stream conversion system and method, a code stream identification unit, and a solution determining unit. Background technique
- H.264/Scalable Video Coding SVC
- H.264/Multi Video Coding MVC
- MVC Video Coding
- video data formats are required to adopt different coding standards depending on the application environment.
- More and more urgent, for many real-time applications video data is usually required to achieve dynamic real-time conversion between various encoding formats. For example, the mutual conversion between stereo video and traditional flat video will also become the focus of demand.
- One technology for converting an encoding format into another encoding format is video transcoding technology.
- the device that performs video transcoding operation is a video transcoder.
- the video transcoding contains two aspects, one is in the same video encoding standard. Internal conversion, such as conversion between different code rates, between different resolutions Conversion, etc., on the other hand is to convert between different video compression standard, i.e. a standard compressed video data into video data, other video compression standard.
- the basic principle of video transcoding technology is the best compromise between the quality and complexity of the code stream conversion in the case of limited environment and processing power.
- the key to the realization is the compression in the compressed video stream.
- the data is multiplexed to avoid complex operations caused by re-encoding.
- Many of the existing transcoding techniques are converted between ordinary flat video, such as Motion Picture Experts Group (MPEG) - 2 stream and MPEG-4 stream, MPEG-4
- MPEG-4 Motion Picture Experts Group
- the embodiment of the invention provides a code stream conversion system and method, a code stream identification unit and a solution determining unit, so as to realize automatic conversion between a stereo video and a plane video, thereby realizing a relationship between a stereo video code stream and a common plane code stream. Interoperability.
- An embodiment of the present invention provides a code stream conversion system, where the system includes:
- a code stream identifying unit configured to parse the read original code stream to be converted, to obtain a source code stream format corresponding to the original code stream
- a solution determining unit configured to determine a transcoding scheme according to the target code stream format and the parsed original code stream format
- a calculating unit configured to: according to the transcoding scheme, apply the original code stream format to decode the original code stream, and apply the target code stream format to encode the decoded code stream to complete code stream conversion, A target code stream corresponding to the target code stream format is obtained.
- the original code stream is parsed by the code stream identification unit, and the program determining unit determines the transcoding scheme according to the target code stream format and the parsed code stream format, thereby realizing the stereo video code stream and the planar video code.
- the mutual conversion between streams is a code stream conversion system.
- the embodiment of the present invention provides a code stream identification unit, where the code stream identification unit includes: a reading module, configured to read a source code stream to be converted, the source code stream includes a stereoscopic video code stream; Parsing the original code stream to obtain an original corresponding to the original code stream Start stream format.
- the code stream identification unit obtains the original code stream format corresponding to the original code stream by parsing the original code stream, and prepares the transcoding scheme for realizing the mutual conversion between the stereo video code stream and the plane frequency code stream.
- An embodiment of the present invention provides a solution determining unit, where the determining unit includes: a receiving module, configured to receive an original code stream format obtained by parsing the original code stream;
- a determining module configured to determine a transcoding scheme according to the target code stream format and the original code stream format.
- the solution determining unit determines the transcoding scheme according to the parsed original code stream format and the target code stream format, so as to implement mutual conversion between the stereo video code stream and the plane frequency code stream according to the transcoding scheme.
- the embodiment of the invention further provides a code stream conversion method, the method comprising:
- Determining a transcoding scheme according to the target code stream format and the original code stream format, and applying the original code stream format to decode the original code stream according to the transcoding scheme, and applying the target code stream format pair to decode The code stream is encoded, and the code stream conversion is completed to obtain a target code stream corresponding to the target code stream format.
- the transcoding scheme is determined according to the parsed original stream format and the target stream format, so that the mutual conversion between the stereo video stream and the planar video stream can be realized.
- FIG. 1 is a schematic structural diagram of an embodiment of a code stream conversion system according to the present invention.
- FIG. 2 is a schematic structural diagram of an embodiment of a code stream identification unit according to the present invention.
- FIG. 3 is a schematic structural diagram of an embodiment of a solution determining unit according to the present invention.
- Embodiment 4 is a flowchart of Embodiment 1 of a code stream conversion method according to the present invention.
- FIG. 5 is a flowchart of Embodiment 2 of a code stream conversion method according to the present invention
- 6 is a flowchart of Embodiment 3 of a code stream conversion method according to the present invention
- FIG. 7 is a flowchart of Embodiment 4 of a code stream conversion method according to the present invention.
- Embodiment 8 is a flowchart of Embodiment 5 of a code stream conversion method according to the present invention.
- Embodiment 9 is a flowchart of Embodiment 6 of a code stream conversion method according to the present invention.
- Embodiment 8 of a code stream conversion method according to the present invention.
- FIG. 13 is a flowchart of Embodiment 10 of a code stream conversion method according to the present invention. detailed description
- FIG. 1 it is a schematic structural diagram of an embodiment of a code stream conversion system according to the present invention.
- the system includes: a code stream identification unit 2 configured to parse a read original code stream to be converted to obtain a corresponding original stream. a source code stream format; a scheme determining unit 3, configured to determine a transcoding scheme according to the target stream format and the parsed original stream format; and the calculating unit 4 is configured to apply the original stream format according to the transcoding scheme Decoding the original code stream, and applying the target code stream format to encode the decoded code stream, and completing the code stream conversion to obtain a target code stream corresponding to the target code stream format.
- the target stream format is a stereo video stream format when the original stream format is a flat video stream format.
- the target stream format is a flat video. Stream format.
- the foregoing code stream conversion system may include: an input unit 1 configured to receive a source code stream to be converted, where the source code stream includes a stereo video code stream or a plane video code stream, for example, the stereo video stream It can be a binocular stereo video stream encoded according to the H.264/Advanced Video Coding (AVC) format, a stereoscopic video stream of a framed structure encoded according to the H.263 standard, or encoded according to the MPEG-4 standard.
- the framed video stream may be a normal H.264 code stream or the like.
- the code stream conversion system may further include: an output unit 5 for outputting the calculation unit 4 The target stream after the stream is converted.
- the above system receives the original code stream to be converted through the input unit, and parses the original code stream by the code stream identification unit to obtain the original code stream format corresponding to the original code stream, according to the preset target code stream format or the received instruction. Carrying the target code stream format, determining, by the scheme determining unit, the transcoding scheme according to the target code stream format and the parsed original stream format, performing the conversion of the code stream by the calculating unit, and finally outputting the converted code stream through the output unit; The mutual conversion between the stereo video stream and the planar video stream is better achieved.
- the code stream identification unit includes: a reading module 21, configured to read an original code stream to be converted, where the original code stream includes a stereo video code.
- the stream or plane video code stream; the parsing module 22 is configured to parse the original code stream to obtain a source code stream format corresponding to the original code stream.
- the reading module 21 can read the stereo video stream to be converted; when the original stream is a flat video stream, the reading module 21 can read the planar video code to be converted.
- the stream, parsing module 22 is configured to parse the read code stream to obtain a source code stream format corresponding to the original code stream.
- the code stream identification unit obtains the original code stream format corresponding to the original code stream by parsing the original code stream, and prepares the transcoding scheme for realizing the mutual conversion between the stereo video code stream and the plane frequency code stream.
- the solution determining unit includes: a receiving module 31, configured to receive a source code stream format obtained by parsing the original code stream; and a determining module 32, configured to The code stream format and the parsed original code stream format determine the transcoding scheme.
- the target code stream format may be preset or may be obtained from the received signaling.
- the target stream format is a stereo video stream format; when the original stream format is a stereo video stream format, the target stream format is a flat video stream.
- the format correspondingly, the transcoding scheme may include: when the original stream is a stereo video stream, and the target stream is a flat video stream, the determining module 32 obtains the stereo video stream format and the planar video according to the parsed original stream.
- the code stream format determines a transcoding scheme; when the original stream is The planar video stream, when the target stream is a stereo video stream, the determining module 32 determines the transcoding scheme according to the planar video stream format and the stereo video stream format obtained by parsing the original stream.
- the solution determining unit determines the transcoding scheme according to the target code stream format and the original code stream format obtained by parsing the original code stream, so that the mutual conversion between the stereo video code stream and the plane frequency code stream can be implemented according to the transcoding scheme.
- Step 101 Receive an original code stream to be converted
- the step is an optional step, and the input unit receives the original code stream to be converted, where the original code stream may include a stereo video stream, a flat video stream, and the like;
- the stereoscopic video stream may be a binocular stereo video stream encoded according to the H.264/AVC format, a stereoscopic video stream of a framed structure encoded according to the H.263 standard, or encoded according to the MPEG-4 standard.
- a stereoscopic video code stream of a frame frame structure, etc., the plane video code stream can be an ordinary H.264 code stream, etc.
- Step 102 Read a source code stream to be converted.
- Step 103 Parse the original code stream, obtain an original code stream format corresponding to the original code stream, and send the original code stream format to the solution determining unit, so that the solution determining unit parses the original code stream according to the target code stream format. Obtaining the original code stream format to determine a transcoding scheme;
- the code stream identifying unit may parse the original code stream, obtain the original code stream format corresponding to the original code stream, and send the original code stream format to the solution determining unit, so that the solution determining unit according to the target code stream format and parsing the original
- the code stream format obtained by the code stream determines a transcoding scheme; the step includes: when the original code stream is a stereo video stream, and the target stream is a flat video stream, parsing the stereo video stream to obtain the stereo video stream Corresponding stereo video stream format, and determining a transcoding scheme according to a stereo video stream format obtained by parsing the stereo video stream and a planar video stream format of the target stream; when the original stream is a flat video stream, the target code When the stream is a stereo video stream, parsing the plane video stream to obtain a one-sided video stream format corresponding to the plane video stream, and Decoding a transcoding scheme according to the format of the planar video bitstream obtained by parsing the planar video bitstream and the stereoscopic video
- the above-mentioned stereo video stream format may also be a new video frame generated by interleaving the left and right channel video frames.
- the above three cases are only examples of the planar video stream format and the stereo video stream format, but are not limited to the above three cases;
- Step 104 Decode the original code stream according to the transcoding scheme, encode the decoded code stream, and complete the code stream conversion.
- the step is an optional step.
- the computing unit decodes the original code stream according to the transcoding scheme, applies the original code stream format, and applies the target code stream format to encode the decoded code stream to complete the code stream conversion.
- Step 105 Output the converted target code stream.
- This step is an optional step in which the converted target code stream is output by the output unit.
- the original code stream format corresponding to the original code stream is obtained by parsing the original code stream, and the transcoding scheme is determined according to the target code stream format and the original code stream format of the original code stream, thereby realizing the stereo video code.
- Step 201 Parse the read original code stream to be converted to obtain an original code stream format corresponding to the original code stream. ;
- the step is an optional step.
- the original code stream to be converted is received by the input unit, and then the original code stream is read by the code stream identification unit, and the original code stream is parsed to obtain the original code stream corresponding to the original code stream.
- Step 202 Receive a target code stream format and parse the original code stream format obtained by the original code stream; the solution determining unit may receive the target code stream format carried in the signaling and parse the original code stream format obtained by the original code stream; the target code stream The format can also be preset in the scheme determination unit.
- Step 203 Determine a transcoding scheme according to the target code stream format and the original code stream format obtained by parsing the original code stream, and send the transcoding scheme to the computing unit.
- the scheme determining unit determines the transcoding scheme according to the target stream format and the original stream format obtained by parsing the original stream; the step may include: when the original stream is a stereo video stream, and the target stream is a flat video stream, The stereo video stream is parsed, the stereo video stream format corresponding to the stereo video stream is obtained, and the transcoding scheme is determined according to the stereo video stream format obtained by parsing the stereo video stream and the planar video stream format of the target stream.
- the original code stream is a planar video code stream and the target code stream is a stereo video code stream
- the plane video code stream is parsed to obtain a one-sided video code stream format corresponding to the plane video code stream, and the plane video code is parsed according to the method.
- Decoding a transcoding scheme by determining a transcoding scheme by using a plane video stream format obtained by the stream and a stereo video stream format of the target stream; and transmitting the transcoding scheme to the computing unit;
- Step 204 Decode the original code stream according to the transcoding scheme, encode the decoded code stream, and complete the code stream conversion.
- the step is an optional step.
- the computing unit decodes the original code stream according to the transcoding scheme, applies the original code stream format, and applies the target code stream format to decode the decoded code stream, and applies the target code stream format pair.
- the decoded code stream is encoded, and the code stream is converted to obtain a target code stream corresponding to the target code stream format.
- Step 205 Output the converted target code stream.
- This step is an optional step in which the converted code stream is output by the output unit.
- the original code stream format corresponding to the original code stream is obtained according to the parsing, and the transcoding scheme is determined according to the target code stream format and the original code stream format of the original code stream, thereby realizing the stereo video stream and the planar video.
- Mutual conversion between code streams is possible.
- FIG. 6 it is a flowchart of Embodiment 3 of a code stream conversion method according to the present invention.
- This embodiment converts a binocular stereo video stream encoded according to an H.264/Advanced Video Coding (AVC) format.
- the normal H.264 code stream wherein the binocular stereo video stream includes two parts of video data: left channel plane video data and right channel video data relative to left channel video data
- Depth/disparity information, depth/disparity information can be obtained by stereo matching between left and right channel video frames or directly by depth camera.
- Binocular stereo video stream is composed of left channel video data as normal video data according to H.264.
- the /AVC standard is encoded into a basic code stream, and a parallax signal corresponding to each video frame of the basic code stream is encoded into a supplemental enhancement signal according to a normal grayscale image frame, and the SEI information is attached to the supplemental enhancement information. Constructed before each frame of the elementary stream, the method includes:
- Step 301 Receive an original binocular stereo video code stream to be converted.
- the input unit receives the original binocular stereo video code stream to be converted
- Step 302 Parse the original binocular stereo video code stream, obtain a basic code stream +SEI type corresponding to the original binocular stereo video stream, and send a basic code stream + SEI type;
- the code stream identification unit reads the input original binocular stereo video code stream from the input unit, and parses the original binocular stereo video code stream to obtain the original stream format as the basic stream + SEI type, and the original binocular to be parsed and obtained.
- the original code stream format of the stereo video stream is sent to the solution determining unit;
- Step 303 Determine a transcoding scheme according to the original code stream format obtained by parsing and the H.264 code stream format.
- the scheme determining unit reads two inputs of the unit: an original stream format (basic stream + SEI) and a target stream format (basic stream), and determines a transcoding scheme to directly remove the SEI information in the stream, and simultaneously modify Part of the parameters;
- Step 304 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the calculating unit reads the code stream data packet in the input data unit according to the transcoding scheme determined by the transcoding scheme selection unit, and determines whether the current data packet is SEI information, and if yes, directly discards, otherwise, does not perform any processing, directly Output through the output data unit;
- Step 305 Output the calculated target code stream.
- the output unit directly outputs the target code stream from which the SEI information is removed from the calculation unit.
- the stereoscopic data including the basic code stream and the disparity information can be better
- the video stream is converted into a flat video stream containing the elementary stream.
- the planar video code stream can be converted into a body video code stream, as shown in FIG. 7 , which is a flowchart of the fourth embodiment of the code stream conversion method of the present invention.
- the original stream is converted into a common H.264/AVC stream, and the target stream is a binocular stereo video stream. It is required to be encoded according to the H.264/AVC standard, and the depth/disparity information is encoded into the SEI according to the ordinary grayscale image.
- the method includes:
- Step 401 Receive a plane video code stream to be converted.
- the input unit receives a part of the original normal H.264/AVC format video stream to be converted;
- Step 402 Parse the read plane video stream to obtain a source stream format corresponding to the plane video stream, and The original code stream format is sent to the solution determining unit;
- the code stream identification unit reads the input original code stream from the input unit, parses the original code stream, and obtains the H.264/AVC format, and sends the parsed acquired original code stream format to the solution determining unit; Step 403, according to the analysis
- the latter planar code stream format and the target code stream format determine a transcoding scheme;
- the above target stream format is a stereo video stream format
- the scheme determining unit reads two inputs of the unit: a planar stream format (H.264/AVC) Format) and stereo video stream format (basic stream + SEI), determine the transcoding scheme to parse the video frame of the plane stream, perform region segmentation, obtain depth information, and then encode the depth information into the SEI information according to the ordinary grayscale image. Attached to the code stream.
- the process of obtaining depth information it may include:
- the image stream is segmented to obtain a video object, and the segmentation can be either content-based segmentation or front-view segmentation; and then, different depth information is assigned to different video objects obtained by segmentation, and the depth information can be systematically
- the default setting can also be specified, so that the depth information of the corresponding flat code stream can be obtained.
- Step 404 Perform decoding on the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the calculating unit reads the code stream data packet in the input unit according to the transcoding scheme determined by the scheme determining unit, parses out the video frame, and then performs area segmentation, additional depth information, and depth information encoding to SEI information, and packaged into a network abstraction layer (NAL) structure;
- NAL network abstraction layer
- Step 405 Output the packed target code stream.
- the output unit directly outputs the packed target code stream from the calculation unit.
- the planar video code stream including the basic code stream can be better converted into a stereoscopic video code stream including the basic code stream and the disparity information.
- the original code stream is a stereo video code stream
- the target code stream is a common plane code stream
- the stereo video stream format is H. 264 format, wherein the left channel video frame and the corresponding depth/disparity information are combined into one frame, encoded according to the H.264/AVC standard
- the normal plane video is a basic H.264/AVC code stream containing only the left channel data
- Step 501 Receive an original stereo video code stream to be converted.
- the input unit receives a part of the original stereo video code stream to be converted
- Step 502 Parse the original stereo video stream to obtain an original stream format corresponding to the original stereo video stream.
- the code stream identification unit reads the original stereo video code stream to be converted from the input unit, and parses the code stream, and parses out the code stream structure to include a left channel video frame and corresponding disparity information for each frame, and left Channel video frames and disparity information are organized according to different slices (SLICE);
- Step 503 Determine a transcoding scheme according to the original stereo video stream format and the target code stream format obtained by parsing;
- the scheme determining unit obtains the original stream format from the code stream identifying unit, and determines that the transcoding scheme is for each SLICE in each video frame in the original stream, if the video frame corresponding to the SLICE is a left channel video frame, then no The processing is directly placed in the output data interface; if the corresponding depth/disparity information is used, it is directly discarded;
- Step 504 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the computing unit parses each video frame in the code stream according to the transcoding scheme determined by the scheme determining unit
- the SLICE sequence number of the NAL if it is the left channel video frame, does not process any processing and directly puts it into the output unit; if the corresponding depth/disparity information is corresponding, it is directly discarded;
- Step 505 Output the converted target code stream.
- the output unit directly outputs the converted target code stream.
- a stereoscopic video code stream including a data stream framed by a basic code stream and disparity information can be preferably converted into a plane video code stream including a basic code stream.
- the plane video code stream can be converted into a body video code stream, as shown in FIG. 9 , which is a flowchart of the sixth embodiment of the code stream conversion method of the present invention.
- the code stream to be converted is a normal plane code stream
- the object code stream is a stereoscopic video code stream of a frame frame structure encoded according to the H.264/AVC standard, and the method includes:
- Step 601 Receive a plane video code stream to be converted.
- the input unit receives a portion of the planar video code stream to be converted
- Step 602 Perform parsing on the foregoing planar video code stream, and obtain an original code stream format corresponding to the plane video code stream.
- the code stream identification unit reads the original plane video code stream originally encoded according to the H.264/AVC standard to be converted from the input unit, parses the code stream, and parses out the original code stream format;
- Step 603 Determine a transcoding scheme according to the original code stream format of the parsed planar video code stream and the target code stream format of the target video bitstream.
- the solution determining unit obtains the parsed planar video code stream format from the code stream identifying unit, and determines a transcoding scheme for each video frame in the planar video bitstream according to the above planar video bitstream format and the stereoscopic video bitstream format;
- Step 604 Perform decoding on the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the calculation unit parses each video frame in the code stream according to the transcoding scheme determined by the scheme determining unit, performs decoding, region segmentation, acquires depth information, and encodes and packs the depth information according to the new SLICE to complete the code stream conversion.
- the process of obtaining depth information it may include:
- the image stream is segmented to obtain a video object, and the segmentation can be either content-based segmentation or front-view segmentation; and then, different depth information is assigned to different video objects obtained by segmentation, and the depth information can be systematically
- the default setting can also be specified, so that the depth information of the corresponding flat code stream can be obtained.
- Step 605 Output the target code stream after transcoding.
- the output unit directly outputs the converted target code stream.
- the planar video code stream including the basic code stream can be better converted into a stereoscopic video code stream including the data frame composed of the basic code stream and the disparity information.
- the code stream to be converted is a stereo video stream
- the stereo video stream format is a binocular stereo video stream.
- Each frame structure is a combination of left and right channel video frame interleaving into a new video frame
- the target code stream is a common plane code stream
- the coding standard may be any standard known, and the method includes:
- Step 701 Receive an original stereo video code stream to be converted.
- the input unit receives a part of the original stereo video code stream to be converted
- Step 702 Parse the original stereo video code stream, and obtain an original code stream format corresponding to the original stereo video code stream.
- the code stream identification unit reads the original stereo video code stream to be converted from the input unit, parses the code stream, and parses the original code stream format into an interleaved structure
- Step 703 Determine a transcoding scheme according to the original stereo video stream format and the target code stream format obtained by parsing;
- the scheme determining unit obtains the original stream format and the target stream format from the code stream identifying unit, and determines that the transcoding scheme is for each video frame in the original stereo video stream;
- Step 704 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the computing unit decodes each video frame in the original stereo video stream according to the transcoding scheme. Extracting video frames of one of the channels for re-encoding;
- Step 705 Output the converted target code stream.
- the output unit directly outputs the converted target code stream.
- the stereo video code stream which is combined by the left and right channel video frame interleaving into a new video frame can be converted into a common plane video code stream.
- the plane video code stream can be converted into a body video code stream, as shown in FIG. 11 , which is a flowchart of the eighth embodiment of the code stream conversion method of the present invention.
- the target plane stream is a stereo video stream, and the method includes:
- Step 801 Receive a channel common plane video code stream to be converted.
- the input unit receives a channel common plane video code stream to be converted
- Step 802 Perform parsing on the common planar video code stream to obtain a source code stream format corresponding to the common plane video code stream.
- the code stream identification unit reads the original common plane video code stream to be converted from the input unit, parses the code stream, and parses out the original code stream format;
- Step 803 Determine a transcoding scheme according to the parsed common plane video stream format and the target stream format.
- the scheme determining unit determines, according to the target code stream format and the parsed normal plane video code stream format, that the transcoding scheme is for each video frame in the original code stream;
- Step 804 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the computing unit parses each video frame in the code stream according to the transcoding scheme determined by the scheme determining unit, performs region segmentation, acquires depth information, and converts the information into disparity information; and then reconstructs a video frame corresponding to another channel,
- the interlaces form a new video frame and are encoded to complete the stream conversion.
- the process of obtaining depth information it may include:
- the image stream is segmented to obtain a video object, and the segmentation can be based on the internal
- the segmentation of the volume can also be the segmentation of the foreground and the scene; then, the different video objects obtained by the segmentation are given different depth information, and the depth information can be set by default or specified, thereby obtaining the depth information of the corresponding plane code stream.
- Step 805 Output the converted target code stream.
- the output unit directly outputs the converted target code stream.
- the ordinary planar video code stream can be better converted into a stereo video code stream which is combined into a new video frame by the left and right channel video frame interleaving.
- the foregoing embodiment of the code stream conversion method can be used to: convert the various types of stereo video code streams into planar video code streams by using the technical solution provided by the present invention, and correspondingly, convert the planar video code streams.
- Various forms of stereo video streams can be used to: convert the various types of stereo video code streams into planar video code streams by using the technical solution provided by the present invention, and correspondingly, convert the planar video code streams.
- the original code stream to be converted is a plane code stream in a common H.264/AVC format
- the target code stream is in accordance with H. 263
- a stereo coded video stream of a standard coded frame structure the method comprising:
- Step 901 Receive a plane code stream of a common H.264/AVC format to be converted.
- the input unit receives a part of the plane stream of the normal H.264/AVC format to be converted; Step 902: parsing the plane code stream of the H.264/AVC format to obtain the
- the code stream identification unit reads the original plane code stream originally encoded according to the H.264 standard to be converted from the input unit, parses the plane code stream, and parses out the original code stream format;
- Step 903 Determine a transcoding scheme according to the original stream format obtained by the parsing and the target video stream format.
- the solution determining unit obtains the parsed code stream structure from the code stream identifying unit, and determines a transcoding scheme according to the foregoing planar video bitstream format and the stereoscopic video bitstream format as each video frame in the planar video bitstream;
- Step 904 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the calculation unit parses each video frame in the code stream according to the transcoding scheme determined by the scheme determining unit, performs decoding, region segmentation, acquires depth information, and combines the depth information as an image with the decoded video frame to form a new one.
- the video frame is then encoded according to the H263 standard and packaged.
- the manner in which the new video frames are spliced may be interlaced or side by side.
- the process of obtaining depth information it may include:
- the image stream is segmented to obtain a video object, and the segmentation can be either content-based segmentation or front-view segmentation; and then, different depth information is assigned to different video objects obtained by segmentation, and the depth information can be systematically
- the default setting can also be specified, so that the depth information of the corresponding flat code stream can be obtained.
- Step 905 Output the target code stream after transcoding.
- the output unit directly outputs the converted target code stream.
- the planar video code stream including the basic code stream can be better converted into a stereoscopic video code stream including the data frame composed of the basic code stream and the disparity information.
- the code stream to be converted is an ordinary plane code stream
- the target code stream is a frame frame structure coded according to the MPEG-4 standard.
- Stereo video stream the method includes:
- Step 911 Receive a plane code stream to be converted.
- the input unit receives a part of the plane code stream to be converted
- Step 912 Parsing the plane code stream to obtain an original code stream format corresponding to the original code stream
- the code stream identification unit reads the original plane video code stream originally encoded according to the H.264 standard to be converted from the input unit, parses the code stream, and parses the code stream structure;
- Step 913 Determine a transcoding scheme according to the parsed planar video stream format and the stereo video stream format.
- the solution determining unit obtains the parsed planar video code stream format from the code stream identifying unit, and determines a transcoding scheme according to the planar video bitstream format and the stereoscopic video bitstream format as a planar video bitstream.
- Step 914 Decode the original code stream according to the transcoding scheme, and perform coding calculation on the decoded code stream.
- the calculation unit parses each video frame in the code stream according to the transcoding scheme determined by the scheme determining unit, performs decoding, region segmentation, acquires depth information, and combines the depth information as an image with the decoded video frame to form a new one.
- the video frame is then encoded and packaged according to the MPEG-4 standard.
- the manner in which the new video frames are spliced may be interlaced or side by side.
- the process of obtaining depth information it may include:
- the image stream is segmented to obtain a video object, and the segmentation can be either content-based segmentation or front-view segmentation; and then, different depth information is assigned to different video objects obtained by segmentation, and the depth information can be systematically
- the default setting can also be specified, so that the depth information of the corresponding flat code stream can be obtained.
- Step 915 Output the target code stream after transcoding.
- the output unit directly outputs the converted target code stream.
- the planar video code stream including the basic code stream can be better converted into a stereoscopic video code stream including the data frame composed of the basic code stream and the disparity information.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Description
码流转换***及方法、 码流识别单元和方案确定单元 本申请要求于 2008 年 8 月 29 日提交中国专利局、 申请号为 200810119459.8、 发明名称为 "码流转换***及方法、 码流识别单元和方案 确定单元"的中国专利申请的优先权, 其全部内容通过引用结合在本申请 中。 技术领域
本发明实施例涉及视频技术领域, 尤其涉及一种码流转换***及方法、 码流识别单元和方案确定单元。 背景技术
近几年, 随着立体视频技术的发展,相关的国际标准正在讨论和制定中, 其扩展特性 H.264/可升级视频编码( Scalable Video Coding, SVC)可以提供不 同质量的视频,即将制定完成的 H.264/多视频编码 (Multi Video Coding, MVC) 将提供多视点视频的压缩标准; 随着数字视频应用的普及, 要求视频数据格 式随着应用环境不同而采用不同编码标准的要求变得越来越迫切, 对于许多 实时应用, 通常要求视频数据在各种编码格式之间实现动态实时转换, 例如 立体视频和传统的平面视频之间的相互转换也将成为需求的重点, 将视频数 据由一种编码格式转换成另一种编码格式的技术是视频转码技术, 执行视频 转码操作的设备就是视频转码器, 视频转码包含两个方面的含义, 一方面是 在同一视频编码标准内部进行转换, 例如不同码率之间的转换, 不同分辨率 之间的转换等, 另一方面是不同视频压缩标准之间的转换, 即将一种标准压 缩的视频数据转换成另一种视频压缩标准的视频数据。
视频转码技术的基本原则是在环境和处理能力受限的情况下, 在码流转 换的质量和复杂度之间的最佳折衷, 实现的关键是对压缩视频码流中的压缩
数据进行复用, 避免重新编码带来的复杂运算。 随着立体视频技术的发展和 标准的逐渐成熟, 立体视频和平面视频之间的转换必将成为应用领域的一个 重要技术。 现有的许多转码技术都是在普通的平面视频之间进行转换, 例如 运动图像专家组 (Motion Picture Experts Group, MPEG) -2码流与 MPEG-4码 流之间的转换, MPEG-4与 H.263、 H.264之间的转换, 这些技术都非常好地 解决了平面视频压缩标准之间的转换问题; 但现有视频转码技术无法进行立 体视频与平面视频之间的转换。 发明内容
本发明实施例提供一种码流转换***及方法、 码流识别单元和方案确定 单元, 以实现立体视频与平面视频之间的自动转换, 从而实现立体视频码流 和普通平面码流之间的互通。
本发明实施例提供了一种码流转换***, 该***包括:
码流识别单元, 用于对读取的待转换的原始码流进行解析, 得到原始码 流对应的原始码流格式;
方案确定单元, 用于根据目标码流格式和解析得到的原始码流格式确定 转码方案;
计算单元, 用于根据所述转码方案, 应用所述原始码流格式对所述原始 码流进行解码、 并应用所述目标码流格式对解码后的码流进行编码, 完成码 流转换, 得到与所述目标码流格式对应的目标码流。
上述码流转换***, 通过码流识别单元对原始码流进行解析, 通过方案 确定单元根据目标码流格式和解析后的码流格式确定转码方案, 从而可以实 现立体视频码流和平面视频码流间的互相转换。
本发明实施例提供了一种码流识别单元, 该码流识别单元包括: 读取模块, 用于读取待转换的原始码流, 该原始码流包括立体视频码流; 解析模块, 用于对所述原始码流进行解析, 得到所述原始码流对应的原
始码流格式。
上述码流识别单元, 通过对原始码流进行解析, 获取原始码流对应的原 始码流格式, 为实现立体视频码流和平面频码流间的互相转换作好了选取转 码方案的准备。
本发明实施例提供了一种方案确定单元, 该方案确定单元包括: 接收模块, 用于接收解析原始码流获取的原始码流格式;
确定模块, 用于根据目标码流格式和所述原始码流格式确定转码方案。 上述方案确定单元, 根据解析后的原始码流格式和目标码流格式确定转 码方案,从而根据该转码方案实现立体视频码流和平面频码流间的互相转换。
本发明实施例还提供了一种码流转换方法, 该方法包括:
接收解析原始码流获取的原始码流格式;
根据目标码流格式和所述原始码流格式确定转码方案, 并根据所述转码 方案应用所述原始码流格式对所述原始码流进行解码、 应用所述目标码流格 式对解码后的码流进行编码, 完成码流转换, 得到与所述目标码流格式对应 的目标码流。
上述码流转换方法, 通过根据解析后原始码流格式和目标码流格式确定 转码方案, 从而可以实现立体视频码流和平面视频码流间的互相转换。
下面通过附图和实施例, 对本发明实施例的技术方案做进一步的详细描 述。 附图说明
图 1为本发明码流转换***实施例的结构示意图;
图 2为本发明码流识别单元实施例的结构示意图;
图 3为本发明方案确定单元实施例的结构示意图;
图 4为本发明码流转换方法实施例一的流程图;
图 5为本发明码流转换方法实施例二的流程图;
图 6为本发明码流转换方法实施例三的流程图;
图 7为本发明码流转换方法实施例四的流程图;
图 8为本发明码流转换方法实施例五的流程图;
图 9为本发明码流转换方法实施例六的流程图;
图 10为本发明码流转换方法实施例七的流程图;
图 11为本发明码流转换方法实施例八的流程图;
图 12为本发明码流转换方法实施例九的流程图;
图 13为本发明码流转换方法实施例十的流程图。 具体实施方式
如图 1所示, 为本发明码流转换***实施例的结构示意图,该***包括: 码流识别单元 2, 用于对读取的待转换的原始码流进行解析, 得到原始码流 对应的原始码流格式; 方案确定单元 3 , 用于根据目标码流格式和解析得到 的原始码流格式确定转码方案; 计算单元 4, 用于根据所述转码方案, 应用 所述原始码流格式对原始码流解码、 并应用目标码流格式对解码后的码流进 行编码, 完成码流转换, 得到与所述目标码流格式对应的目标码流。 其中, 当上述原始码流格式为平面视频码流格式时, 上述目标码流格式为立体视频 码流格式; 当上述原始码流格式为立体视频码流格式时, 上述目标码流格式 为平面视频码流格式。
可选的, 上述码流转换***可以包括: 输入单元 1 , 用于接收待转换的 原始码流, 上述原始码流包括立体视频码流或平面视频码流, 举例来说, 该 立体视频码流可以为按照 H.264/高级视频编码 (Advanced Video Coding, AVC)格式编码的双目立体视频码流、 按照 H.263标准编码的拼帧结构的立 体视频码流或者按照 MPEG-4标准编码的拼帧结构的立体视频码流等等, 该 平面视频码流可以为普通的 H.264码流等等; 另外, 上述码流转换***还可 以包括: 输出单元 5 , 用于输出计算单元 4进行码流转换后的目标码流。
上述***通过输入单元接收待转换的原始码流, 通过码流识别单元对上 述原始码流进行解析得到原始码流对应的原始码流格式, 根据预先设置的目 标码流格式或者接收到的指令中携带的目标码流格式, 通过方案确定单元根 据目标码流格式和解析获取的原始码流格式确定转码方案, 通过计算单元完 成码流的转换, 最后通过输出单元输出转换后的码流; 从而较好地实现了立 体视频码流和平面视频码流间的互相转换。
如图 2所示, 为本发明码流识别单元实施例的结构示意图, 该码流识别 单元包括: 读取模块 21 , 用于读取待转换的原始码流, 上述原始码流包括立 体视频码流或平面视频码流; 解析模块 22, 用于对上述原始码流进行解析, 得到所述原始码流对应的原始码流格式。
当原始码流为立体视频码流时,读取模块 21可以读取待转换的立体视频 码流; 当原始码流为平面视频码流时, 读取模块 21可以读取待转换的平面视 频码流, 解析模块 22用于对读取后的码流进行解析, 从而得到与原始码流对 应的原始码流格式。
上述码流识别单元, 通过对原始码流进行解析, 获取原始码流对应的原 始码流格式, 为实现立体视频码流和平面频码流间的互相转换作好了选取转 码方案的准备。
如图 3所示, 为本发明方案确定单元实施例的结构示意图, 该方案确定 单元包括: 接收模块 31 , 用于接收解析原始码流获取的原始码流格式; 确定 模块 32,用于根据目标码流格式和上述解析后的原始码流格式确定转码方案。 该目标码流格式可以是预先设置的, 也可以是从接收的信令中获取的。
当上述原始码流格式为平面视频码流格式时, 上述目标码流格式为立体 视频码流格式; 当上述原始码流格式为立体视频码流格式时, 上述目标码流 格式为平面视频码流格式, 相应地, 转码方案可以包括: 当原始码流为立体 视频码流, 目标码流为平面视频码流时, 上述确定模块 32根据解析原始码流 获取的立体视频码流格式和平面视频码流格式确定转码方案; 当原始码流为
平面视频码流, 目标码流为立体视频码流时, 上述确定模块 32根据解析原始 码流获取的平面视频码流格式和立体视频码流格式确定转码方案。
上述方案确定单元, 根据目标码流格式和解析原始码流获取的原始码流 格式确定转码方案, 从而可以根据该转码方案实现立体视频码流和平面频码 流间的互相转换。
如图 4所示, 为本发明码流转换方法实施例一的流程图, 该方法包括: 步骤 101、 接收待转换的原始码流;
该步骤为可选步骤, 输入单元接收待转换的原始码流, 此处原始码流可 以包括立体视频码流、 平面视频码流等;
举例来说, 该立体视频码流可以为按照 H.264/ AVC格式编码的双目立体 视频码流、按照 H.263标准编码的拼帧结构的立体视频码流或者按照 MPEG-4 标准编码的拼帧结构的立体视频码流等等, 该平面视频码流可以为普通的 H.264码流等等
步骤 102、 读取待转换的原始码流;
通过码流识别单元读取待转换的原始码流;
步骤 103、对上述原始码流进行解析,获取原始码流对应的原始码流格式, 并将所述原始码流格式发送给方案确定单元, 以便方案确定单元根据目标码 流格式和解析原始码流获取的原始码流格式确定转码方案;
码流识别单元可以对上述原始码流进行解析, 获取该原始码流对应的原 始码流格式, 并将该原始码流格式发送至方案确定单元, 以便方案确定单元 根据目标码流格式和解析原始码流获取的码流格式确定转码方案; 该步骤包 括: 当原始码流为立体视频码流, 目标码流为平面视频码流时, 对立体视频 码流进行解析, 获取该立体视频码流对应的立体视频码流格式, 并根据解析 该立体视频码流获取的立体视频码流格式和目标码流的平面视频码流格式确 定转码方案; 当原始码流为平面视频码流, 目标码流为立体视频码流时, 对 平面视频码流进行解析, 获取该平面视频码流对应的片面视频码流格式, 并
根据解析该平面视频码流获取的平面视频码流格式和目标码流的立体视频码 流格式确定转码方案; 上述立体视频码流可以为基本码流和视差信息, 上述 平面视频码流格式可以为基本码流; 上述立体视频码流格式也可以为由基本 码流和视差信息拼成的帧, 上述平面视频码流格式也可以为基本码流; 上述 平面视频码流格式还可以为基本码流, 上述立体视频码流格式还可以为左右 通道视频帧交织生成的新视频帧, 上述三种情况只是对平面视频码流格式和 立体视频码流格式的举例, 但不限于上述三种情况;
步骤 104、根据上述转码方案对原始码流进行解码、对解码后的码流进行 编码, 完成码流转换;
该步骤为可选步骤, 由计算单元根据上述转码方案, 应用原始码流格式 对所述原始码流进行解码、 应用目标码流格式对解码后的码流进行编码, 完 成码流转换, 得到与所述目标码流格式对应的目标码流。
步骤 105、 输出转换后的目标码流。
该步骤为可选步骤, 由输出单元输出转换后的目标码流。
上述码流转换方法, 通过对原始码流进行解析得到原始码流对应的原始 码流格式, 并根据目标码流格式及原始码流的原始码流格式确定转码方案, 从而可以实现立体视频码流和平面视频码流间的互相转换。
如图 5所示, 为本发明码流转换方法实施例二的流程图, 该方法包括: 步骤 201、对读取的待转换的原始码流进行解析,得到原始码流对应的原 始码流格式;
该步骤为可选步骤, 首先由输入单元接收待转换的原始码流, 然后由码 流识别单元读取上述原始码流, 并对上述原始码流进行解析, 得到原始码流 对应的原始码流格式;
步骤 202、 接收目标码流格式和解析原始码流获取的原始码流格式; 方案确定单元可以接收信令中携带的目标码流格式和解析原始码流获取 的原始码流格式; 该目标码流格式也可以预先设置在方案确定单元中。
步骤 203、根据目标码流格式和解析原始码流获取的原始码流格式确定转 码方案, 并将该转码方案发送给计算单元;
方案确定单元根据目标码流格式和解析原始码流获取的原始码流格式确 定转码方案; 该步骤可以包括: 当原始码流为立体视频码流, 目标码流为平 面视频码流时, 对立体视频码流进行解析, 获取该立体视频码流对应的立体 视频码流格式, 并根据解析该立体视频码流获取的立体视频码流格式和目标 码流的平面视频码流格式确定转码方案; 当原始码流为平面视频码流, 目标 码流为立体视频码流时, 对平面视频码流进行解析, 获取该平面视频码流对 应的片面视频码流格式, 并根据解析该平面视频码流获取的平面视频码流格 式和目标码流的立体视频码流格式确定转码方案; 将上述转码方案发送至计 算单元;
步骤 204、根据上述转码方案对原始码流进行解码、对解码后的码流进行 编码, 完成码流转换;
该步骤为可选步骤, 由计算单元根据上述转码方案, 应用原始码流格式 对所述原始码流进行解码、 应用目标码流格式对解码后的码流进行解码、 应 用目标码流格式对解码后的码流进行编码, 完成码流转换, 得到与所述目标 码流格式对应的目标码流。
步骤 205、 输出转换后的目标码流。
该步骤为可选步骤, 由输出单元输出转换后的码流。
上述码流转换方法, 通过根据解析得到原始码流对应的原始码流格式, 并根据目标码流格式及原始码流的原始码流格式确定转码方案, 从而可以实 现立体视频码流和平面视频码流间的互相转换。
如图 6所示, 为本发明码流转换方法实施例三的流程图, 该实施例是将 按照 H.264/高级视频编码 (Advanced Video Coding, AVC)格式编码的双目立 体视频码流转换成普通的 H.264码流, 其中, 双目立体视频码流包括两部分 视频数据: 左通道平面视频数据和右通道视频数据相对与左通道视频数据的
深度 /视差信息,深度 /视差信息的获取可以通过在左右通道视频帧之间进行立 体匹配得到或者由深度摄像机直接摄取, 双目立体视频码流由左通道视频数 据作为普通视频数据按照 H.264/AVC标准编码成基本码流, 与基本码流每一 视频帧对应的视差信, 按照普通灰度图像帧编码到补充增强信 , ¾ (Supplemental Enhancement Information, SEI)信息中 , SEI信息附力口在基本码 流的每一帧前构成的, 该方法包括:
步骤 301、 接收待转换的原始双目立体视频码流;
输入单元接收待转换的原始双目立体视频码流;
步骤 302、 对上述原始双目立体视频码流进行解析, 获取原始双目立体 视频码流对应的基本码流 +SEI 类型, 并发送基本码流 +SEI类型;
码流识别单元从输入单元读取输入的原始双目立体视频码流, 并解析上 述原始双目立体视频码流,得到原始码流格式为基本码流 +SEI 类型, 将解析 获取的原始双目立体视频码流的原始码流格式发送给方案确定单元;
步骤 303、 根据解析获取的原始码流格式和 H.264码流格式, 确定转码 方案;
方案确定单元读取该单元的两个输入: 原始码流格式(基本码流 + SEI ) 和目标码流格式 (基本码流),确定转码方案为直接去掉码流中的 SEI信息, 同 时修改部分参数;
步骤 304、 根据上述转码方案, 对原始码流进行解码、 对解码后的码流 进行编码计算;
计算单元根据转码方案选择单元确定的转码方案, 读取输入数据单元中 的码流数据包, 判断出当前数据包是否为 SEI信息, 如果是, 则直接抛弃, 否则, 不作任何处理, 直接通过输出数据单元输出;
步骤 305、 输出计算后的目标码流。
输出单元从计算单元得到去掉 SEI信息的目标码流后直接输出。
采用上述码流转换方法, 可以较好地将包含基本码流和视差信息的立体
视频码流转换成包含基本码流的平面视频码流。
与本发明码流转换方法实施例三相对应, 可以将平面视频码流转换成立 体视频码流, 如图 7所示, 为本发明码流转换方法实施例四的流程图, 当输 入的待转换原始码流为普通的 H.264/AVC码流, 目标码流为双目立体视频码 流,要求按照 H.264/AVC标准进行编码,深度 /视差信息按照普通的灰度图编 码到 SEI信息中, 该方法包括:
步骤 401、 接收待转换的平面视频码流;
输入单元接收部分待转换的原始普通 H.264/AVC格式的视频码流; 步骤 402、 对读取的平面视频码流进行解析, 获取平面视频码流对应的 原始码流格式, 并将所述原始码流格式发送给方案确定单元;
码流识别单元从输入单元读取输入的原始码流, 解析上述原始码流, 得 到为 H.264/AVC格式, 并将解析获取的原始码流格式发送给方案确定单元; 步骤 403、 根据解析后的平面码流格式和目标码流格式确定转码方案; 上述目标码流格式为立体视频码流格式, 方案确定单元读取该单元的两 个输入: 平面码流格式 (H.264/AVC格式)和立体视频码流格式 (基本码流 + SEI), 确定转码方案为解析平面码流的视频帧, 进行区域分割, 获取深度信 息, 然后将深度信息按照普通灰度图编码到 SEI信息附加到码流中。
对于获取深度信息过程, 可以包括:
首先, 对平面码流进行图像分割, 得到视频对象, 分割既可以是基于内 容的分割, 也可以是前后景分割; 然后, 对分割得到的不同视频对象赋予不 同的深度信息, 该深度信息可以***默认设置, 也可以指定, 由此可以获取 对应平面码流的深度信息。
步骤 404、 根据上述转码方案进行对原始码流进行解码、 对解码后的码 流进行编码计算;
计算单元根据方案确定单元确定的转码方案, 读取输入单元中的码流数 据包, 解析出视频帧, 然后进行区域分割, 附加深度信息, 深度信息编码到
SEI信息中, 并打包成网络抽象层(NAL )结构;
步骤 405、 输出打包后的目标码流。
输出单元从计算单元得到打包后的目标码流后直接输出。
采用上述码流转换方法, 可以较好地将包含基本码流的平面视频码流转 换成包含基本码流和视差信息的立体视频码流。
如图 8所示, 为本发明码流转换方法实施例五的流程图, 该实施例中原 始码流为立体视频码流, 目标码流为普通平面码流, 立体视频码流格式为 H.264 格式, 其中左通道视频帧和对应的深度 /视差信息拼成一大帧, 按照 H.264/AVC标准编码; 普通平面视频为只包含左通道数据的基本 H.264/AVC 码流, 该方法包括:
步骤 501、 接收待转换的原始立体视频码流;
输入单元接收部分待转换的原始立体视频码流;
步骤 502、 对原始立体视频码流进行解析, 获取原始立体视频码流对应 的原始码流格式;
码流识别单元从输入单元读取待转换的原始立体视频码流, 并对该码流 进行解析, 解析出码流结构为每一帧都包含了左通道视频帧和对应的视差信 息, 并且左通道视频帧和视差信息按照不同的片 (SLICE )进行组织;
步骤 503、 根据解析获取的原始立体视频码流格式和目标码流格式确定 转码方案;
方案确定单元从码流识别单元得到原始码流格式, 确定转码方案为对于 原始码流中每个视频帧中的每个 SLICE, 如果该 SLICE对应的视频帧为左通 道视频帧, 则不作任何处理直接放入输出数据接口; 如果对应的是深度 /视差 信息, 则直接抛弃;
步骤 504、 根据上述转码方案对原始码流进行解码、 对解码后的码流进 行编码计算;
计算单元按照方案确定单元确定的转码方案, 解析码流中每个视频帧
NAL的 SLICE序号, 如果对应的是左通道视频帧, 则不作任何处理, 直接放 入输出单元; 如果对应的是深度 /视差信息, 则直接抛弃;
步骤 505、 输出转换后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将包含由基本码流和视差信息拼成 数据帧的立体视频码流转换成包含基本码流的平面视频码流。
与本发明码流转换方法实施例五相对应, 可以将平面视频码流转换成立 体视频码流, 如图 9所示, 为本发明码流转换方法实施例六的流程图, 本实 施例中待转换的码流为普通的平面码流, 目标码流为按照 H.264/AVC标准编 码的拼帧结构的立体视频码流, 该方法包括:
步骤 601、 接收待转换的平面视频码流;
输入单元接收部分待转换的平面视频码流;
步骤 602、 对上述平面视频码流进行解析, 获取平面视频码流对应的原 始码流格式;
码流识别单元从输入单元读取待转换的原始按照 H.264/AVC标准编码 的普通平面视频码流, 解析上述码流, 并解析出原始码流格式;
步骤 603、 根据解析后的平面视频码流的原始码流格式和目标视频码流 的目标码流格式确定转码方案;
方案确定单元从码流识别单元得到解析后的平面视频码流格式, 根据上 述平面视频码流格式和立体视频码流格式确定转码方案为对于平面视频码流 中每个视频帧;
步骤 604、 根据转码方案进行对原始码流进行解码、 对解码后的码流进 行编码计算;
计算单元按照方案确定单元确定的转码方案, 解析码流中每个视频帧, 进行解码、 区域分割, 获取深度信息, 并将上述深度信息按照新的 SLICE进 行编码、 打包, 完成码流转换。
对于获取深度信息过程, 可以包括:
首先, 对平面码流进行图像分割, 得到视频对象, 分割既可以是基于内 容的分割, 也可以是前后景分割; 然后, 对分割得到的不同视频对象赋予不 同的深度信息, 该深度信息可以***默认设置, 也可以指定, 由此可以获取 对应平面码流的深度信息。
步骤 605、 输出转码后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将包含基本码流的平面视频码流转 换成包含由基本码流和视差信息拼成数据帧的立体视频码流。
如图 10所示,为本发明码流转换方法实施例七的流程图,在该实施例中, 待转换的码流为立体视频码流, 立体视频码流格式为双目立体视频码流, 每 一帧结构为左右通道视频帧交织结合成新的视频帧; 目标码流为普通平面码 流, 编码标准可以为已知的任一标准, 该方法包括:
步骤 701、 接收待转换的原始立体视频码流;
输入单元接收部分待转换的原始立体视频码流;
步骤 702、 对原始立体视频码流进行解析, 获取该原始立体视频码流对 应的原始码流格式;
码流识别单元从输入单元读取待转换的原始立体视频码流后, 解析上述 码流, 并解析出原始码流格式为交织结构;
步骤 703、 根据解析获取的原始立体视频码流格式和目标码流格式确定 转码方案;
方案确定单元从码流识别单元得到原始码流格式和目标码流格式, 确定 转码方案为对于原始立体视频码流中的每个视频帧;
步骤 704、 根据转码方案对原始码流进行解码、 对解码后的码流进行编 码计算;
计算单元按照转码方案对于原始立体视频码流中每个视频帧进行解码,
提取出其中一个通道的视频帧, 进行重新编码;
步骤 705、 输出转换后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将由左右通道视频帧交织结合成新 的视频帧的立体视频码流转换成普通平面视频码流。
与本发明码流转换方法实施例七相对应, 可以将平面视频码流转换成立 体视频码流, 如图 1 1所示, 为本发明码流转换方法实施例八的流程图, 该实 施例中, 待转换得码流位普通平面视频码流, 目标码流为立体视频码流, 该 方法包括:
步骤 801、 接收待转换的一个通道普通平面视频码流;
输入单元接收部分待转换的一个通道普通平面视频码流;
步骤 802、 对上述普通平面视频码流进行解析, 获取该普通平面视频码 流对应的原始码流格式;
码流识别单元从输入单元读取待转换的原始普通平面视频码流, 解析上 述码流, 并解析出原始码流格式;
步骤 803、 根据解析获取的普通平面视频码流格式和目标码流格式确定 转码方案;
方案确定单元根据目标码流格式和解析后的普通平面视频码流格式, 确 定转码方案为对于原始码流中每个视频帧;
步骤 804、 根据上述转码方案对原始码流进行解码、 对解码后的码流进 行编码计算;
计算单元按照方案确定单元确定的转码方案,解析码流中的每个视频帧, 进行区域分割, 获取深度信息, 并将其转换为视差信息; 然后重构出另一通 道对应的视频帧, 交织组成新的视频帧, 并进行编码, 完成码流转换。
对于获取深度信息过程, 可以包括:
首先, 对平面码流进行图像分割, 得到视频对象, 分割既可以是基于内
容的分割, 也可以是前后景分割; 然后, 对分割得到的不同视频对象赋予不 同的深度信息, 该深度信息可以***默认设置, 也可以指定, 由此可以获取 对应平面码流的深度信息。
步骤 805、 输出转换后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将普通平面视频码流转换成由左右 通道视频帧交织结合成新的视频帧的立体视频码流。
通过上述码流转换方法实施例可以看出: 采用本发明提供的技术方案可 以较好地将各种形式的立体视频码流转换成平面视频码流, 相应地, 也可以 将平面视频码流转换成各种形式的立体视频码流。
如图 12所示, 为本发明码流转换方法实施例九的流程图,本实施例中待 转换的原始码流为普通 H.264/AVC格式的平面码流, 目标码流为按照 H.263 标准编码的拼帧结构的立体视频码流, 该方法包括:
步骤 901、 接收待转换的普通的 H.264/AVC格式的平面码流;
输入单元接收部分待转换的普通的 H.264/AVC格式的平面码流; 步骤 902、 对上述 H.264/AVC格式的平面码流进行解析, 获取该
H.264/AVC格式的平面码流对应的原始码流格式;
码流识别单元从输入单元读取待转换的原始按照 H.264标准编码的普通 的平面码流, 解析上述平面码流, 并解析出原始码流格式;
步骤 903、 根据解析获取的原始码流格式和目标视频码流格式确定转码 方案;
方案确定单元从码流识别单元得到解析后的码流结构, 根据上述平面视 频码流格式和立体视频码流格式确定转码方案为对于平面视频码流中每个视 频帧;
步骤 904、 根据转码方案对原始码流进行解码、 对解码后的码流进行编 码计算;
计算单元按照方案确定单元确定的转码方案, 解析码流中每个视频帧, 进行解码、 区域分割, 获取深度信息, 并将上述深度信息作为图像, 与解码 的视频帧拼接起来, 构成新的视频帧, 后按照 H263标准进行编码, 打包。 其中拼接构成新的视频帧的方式可以是交错式,也可以是并排式等多种方式。
对于获取深度信息过程, 可以包括:
首先, 对平面码流进行图像分割, 得到视频对象, 分割既可以是基于内 容的分割, 也可以是前后景分割; 然后, 对分割得到的不同视频对象赋予不 同的深度信息, 该深度信息可以***默认设置, 也可以指定, 由此可以获取 对应平面码流的深度信息。
步骤 905、 输出转码后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将包含基本码流的平面视频码流转 换成包含由基本码流和视差信息拼成数据帧的立体视频码流。
如图 13所示, 为本发明码流转换方法实施例十的流程图,本实施例中待 转换的码流为普通的平面码流, 目标码流为按照 MPEG-4标准编码的拼帧结 构的立体视频码流, 该方法包括:
步骤 911、 接收待转换的平面码流;
输入单元接收部分待转换的平面码流;
步骤 912、 对上述平面码流进行解析, 获取原始码流对应的原始码流格 式;
码流识别单元从输入单元读取待转换的原始按照 H.264标准编码的普通 平面视频码流, 解析上述码流, 并解析出码流结构;
步骤 913、 根据解析获取的平面视频码流格式和立体视频码流格式确定 转码方案;
方案确定单元从码流识别单元得到解析后的平面视频码流格式, 根据上 述平面视频码流格式和立体视频码流格式确定转码方案为对于平面视频码流
中每个视频帧;
步骤 914、 根据转码方案对原始码流进行解码、 对解码后的码流进行编 码计算;
计算单元按照方案确定单元确定的转码方案, 解析码流中每个视频帧, 进行解码、 区域分割, 获取深度信息, 并将上述深度信息作为图像, 与解码 的视频帧拼接起来, 构成新的视频帧, 后按照 MPEG-4标准进行编码, 打包。 其中拼接构成新的视频帧的方式可以是交错式,也可以是并排式等多种方式。
对于获取深度信息过程, 可以包括:
首先, 对平面码流进行图像分割, 得到视频对象, 分割既可以是基于内 容的分割, 也可以是前后景分割; 然后, 对分割得到的不同视频对象赋予不 同的深度信息, 该深度信息可以***默认设置, 也可以指定, 由此可以获取 对应平面码流的深度信息。
步骤 915、 输出转码后的目标码流。
输出单元将转换后的目标码流直接输出。
采用上述码流转换方法, 可以较好地将包含基本码流的平面视频码流转 换成包含由基本码流和视差信息拼成数据帧的立体视频码流。
最后应说明的是: 以上实施例仅用以说明本发明的技术方案, 而非对其 限制; 尽管参照前述实施例对本发明进行了详细的说明, 本领域的普通技术 人员应当理解: 其依然可以对前述各实施例所记载的技术方案进行修改, 或 者对其中部分技术特征进行等同替换; 而这些修改或者替换, 并不使相应技 术方案的本质脱离本发明各实施例技术方案的精神和范围。
Claims
1、 一种码流转换***, 其特征在于包括:
码流识别单元, 用于对读取的待转换的原始码流进行解析, 得到原始码 流对应的原始码流格式;
方案确定单元, 用于根据目标码流格式和解析得到的原始码流格式确定 转码方案;
计算单元, 用于根据所述转码方案, 应用所述原始码流格式对所述原始 码流进行解码、 并应用所述目标码流格式对解码后的码流进行编码, 完成码 流转换, 得到与所述目标码流格式对应的目标码流。
2、 根据权利要求 1所述的码流转换***, 其特征在于还包括: 输入单元, 用于接收待转换的原始码流, 所述原始码流包括立体视频码 流或平面视频码流;
输出单元, 用于输出所述计算单元进行码流转换后的目标码流。
3、 一种码流识别单元, 其特征在于包括:
读取模块, 用于读取待转换的原始码流, 所述原始码流包括立体视频码 流;
解析模块, 用于对所述原始码流进行解析, 得到所述原始码流对应的原 始码流格式。
4、 一种方案确定单元, 其特征在于包括:
接收模块, 用于接收解析原始码流获取的原始码流格式;
确定模块, 用于根据目标码流格式和所述原始码流格式确定转码方案。
5、 一种码流转换方法, 其特征在于包括:
接收解析原始码流获取的原始码流格式;
根据目标码流格式和所述原始码流格式确定转码方案, 并根据所述转码 方案应用所述原始码流格式对所述原始码流进行解码、 应用所述目标码流格 式对解码后的码流进行编码, 完成码流转换, 得到与所述目标码流格式对应
的目标码流。
6、 根据权利要求 5所述的码流转换方法, 其特征在于,
当所述原始码流格式为平面视频码流格式时, 所述目标码流格式为立体 视频码流格式; 当所述原始码流格式为立体视频码流格式时, 所述目标码流 格式为平面视频码流格式。
7、 根据权利要求 6所述的码流转换方法, 其特征在于所述立体视频码 流包括基本码流和视差信息, 所述平面视频码流包括基本码流。
8、 根据权利要求 6所述的码流转换方法, 其特征在于所述平面视频码 流包括基本码流, 所述立体视频码流包括由基本码流和视差信息拼成的帧。
9、 根据权利要求 6所述的码流转换方法, 其特征在于所述平面视频码 流包括基本码流, 所述立体视频码流包括左右通道视频帧交织生成的新视频 帧。
10、 根据权利要求 5〜9中任一权利要求所述的码流转换方法,其特征在 于, 还包括:
对解码后的码流进行图像分割, 获取视频对象;
对分割获取的不同视频对象赋予不同的深度信息。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP09809257A EP2312822A4 (en) | 2008-08-29 | 2009-08-28 | CODE FLOW FORMATION SYSTEM, CODE FLOW RECOGNITION UNIT AND SCHEMA CONFIGURATION UNIT SYSTEM AND METHOD |
US13/036,913 US20110149033A1 (en) | 2008-08-29 | 2011-02-28 | Code stream conversion system and method, code stream identifying unit and solution determining unit |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810119459.8 | 2008-08-29 | ||
CN2008101194598A CN101662677B (zh) | 2008-08-29 | 2008-08-29 | 码流转换***及方法、码流识别单元和方案确定单元 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/036,913 Continuation US20110149033A1 (en) | 2008-08-29 | 2011-02-28 | Code stream conversion system and method, code stream identifying unit and solution determining unit |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010022672A1 true WO2010022672A1 (zh) | 2010-03-04 |
Family
ID=41720845
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2009/073612 WO2010022672A1 (zh) | 2008-08-29 | 2009-08-28 | 码流转换***及方法、码流识别单元和方案确定单元 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20110149033A1 (zh) |
EP (1) | EP2312822A4 (zh) |
CN (1) | CN101662677B (zh) |
WO (1) | WO2010022672A1 (zh) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010087575A2 (en) * | 2009-02-01 | 2010-08-05 | Lg Electronics Inc. | Broadcast receiver and 3d video data processing method |
CN102055983B (zh) * | 2011-01-26 | 2013-01-23 | 北京世纪鼎点软件有限公司 | 基于标准的h.264解码器的mvc-3d立体视频的解码方法 |
CN102801990B (zh) * | 2011-05-24 | 2016-09-07 | 传线网络科技(上海)有限公司 | 基于互联网服务端立体视频实时转码方法及*** |
CN102801989B (zh) * | 2011-05-24 | 2015-02-11 | 传线网络科技(上海)有限公司 | 基于互联网客户端立体视频实时转码方法及*** |
US20130044192A1 (en) * | 2011-08-17 | 2013-02-21 | Google Inc. | Converting 3d video into 2d video based on identification of format type of 3d video and providing either 2d or 3d video based on identification of display device type |
CN104053019A (zh) * | 2013-03-12 | 2014-09-17 | 中兴通讯股份有限公司 | 基于虚拟桌面的视频播放、处理方法及装置 |
US9537779B2 (en) * | 2013-10-11 | 2017-01-03 | Huawei Technologies Co., Ltd. | System and method for real-time traffic delivery |
US10284858B2 (en) * | 2013-10-15 | 2019-05-07 | Qualcomm Incorporated | Support of multi-mode extraction for multi-layer video codecs |
CN104104897B (zh) * | 2014-06-27 | 2018-10-23 | 北京奇艺世纪科技有限公司 | 一种移动终端的视频编辑方法和装置 |
US20160277751A1 (en) * | 2015-03-19 | 2016-09-22 | Patrick J. Sweeney | Packaging/mux and unpackaging/demux of geometric data together with video data |
CN109788314B (zh) * | 2018-12-18 | 2021-05-11 | 视联动力信息技术股份有限公司 | 一种视频流数据传输的方法和装置 |
CN112584182B (zh) * | 2019-09-30 | 2024-01-09 | 华为云计算技术有限公司 | 多码率直播转码的数据包封装方法以及相关设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1485989A (zh) * | 2002-08-30 | 2004-03-31 | ��ʿͨ��ʽ���� | 数据编码/解码设备 |
CN2634757Y (zh) * | 2003-09-09 | 2004-08-18 | 北京华通为尔广视科技有限公司 | 数字视频录像装置 |
CN1617589A (zh) * | 2004-05-19 | 2005-05-18 | 深圳市富来科技有限公司 | 大容量数字视频广播多节目传输流传输***及其方法 |
WO2007068648A1 (en) * | 2005-12-12 | 2007-06-21 | Thomson Licensing | Method and device for watermarking on stream |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7254265B2 (en) * | 2000-04-01 | 2007-08-07 | Newsight Corporation | Methods and systems for 2D/3D image conversion and optimization |
US20050259147A1 (en) * | 2002-07-16 | 2005-11-24 | Nam Jeho | Apparatus and method for adapting 2d and 3d stereoscopic video signal |
US20050018911A1 (en) * | 2003-07-24 | 2005-01-27 | Eastman Kodak Company | Foveated video coding system and method |
JP2005184377A (ja) * | 2003-12-18 | 2005-07-07 | Sharp Corp | 画像変換装置及びそれを用いた画像記録装置 |
JP2007525920A (ja) * | 2004-03-01 | 2007-09-06 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | ビデオ信号エンコーダ、ビデオ信号プロセッサ、ビデオ信号配信システム及びビデオ信号配信システムの動作方法 |
CN101242538B (zh) * | 2008-03-18 | 2010-06-02 | 华为技术有限公司 | 一种码流解码方法和装置 |
US8106924B2 (en) * | 2008-07-31 | 2012-01-31 | Stmicroelectronics S.R.L. | Method and system for video rendering, computer program product therefor |
US8629899B2 (en) * | 2009-08-06 | 2014-01-14 | Qualcomm Incorporated | Transforming video data in accordance with human visual system feedback metrics |
-
2008
- 2008-08-29 CN CN2008101194598A patent/CN101662677B/zh active Active
-
2009
- 2009-08-28 WO PCT/CN2009/073612 patent/WO2010022672A1/zh active Application Filing
- 2009-08-28 EP EP09809257A patent/EP2312822A4/en not_active Withdrawn
-
2011
- 2011-02-28 US US13/036,913 patent/US20110149033A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1485989A (zh) * | 2002-08-30 | 2004-03-31 | ��ʿͨ��ʽ���� | 数据编码/解码设备 |
CN2634757Y (zh) * | 2003-09-09 | 2004-08-18 | 北京华通为尔广视科技有限公司 | 数字视频录像装置 |
CN1617589A (zh) * | 2004-05-19 | 2005-05-18 | 深圳市富来科技有限公司 | 大容量数字视频广播多节目传输流传输***及其方法 |
WO2007068648A1 (en) * | 2005-12-12 | 2007-06-21 | Thomson Licensing | Method and device for watermarking on stream |
Also Published As
Publication number | Publication date |
---|---|
CN101662677B (zh) | 2011-08-10 |
CN101662677A (zh) | 2010-03-03 |
EP2312822A4 (en) | 2011-08-03 |
EP2312822A1 (en) | 2011-04-20 |
US20110149033A1 (en) | 2011-06-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2010022672A1 (zh) | 码流转换***及方法、码流识别单元和方案确定单元 | |
US10129525B2 (en) | Broadcast transmitter, broadcast receiver and 3D video data processing method thereof | |
TWI581613B (zh) | 用於編碼標準可縮放性之層間參考圖像處理技術 | |
JP5072996B2 (ja) | 三次元ビデオ符号化に関するシステム及び方法 | |
KR101619448B1 (ko) | 영상 신호 처리 방법 및 장치 | |
JP4947389B2 (ja) | 画像信号復号装置、画像信号復号方法、および画像信号符号化方法 | |
US20120212579A1 (en) | Method and Arrangement for Multi-View Video Compression | |
US20100110163A1 (en) | Method and system for encoding a video data signal, encoded video data signal, method and sytem for decoding a video data signal | |
JP2013192258A (ja) | ハイレベル・シンタックスで伝送されるマルチビュー情報のための方法および装置 | |
US8798356B2 (en) | Apparatus and method for encoding and decoding multi-view image | |
KR20140035065A (ko) | 다시점 비디오 인코딩 및 디코딩 방법 및 이를 이용한 인코딩 및 디코딩 장치 | |
CA2887120A1 (en) | Method and device for processing video signal | |
Kumar et al. | A Comparative Analysis of Advance Three Dimensional Video Coding for Mobile Three Dimensional TV | |
CN116057934A (zh) | 多视图相关的辅助增强信息消息 | |
JP5355606B2 (ja) | ステレオ動画像符号化方法、装置およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09809257 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009809257 Country of ref document: EP |