WO2013134990A1 - 用于三维图像数据发送、接收、传输的方法和装置 - Google Patents

用于三维图像数据发送、接收、传输的方法和装置 Download PDF

Info

Publication number
WO2013134990A1
WO2013134990A1 PCT/CN2012/074623 CN2012074623W WO2013134990A1 WO 2013134990 A1 WO2013134990 A1 WO 2013134990A1 CN 2012074623 W CN2012074623 W CN 2012074623W WO 2013134990 A1 WO2013134990 A1 WO 2013134990A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
view
dimensional image
image data
group
Prior art date
Application number
PCT/CN2012/074623
Other languages
English (en)
French (fr)
Inventor
尚国强
陈军
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2013134990A1 publication Critical patent/WO2013134990A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies

Definitions

  • the present invention relates to the field of multimedia communications, and in particular, to a method and apparatus for transmitting, receiving, and transmitting three-dimensional image data. Background technique
  • 3D (Three Dimensions, 3D) multimedia content is increasing.
  • 3D movies and 3D TVs are increasingly entering the homes of ordinary people, but transmitting 3D data and displaying 3D image bandwidth.
  • the requirements for hardware are very high.
  • 3D data transmission is represented by 2D (Two Dimensions) data plus depth data, and is also transmitted through such a data stream, that is, it is necessary to transmit complete 2D data and depth data.
  • the 3D image is better displayed. In the case of a small bandwidth, this data transmission method is very slow, and it is impossible to select the transmission image data according to the image quality requirements. Summary of the invention
  • the main technical problem to be solved by the present invention is to provide a method and device for transmitting, receiving, and transmitting three-dimensional image data, which can use another transmission mode to avoid selecting image transmission data and view reorganization according to bandwidth conditions and image quality requirements.
  • a method for transmitting three-dimensional image data includes the following steps:
  • Reading three-dimensional image data to be transmitted
  • Parsing the three-dimensional image data into at least three view data where the at least three view data are data sources to be sent; Extracting at least three view data in the to-be-sent data source is packaged into a data packet and transmitted.
  • the three-dimensional image data may also be subjected to group analysis, and the three-dimensional image data is parsed into at least one set of view group data, and each set of the view is At least three view data are included in the group data; and in the step of packaging, at least three of the at least one of the view group data are extracted and packaged into a data packet and sent.
  • the view group data group is left eye view group data or / and right view group data.
  • the process of parsing the three-dimensional image data into the left eye view group data or/and the right eye view group data, respectively, according to the left eye light source data and the right eye light source data, respectively The left eye view group data or/and the right view group data are parsed.
  • a method for receiving three-dimensional image data includes the following steps:
  • the three-dimensional image data packet includes at least three view data; splitting the data packet to obtain view data;
  • a three-dimensional image is displayed based on the three-dimensional image data.
  • each set of the view group data includes at least three view data; during the view reorganization process, at least one is extracted. Grouping at least three view data in the view group data for view reorganization.
  • the view group data is left eye view group data or / and right eye view group data.
  • the method further includes the following steps: extracting left eye light source data and right eye light source Data, and performing view recombination on the left eye view group data or/and the at least three view data in the right eye view group data according to the left eye light source data or/and the right eye light source data respectively .
  • a three-dimensional image data transmission method comprising the above-mentioned three-dimensional image data transmission method and any one of the above-mentioned three-dimensional image data reception methods.
  • a three-dimensional image data transmitting device includes a reading module, a parsing module, a packing module and a sending module;
  • the reading ear module is configured to read three-dimensional image data to be sent
  • the parsing module is configured to parse the three-dimensional image data into at least three view data, where the at least three view data are data sources to be sent;
  • the packaging module is configured to extract at least three view data in the data source to be sent, and package the data into a data packet;
  • the sending module is configured to send the data packet.
  • the parsing module is further configured to perform group parsing on the three-dimensional image data, parse the three-dimensional image data into at least one set of view group data, and include at least three views in each set of the view group data.
  • the data module is further configured to extract at least three view data from at least one of the view group data into a data package.
  • the view group data is left eye view group data or / and right eye view group data.
  • the parsing module further includes a light source data unit, and the parsing module respectively pairs the left eye view group data or/and according to the left eye light source data or/and the right eye light source data provided by the light source data unit.
  • Right-view view group data is parsed.
  • a three-dimensional image data receiving device comprises a receiving module, a splitting module, a recombining module and a display module;
  • the receiving module is configured to receive a three-dimensional data packet, where the three-dimensional image data packet includes at least three view data;
  • the splitting module is configured to split the three-dimensional data data packet to obtain view data of the three-dimensional image
  • the recombining module is configured to perform view recombination on at least three view data in the view data to obtain corresponding three-dimensional image data;
  • the display module is configured to display a three-dimensional image according to the three-dimensional image data.
  • the split module obtains And at least three sets of view data are included in each group of the view group data; and the recombination module extracts at least three view data from at least one set of the view group data for view recombination.
  • the view group data is left eye view group data or / and right eye view group data.
  • the recombining module is further configured to extract left eye view group data or/and left eye light source data or/and right eye light source data in the right eye view group data, and according to the left eye light source The data or/and the right eye source data respectively perform view recombination on the left eye view group data or/and the at least three view data extracted in the right eye view group data.
  • a three-dimensional image data transmitting apparatus comprising the three-dimensional image data transmitting apparatus according to any one of the above-mentioned ones, and the three-dimensional image data receiving apparatus according to any one of the above-mentioned ones.
  • the beneficial effects of the present invention are: by parsing a three-dimensional image into a plurality of views or groups of views at the transmitting end, and selectively transmitting and transmitting to a plurality of views or groups of views; and selectively performing the pairing of views at the receiving end Reorganization.
  • the fast transmission of the three-dimensional image in another manner is realized, and the number of the analysis resolution views and the selective resolution of the analysis view can be automatically selected according to the bandwidth and the quality requirements of the desired image.
  • the transmission efficiency of the three-dimensional image is improved; the requirements of different devices for different image quality are satisfied, and the display of the three-dimensional image is more diverse.
  • FIG. 1 is a schematic diagram showing the analysis of three-dimensional image data in a method for transmitting three-dimensional image data according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a packing mode in a method for transmitting three-dimensional image data in still another embodiment of the present invention
  • FIG. 3 is a schematic diagram of a view group data packing manner in a method for transmitting a three-dimensional image data according to another embodiment of the present invention.
  • FIG. 4 is a flowchart of a three-dimensional image data transmission method in the present invention
  • Figure 5 is a schematic structural view of a three-dimensional image data transmitting apparatus of the present invention
  • FIG. 6 is a schematic structural view of a three-dimensional image data receiving apparatus of the present invention.
  • Figure 7 is a block diagram showing the structure of a three-dimensional image data transmission device of the present invention. detailed description
  • the present invention provides a three-dimensional image data transmission method, and the general inventive idea is as follows: It can be divided into a three-dimensional image data transmitting method and a three-dimensional image data receiving method.
  • the three-dimensional image data transmission method processes the three-dimensional image as follows: First, the three-dimensional image data to be transmitted is read, and the three-dimensional image data is parsed into a plurality of view data, and the parsed view data is packaged and transmitted.
  • the three-dimensional image data receiving method processes the received data packet into: processing the received data packet with the parsed view data to obtain the view data; and then performing the view recombination on the obtained view data to obtain the corresponding three-dimensional image. data.
  • the specific implementation method will be elaborated below:
  • the three-dimensional image data can be parsed into at least three view data in the three-dimensional image data transmitting method, as shown in the left view and the right. View, front view, back view, etc. Further, in a specific operation process, at least three view data may be selected from the parsed view data for packet transmission according to different network bandwidths, so as to reduce the pressure on the network bandwidth.
  • the three-dimensional view data can also be parsed into groups, that is, the three-dimensional image data is parsed into at least one set of view group data; preferably, the left-eye view group data and the right-eye view group can be generally divided into: Data; and in order to reproduce the transmitted three-dimensional data into a three-dimensional image, at least three parsed view data should be included in the view group data.
  • At least one group of view group data can be packaged and sent, because a single
  • the image formed by the reorganization of the view group data is also a three-dimensional image, that is, one view group data in the left eye view group data and the right eye view group data may be packaged and sent, or may be formed into a three-dimensional image after recombination.
  • the three-dimensional image when analyzing the three-dimensional image, it can also be analyzed according to the light source data, taking the left and right eye view group data as an example, and also according to the left eye light source data and the right eye light respectively.
  • the source data parses the left eye view group data and the right eye view group data, wherein the left eye view group data is parsed according to the left eye source data, and correspondingly, the right eye view group data is parsed according to the right eye source data;
  • a single group of view group data can be reorganized into a three-dimensional image, so the view group data after parsing according to the source data can also be packaged and sent individually.
  • the view data is used as a data source to be sent, and then at least three view data in the data source to be sent are extracted and packaged into a data packet and sent.
  • the following provides a specific packaging method to explain the packaging process in detail:
  • FIG. 2 taking a view group data as an example to illustrate the packaging process.
  • the view group type is used to indicate whether the view group data is left eye view group data or right eye view group data or other view group data; the number and type of views use 8 bytes of one byte to indicate which view group
  • the view and the order of these views, each bit represents a view, so that there can be up to 8 views; in 6 views, in order of byte order, it is left view, right view, top view, bottom view, Front view, rear view.
  • the byte is displayed as 01101100 (when it is 1 on a certain byte, it can indicate that it has the view, and when it is 0, it means there is no such view), it means that there is a right view, a top view, and a front view in the view group.
  • the view data is the data for each view in the view group.
  • the data packet includes two sets of view group data, which are left eye view group data and right eye view group data, and each group includes four view data, and I U in the figure.
  • I L 2, IL3, I L4 respectively represent view data of four views in the left-eye view group data, correspondingly, I R1 , I R2 , IR 3 , and I R4 represent view data of four views in the right eye view group data, respectively.
  • the three-dimensional image data packet is processed correspondingly, and when the data packet with at least three view data is received, the data packet is split to obtain view data or at least one.
  • Group view group data then reorganize these views according to a preset calculation method to obtain a three-dimensional image.
  • at least three views in the view data may be selected for recombination according to computing power or image quality requirements, or at least three view data in at least one group of view group data may be selected for recombination to obtain corresponding three-dimensional images. Image, this saves computation time and reduces the amount of computational effort.
  • the commonly used ones can generally be split into the left eye view group data and the right eye view group data, and the view data can be extracted therefrom for the reorganization of the three-dimensional image data; and in the process of extracting the view group data
  • the light source data can also be extracted, and the light source data corresponds to the view group data. If only the left eye view group data exists in the data packet, correspondingly, the light source data is the left eye light source data.
  • the left eye light source data and the right eye light source data may be extracted; in order to make the reconstructed three-dimensional image better displayed, the left eye view group data may be compared according to the left eye light source data.
  • At least three view data in the view are reorganized, and at least three view data in the right eye view group data are reorganized according to the right eye source data.
  • the present invention further provides a three-dimensional image data transmission method.
  • the specific transmission step includes the above-mentioned three-dimensional image data transmission method and three-dimensional image data reception method, and the simple steps can be summarized as: reading three-dimensional image data; Parsing the parsed at least three view data, and transmitting the data packet; receiving the data packet at the receiving end, and splitting the same; and reconstructing the split view data to obtain a three-dimensional image Data; and display the 3D image data.
  • the specific operational steps have been described in detail in the above three-dimensional image data transmitting method and three-dimensional image data receiving method.
  • the present invention also provides a three-dimensional image data transmission device, which specifically includes: a three-dimensional image data transmitting device and a three-dimensional image data receiving device.
  • the three-dimensional image data transmitting device mainly includes a reading block 4 and an analytical module. a block, a packing module, and a sending module; wherein, the reading module is mainly used to read the three-dimensional image data to be sent; the parsing module is mainly used to parse the three-dimensional image data into at least three view data, and the at least three view data are to be
  • the data module is configured to extract at least three view data in the data source to be sent and package the data into a data packet; the sending module is configured to send and process the data packet.
  • the parsing module is further configured to perform group parsing on the three-dimensional image data, that is, parse the three-dimensional image data into at least one set of view group data, and in order to enable the three-dimensional image data to be smoothly imaged, each set of view group data should include at least three
  • the packaging module is further configured to extract at least three view data from the at least one view group data into a data packet.
  • view group data can be generally divided into left eye view group data and right eye view group data.
  • the two sets of data can be sent together or in a single group, because a single set of view group data can also be reorganized into a three-dimensional view.
  • a light source data unit may be added in the parsing module, which may provide the light source data for the parsing module, taking the left and right eye view group data as an example, which may provide the left eye light source data and the right eye light source for the parsing module.
  • the data enables the parsing module to parse the left eye view group data and the right eye view group data according to the corresponding light source data, that is, the left eye light source data is used to parse the left eye view group data, and the right eye light source data is used to parse the right eye view data.
  • the corresponding light source data that is, the left eye light source data is used to parse the left eye view group data, and the right eye light source data is used to parse the right eye view data.
  • the method includes: a receiving module, a splitting module, a recombining module, and a display module; wherein the receiving module is configured to receive a three-dimensional data packet; the three-dimensional image data packet includes at least three views.
  • the data splitting module is mainly used for splitting the three-dimensional data data packet to obtain the view data of the three-dimensional image; the recombining module is mainly used for performing view recombination on at least three view data in the view data to obtain corresponding three-dimensional image data;
  • the display module mainly displays the three-dimensional image according to the three-dimensional image data.
  • the reorganization module can also reorganize the view group data, which can extract the view data from the view group data.
  • the view group data can generally be the left eye view group data and the right eye view group data.
  • the reorganization module can also extract the light source data when extracting the view data from the view group data, and the light source data corresponds to the view group data, if only the data packet exists
  • the left eye view group data correspondingly, the light source data is the left eye light source data.
  • the light source data is the left eye light source data and the right eye light source data
  • the recombining module can use the light source data to perform view recombination on the left eye view group data and the right eye view group data respectively.
  • the present invention further provides a three-dimensional image data transmission apparatus, which comprises the three-dimensional image data transmitting apparatus and the three-dimensional image data receiving apparatus provided by the present invention, and the specific structure of the apparatus is in the above three-dimensional image data transmitting apparatus and three-dimensional
  • a three-dimensional image data transmission apparatus which comprises the three-dimensional image data transmitting apparatus and the three-dimensional image data receiving apparatus provided by the present invention, and the specific structure of the apparatus is in the above three-dimensional image data transmitting apparatus and three-dimensional
  • the description of the image data receiving device has been described in detail. It is to be understood that the specific embodiments of the invention are limited only by the description. It is to be understood by those skilled in the art that the present invention may be practiced without departing from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明提供一种用于三维图像数据发送、接收、传输的方法和装置。通过在发送端将三维图像数据解析成多个视图数据或视图组数据，可对多个视图数据或视图组数据选择性的打包发送；并通过在接收端对视图数据可选择的进行视图重组。实现了用另一种方式对三维图像数据的快速传输，且可以根据带宽的大小及所需图像的质量要求，自动选择传输视图数量及选择性的对视图数据进行重组。使三维图像的传输效率得到提高；更满足了不同设备对不同图像质量的要求，使三维图像的显示更加多样化。

Description

用于三维图像数据发送、 接收、 传输的方法和装置 技术领域
本发明涉及多媒体通讯领域，特别涉及一种三维图像数据发送、接收、 传输的方法和装置。 背景技术
随着硬件技术的发展和软件的发展， 3D ( Three Dimensions, 三维）类 多媒体内容越来越多， 3D 电影、 3D 电视越来越走入平常百姓家， 但是传 输 3D数据、 显示 3D图像对带宽、 对硬件的要求都非常高， 对于移动通讯 来讲， 在一定程度会吞噬有限的无线资源， 也对有限的电源设备造成重大 的考验。 通常情况下， 3D数据的传输是以 2D ( Two Dimensions, 二维）数 据加上深度数据来表示的， 也通过这样的数据流来进行传输， 即必须传输 完整的 2D数据和深度数据后才能将 3D图像较好的显示出来， 在带宽较小 的情况下， 这种数据传输方式十分緩慢， 且无法根据图像质量需求选择传 输图像数据。 发明内容
本发明要解决的主要技术问题是：提供一种三维图像数据发送、接收、 传输的方法和装置， 能够使用另一种传输方式， 避免无法根据带宽情况及 图像质量需求选择图像传输数据和视图重组的问题。
为解决上述技术问题， 本发明采用的技术方案如下：
一种三维图像数据发送方法， 包括以下步驟：
读取待发送的三维图像数据；
将所述三维图像数据解析成至少三个视图数据， 所述的至少三个视图 数据为待发送数据源； 提取所述待发送数据源中的至少三个视图数据打包成数据包并发送。 较佳地， 在对所述三维图像数据进行解析的步驟中， 还可以对所述三 维图像数据进行分组解析， 将所述三维图像数据解析成至少一组视图组数 据，且每组所述视图组数据中包括至少三个视图数据；并在打包的步驟中， 提取至少一个所述视图组数据中的至少三个视图数据打包成数据包并发送。
较佳地，所述的视图组数据组为左眼视图组数据或 /和右目艮视图组数据。 较佳地， 在将所述三维图像数据解析成所述左眼视图组数据或 /和所述 右眼视图组数据的过程中， 需分别根据左眼光源数据和右眼光源数据分别 对所述左眼视图组数据或 /和所述右目艮视图组数据进行解析。
一种三维图像数据接收方法， 包括以下步驟：
接收三维图像数据包， 所述三维图像数据包包括至少三个视图数据； 对所述数据包进行拆分， 获得视图数据；
将所述视图数据中的至少三个视图数据进行视图重组， 得到相应的三 维图像数据；
根据所述三维图像数据显示三维图像。
较佳地， 在对所述三维图像数据包进行拆分后， 得到至少一组视图组 数据， 且每组所述视图组数据中包括至少三个视图数据； 在视图重组过程 中， 提取至少一组所述视图组数据中的至少三个视图数据进行视图重组。
较佳地， 所述的视图组数据为左眼视图组数据或 /和右眼视图组数据。 较佳地， 在提取所述左眼视图组数据和所述右眼视图组数据中的所述 至少三个视图数据进行重组的过程中， 还包括以下步驟： 提取左眼光源数 据和右眼光源数据， 并根据所述左眼光源数据或 /和所述右眼光源数据分别 对所述左眼视图组数据或 /和所述右眼视图组数据中的所述至少三个视图数 据进行视图重组。
一种三维图像数据传输方法， 包括以上提到的任何一种所述的三维图 像数据发送方法和以上提到的任何一种所述的三维图像数据接收方法。 一种三维图像数据发送装置， 包括读取模块、 解析模块、 打包模块和 发送模块；
所述读耳 4莫块， 用于读取待发送的三维图像数据；
所述解析模块， 用于将所述三维图像数据解析成至少三个视图数据， 所述的至少三个视图数据为待发送数据源；
所述打包模块， 用于提取所述待发送数据源中的至少三个视图数据， 并将其打包成数据包；
所述发送模块， 用于对所述数据包进行发送。
较佳地， 所述解析模块还用于对所述三维图像数据进行分组解析， 将 所述三维图像数据解析成至少一组视图组数据， 且每组所述视图组数据中 包括至少三个视图数据； 打包模块还用于从至少一个所述视图组数据中提 取至少三个视图数据打包成数据包。
较佳地， 所述的视图组数据为左眼视图组数据或 /和右眼视图组数据。 较佳地， 所述解析模块还包括一个光源数据单元， 所述解析模块根据 所述光源数据单元提供的左眼光源数据或 /和右眼光源数据分别对所述左眼 视图组数据或 /和右目艮视图组数据进行解析。
一种三维图像数据接收装置， 包括接收模块、 拆分模块、 重组模块和 显示模块；
所述接收模块， 用于接收三维数据数据包， 所述三维图像数据包包括 至少三个视图数据；
所述拆分模块， 用于对所述三维数据数据包进行拆分， 获得所述三维 图像的视图数据；
所述重组模块， 用于将所述视图数据中的至少三个视图数据进行视图 重组， 得到相应的三维图像数据；
所述显示模块， 用于根据所述三维图像数据对三维图像进行显示。 较佳地， 所述拆分模块在对所述三维图像数据包进行分组拆分后， 得 到至少一组视图组数据， 且每组所述视图组数据中包括至少三个视图数据； 所述重组模块从至少一组所述视图组数据中提取至少三个视图数据进行视 图重组。
较佳地， 所述的视图组数据为左眼视图组数据或 /和右眼视图组数据。 较佳地， 所述重组模块还用于提取所述左眼视图组数据或 /和所述右眼 视图组数据中的左眼光源数据或 /和右眼光源数据， 并根据所述左眼光源数 据或 /和右眼光源数据分别对所述左眼视图组数据或 /和所述右眼视图组数 据中提取的至少三个视图数据进行视图重组。
一种三维图像数据传输装置， 其特征在于， 包括以上提到的任意一种 所述的三维图像数据发送装置和以上提到的任意一种所述的三维图像数据 接收装置。
本发明的有益效果是： 通过在发送端将三维图像解析成多个视图或视 图组， 并可对多个视图或视图组选择性的打包发送； 并通过在接收端对解 析视图可选择的进行重组。 实现了用另一种方式对三维图像的快速传输， 且可以根据带宽的大小及所需图像的质量要求， 自动选择传输解析视图数 量及选择性的对解析视图进行重组。 使三维图像的传输效率得到提高； 更 满足了不同设备对不同图像质量的要求， 使三维图像的显示更加多样化。 附图说明
图 1 是本发明一实施例三维图像数据发送方法中三维图像数据解析示 意图；
图 2是本发明又一实施例中三维图像数据发送方法中一种打包方式示 意图；
图 3是本发明又一实施例中三维图像数据发送方法中视图组数据打包 方式示意图；
图 4是本发明中的三维图像数据传输方法的流程图； 图 5是本发明的三维图像数据发送装置结构示意图；
图 6是本发明的三维图像数据接收装置结构示意图；
图 7是本发明的三维图像数据传输装置结构示意图。 具体实施方式
为使本发明的技术方案和优点更加清楚， 下面通过具体实施方式结合 附图对本发明作进一步详细说明。
为了改变现有三维图像传输中需以二维数据加上深度数据为传输数据 的繁复方式， 本发明提供了一种三维图像数据传输方法， 总体的发明思路 为： 上述的三维图像数据传输方法具体可分为三维图像数据发送方法和三 维图像数据接收方法。 其中， 三维图像数据发送方法对三维图像的处理过 程为： 首先读取待发送的三维图像数据， 并将该三维图像数据解析成多个 视图数据， 再将解析后的视图数据打包进行发送。 而三维图像数据接收方 法对接收到的数据包处理过程为： 对接收到的装有解析视图数据的数据包 进行拆分， 获得视图数据； 然后将获得的视图数据进行视图重组得到相应 的三维图像数据。 具体的实现方法下面将做详细阐述：
请参考图 1 , 在本发明中， 因传递的是三维图像数据， 所以较优的在三 维图像数据发送方法中可以将三维图像数据解析成至少三个视图数据， 如 图中的左视图、 右视图、 前视图、 后视图等。 进一步地， 在具体的操作过 程中， 因考虑到网络带宽的不同， 还可以从解析出来的视图数据中选择至 少三个视图数据来进行打包发送， 以减小对网络带宽的压力。
为了使解析效果更好， 还可以对三维视图数据进行分组解析， 即将三 维图像数据解析成至少一组的视图组数据； 较优的， 一般可分为， 左目艮视 图组数据和右眼视图组数据； 而为了使传输的三维数据能重组为三维图像， 在所述的视图组数据中， 至少应该包括有三个解析后得到的视图数据。 在 传输过程中， 可以对其中至少一组视图组数据进行打包发送， 因为单个的 视图组数据在重组后所形成的图像亦为三维图像， 即可以对左眼视图组数 据和右眼视图组数据中的一个视图组数据进行打包发送， 也可在重组后形 成三维图像。
在实际操作中，为了更好的体现三维图像的效果，在解析三维图像时， 还可以根据光源数据来进行解析， 以左右眼视图组数据为例， 还需分别根 据左眼光源数据和右眼光源数据对左眼视图组数据和右眼视图组数据进行 解析， 其中， 根据左眼光源数据解析左目艮视图组数据， 相应的， 根据右眼 光源数据解析右眼视图组数据； 同样的， 因为单组的视图组数据可重组为 三维图像， 所以根据光源数据解析之后的视图组数据也可以单个进行打包 发送。
在解析三维图像数据后， 将这些视图数据作为待发送数据源， 然后提 取该待发送数据源中的至少三个视图数据打包成数据包并发送。 下面提供 一种具体的打包方式对打包过程进行详细的说明：
请参考图 2 ,以一个视图组数据为例，对打包过程进行说明，图中可见， 数据包分为三个部分： 视图组类型、 视图数量及类型、 视图数据。 其中， 视图组类型用来表示该视图组数据是左眼视图组数据还是右眼视图组数据 或者其他视图组数据； 视图数量及类型用一个字节的 8个比特位来说明该 视图组有哪些视图及这些视图的顺序，每一个比特位表示一个视图，这样， 最多能有 8个视图； 以 6个视图为例， 按照字节顺序依次表示为左视图、 右视图、 上视图、 下视图、 前视图、 后视图。 若字节显示为 01101100 (当 该字节的某位上为 1时， 可以表示具有该视图， 为 0时， 表示没有这个视 图）， 则表示该视图组中有右视图、 上视图、 前视图和后视图； 而视图数据 则为视图组中各个视图的数据。
请参考图 3 , 从图中可知， 该数据包包括有两组视图组数据， 分别为左 眼视图组数据和右眼视图组数据，每组中都包括 4个视图数据，图中的 IU , IL2, IL3, IL4分别表示左目艮视图组数据中 4个视图的视图数据，相应的， IR1 , IR2, IR3 , IR4分别表示右眼视图组数据中 4个视图的视图数据。 在三维图像数据接收方法中， 主要针对接收的三维图像数据包进行相 应的处理， 在接收到带有至少三个视图数据的数据包时， 将该数据包进行 拆分， 得到视图数据或者至少一组的视图组数据； 然后根据预先设置的计 算方法对这些视图进行重组， 得到三维图像。 在重组过程中， 也可以根据 计算能力或者图像质量需求， 选择视图数据中的至少三个视图进行重组， 或者选择至少一组视图组数据中的至少三个视图数据进行重组， 以得到相 应的三维图像， 这样做可以节省计算时间和减少计算的工作量。
在拆分数据包过程中， 较常用的， 一般可拆分到左眼视图组数据和右 目艮视图组数据， 可从中提取视图数据进行三维图像数据的重组； 而在对视 图组数据提取的过程中， 还能提取到光源数据， 该光源数据与视图组数据 相对应， 若数据包中只存在左眼视图组数据， 相应的， 光源数据为左眼光 源数据。 在本实施例中， 对应于视图组数据， 可提取到左眼光源数据和右 眼光源数据； 为了使重组后的三维图像更好的显示， 可根据该左眼光源数 据对左眼视图组数据中的至少三个视图数据进行视图重组， 根据右眼光源 数据对右眼视图组数据中的至少三个视图数据进行重组。
请参考图 4, 本发明还提供一种三维图像数据传输方法， 具体的传输步 驟包括上述的三维图像数据发送方法和三维图像数据接收方法， 简单的步 驟可归纳为： 读取三维图像数据； 对其进行解析； 将解析到的至少三个视 图数据进行打包， 并将数据包发送； 接收端接收到数据包， 并对其进行拆 分； 将拆分后得到的视图数据进行重组， 得到三维图像数据； 并对三维图 像数据进行显示。 具体的操作步驟在上面三维图像数据发送方法和三维图 像数据接收方法中已进行了详细的说明。
本发明还提供一种三维图像数据传输装置， 其具体包括： 三维图像数 据发送装置和三维图像数据接收装置。
请参考图 5 , 其中三维图像数据发送装置主要包括有读耳 4莫块、解析模 块、 打包模块和发送模块； 其中， 读取模块主要用于读取待发送的三维图 像数据； 解析模块主要用于将三维图像数据解析成至少三个视图数据， 该 至少三个视图数据为待发送数据源； 而打包模块主要用于提取该待发送数 据源中的至少三个视图数据， 并将其打包成数据包； 发送模块用于对数据 包进行发送处理。
相应的， 解析模块还用于对所述三维图像数据进行分组解析， 即将三 维图像数据解析成至少一组视图组数据， 为了使三维图像数据能顺利成像， 每组视图组数据中应包括至少三个视图数据； 对应的， 打包模块还用于从 至少一个视图组数据中提取至少三个视图数据打包成数据包。
较常用的， 视图组数据一般可分为左眼视图组数据和右眼视图组数据， 两组数据可以一起发送， 也可以单组进行发送， 因为单组视图组数据也可 重组为三维视图。 为了使解析效果更好， 可以在解析模块中增加一个光源 数据单元， 其可以为解析模块提供光源数据， 以左右眼视图组数据为例， 其可以为解析模块提供左眼光源数据和右眼光源数据， 使解析模块能根据 相应的光源数据对左眼视图组数据和右眼视图组数据进行解析， 即左眼光 源数据用于解析左眼视图组数据， 右眼光源数据用于解析右眼视图组数据。
请参考图 6, 在三维图像数据接收装置中， 主要包括接收模块、 拆分模 块、 重组模块和显示模块； 其中， 接收模块用于接收三维数据数据包； 该 三维图像数据包包括至少三个视图数据； 拆分模块主要用于对三维数据数 据包进行拆分， 获得三维图像的视图数据； 重组模块主要用于将视图数据 中的至少三个视图数据进行视图重组， 得到相应的三维图像数据； 而显示 模块主要根据所述三维图像数据对三维图像进行显示。
根据本发明的发明思路， 重组模块还可以对视图组数据进行重组， 其 可以从视图组数据中提取视图数据； 较优的， 视图组数据一般可以为左眼 视图组数据和右眼视图组数据； 重组模块在对视图组数据提取视图数据时 还能提取光源数据， 该光源数据与视图组数据相对应， 若数据包中只存在 左目艮视图组数据， 相应的， 光源数据为左眼光源数据。 在本实施例中， 对 应于视图组数据， 该光源数据即为左眼光源数据和右眼光源数据， 重组模 块可利用该光源数据分别对左眼视图组数据和右眼视图组数据进行视图重 组。
请参考图 7, 本发明还提供一种三维图像数据传输装置， 其中包括本发 明所提供的三维图像数据发送装置和三维图像数据接收装置， 该装置的具 体结构在上述三维图像数据发送装置和三维图像数据接收装置的说明中已 详细阐述。 能认定本发明的具体实施只局限于这些说明。 对于本发明所属技术领域的 普通技术人员来说， 在不脱离本发明构思的前提下， 还可以做出若干简单 推演或替换， 都应当视为属于本发明的保护范围。

Claims

权利要求书
1、 一种三维图像数据发送方法， 包括以下步驟：
读取待发送的三维图像数据；
将所述三维图像数据解析成至少三个视图数据， 所述的至少三个视图 数据为待发送数据源；
提取所述待发送数据源中的至少三个视图数据打包成数据包并发送。
2、 如权利要求 1所述的三维图像数据发送方法， 其中， 在对所述三维 图像数据进行解析的步驟中， 具体的步驟是： 对所述三维图像数据进行分 组解析， 将所述三维图像数据解析成至少一组视图组数据， 且每组所述视 图组数据中包括至少三个视图数据； 在所述对视图数据打包的步驟中， 提 取至少一个所述视图组数据中的至少三个视图数据打包成数据包并发送。
3、 如权利要求 2所述的三维图像数据发送方法， 其中， 所述的视图组 数据组为左眼视图组数据或 /和右目艮视图组数据。
4、 如权利要求 3所述的三维图像数据发送方法， 其中， 在将所述三维 图像数据解析成所述左眼视图组数据或 /和所述右目艮视图组数据的过程中， 需分别根据左眼光源数据或 /和右眼光源数据分别对所述左眼视图组数据或 /和所述右眼视图组数据进行解析。
5、 一种三维图像数据接收方法， 包括以下步驟：
接收三维图像数据包， 所述三维图像数据包包括至少三个视图数据； 对所述数据包进行拆分， 获得视图数据；
将所述视图数据中的至少三个视图数据进行视图重组， 得到相应的 三维图像数据；
根据所述三维图像数据显示三维图像。
6、 如权利要求 5所述的三维图像数据接收方法， 其中， 在对所述三 维图像数据包进行拆分后， 得到至少一组视图组数据， 且每组所述视图 组数据中包括至少三个视图数据； 在对所述视图数据视图重组过程中， 提取至少一组所述视图组数据中的至少三个视图数据进行视图重组。
7、 如权利要求 6所述的三维图像数据接收方法， 其中， 所述的视图 组数据为左眼视图组数据或 /和右目艮视图组数据。
8、 如权利要求 7所述的三维图像数据接收方法， 其中， 在提取所述 左眼视图组数据或 /和所述右眼视图组数据中的所述至少三个视图数据进 行重组的过程中， 还包括以下步驟： 提取左眼光源数据或 /和右眼光源数 据， 并根据所述左眼光源数据或 /和所述右眼光源数据分别对所述左眼视 图组数据或 /和所述右眼视图组数据中的所述至少三个视图数据进行视图 重组。
9、 一种三维图像数据传输方法， 包括权利要求 1-4中任一项所述的 三维图像数据发送方法和权利要求 5-8 中任一项所述的三维图像数据接 方法。
10、 一种三维图像数据发送装置， 包括读取模块、 解析模块、 打包 模块和发送模块；
所述读耳 4莫块， 用于读取待发送的三维图像数据；
所述解析模块， 用于将所述三维图像数据解析成至少三个视图数据， 所述的至少三个视图数据为待发送数据源；
所述打包模块， 用于提取所述待发送数据源中的至少三个视图数据， 并将其打包成数据包；
所述发送模块， 用于对所述数据包进行发送。
11、 如权利要求 10所述的三维图像数据发送装置， 其中， 所述解析 模块还用于对所述三维图像数据进行分组解析， 将所述三维图像数据解 析成至少一组视图组数据， 且每组所述视图组数据中包括至少三个视图 数据； 打包模块还用于从至少一个所述视图组数据中提取至少三个视图 数据打包成数据包。
12、 如权利要求 11所述的三维图像数据发送装置， 其中， 所述的视 图组数据为左眼视图组数据或 /和右眼视图组数据。
13、 如权利要求 12所述的三维图像数据发送装置， 其中， 所述解析 模块还包括一个光源数据单元， 所述解析模块根据所述光源数据单元提 供的左眼光源数据或 /和右眼光源数据分别对所述左眼视图组数据或 /和 右眼视图组数据进行解析。
14、 一种三维图像数据接收装置， 包括接收模块、 拆分模块、 重组 模块和显示模块；
所述接收模块， 用于接收三维数据数据包， 所述三维图像数据包包 括至少三个视图数据；
所述拆分模块， 用于对所述三维数据数据包进行拆分， 获得所述三 维图像的视图数据；
所述重组模块， 用于将所述视图数据中的至少三个视图数据进行视 图重组， 得到相应的三维图像数据；
所述显示模块， 用于根据所述三维图像数据对三维图像进行显示。
15、 如权利要求 14所述的三维图像数据接收装置， 其中， 所述拆分 模块在对所述三维图像数据包进行分组拆分后， 得到至少一组视图组数 据， 且每组所述视图组数据中包括至少三个视图数据； 所述重组模块从 至少一组所述视图组数据中提取至少三个视图数据进行视图重组。
16、 如权利要求 15所述的三维图像数据接收装置， 其中， 所述的视 图组数据为左眼视图组数据或 /和右眼视图组数据。
17、 如权利要求 16所述的三维图像数据接收装置， 其中， 所述重组 模块还用于提取所述左眼视图组数据或 /和所述右眼视图组数据中的左眼 光源数据或 /和右眼光源数据， 并根据所述左眼光源数据或 /和右眼光源数 据分别对所述左眼视图组数据或 /和所述右目艮视图组数据中提取的至少三 个视图数据进行视图重组。
18、一种三维图像数据传输装置， 其中， 包括权利要求 10-13中任一 项所述的三维图像数据发送装置和权利要求 14-17 中任一项所述的三维 图像数据接收装置。
PCT/CN2012/074623 2012-03-12 2012-04-24 用于三维图像数据发送、接收、传输的方法和装置 WO2013134990A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210063666.2 2012-03-12
CN201210063666.2A CN103313073B (zh) 2012-03-12 2012-03-12 用于三维图像数据发送、接收、传输的方法和装置

Publications (1)

Publication Number Publication Date
WO2013134990A1 true WO2013134990A1 (zh) 2013-09-19

Family

ID=49137787

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/074623 WO2013134990A1 (zh) 2012-03-12 2012-04-24 用于三维图像数据发送、接收、传输的方法和装置

Country Status (2)

Country Link
CN (1) CN103313073B (zh)
WO (1) WO2013134990A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107018399A (zh) * 2017-03-28 2017-08-04 北京犀牛数字互动科技有限公司 图像数据传输方法及装置
CN107194976B (zh) * 2017-03-31 2021-11-12 上海浩远智能科技有限公司 一种温度云图的处理方法和装置
CN114040445B (zh) * 2021-11-08 2023-08-15 聚好看科技股份有限公司 一种数据传输方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101035261A (zh) * 2007-04-11 2007-09-12 宁波大学 一种交互式多视点视频***的图像信号处理方法
CN101170697A (zh) * 2006-10-24 2008-04-30 华为技术有限公司 多视图象编解码方法及编解码器
CN101453662A (zh) * 2007-12-03 2009-06-10 华为技术有限公司 立体视频通信终端、***及方法
US20110157302A1 (en) * 2009-12-30 2011-06-30 Ati Technologies Ulc Three-dimensional video display system with multi-stream sending/receiving operation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101170697A (zh) * 2006-10-24 2008-04-30 华为技术有限公司 多视图象编解码方法及编解码器
CN101035261A (zh) * 2007-04-11 2007-09-12 宁波大学 一种交互式多视点视频***的图像信号处理方法
CN101453662A (zh) * 2007-12-03 2009-06-10 华为技术有限公司 立体视频通信终端、***及方法
US20110157302A1 (en) * 2009-12-30 2011-06-30 Ati Technologies Ulc Three-dimensional video display system with multi-stream sending/receiving operation

Also Published As

Publication number Publication date
CN103313073A (zh) 2013-09-18
CN103313073B (zh) 2016-12-14

Similar Documents

Publication Publication Date Title
US8397272B2 (en) Multi-stream digital display interface
CN103986960A (zh) 一种单视频画面分割多路由远传精确同步拼接显示的方法
EP2732633A1 (en) Wireless 3d streaming server
RU2011122274A (ru) Устройство и способ обработки изображений
CN106790257A (zh) 基于ip的多媒体传输方法及***
CN109525559B (zh) 一种画面共享方法及***
WO2013134990A1 (zh) 用于三维图像数据发送、接收、传输的方法和装置
CN112616033A (zh) 多路视频源预监方法及***和视频处理设备
CN107547882A (zh) 一种vr视频数据新处理***
WO2021248889A1 (zh) 一种拼接墙信号同步方法及装置
CN102223406B (zh) 音频信息网络数字化实时传输***及方法
US20110157302A1 (en) Three-dimensional video display system with multi-stream sending/receiving operation
US20230362330A1 (en) Transmission Method, Apparatus, and System
CN105304001B (zh) 一种基于serdes的信号扩展盒
Blackwell et al. 54‐6: Holographic 3D Telepresence System with Light Field 3D Displays and Depth Cameras over a LAN
CN104717397A (zh) 一种图像数据处理方法及电子设备
CN105306955B (zh) 3d视频编码***
CN210986124U (zh) 远距离传输场景中音视频数据的发送、接收装置及***
US20120026281A1 (en) Data processing apparatus for segmental processing of input data, systems using the apparatus and methods for data transmittal
CN117119157B (zh) 一种光纤视频坐席多画面拼合重传方法及***
WO2023087143A1 (zh) 一种视频传输方法和装置
CN104581109A (zh) 一种3d数字视频信号处理方法及其装置
CN215912173U (zh) 一种可支持8k输入输出的视频处理器
CN114339188B (zh) 一种多视角虚拟现实沉浸式显示方法、装置、介质及电子设备
CN102638701A (zh) 显示器、影像处理装置以及影像处理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12871307

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12871307

Country of ref document: EP

Kind code of ref document: A1