CN113660509A - Three-dimensional model processing system and method based on cloud rendering - Google Patents
Three-dimensional model processing system and method based on cloud rendering Download PDFInfo
- Publication number
- CN113660509A CN113660509A CN202111207207.2A CN202111207207A CN113660509A CN 113660509 A CN113660509 A CN 113660509A CN 202111207207 A CN202111207207 A CN 202111207207A CN 113660509 A CN113660509 A CN 113660509A
- Authority
- CN
- China
- Prior art keywords
- server
- client
- dimensional model
- video stream
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 65
- 238000012545 processing Methods 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims description 13
- 238000004891 communication Methods 0.000 claims abstract description 39
- 238000013178 mathematical model Methods 0.000 claims abstract description 16
- 238000003672 processing method Methods 0.000 claims description 13
- 238000013461 design Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 6
- 239000011521 glass Substances 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 13
- 230000002452 interceptive effect Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- -1 mobile phones Substances 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a three-dimensional model processing system based on cloud rendering, which comprises: the server acquires the edited three-dimensional model, renders the three-dimensional model, converts the rendered model data into video stream, and transmits the video stream in real time based on an FMETP real-time video stream communication protocol; and the client is in communication connection with the server in a 5G network environment, and receives and views the transmitted video stream based on the rendered model data in real time from the server. The cloud rendering-based three-dimensional model processing system can realize rendering processing of a large three-dimensional mathematical model at a cloud end, and can establish a real-time video stream transmission channel between a server and a client to realize real-time interactive communication.
Description
Technical Field
The invention relates to the technical field of cloud rendering, in particular to a cloud rendering-based three-dimensional model processing system and method applied to aircraft design and field assembly.
Background
During the design and field assembly of an aircraft, a large number of three-dimensional models are viewed and manipulated. Designers need to complete the design tasks of all sections and related parts of the airplane according to the three-dimensional model, and assemblers need to complete the production and assembly of all sections and related parts of the airplane according to the three-dimensional model.
However, the mathematical model involved in the aircraft production needs to cover a large amount of detailed contents and parameters such as wire harnesses, parts and sections, so that the aircraft mathematical model generally has a large capacity and the number of triangular patches is extremely large. Therefore, a problem arises in that some computers with ordinary performance cannot normally process large mathematical models in actual production. Especially, the handheld mobile terminal with low processing performance like a tablet computer and a smart phone cannot open the airplane model with a complicated structure. In addition, even if the three-dimensional model is normally opened by a device with excellent performance, the operator needs to spend much time downloading the three-dimensional model, and a large amount of time cost is consumed in the rendering process of the three-dimensional model. Moreover, when an operator wants to verify or adjust the aircraft mathematical model on the site, the operator cannot ensure that the model viewed at that time is the model of the latest version, so that the problem that real-time interactive communication between the site and the design level cannot be realized due to the limitation of hardware performance and response speed is caused.
Disclosure of Invention
The present invention is made in view of the above problems, and an object of the present invention is to provide a cloud rendering-based three-dimensional model processing system and method, which render a large three-dimensional mathematical model of an aircraft on a cloud server, and can establish a real-time video streaming transmission path between the server and a client to implement real-time interactive communication.
A first aspect of the present invention provides a cloud rendering-based three-dimensional model processing system, including: the server acquires the edited three-dimensional model, renders the three-dimensional model, converts the rendered model data into video stream, and transmits the video stream in real time based on an FMETP real-time video stream communication protocol; and the client is in communication connection with the server in a 5G network environment, and receives and views the transmitted video stream based on the rendered model data in real time from the server.
Preferably, the client further sends control information for adjusting the three-dimensional model to the server, and the server adjusts the three-dimensional model according to the control information sent from the client and renders the adjusted three-dimensional model, converts the rendered model data into a video stream again and transmits the video stream to the client in real time.
Preferably, a CPE is connected between the server and the client, and the client performs communication connection with the server by accessing an IP address assigned to the server from a WiFi network enhanced by the CPE.
Preferably, a virtual camera for shooting the rendered model data in real time is provided on the server.
Preferably, the server encodes the model data photographed by the virtual camera based on the H264 coding standard to convert it into the video stream, transmits the video stream to the client in real time by adopting an encoding format corresponding to the H264 coding standard in the FMETP real-time video stream communication protocol, and the client decodes and plays the transmitted video stream based on the H264 coding standard.
Preferably, the three-dimensional model is an aircraft mathematical model used to design or assemble various sections and related parts of the aircraft.
Preferably, a plurality of clients are arranged, and the clients can realize the remote real-time viewing and adjustment of the information of the three-dimensional model.
Preferably, the client is at least one of AR glasses, mobile phones, tablet computers, notebook computers and other portable terminal devices.
The second aspect of the present invention provides a cloud rendering-based three-dimensional model processing method, which includes: a communication connection step, in which the server is in communication connection with the client under a 5G network environment; a server processing step, namely acquiring an edited three-dimensional model through a server, rendering the three-dimensional model, converting model data subjected to rendering into a video stream, and transmitting the video stream to the client in real time based on an FMETP real-time video stream communication protocol; and a client processing step of receiving and viewing the transmitted video stream based on the rendered model data in real time from the server through the client.
Preferably, the cloud rendering-based three-dimensional model processing method further includes a real-time interaction step between the client and the server, in which control information for adjusting the three-dimensional model is sent to the server through the client, the server adjusts the three-dimensional model according to the control information sent from the client and renders the adjusted three-dimensional model, and the rendered model data is converted into a video stream again and transmitted to the client in real time.
Preferably, the step of communicatively connecting the server to the client further comprises the steps of: the communication connection with the server is achieved at the client by accessing an IP address assigned to the server from a WiFi network enhanced via a CPE connected between the server and the client.
Preferably, in the server processing step, converting the rendering-processed model data into a video stream by the server includes capturing the rendering-processed model data in real time with a virtual camera provided on the server, and converting the captured model data into the video stream.
Preferably, the server processing step includes the steps of: encoding, by the server, the model data photographed by the virtual camera based on the H264 encoding standard to convert it into the video stream, and transmitting the video stream to the client in real time by adopting an encoding format corresponding to the H264 encoding standard in the FMETP real-time video stream communication protocol, wherein the client processing step includes the steps of: and decoding and playing the transmitted video stream by the client based on the H264 coding standard.
According to the cloud rendering-based three-dimensional model processing system and the cloud rendering-based three-dimensional model processing method, the three-dimensional model with a complex structure is rendered through the server, so that the processing capacity of rendering processing can be enhanced, and the client only needs to receive and view the video stream of the rendered model data without performing rendering processing on the client, so that the hardware performance requirement on client equipment is lowered, and an operator can conveniently view and adjust the airplane model through the portable mobile terminal. In addition, by adopting the FMETP real-time video streaming protocol, compared with the traditional video streaming protocol, the real-time video streaming protocol can realize real-time video streaming transmission, and a real-time video streaming transmission channel between the server and the client is ensured, so that when the airplane model is required to be verified or adjusted on site, the remote and long-distance real-time interactive communication between the server and the client and among the clients based on the 5G network environment can be realized.
Drawings
For a better understanding of the above and other objects, features, advantages and functions of the present invention, reference should be made to the preferred embodiments illustrated in the accompanying drawings. Like reference numerals in the drawings refer to like parts. It will be appreciated by persons skilled in the art that the drawings are intended to illustrate preferred embodiments of the invention without any limiting effect on the scope of the invention, and that the various components in the drawings are not drawn to scale.
Fig. 1 is a schematic diagram showing a configuration of a cloud-rendering-based three-dimensional model processing system of the present invention.
Fig. 2 is a schematic diagram illustrating a video flow path between a server and a client in the cloud rendering-based three-dimensional model processing system of the present invention.
Fig. 3 is a schematic diagram illustrating a client receiving and playing a video stream in the cloud rendering-based three-dimensional model processing system according to the present invention.
Fig. 4 is a flowchart illustrating a cloud rendering-based three-dimensional model processing method of the present invention.
Wherein the reference numerals are as follows:
100 server
110 virtual camera
200 client
300 CPE。
Detailed Description
The inventive concept of the present invention will be described in detail below with reference to the accompanying drawings. What has been described herein is merely a preferred embodiment in accordance with the present invention and other ways of practicing the invention will occur to those skilled in the art and are within the scope of the invention.
As mentioned above, because three-dimensional mathematical models used in aircraft manufacturing generally have the characteristics of complex structure, large information content, and many triangular facets, the requirements of rendering processing performed on such three-dimensional mathematical models on the hardware performance of devices and the response speed of client instructions are very strict, and the existing three-dimensional model rendering system has the problem that these requirements cannot be met. Therefore, the invention provides a three-dimensional model processing scheme based on cloud rendering, which realizes the rendering of a large three-dimensional mathematical model of an airplane on a cloud server and can establish a real-time video stream transmission path between the server and a client.
Embodiments of the present invention are described below with reference to the drawings.
Example System
Fig. 1 is a schematic diagram showing a configuration of a cloud-rendering-based three-dimensional model processing system of the present invention. As shown in fig. 1, the cloud rendering-based three-dimensional model processing system mainly includes a server 100 and a client 200 in a cloud end. The communication connection between the server 100 and the client 200 is in a 5G network environment with high bandwidth and low latency. In this embodiment, the three-dimensional model to be processed at the cloud is an aircraft mathematical model used to design or assemble various sections and related parts of the aircraft.
The server 100 includes high-efficiency CPU, high-performance GPU, and hardware devices with excellent performance, such as a video card, and is mainly used for performing a rendering process of a large three-dimensional mathematical model of an aircraft acquired at a cloud end at the cloud end.
The cloud server 100 may obtain the mathematical model of the aircraft from a device used by a designer, for example, an application interface in communication connection with the cloud server 100 may be established on a device at the device, and after the designer finishes editing the aircraft model, the designer may drag the three-dimensional model to the application interface on a screen to place the three-dimensional model in the cloud server 100, so as to perform cloud rendering processing described later. The designer may upload the edited three-dimensional model to a center cloud module, not shown, in the server 100, and may directly acquire the three-dimensional model from the center cloud module when performing the cloud rendering process.
The server 100 includes, for example, a cloud rendering module, not shown, by which an edited three-dimensional model acquired from the device-side or center cloud module is rendered to render the three-dimensional model into two-dimensional image or video data with high realism. In addition, a virtual camera 110 for capturing these rendered images or video data in real time may be provided on the server 100.
Meanwhile, the cloud rendering module of the server 100 encodes model data, such as rendered images or video data, captured by the virtual camera 110, converts it into a video stream, and transmits the video stream to the client 200 in real time.
In the present embodiment, since the rendering process for the three-dimensional mathematical model of the airplane having a complicated structure and a large information content is performed in the server 100 including the hardware device having excellent performance, the processing capacity of the rendering process is enhanced, and the rendering process does not need to be performed in the client 200, which will be described later, thereby reducing the hardware performance requirement for the client 200 device.
The client 200 is typically held by an assembly or operator at the assembly site. In the present embodiment, as described above, since the receiving and viewing target of the client 200 is not a large-scale three-dimensional model of an airplane but a video stream based on two-dimensional images or video data, the client 200 does not need to select a device having excellent processing performance, and the client may be any of AR glasses, or a mobile terminal device such as a mobile phone, a tablet computer, or a notebook computer. The client 200 receives the transmitted video stream from the server 100 in real time and decodes the video stream. The decoded video stream is then played to facilitate the operator viewing the aircraft model as cloud rendered at the server 100.
In the present embodiment, a 5G CPE (Customer Premise Equipment) 300 is also connected between the server 100 and the client 200, and this CPE is mainly responsible for performing secondary relaying (strengthening) of WiFi signals to extend the coverage of the WiFi signals. By connecting the server 100 and the client 200 to the same CPE, both can be covered under the same lan for safe viewing and tuning of the airplane model. Specifically, since the functions of acquiring and displaying the IP address of the server 100 are completed in the code logic at the bottom, after the networking is completed, the setting of the server 100 is clicked to be opened, and the IP address assigned to the server 100 by the current WiFi network can be visually checked. At this time, the client 200 having completed networking is opened, the IP address of the server 100 is input, and the operation button is clicked, so that the client 200 can access the IP address of the server 100 to realize communication connection with the server 100.
Real-time video streaming path
As described above, in the present embodiment, the client 200 and the server 100 are connected in a 5G network environment. As shown in fig. 2, the transmission of the video stream between the client 200 and the server 100 is performed based on the FMETP real-time video streaming protocol, which needs to combine the above-mentioned high-bandwidth low-latency 5G network environment to complete the transmission of the whole real-time video stream.
In the present embodiment, the server 100 encodes the rendered model data based on the H264 or H265 encoding standard, and here, in consideration of the compatibility with other devices, it is more preferable to encode the model data based on the H264 encoding standard. In addition, in order to realize real-time transmission of the video stream, the encoding standard is modified at the bottom development, for example, by adjusting the compression ratio of the video stream, so as to improve the encoding speed of the video stream at the server 100 and the decoding speed of the video stream at the client 200. Similarly, the FMETP live video stream communication protocol used in the present embodiment adopts an encoding format (for example, 264 encoding format) corresponding to the H264 encoding standard, and thus the server 100 can transmit an encoded video stream in real time based on the FMETP live video stream communication protocol. The client 200 decodes the transmitted video stream based on the H264 encoding standard and plays it on the full screen canvas (as shown in fig. 3).
By adopting the FMETP real-time video stream transmission protocol, the invention can realize real-time video stream transmission compared with the traditional video stream transmission protocol, and ensure a real-time video stream transmission path between the server and the client, thereby not being incapable of realizing real-time interactive communication between a site and a design level due to the limitation of response speed when the airplane model is required to be verified or adjusted on the site.
Interactive communication
In addition, the client 200 also has a function of performing interactive communication with the server 100. For example, when the client 200 views the rendered airplane model by decoding and playing a video stream, an operator may send control information, which is the interaction information for adjusting the three-dimensional model, to the server 100, and at the same time, the cloud rendering module in the server 100 adjusts the three-dimensional model in real time according to the control information, and performs rendering processing on the adjusted three-dimensional model again, and then converts the image or video data captured by the virtual camera 110 into a video stream and sends the video stream back to the client 200.
The adjustment of the three-dimensional model of the airplane generally refers to the adjustment of the position and the posture of the three-dimensional model, and does not include the parameter adjustment of the airplane model, so as to prevent the airplane model from being tampered at will and ensure the safety and the stability of the airplane model. The client 200 may set a gesture corresponding to the adjustment of the three-dimensional model in advance, for example, the distance between two fingers is changed at the client to zoom the three-dimensional model at the server, one finger is slid at the client to adjust the orientation of the three-dimensional model at the server, and two fingers are slid at the same time at the client to adjust the position of the three-dimensional model at the server.
In order to support multiple people in different places to check and adjust the three-dimensional model, multiple clients 200 can be connected in multiple places, and when an operator adjusts the model on one client 200, the server 100 and other clients 200 can both respond in real time, so that communication and coordination among operators in different places are facilitated, and remote different-place real-time interactive communication among the server 100, the clients 200 and the clients 200 is realized.
Fig. 4 is a flowchart illustrating a cloud rendering-based three-dimensional model processing method of the present invention. The cloud-rendering-based three-dimensional model processing method may be implemented, for example, using the cloud-rendering three-dimensional model processing system illustrated in fig. 1.
In step S10, the server 100 is communicatively connected to the client 200 in a 5G network environment. In step S20, the server 100 obtains the edited three-dimensional model from the device side of the designer or the central cloud module in the server 100, the cloud rendering module in the server 100 performs rendering processing on the three-dimensional model, converts the rendered model data into a video stream, and transmits the video stream to the client 200 in real time based on the FMETP real-time video stream communication protocol. In step S30, the transmitted video stream based on the rendering-processed model data is received and viewed in real time from the server 100 by the client 200.
In addition, the cloud rendering-based three-dimensional model processing method according to the embodiment may further include the following steps: the control information used for adjusting the three-dimensional model and serving as the interaction information is sent to the server 100 through the client 200, the three-dimensional model is adjusted according to the control information sent from the client 200 by using a cloud rendering module in the server 100, the adjusted three-dimensional model is rendered, the rendered model data is converted into a video stream again, and the video stream is sent back to the client 200, so that the real-time interaction between the client 200 and the server 100 is realized.
Further, step S10 includes the following steps: an IP address assigned to the server 100 from the WiFi network enhanced via the 5G CPE300 connected between the server 100 and the client 200 is input at the client 200, and a communication connection with the server 100 is realized by having the client 200 access the IP address.
The converting of the rendering-processed model data into a video stream in step S20 further includes capturing the rendering-processed model data in real time with the virtual camera 110 provided on the server 100, and converting the captured image or video data into a video stream.
Further, step S20 includes the following steps: the server 100 is caused to encode the image or video data captured by the virtual camera 110 based on the H264 encoding standard to convert it into a video stream, and to transmit the video stream to the client 200 in real time by adopting an encoding format corresponding to the H264 encoding standard in the FMETP real-time video stream communication protocol. The step S30 includes the following steps: the transmitted video stream is decoded and played by the client 200 based on the H264 coding standard.
In the cloud rendering three-dimensional model processing method of the embodiment, as with the cloud rendering three-dimensional model processing system, the three-dimensional mathematical model of the airplane is rendered by the server at the cloud end, and the real-time video stream transmission path is established between the server and the client, so that an operator can conveniently check and adjust the airplane model through the portable mobile terminal, the real-time updating of multiple clients in different places is supported, and the real-time interactive communication between the server and the client and among the clients based on the 5G network environment is realized.
The scope of the invention is limited only by the claims. Persons of ordinary skill in the art, having benefit of the teachings of the present invention, will readily appreciate that alternative structures to the structures disclosed herein are possible alternative embodiments, and that combinations of the disclosed embodiments may be made to create new embodiments, which also fall within the scope of the appended claims.
Claims (13)
1. A three-dimensional model processing system based on cloud rendering, comprising:
the server acquires the edited three-dimensional model, renders the three-dimensional model, converts the rendered model data into video stream, and transmits the video stream in real time based on an FMETP real-time video stream communication protocol; and
and the client is in communication connection with the server in a 5G network environment, and receives and views the transmitted video stream based on the rendered model data in real time from the server.
2. The cloud rendering based three-dimensional model processing system of claim 1,
the client also sends control information for adjusting the three-dimensional model to the server,
and the server adjusts the three-dimensional model according to the control information sent from the client, renders the adjusted three-dimensional model, converts the rendered model data into a video stream again and transmits the video stream to the client in real time.
3. The cloud rendering based three-dimensional model processing system according to claim 1 or 2,
and the client side realizes communication connection with the server by accessing an IP address distributed to the server from a WiFi network enhanced by the CPE.
4. The cloud rendering based three-dimensional model processing system according to claim 1 or 2,
and a virtual camera for shooting the rendered model data in real time is arranged on the server.
5. The cloud rendering based three-dimensional model processing system of claim 4,
the server encodes the model data photographed by the virtual camera based on the H264 encoding standard to convert it into the video stream,
transmitting the video stream to the client in real time by adopting an encoding format corresponding to the H264 encoding standard in the FMETP real-time video stream communication protocol,
and the client decodes and plays the transmitted video stream based on the H264 coding standard.
6. The cloud rendering based three-dimensional model processing system according to claim 1 or 2,
the three-dimensional model is an aircraft mathematical model used to design or assemble various sections and related parts of the aircraft.
7. The cloud rendering based three-dimensional model processing system according to claim 1 or 2,
the plurality of clients are arranged, and the plurality of clients can realize the remote real-time viewing and adjustment of the information of the three-dimensional model.
8. The cloud rendering based three-dimensional model processing system according to claim 1 or 2,
the client is AR glasses or at least one of a mobile phone, a tablet computer, a notebook computer and other portable terminal equipment.
9. A three-dimensional model processing method based on cloud rendering is characterized by comprising the following steps:
a communication connection step, in which the server is in communication connection with the client under a 5G network environment;
a server processing step, namely acquiring an edited three-dimensional model through a server, rendering the three-dimensional model, converting model data subjected to rendering into a video stream, and transmitting the video stream to the client in real time based on an FMETP real-time video stream communication protocol; and
and a client processing step of receiving and viewing the transmitted video stream based on the rendered model data in real time from the server through the client.
10. The cloud rendering based three-dimensional model processing method according to claim 9,
the method comprises a client-side and a server, and further comprises a real-time interaction step between the client-side and the server, wherein in the real-time interaction step, control information used for adjusting the three-dimensional model is sent to the server through the client-side, the server adjusts the three-dimensional model according to the control information sent from the client-side and renders the adjusted three-dimensional model, and model data after rendering is converted into video streams again and transmitted to the client-side in real time.
11. The cloud rendering based three-dimensional model processing method according to claim 9 or 10,
in the communication connection step, the method further includes the steps of: the communication connection with the server is achieved at the client by accessing an IP address assigned to the server from a WiFi network enhanced via a CPE connected between the server and the client.
12. The cloud rendering based three-dimensional model processing method according to claim 9 or 10,
in the server processing step, converting the model data subjected to the rendering processing into a video stream by the server includes shooting the model data subjected to the rendering processing in real time by a virtual camera provided on the server, and converting the shot model data into the video stream.
13. The cloud rendering based three-dimensional model processing method according to claim 12,
the server processing step includes the steps of: encoding, by the server, the model data photographed by the virtual camera based on the H264 encoding standard to convert it into the video stream, and transmitting the video stream to the client in real time by adopting an encoding format corresponding to the H264 encoding standard in the FMETP real-time video stream communication protocol,
the client processing step includes the steps of: and decoding and playing the transmitted video stream by the client based on the H264 coding standard.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111207207.2A CN113660509A (en) | 2021-10-18 | 2021-10-18 | Three-dimensional model processing system and method based on cloud rendering |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111207207.2A CN113660509A (en) | 2021-10-18 | 2021-10-18 | Three-dimensional model processing system and method based on cloud rendering |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113660509A true CN113660509A (en) | 2021-11-16 |
Family
ID=78494555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111207207.2A Pending CN113660509A (en) | 2021-10-18 | 2021-10-18 | Three-dimensional model processing system and method based on cloud rendering |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113660509A (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642092A (en) * | 2004-01-12 | 2005-07-20 | 财团法人资讯工业策进会 | Interactive multimedia data processing system and method |
| CN103077239A (en) * | 2013-01-10 | 2013-05-01 | 上海电力学院 | IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering |
| CN106204595A (en) * | 2016-07-13 | 2016-12-07 | 四川大学 | A kind of airdrome scene three-dimensional panorama based on binocular camera monitors method |
| CN206353330U (en) * | 2017-01-10 | 2017-07-25 | 南京傲方智能科技有限公司 | A kind of true real-time rendering processing system |
| CN108521788A (en) * | 2017-11-07 | 2018-09-11 | 深圳市大疆创新科技有限公司 | Generate method, the method for simulated flight, equipment and the storage medium in simulation course line |
| CN109558507A (en) * | 2017-09-26 | 2019-04-02 | 中建科技有限公司深圳分公司 | Threedimensional model rendering method and system |
| CN110415325A (en) * | 2019-07-25 | 2019-11-05 | 杭州经纬信息技术股份有限公司 | Cloud renders three-dimensional the Visual Implementation method and system |
| CN111739141A (en) * | 2020-08-12 | 2020-10-02 | 绿漫科技有限公司 | 3D cloud rendering method for light terminal |
| CN112020078A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Data transmission method and device |
| CN112560137A (en) * | 2020-12-04 | 2021-03-26 | 武汉光谷信息技术股份有限公司 | Multi-model fusion method and system based on smart city |
| US20210136838A1 (en) * | 2019-11-06 | 2021-05-06 | Charter Communications Operating, Llc | Methods and Apparatus for Enhancing Coverage in Quasi-Licensed Wireless Systems |
| CN113099404A (en) * | 2021-04-08 | 2021-07-09 | 深圳高性能医疗器械国家研究院有限公司 | Medical image transmission method based on 5G network |
-
2021
- 2021-10-18 CN CN202111207207.2A patent/CN113660509A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642092A (en) * | 2004-01-12 | 2005-07-20 | 财团法人资讯工业策进会 | Interactive multimedia data processing system and method |
| CN103077239A (en) * | 2013-01-10 | 2013-05-01 | 上海电力学院 | IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering |
| CN106204595A (en) * | 2016-07-13 | 2016-12-07 | 四川大学 | A kind of airdrome scene three-dimensional panorama based on binocular camera monitors method |
| CN206353330U (en) * | 2017-01-10 | 2017-07-25 | 南京傲方智能科技有限公司 | A kind of true real-time rendering processing system |
| CN109558507A (en) * | 2017-09-26 | 2019-04-02 | 中建科技有限公司深圳分公司 | Threedimensional model rendering method and system |
| CN108521788A (en) * | 2017-11-07 | 2018-09-11 | 深圳市大疆创新科技有限公司 | Generate method, the method for simulated flight, equipment and the storage medium in simulation course line |
| CN112020078A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Data transmission method and device |
| CN110415325A (en) * | 2019-07-25 | 2019-11-05 | 杭州经纬信息技术股份有限公司 | Cloud renders three-dimensional the Visual Implementation method and system |
| US20210136838A1 (en) * | 2019-11-06 | 2021-05-06 | Charter Communications Operating, Llc | Methods and Apparatus for Enhancing Coverage in Quasi-Licensed Wireless Systems |
| CN111739141A (en) * | 2020-08-12 | 2020-10-02 | 绿漫科技有限公司 | 3D cloud rendering method for light terminal |
| CN112560137A (en) * | 2020-12-04 | 2021-03-26 | 武汉光谷信息技术股份有限公司 | Multi-model fusion method and system based on smart city |
| CN113099404A (en) * | 2021-04-08 | 2021-07-09 | 深圳高性能医疗器械国家研究院有限公司 | Medical image transmission method based on 5G network |
Non-Patent Citations (2)
| Title |
|---|
| JONAS SCHEER: "A client-server architecture for real-time view-dependent streaming of free-viewpoint video", 《2017 3DTV CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON)》 * |
| 汪顺利: "基于数字化转型的飞机智能制造", 《网络新媒体技术》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658205B (en) | Live broadcast room video stream synthesis control method and device and terminal equipment | |
| WO2021047419A1 (en) | Live broadcast interaction method, live broadcast system, electronic device and storage medium | |
| CN102883134B (en) | Screen sharing and controlling method for video conference system | |
| CN104244088B (en) | Display controller, screen picture transmission device and screen picture transfer approach | |
| CN102883135B (en) | Screen sharing and control method | |
| EP3562163A1 (en) | Audio-video synthesis method and system | |
| US20120287231A1 (en) | Media sharing during a video call | |
| CN106713937A (en) | Video playing control method and device as well as terminal equipment | |
| US20130310083A1 (en) | Method and apparatus for managing bandwidth by managing selected internet access by devices in a wi-fi linked audience | |
| US11489891B2 (en) | Virtual video driver bridge system for multi-source collaboration within a web conferencing system | |
| CN105637472B (en) | The frame of screen content shared system with the description of broad sense screen | |
| KR20130138263A (en) | Streaming digital video between video devices using a cable television system | |
| CN105493501A (en) | Virtual video camera | |
| CN107770564B (en) | Method and device for remotely acquiring audio and video data | |
| CN105959719A (en) | Video live broadcast method, device and system | |
| WO2008111746A1 (en) | System and method for realizing virtual stuio through network | |
| CN102611878A (en) | Low-bandwidth-occupancy high-definition camera mapping method | |
| JP6453345B2 (en) | Method, system and medium for remote rendering of web content on a television device | |
| US9596435B2 (en) | Distribution control apparatus, distribution control method, and computer program product | |
| CN113438442A (en) | Conference data sharing method and device | |
| CN106412617B (en) | Remote debugging control method and device | |
| CN103116482A (en) | Picture-playing device and method based on spliced wall | |
| US9838463B2 (en) | System and method for encoding control commands | |
| CN105872480B (en) | Control system and method for playing on LED screen based on real-time camera shooting of mobile phone | |
| CN112311784A (en) | Screen projection system and screen projection method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211116 |
|
| RJ01 | Rejection of invention patent application after publication |