CN112446961A - Scene reconstruction system and method - Google Patents

Scene reconstruction system and method Download PDF

Info

Publication number
CN112446961A
CN112446961A CN201910819075.5A CN201910819075A CN112446961A CN 112446961 A CN112446961 A CN 112446961A CN 201910819075 A CN201910819075 A CN 201910819075A CN 112446961 A CN112446961 A CN 112446961A
Authority
CN
China
Prior art keywords
data
reacquisition
real scene
area
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910819075.5A
Other languages
Chinese (zh)
Inventor
周彬花
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201910819075.5A priority Critical patent/CN112446961A/en
Priority to PCT/CN2020/112362 priority patent/WO2021037257A1/en
Publication of CN112446961A publication Critical patent/CN112446961A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The application provides a scene reconstruction system and a scene reconstruction method. The system comprises: the system comprises a data acquisition module, a reacquisition control module and a three-dimensional reconstruction module, wherein the data acquisition module, the reacquisition control module and the three-dimensional reconstruction module are sequentially connected through a wireless network; the data acquisition module is used for acquiring real scene data and sending the real scene data to the reacquisition control module; the reacquisition control module is used for determining an reacquisition area according to the real scene data sent by the data acquisition module; generating a reacquisition instruction under the condition that the reacquisition area is not empty, wherein the reacquisition instruction is used for instructing the data acquisition module to reacquire and send real scene data; under the condition that the reacquisition area is empty, the real scene data are sent to the three-dimensional reconstruction module; and the three-dimensional reconstruction module is used for reconstructing to obtain a virtual scene according to the real scene data sent by the reacquisition control module.

Description

Scene reconstruction system and method
Technical Field
The present application relates to virtual reality, and for example, to a scene reconstruction system and method.
Background
Virtual Reality (VR) technology is a computer simulation technology that can create and experience a Virtual scene, and obtains a three-dimensional Virtual scene by performing scene reconstruction on a real scene, so that a user is immersed in a Virtual environment to obtain an immersive experience. In related applications, the VR technology is usually based on a constructed virtual computer simulation scene, and cannot perform real-time end-to-end update, and cannot obtain timely correction even under the condition of poor scene picture quality, accuracy of scene reconstruction cannot be guaranteed, and a user cannot fully experience a real scene from a virtual scene.
Disclosure of Invention
The application provides a scene reconstruction system and method, which are used for improving the accuracy of scene reconstruction.
An embodiment of the present application provides a scene reconstruction system, including:
the system comprises a data acquisition module, a reacquisition control module and a three-dimensional reconstruction module, wherein the data acquisition module, the reacquisition control module and the three-dimensional reconstruction module are sequentially connected through a wireless network;
the data acquisition module is used for acquiring real scene data and sending the real scene data to the reacquisition control module;
the reacquisition control module is used for determining an reacquisition area according to the real scene data sent by the data acquisition module; generating a reacquisition instruction under the condition that the reacquisition area is not empty, wherein the reacquisition instruction is used for instructing the data acquisition module to reacquire and send real scene data; under the condition that the reacquisition area is empty, the real scene data are sent to the three-dimensional reconstruction module;
and the three-dimensional reconstruction module is used for reconstructing to obtain a virtual scene according to the real scene data sent by the reacquisition control module.
The embodiment of the application further provides a scene reconstruction method, which includes:
collecting real scene data;
determining a reacquisition area according to the acquired real scene data;
generating a reacquisition instruction if the reacquisition area is not empty, the reacquisition instruction to instruct reacquisition of real scene data for the reacquisition area;
and under the condition that the reacquisition area is empty, reconstructing to obtain a virtual scene according to the real scene data.
Drawings
Fig. 1 is a schematic structural diagram of a scene reconstruction system according to an embodiment;
fig. 2 is a schematic structural diagram of another scene reconstruction system according to an embodiment;
fig. 3 is a flowchart of a scene reconstruction method according to an embodiment;
fig. 4 is a flowchart of another scene reconstruction method according to an embodiment.
Detailed Description
The present application will be described with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
The VR technology can be applied to different scenes such as tourism, performance, games and meetings, and a user can experience different environments and scenes without personally reaching the VR technology. However, in the related art, the virtual scene is a built virtual computer simulation scene, data is transmitted from a camera and other acquisition devices to a computer and other processing devices for three-dimensional reconstruction only in a single direction, and cannot be updated end to end in real time, the three-dimensional virtual scene is reconstructed by simply depending on an image acquired from the scene on the spot, the quality requirement on the acquired data is high, if the acquired data is not accurate enough, the reconstruction cannot be performed accurately, details of the reconstructed scene are not rich enough, and the scene cannot be corrected in time under the condition of poor quality of the scene.
The embodiment of the application provides a scene reconstruction system, which is used for learning or screening acquired real scene data, determining an area needing to be re-acquired, re-acquiring the data in a targeted manner, ensuring the quality of the real scene data and accurately reconstructing a virtual scene on the basis; and data are transmitted through a wireless network, so that the real-time property of scene reconstruction can be ensured, and the virtual scene is more real.
Fig. 1 is a schematic structural diagram of a scene reconstruction system according to an embodiment. As shown in fig. 1, the scene reconstruction system provided in this embodiment includes a data acquisition module 10, a reacquisition control module 20, and a three-dimensional reconstruction module 30, and the data acquisition module 10, the reacquisition control module, and the three-dimensional reconstruction module 30 are sequentially connected via a wireless network. The data acquisition module 10 is configured to acquire real scene data and send the real scene data to the reacquisition control module 20; the reacquisition control module 20 is configured to determine an reacquisition area according to the real scene data sent by the data acquisition module 10, and generate an reacquisition instruction when the reacquisition area is not empty, for instructing the data acquisition module 10 to reacquire and send the real scene data; under the condition that the reacquisition area is empty, the real scene data is sent to the three-dimensional reconstruction module 30; the three-dimensional reconstruction module 30 is configured to reconstruct the real scene data sent by the reacquisition control module 20 to obtain a virtual scene.
In this embodiment, the data acquisition module 10 is configured to acquire real scene data, the real scene data may be in different forms such as an image, sound, temperature and humidity, the data acquisition module 10 may include a camera, a microphone, a temperature and humidity sensor, and the like, and are respectively configured to acquire data in different forms, and the acquired real scene data is transmitted to the reacquisition control module 20 through a wireless network.
The reacquisition control module 20 is trained and learned based on a large amount of sample data for determining reacquisition regions based on the quality of real scene data. For example, by comparing or matching real scene data acquired in real time with sample data, an area where the scene details are not rich enough or the data content is wrong, i.e., a reacquisition area, is identified. Taking the image data as an example, in the case that the image data is missing, the missing area is taken as a re-acquisition area, for example, the shooting range of the camera is constant, and if the image data of a certain area in the range is missing, the area can be taken as the re-acquisition area; under the condition that images are blurred and distorted due to the shaking of a camera or the change of a real scene, the blurred and distorted areas can be used as re-acquisition areas; or reconstructing a virtual scene according to the image data, and if the reconstructed virtual scene has low definition and distortion, taking a shooting area of the image data corresponding to an area with low definition or distortion in the virtual scene as a reacquisition area.
In this embodiment, in the case that the reacquisition area is not empty, the reacquisition control module 20 generates an reacquisition instruction, instructs the data acquisition module 10 to reacquire real scene data for the reacquisition area and send to the reacquisition control module 20, until the reacquisition area is empty, which indicates that the quality of the real scene data reaches a preset standard, or the difference from the quality of the sample data is within an acceptable range, and there is no data or area that needs to be reacquired, and in this case, the real scene data is sent to the three-dimensional reconstruction module 30.
The three-dimensional reconstruction module 30 is configured to reconstruct the real scene data sent by the reacquisition control module 20 to obtain a virtual scene. Things in the real scene can be sensed and calculated through the real scene data, virtual scenes such as virtual images, videos and 3D models are established and displayed to a user.
The scene reconstruction system of the embodiment determines a reacquired region and acquires data again in a targeted manner by learning and screening the acquired real scene data, so that the quality of the real scene data is ensured, and a virtual scene is accurately reconstructed on the basis; and data are transmitted through a wireless network, so that the real-time property of scene reconstruction can be ensured, and the virtual scene is more real.
Fig. 2 is a schematic structural diagram of another scene reconstruction system according to an embodiment. As shown in fig. 2, the reacquisition control module 20 includes: the proofreading submodule 21 is configured to proofread the real scene data acquired by the data acquisition module 10, and determine a reacquisition area according to a proofreading result, where the reacquisition area includes an area where a scene is missing or data quality is lower than a preset standard; the instruction generation submodule 22 is used for generating a reacquisition instruction for the reacquisition area under the condition that the reacquisition area is not empty; and the sending submodule 23 is configured to send the real scene data to the three-dimensional reconstruction module 30 under the condition that the reacquisition area is empty.
In this embodiment, the real scene data is transmitted from the data acquisition module 10 to the reacquisition control module 20 and the three-dimensional reconstruction module 30, the reacquisition instruction is transmitted from the reacquisition control module 20 to the data acquisition module 10, and data is reacquired in a targeted manner by bidirectional transmission of data between devices, so that data quality can be ensured and real-time end-to-end update can be realized.
In one embodiment, the data acquisition module 10 includes: the image acquisition submodule 11 is used for acquiring image data of a real scene; the sound acquisition submodule 12 is used for acquiring sound data of a real scene; a temperature and humidity acquisition submodule 13; the method is used for collecting temperature and humidity data of a real scene.
In this embodiment, the image acquisition sub-module 11 includes an image sensor such as a camera, and is configured to acquire image data in a real scene; the sound collection submodule 12 comprises a sound sensor such as a microphone and is used for collecting sound data in a real scene; the temperature and humidity acquisition submodule 13 includes a temperature sensor, a heat sensor, an infrared sensor, a humidity sensor, and the like, and can be used for acquiring temperature and humidity data of a real scene.
In one embodiment, the data acquisition module 10 further comprises: and the image reacquisition submodule 14 is used for switching the image sensor with higher definition than the current definition to reacquire the image data of the reacquisition area according to the reacquisition instruction, or adjusting the focal length or angle of the shooting reacquisition area to reacquire the image data of the reacquisition area.
In an embodiment, the image capturing sub-module 11 includes a wide-angle camera, the image reacquiring sub-module 14 includes at least one telephoto camera, and the image capturing sub-module 11 and the image reacquiring sub-module 14 together form a multi-focal-length camera array, wherein the wide-angle camera has a shorter focal length, a larger viewing angle, and a wider coverage area; the long-focus camera has longer focal length, smaller visual angle and smaller coverage area, but the shot picture has higher resolution. In case that it is determined from the real scene data acquired by the image acquisition sub-module 11 that the reacquisition area is not empty, it may be switched to a tele-camera in the image reacquisition sub-module 14 to take a re-shot in a targeted manner to obtain more details of the image data.
In an embodiment, the image re-acquisition sub-module 14 includes an image sensor with adjustable definition, focal length or angle, and the image sensor in the image re-acquisition sub-module 14 may be the same as the image sensor in the image acquisition sub-module 11.
In an embodiment, the synchronous reacquisition submodule is configured to synchronously acquire the temperature and humidity data and the sound data during the reacquisition of the image data. In this embodiment, the collected or re-collected temperature and humidity data and sound data are synchronized with the image data. For example, if the image data acquired within a certain time period is a scene in which a pedestrian walks in a snow field, the corresponding sound data may be a sound of stepping on the snow, and the corresponding temperature and humidity data may be low in temperature and high in humidity; for another example, if the image data collected in a certain time period is a scene where burning sun shines on a big tree and forms a tree shadow, the corresponding sound data may be sound of cicada bugs, and the corresponding temperature and humidity data may be high in temperature and low in humidity.
In one embodiment, the three-dimensional reconstruction module 30 includes: the image reconstruction submodule 31 is configured to reconstruct a three-dimensional image of the virtual scene according to the image data in the real scene data sent by the reacquisition control module 20; and the synchronous reconstruction submodule 32 is configured to synchronize sound data and temperature and humidity data in the real scene data to the three-dimensional image according to the timestamp of the real scene data.
In this embodiment, when the reacquisition area is empty, that is, there is no area that needs to reacquire data, the virtual scene can be reconstructed more accurately based on the high-quality real scene data sent by the reacquisition control module 20 without the situations of deletion, blur, and the like. In addition, in the process of acquiring real scene data, image data, sound data, temperature and humidity data and the like have time stamps, and various data have corresponding relation in time and are acquired synchronously; in the reconstructed virtual scene, the sound data, the temperature and humidity data and the image data are all synchronous.
In one embodiment, the system further comprises: the display module 40 is connected with the three-dimensional reconstruction module 30 through a wireless network; a display module 40, comprising: a display sub-module 41 for displaying a three-dimensional image of a virtual scene; the sound submodule 42 is used for synchronously playing sound data according to the three-dimensional images; and the perception submodule 43 is used for synchronously simulating the temperature and the humidity of the real scene according to the three-dimensional image.
In the present embodiment, the display sub-module 41 may include a head-mounted display, a large-screen stereoscopic projection device, a computer-generated hologram display device, and the like; the sound sub-module 42 may be a sound output device such as a sound box and an earphone; the sensory sub-module 43 may be VR gloves or a hot spot device placed near the user's body surface, a blowing device, a device for releasing smell and mist, and the like.
In an embodiment, the data collection module 10 may further include a motion sensing device, which receives motion or voice information of a user through a sensor, so that the three-dimensional reconstruction module 30 simulates a viewing angle of the user in real time, reconstructs a virtual scene, and displays the virtual scene in the display module 40.
In one embodiment, the system further comprises: and the data cleaning module 50 is configured to pre-process the real image data and send the pre-processed real image data to the reacquisition control module 20.
In this embodiment, the data cleaning module 50 is configured to perform preprocessing or data cleaning on the real scene data acquired by the data acquisition module 10, that is, to find and correct recognizable errors in the data, for example, to check data consistency, process invalid values and missing values, and also to remove noise in image data or sound data, so as to further ensure data quality.
Scene reconstruction technology in the related technology cannot fully utilize data of a real scene, a self-learning mechanism is lacked, a three-dimensional image can only be displayed to a user through a virtual scene, sound data cannot be displayed, details of the created virtual real scene are not rich enough, and sensory experience is poor. In the embodiment, data among the modules support wireless network transmission, so that real-time updating of the virtual scene is ensured; the reacquisition control module learns a large amount of sample data to construct a training model, can calculate real scene data acquired in real time, intelligently identifies reacquisition areas with insufficient details or wrong contents, and instructs the data acquisition module 10 to perform targeted automatic reacquisition, so that a virtual scene is richer and more real through bidirectional high-speed data transmission; the data quality is further ensured through data cleaning, and more details of the virtual scene can be obtained; through synchronous collection and show speech data and humiture data, realize the effect of scene, sound, the synchronous show of sense, improve the accuracy and the authenticity of virtual scene, bring the experience that the user is on the spot.
The embodiment of the application also provides a scene reconstruction method. Fig. 3 is a flowchart of a scene reconstruction method according to an embodiment. As shown in fig. 3, the method includes steps 110-150.
In step 110, real scene data is acquired. In this embodiment, the real scene data may be in different forms such as images, sounds, temperature and humidity, and may be collected by a camera, a microphone, a temperature and humidity sensor, and the like.
In step 120, a reacquisition area is determined based on the acquired real scene data. According to the embodiment, the data quality of the acquired real scene data can be analyzed through training and learning based on a large amount of sample data, and the reacquisition region is determined according to the data quality.
In step 130, whether the reacquisition area is empty is determined, if yes, step 150 is performed, and if not, step 140 is performed.
In step 140, reacquisition instructions are generated instructing reacquisition of real scene data for the reacquisition area.
In step 150, a virtual scene is reconstructed from the real scene data.
In the embodiment, a reacquisition instruction is generated under the condition that the reacquisition area is not empty, and the reacquisition instruction is used for indicating to reacquire real scene data; and under the condition that the reacquisition area is empty, reconstructing according to the real scene data to obtain the virtual scene.
In an embodiment, in step 140, the step 110 may be executed again according to the reacquisition instruction, the real scene data is acquired, and the reacquisition area is reacquired, and for the real scene data reacquired according to the reacquisition instruction, whether the reacquisition area is empty may be further determined, until there is no data that needs to be reacquired, and the virtual scene is reconstructed according to the real scene data.
According to the scene reconstruction method, the acquired real scene data are learned or screened, a reacquired area is determined, the data are acquired again in a targeted manner, the quality of the real scene data is guaranteed, and the virtual scene is accurately reconstructed on the basis; and data are transmitted through a wireless network, so that the real-time property of scene reconstruction can be ensured, and the virtual scene is more real.
The embodiment of the application also provides another scene reconstruction method. Fig. 4 is a flowchart of another scene reconstruction method according to an embodiment. As shown in fig. 4, the method includes steps 210-290.
In step 210, real scene data is acquired.
In one embodiment, the real scene data includes: image data, sound data and temperature and humidity data of a real scene.
In step 220, the acquired real scene data is collated and a reacquisition area is determined according to the collated result.
Through training and learning based on a large amount of sample data, the acquired real scene data and the sample data can be corrected, the data quality of the real scene data is analyzed, and accordingly the reacquisition area is determined.
In step 230, whether the reacquisition area is empty is determined, if yes, step 260 is performed, and if not, step 240 is performed.
In step 240, reacquisition instructions are generated instructing reacquisition of real scene data for the reacquisition area.
In step 250, the real scene data of the reacquisition area is reacquired according to the reacquisition instruction.
In an embodiment, the re-acquiring the real scene data of the re-acquisition area according to the re-acquisition instruction includes: switching an image sensor with higher definition than the current definition to acquire the image data of the reacquired area again according to the reacquired instruction, or adjusting the focal length or angle of shooting the reacquired area to acquire the image data of the reacquired area again; and synchronously acquiring temperature and humidity data and sound data in the process of acquiring the image data again.
In this step, the step 220 may be performed again for the re-collected real scene data, and the re-collected real scene data and the sample data are collated, so as to determine a re-collection area, and if the re-collection area is empty, S260 is performed.
In step 260, a three-dimensional image of the virtual scene is reconstructed from the real scene data.
In step 270, sound data and temperature and humidity data are synchronized to the three-dimensional image according to the timestamp of the real scene data.
In step 280, a three-dimensional image of the virtual scene is displayed.
In step 290, sound data is played in synchronization with the three-dimensional image and the temperature and humidity of the real scene are simulated in synchronization.
The scene reconstruction method in this embodiment and the scene reconstruction system in the above embodiments belong to the same inventive concept, and have the same beneficial effects, and the technical details that are not described in detail in this embodiment can be referred to any of the above embodiments.
The above description is only exemplary embodiments of the present application, and is not intended to limit the scope of the present application.
The foregoing has provided by way of exemplary and non-limiting examples a detailed description of exemplary embodiments of the present application. Various modifications and adaptations to the foregoing embodiments may become apparent to those skilled in the relevant arts in view of the following drawings and the appended claims without departing from the scope of the invention. Therefore, the proper scope of the invention is to be determined according to the claims.

Claims (14)

1. A scene reconstruction system, comprising: the system comprises a data acquisition module, a reacquisition control module and a three-dimensional reconstruction module, wherein the data acquisition module, the reacquisition control module and the three-dimensional reconstruction module are sequentially connected through a wireless network;
the data acquisition module is used for acquiring real scene data and sending the real scene data to the reacquisition control module;
the reacquisition control module is used for determining an reacquisition area according to the real scene data sent by the data acquisition module; generating a reacquisition instruction under the condition that the reacquisition area is not empty, wherein the reacquisition instruction is used for instructing the data acquisition module to reacquire and send real scene data; under the condition that the reacquisition area is empty, the real scene data are sent to the three-dimensional reconstruction module;
and the three-dimensional reconstruction module is used for reconstructing to obtain a virtual scene according to the real scene data sent by the reacquisition control module.
2. The system of claim 1, wherein the reacquisition control module comprises:
the proofreading submodule is used for proofreading the real scene data acquired by the data acquisition module and determining a reacquisition area according to a proofreading result, wherein the reacquisition area comprises an area with scene missing or data quality lower than a preset standard;
the instruction generation submodule is used for generating a reacquisition instruction aiming at the reacquisition area under the condition that the reacquisition area is not empty;
and the sending submodule is used for sending the real scene data to the three-dimensional reconstruction module under the condition that the reacquisition area is empty.
3. The system of claim 1, wherein the data acquisition module comprises:
the image acquisition submodule is used for acquiring image data of a real scene;
the sound acquisition submodule is used for acquiring sound data of a real scene;
a temperature and humidity acquisition submodule; the method is used for collecting temperature and humidity data of a real scene.
4. The system of claim 3, wherein the data acquisition module further comprises:
the image reacquisition submodule is used for switching an image sensor with higher definition than the current definition to reacquire the image data of the reacquisition area according to the reacquisition instruction, or adjusting the focal length or angle of shooting the reacquisition area, and reacquiring the image data of the reacquisition area;
and the synchronous reacquisition submodule is used for synchronously acquiring temperature and humidity data and sound data in the process of reacquiring the image data.
5. The system of claim 3, wherein the three-dimensional reconstruction module comprises:
the image reconstruction submodule is used for reconstructing a three-dimensional image of a virtual scene according to image data in the real scene data sent by the reacquisition control module;
and the synchronous reconstruction submodule is used for synchronizing the sound data and the temperature and humidity data in the real scene data to the three-dimensional image according to the timestamp of the real scene data.
6. The system of claim 5, further comprising: the display module is connected with the three-dimensional reconstruction module through a wireless network;
the display module comprises:
a display sub-module for displaying a three-dimensional image of the virtual scene;
the sound submodule is used for synchronously playing sound data according to the three-dimensional image;
and the perception submodule is used for synchronously simulating the temperature and the humidity of a real scene according to the three-dimensional image.
7. The system of any one of claims 1-6, further comprising:
and the data cleaning module is used for preprocessing the real image data and sending the preprocessed real image data to the reacquisition control module.
8. A method for scene reconstruction, comprising:
collecting real scene data;
determining a reacquisition area according to the acquired real scene data;
generating a reacquisition instruction if the reacquisition area is not empty, the reacquisition instruction to instruct reacquisition of real scene data for the reacquisition area;
and under the condition that the reacquisition area is empty, reconstructing to obtain a virtual scene according to the real scene data.
9. The method of claim 8, wherein determining the reacquisition regions from the acquired real scene data comprises:
and correcting the acquired real scene data and determining a re-acquisition area according to a correction result, wherein the re-acquisition area comprises an area with scene missing or data quality lower than a preset standard.
10. The method according to claim 8 or 9, wherein the real scene data comprises: image data, sound data and temperature and humidity data of a real scene.
11. The method of claim 10, further comprising:
and re-collecting the real scene data of the re-collecting area according to the re-collecting instruction.
12. The method of claim 11, wherein said re-acquiring real scene data of the re-acquisition region according to the re-acquisition instruction comprises:
switching an image sensor with higher definition than the current definition to acquire the image data of the reacquired area again according to the reacquired instruction, or adjusting the focal length or angle of shooting the reacquired area to acquire the image data of the reacquired area again;
and synchronously acquiring temperature and humidity data and sound data in the process of acquiring the image data again.
13. The method of claim 10, wherein reconstructing the virtual scene from the real scene data comprises:
reconstructing a three-dimensional image of a virtual scene according to the image data of the real scene;
and synchronizing sound data and temperature and humidity data to the three-dimensional image according to the timestamp of the real scene data.
14. The method of claim 13, further comprising:
displaying a three-dimensional image of the virtual scene;
and synchronously playing sound data with the three-dimensional image and synchronously simulating the temperature and the humidity of a real scene.
CN201910819075.5A 2019-08-30 2019-08-30 Scene reconstruction system and method Pending CN112446961A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910819075.5A CN112446961A (en) 2019-08-30 2019-08-30 Scene reconstruction system and method
PCT/CN2020/112362 WO2021037257A1 (en) 2019-08-30 2020-08-31 Scene reconstruction system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910819075.5A CN112446961A (en) 2019-08-30 2019-08-30 Scene reconstruction system and method

Publications (1)

Publication Number Publication Date
CN112446961A true CN112446961A (en) 2021-03-05

Family

ID=74685599

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910819075.5A Pending CN112446961A (en) 2019-08-30 2019-08-30 Scene reconstruction system and method

Country Status (2)

Country Link
CN (1) CN112446961A (en)
WO (1) WO2021037257A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114863037B (en) * 2022-07-06 2022-10-11 杭州像衍科技有限公司 Single-mobile-phone-based human body three-dimensional modeling data acquisition and reconstruction method and system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015228186A (en) * 2014-06-02 2015-12-17 株式会社ソニー・コンピュータエンタテインメント Image processor and image processing method
CN106296669B (en) * 2016-08-01 2019-11-19 微梦创科网络科技(中国)有限公司 A kind of image quality evaluating method and device
CN107146200B (en) * 2017-04-25 2020-06-30 广西大学 Unmanned aerial vehicle remote sensing image splicing method based on image splicing quality evaluation
CN107749047B (en) * 2017-10-13 2020-10-16 中国科学院计算技术研究所 Progressive compressed sensing reconstruction method and system based on Hadamard matrix
CN109377551B (en) * 2018-10-16 2023-06-27 北京旷视科技有限公司 Three-dimensional face reconstruction method and device and storage medium thereof
CN109949281A (en) * 2019-03-11 2019-06-28 哈尔滨工业大学(威海) A kind of gastroscope picture quality detection method and device

Also Published As

Publication number Publication date
WO2021037257A1 (en) 2021-03-04

Similar Documents

Publication Publication Date Title
CN108200445B (en) Virtual playing system and method of virtual image
US11076142B2 (en) Real-time aliasing rendering method for 3D VR video and virtual three-dimensional scene
CN103608847B (en) A kind of method and apparatus built for iconic model
US20160267699A1 (en) Avatar control system
TWI752502B (en) Method for realizing lens splitting effect, electronic equipment and computer readable storage medium thereof
US7173672B2 (en) System and method for transitioning between real images and virtual images
CN105939481A (en) Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method
CN106713755A (en) Method and apparatus for processing panoramic image
CN114401414B (en) Information display method and system for immersive live broadcast and information pushing method
US20240029342A1 (en) Method and data processing system for synthesizing images
CN110738717B (en) Method and device for correcting motion data and electronic equipment
CN108960889B (en) Method and device for controlling voice speaking room progress in virtual three-dimensional space of house
KR20130090621A (en) Apparatus and method for pre-visualization image
CN108600729B (en) Dynamic 3D model generation device and image generation method
CN108107578A (en) View angle regulating method, device, computing device and the storage medium of virtual reality
JP2019022151A (en) Information processing apparatus, image processing system, control method, and program
CN114125301A (en) Virtual reality technology shooting delay processing method and device
CN112446961A (en) Scene reconstruction system and method
CN110433491A (en) Movement sync response method, system, device and the storage medium of virtual spectators
JP2019103126A (en) Camera system, camera control device, camera control method, and program
CN109710061B (en) dynamic feedback system and method for image
WO2023236656A1 (en) Method and apparatus for rendering interactive picture, and device, storage medium and program product
JP7110378B2 (en) METHOD AND PROGRAM FOR PROVIDING AUGMENTED REALITY IMAGE USING DEPTH DATA
JP2017506523A (en) Image display method and apparatus
CN108833740A (en) A kind of real-time word extractor method and apparatus based on three-dimensional animation live streaming

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination