CN114091150A - Layout rationality detection method based on VR, multi-camera and robot linkage - Google Patents
Layout rationality detection method based on VR, multi-camera and robot linkage Download PDFInfo
- Publication number
- CN114091150A CN114091150A CN202111344957.4A CN202111344957A CN114091150A CN 114091150 A CN114091150 A CN 114091150A CN 202111344957 A CN202111344957 A CN 202111344957A CN 114091150 A CN114091150 A CN 114091150A
- Authority
- CN
- China
- Prior art keywords
- scene
- robot
- furniture
- client
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 24
- 230000000694 effects Effects 0.000 claims abstract description 13
- 238000005516 engineering process Methods 0.000 claims description 19
- 230000003993 interaction Effects 0.000 claims description 8
- 238000010586 diagram Methods 0.000 claims description 6
- 230000009290 primary effect Effects 0.000 claims description 4
- 238000000034 method Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 3
- 238000010276 construction Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 241001122767 Theaceae Species 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/13—Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Structural Engineering (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a layout rationality detection method based on VR, multi-camera and robot linkage, which comprises the following steps: step 1, generating a primary VR effect graph; step 2, selecting sizes of the table top and the furniture and adjusting the placement position in the VR scene, and updating the VR scene effect in real time; step 3, when a client feels a VR scene, a plurality of cameras in the venue can detect the position and the posture of the client in real time, analyze the position and the posture together with the VR scene, and judge whether the client collides with a wall surface, a table top, furniture and the like at present, so that the size and the position of the client can be adjusted; step 4, when the client feels the VR scene, the intelligent robot in the venue can be linked with the position of the client, the sizes of furniture and a table top can be simulated, and the size and the position can be dynamically adjusted; and 5, outputting a reasonable design layout according to the VR scene graph after actual adjustment. The invention can enhance the experience of the customer, is beneficial to improving the efficiency and the satisfaction of the design and perfects the accuracy of the design scheme.
Description
Technical Field
The invention relates to the field of virtual reality and artificial intelligence, in particular to a layout rationality detection method based on VR (virtual reality), multi-camera and robot linkage.
Background
With the rapid construction of real estate, people have higher and higher requirements on indoor design, and most of the indoor designs are designed reasonably by designers to achieve satisfactory effects. When a designer designs a user, due to the difference of personal understanding and cognition, the actual effect often causes many problems (insufficient passageway passing performance, improper table top size and the like), and often needs a client to confirm on site for many times, so that the construction period is prolonged, and the user experience is influenced; and the repeated modification and adjustment brings huge workload, and the design efficiency is seriously influenced.
In addition, in the indoor design, the size selection of furniture such as sofas, tea tables, beds and the like is also an important link. The designer can utilize past experience, helps the customer to select various furniture, and the customer can not carry out actual experience, often can bring the unreasonable problem of overall arrangement (size and locating position are unreasonable), reduces the travelling comfort.
The VR (virtual reality) technology comprehensively utilizes various high-tech technologies such as computer graphic imaging, multimedia technology, sensing technology, network technology, artificial intelligence technology and the like to simulate various sensory systems such as vision, touch, hearing and the like of a human body, construct a virtual scene, immerse a consumer in a virtual environment constructed by a computer, enhance interaction and sense of reality by utilizing head-mounted wearable equipment and display equipment through real-time interaction such as limbs, natural language and the like, and enable an experiencer to be in a multi-dimensional space.
The application of VR technology in indoor design can create a virtual reality scene for a customer, and create a designed virtual environment for the customer according to the requirements of the customer, so that the customer can experience the virtual reality scene, the actual situation after the design is finished can be really felt, the experience of the customer can be enhanced, and the service quality can be improved; secondly, the VR technology can help customers add various furniture and table tops in the virtual scene, so that the customers can see and obtain the virtual scene, the customers really feel the design effect in advance, and the condition that the satisfaction degree of the customers is reduced due to the fact that the design scene is far from the expected scene is avoided.
Disclosure of Invention
The invention aims to provide a layout rationality detection method based on VR, multi-camera and robot linkage; the method creates a designed virtual environment for the customer, so that the customer can experience himself, really feel the actual situation after the design is finished, enhance the experience of the customer and improve the service quality; secondly, the VR technology can enable a customer to really feel the design effect in advance, and the situation that the satisfaction degree of the customer is reduced due to the fact that the design scene is far away from the expected scene is avoided.
The technical scheme adopted by the invention is as follows: a layout rationality detection method based on VR, multi-camera and robot linkage comprises the following steps:
step 1, generating a primary VR effect diagram according to a house type diagram provided by a customer and actually measured house data;
step 2: the primary effect picture is displayed by using a VR technology, so that a customer can select the sizes of table tops and furniture and adjust the placement position in a VR scene, and the VR scene effect is updated in real time;
and step 3: when a client feels a VR scene, a plurality of cameras in a venue detect the position and the posture of the client in real time, and analyze the position and the posture together with the VR scene to judge whether the client collides with a wall surface, a table top and furniture at present, so that the size and the placement position of a collider are adjusted;
and 4, step 4: when a client feels a VR scene, an intelligent robot in a venue is linked with the position of the client, and simultaneously the intelligent robot can simulate the sizes of furniture and a table top, so that the client can feel the VR scene actually and dynamically adjust the size and the position, and the layout rationality is improved;
and 5: and outputting a reasonable design layout according to the VR scene graph after the actual adjustment of the customer.
Furthermore, in the step 2, the size selection and the placement position adjustment of the table board and the furniture are completed by means of an intelligent voice interaction technology.
Further, in the step 3, the cameras are arranged on the periphery of the top of the VR venue and on the wall of the venue.
Furthermore, in the step 3, the client posture and position image data acquired by the multiple cameras are fused with rendered VR scenes, and the client three-dimensional virtual point cloud is added into the VR scene to predict whether the client collides, so that the rationality of placing the colliders is judged.
Further, in step 3, the collision detection further includes passing detection when passing through the complex object.
Furthermore, in the step 4, the sizes of the simulated furniture and the table board of the intelligent robot are obtained by comparing the images of the robot collected by the multiple cameras with VR scenes, and the sizes of the intelligent robot are dynamically adjusted until the sizes of the intelligent robot are matched with the VR scenes.
Further, in the step 4, when the intelligent robot does not simulate a table top or furniture, the table top or furniture in the VR scene is a light-colored virtual shadow; when the intelligent robot simulates a table top or furniture, dark real shadows are formed in the VR scene.
Further, in step 4, the adjustment of the intelligent robot is completed by means of an intelligent voice interaction technology.
The invention has the beneficial effects that:
1. according to the virtual space construction method, the virtual space can be quickly constructed through the VR technology, the whole space is divided into primary and secondary spaces, a user can feel from different directions conveniently, and the experience of the user is enhanced.
2. The invention also enables the customer to actually participate in the design, and autonomously selects the sizes and the placing positions of various table tops and furniture, thereby being beneficial to improving the efficiency and the satisfaction degree of the design and enabling the user to feel the design effect more comprehensively and intuitively.
3. The invention also realizes collision detection and layout rationality detection in VR scene by combining multiple cameras and intelligent robot, and improves the accuracy of design scheme.
Drawings
FIG. 1 is an overall flow chart of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and specific embodiments.
Referring to fig. 1, a layout rationality detection method based on VR, multi-camera and robot linkage includes the following steps:
step 1, generating a primary effect graph: generating a primary VR effect diagram according to a house type diagram provided by a customer and actually measured house data;
step 2, selecting and placing the table board and the furniture in size: the primary effect picture is displayed by using a VR technology, so that a customer can select the sizes of table tops and furniture and adjust the placement position in a VR scene, and the VR scene effect is updated in real time;
step 3, detecting the collision performance: when a client feels a VR scene, a plurality of cameras in a venue can detect the position and the posture of the client in real time, analyze the position and the posture together with the VR scene and judge whether the client collides with a wall surface, a table top, furniture and the like at present, so that the size and the placement position of a colliding object are adjusted;
step 4, detecting the reasonability of the layout: when a client feels a VR scene, an intelligent robot in a venue can be linked with the position of the client, the intelligent robot can also simulate the sizes of furniture and a table top, the client can feel the VR scene actually, the size and the position can be adjusted dynamically, and the layout rationality is improved;
and 5, outputting a reasonable design layout: and outputting a reasonable design layout according to the VR scene graph after the actual adjustment of the customer.
In the step 2, the size selection and the placement position adjustment of the table board and the furniture are completed by means of an intelligent voice interaction technology.
In the step 3, besides the cameras are arranged around the top of the VR venue, a plurality of cameras are also arranged on the wall of the venue.
In the step 3, the collision detection means that image data of the client such as the posture and the position, which are acquired by a plurality of cameras, are fused with rendered VR scenes, and the three-dimensional virtual point cloud of the client is added in the VR scene to predict whether the client collides, so that the rationality of the placement of the colliders is judged.
In step 3, the collision detection includes, but is not limited to, collision detection of walls, floors, furniture, and the like, and also includes passing detection when passing through a complex object, such as whether a passageway is too narrow, a distance between furniture and a floor, and the like.
In the step 3, the detection of the height of the cabinet due to the multiple cameras on the wall surface can be realized, for example, whether the cabinet fixed on the wall surface collides with the head or not can be realized.
In the step 4, the sizes of the simulated furniture table board and the like of the intelligent robot are compared with VR scenes through images of the robot collected by a plurality of cameras, and the size of the intelligent robot is dynamically adjusted until the size of the intelligent robot is matched with the VR scenes.
In the step 4, the furniture table top and other dimensions are adjusted, and the intelligent robot is used for sequentially simulating the height, width, length and other information, for example, the intelligent robot sequentially simulates the height, width and length of the table top, so that a customer can feel whether the dimensions are reasonable or not and whether the adjustment is needed or not.
In the step 4, when the intelligent robot does not simulate a table top or furniture, the table top (furniture) in the VR scene is in a light-color virtual shadow; when intelligent robot simulation mesa (furniture), be dark real shadow in the VR scene, the customer can actually experience, for example when the robot simulates the mesa, the customer can try under this size, whether the impression is taken article and is convenient comfortable to judge the overall arrangement rationality.
In the step 4, the adjustment of the intelligent robot is also completed by means of an intelligent voice interaction technology.
The foregoing illustrates and describes the principles, general features, and advantages of the present invention. It should be understood by those skilled in the art that the above embodiments do not limit the scope of the present invention in any way, and all technical solutions obtained by using equivalent substitution methods fall within the scope of the present invention.
The parts not involved in the present invention are the same as or can be implemented using the prior art.
Claims (8)
1. A layout rationality detection method based on VR, multi-camera and robot linkage is characterized by comprising the following steps:
step 1, generating a primary VR effect diagram according to a house type diagram provided by a customer and actually measured house data;
step 2: the primary effect picture is displayed by using a VR technology, so that a customer can select the sizes of table tops and furniture and adjust the placement position in a VR scene, and the VR scene effect is updated in real time;
and step 3: when a client feels a VR scene, a plurality of cameras in a venue detect the position and the posture of the client in real time, and analyze the position and the posture together with the VR scene to judge whether the client collides with a wall surface, a table top and furniture at present, so that the size and the placement position of a collider are adjusted;
and 4, step 4: when a client feels a VR scene, an intelligent robot in a venue is linked with the position of the client, and simultaneously the intelligent robot can simulate the sizes of furniture and a table top, so that the client can feel the VR scene actually and dynamically adjust the size and the position, and the layout rationality is improved;
and 5: and outputting a reasonable design layout according to the VR scene graph after the actual adjustment of the customer.
2. The layout rationality detection method based on VR, multi-camera and robot linkage according to claim 1, characterized in that in step 2, table top, furniture size selection and placement position adjustment are completed by means of intelligent voice interaction technology.
3. The VR, multi-camera and robot linkage based layout rationality detection method of claim 1, wherein in step 3, the cameras are arranged around the top of the VR venue and on the wall of the venue.
4. The method for detecting the layout rationality based on the linkage of VR, multi-camera and robot according to claim 1, wherein in step 3, the posture and position image data of the customer collected by the multi-camera is fused with the rendered VR scene, and the three-dimensional virtual point cloud of the customer is added in the VR scene to predict whether the customer will collide, so as to judge the rationality of the placement of the collided object.
5. The VR, multi-camera and robot linkage based layout rationality detection method of claim 1 wherein in step 3, collision detection further includes passing complex objects.
6. The VR, multi-camera and robot linkage based layout rationality detection method of claim 1, wherein in step 4, the sizes of the simulated furniture and the table top of the intelligent robot are the images of the robot collected by the multi-camera, the images are compared with VR scenes, and the size of the intelligent robot is dynamically adjusted until the size of the intelligent robot is matched with the VR scenes.
7. The layout rationality detection method based on VR, multi-camera and robot linkage of claim 1, characterized in that in step 4, when the intelligent robot does not simulate a table or furniture, the table or furniture in the VR scene is a light-colored ghost; when the intelligent robot simulates a table top or furniture, dark real shadows are formed in the VR scene.
8. The VR, multi-camera and robot linkage based layout rationality detection method of claim 1, wherein in step 4, the intelligent robot is adjusted by means of an intelligent voice interaction technology.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111344957.4A CN114091150A (en) | 2021-11-15 | 2021-11-15 | Layout rationality detection method based on VR, multi-camera and robot linkage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111344957.4A CN114091150A (en) | 2021-11-15 | 2021-11-15 | Layout rationality detection method based on VR, multi-camera and robot linkage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114091150A true CN114091150A (en) | 2022-02-25 |
Family
ID=80300544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111344957.4A Pending CN114091150A (en) | 2021-11-15 | 2021-11-15 | Layout rationality detection method based on VR, multi-camera and robot linkage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114091150A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205809568U (en) * | 2016-06-21 | 2016-12-14 | 武汉方格信息技术有限公司 | A kind of combination VR and the intelligent domestic system of robot |
| CN108648276A (en) * | 2018-05-17 | 2018-10-12 | 上海宝冶集团有限公司 | A kind of construction and decoration design method, device, equipment and mixed reality equipment |
| CN109033535A (en) * | 2018-06-29 | 2018-12-18 | 中国航空规划设计研究总院有限公司 | A kind of Design of Production Line visualization system based on VR technology |
| CN109871912A (en) * | 2017-12-04 | 2019-06-11 | 深圳市易特科信息技术有限公司 | Virtual reality scenario simulator and method |
| CN110060350A (en) * | 2019-02-28 | 2019-07-26 | 浙江华越设计股份有限公司 | A kind of architectural design method based on VR technology |
| US20190333174A1 (en) * | 2017-05-12 | 2019-10-31 | Gyou Young JUNG | System for providing removals simulation using virtual reality and augmented reality and brokering real estate therethrough |
| CN110799926A (en) * | 2017-06-30 | 2020-02-14 | 托比股份公司 | System and method for displaying images in a virtual world environment |
| CN110915208A (en) * | 2017-07-31 | 2020-03-24 | 谷歌有限责任公司 | Virtual reality environment boundary using depth sensor |
| CN113450450A (en) * | 2021-05-18 | 2021-09-28 | 深圳市中装建设集团股份有限公司 | Intelligent design method and system for home decoration |
-
2021
- 2021-11-15 CN CN202111344957.4A patent/CN114091150A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205809568U (en) * | 2016-06-21 | 2016-12-14 | 武汉方格信息技术有限公司 | A kind of combination VR and the intelligent domestic system of robot |
| US20190333174A1 (en) * | 2017-05-12 | 2019-10-31 | Gyou Young JUNG | System for providing removals simulation using virtual reality and augmented reality and brokering real estate therethrough |
| CN110799926A (en) * | 2017-06-30 | 2020-02-14 | 托比股份公司 | System and method for displaying images in a virtual world environment |
| CN110915208A (en) * | 2017-07-31 | 2020-03-24 | 谷歌有限责任公司 | Virtual reality environment boundary using depth sensor |
| CN109871912A (en) * | 2017-12-04 | 2019-06-11 | 深圳市易特科信息技术有限公司 | Virtual reality scenario simulator and method |
| CN108648276A (en) * | 2018-05-17 | 2018-10-12 | 上海宝冶集团有限公司 | A kind of construction and decoration design method, device, equipment and mixed reality equipment |
| CN109033535A (en) * | 2018-06-29 | 2018-12-18 | 中国航空规划设计研究总院有限公司 | A kind of Design of Production Line visualization system based on VR technology |
| CN110060350A (en) * | 2019-02-28 | 2019-07-26 | 浙江华越设计股份有限公司 | A kind of architectural design method based on VR technology |
| CN113450450A (en) * | 2021-05-18 | 2021-09-28 | 深圳市中装建设集团股份有限公司 | Intelligent design method and system for home decoration |
Non-Patent Citations (4)
| Title |
|---|
| 刘贤梅等著: "《基于虚拟现实的室内仿真操作***研究与应用》", 《计算机技术与发展》, vol. 30, no. 1, 31 January 2020 (2020-01-31), pages 149 - 154 * |
| 王波等著: "《基于图像处理的虚拟现实技术的室内设计***研究》", 《现代电子技术》, vol. 43, no. 11, 1 June 2020 (2020-06-01), pages 68 - 71 * |
| 经彤等著: "《实时交互仿真环境设计研究》", 《西北工业大学学报》, vol. 16, no. 4, 30 November 1998 (1998-11-30), pages 485 - 490 * |
| 苗群英著: "《沉浸式VR技术在室内家具设计实践中的应用》", 《居舍》, no. 2020, 31 October 2020 (2020-10-31), pages 41 - 42 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200380333A1 (en) | System and method for body scanning and avatar creation | |
| US11640672B2 (en) | Method and system for wireless ultra-low footprint body scanning | |
| US10628666B2 (en) | Cloud server body scan data system | |
| CN107680165B (en) | HoloLens-based computer console holographic display and natural interaction application method | |
| CN106780421A (en) | Finishing effect methods of exhibiting based on panoramic platform | |
| US6195104B1 (en) | System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs | |
| CN103778538A (en) | Furniture simulation layout method and furniture simulation layout system | |
| US20110298897A1 (en) | System and method for 3d virtual try-on of apparel on an avatar | |
| JP2013061937A (en) | Combined stereo camera and stereo display interaction | |
| CN113761614B (en) | Plane home decoration design auxiliary method | |
| Jimeno-Morenilla et al. | Augmented and virtual reality techniques for footwear | |
| CN109657387B (en) | Household model positioning and placing method based on mixed reality scene | |
| Tang et al. | AR interior designer: Automatic furniture arrangement using spatial and functional relationships | |
| Liang et al. | Functional workspace optimization via learning personal preferences from virtual experiences | |
| CN110060350A (en) | A kind of architectural design method based on VR technology | |
| Khattak et al. | A real-time reconstructed 3D environment augmented with virtual objects rendered with correct occlusion | |
| Zhang et al. | Evaluation of auditory and visual feedback on task performance in a virtual assembly environment | |
| WO2018182938A1 (en) | Method and system for wireless ultra-low footprint body scanning | |
| CN114091150A (en) | Layout rationality detection method based on VR, multi-camera and robot linkage | |
| JP5999802B1 (en) | Image processing apparatus and method | |
| Novak-Marcincin | Application of the virtual reality modeling language for design of automated workplaces | |
| Ogi | Emotional design in the virtual environment | |
| WO2024077518A1 (en) | Interface display method and apparatus based on augmented reality, and device, medium and product | |
| Mao | Application of virtual reality imaging technology in interior decoration design | |
| Wacker et al. | A comparative study on user performance in the Virtual Dressmaker application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |