KR20160121257A

KR20160121257A - Architectural design verification system and method using augmented reality

Info

Publication number: KR20160121257A
Application number: KR1020150051026A
Authority: KR
Inventors: 류재호
Original assignee: 서울과학기술대학교 산학협력단
Priority date: 2015-04-10
Filing date: 2015-04-10
Publication date: 2016-10-19
Also published as: KR101674043B1

Abstract

The present invention relates to an architectural design verification system and a method thereof using augmented reality. The architectural design verification system using augmented reality includes: a main body having a first slope inclined plane and a second slope inclined plane; a marker disposed inside the main body; one or more camera units located inside a real architectural model and the main body and obtaining the marker and an image of the real architectural model; a lighting unit disposed inside the main body; a first display unit disposed on the first slope inclined plane and outputting a virtual architectural model and the real architectural model to be previously stored; and a second display unit disposed on the second slope inclined plane and outputting the virtual architectural model and the real architectural model.

Description

[0001] ARCHITECTURAL DESIGN VERIFICATION SYSTEM AND METHOD USING AUGMENTED REALITY [0002]

Architectural design verification system and method using augmented reality are provided.

Virtual reality (VR) technology is widely used in the field of architecture because it provides various visual information such as shape and internal information of a designed building.

Various types of immersive virtual reality environments are used in presentations of buildings using virtual reality technology. CAVE (human-scale) systems that implement a human-scale system through large- cave automated virtual environment, and a head-mounted display (HMD) system that implements a relatively small system.

However, in the case of using the virtual reality technology, the whole virtual world to be expressed must be generated through a computer, so that it is difficult to utilize the existing surrounding building model or the site model.

On the other hand, the augmented reality (AR) technology can realize a more realistic virtual space than the virtual reality technology by combining the real image and the virtual image to the user.

1 shows a kind of an augmented reality system.

1, an augmented reality system includes a head-attached (fixed) display including a retinal display and a head-mounted display, and a hand-held display Hand-held (including portable displays), and spatial (spatial), including spatial optical see-through displays.

Recently, a method of projecting a three-dimensional virtual object under construction planning on a building target site is used in the architectural design work and verification stage.

For example, MR ² (MR Square, A Mixed-Reality Meeting Room), a system that allows a large number of users wearing HMDs (Head Mounted Display) to view virtual objects in front of each other according to their viewpoints, A system proposed by Broll in 2004, ARTHUR (A Collaborative Augmented Environment for Architectural Design and Urban Planning) is used to track users' positions using HMDs and to provide appropriate AR images. However, these systems can be dangerous in that they require a heavy HMD on the human head when implemented as a video see-through display.

In addition, there is a Second Surface (Multi-user Spatial Collaboration System based on Augmented Reality) system that provides a work environment in which a plurality of virtual surfaces existing in a virtual space are shared using a mobile device , Design work and verification are possible only in the mobile device environment.

A problem to be solved by one embodiment of the present invention is to provide a system and a method capable of verifying a multi-dimensional architectural design by implementing an architectural design as an augmented reality through a transparent display.

Embodiments according to the present invention can be used to accomplish other tasks not specifically mentioned other than the above-described tasks.

According to an aspect of the present invention, there is provided a method of constructing a body including a main body including a first oblique plane and a second oblique plane, a marker and a real building model located inside the main body, A first display section for outputting a virtual building model and a real building model, which are located in a first oblique plane and are stored in advance, and a second display section for displaying a virtual building model, And a second display unit for outputting a virtual architecture model and a real architecture model.

Here, the marker recognition unit recognizes the marker and obtains the real coordinate system based on the image of the marker and the real building model, converts the virtual architectural model into the direction or position corresponding to the viewpoint of the user based on the real coordinate system, A viewpoint correction unit that outputs the viewpoint information through the second display unit, and an image removal unit that removes the image of the marker and the real building model of the first display unit or the second display unit.

Also, the virtual architectural model may be an architectural digital model created through a 3D modeling program, and the physical architectural model may include at least one of a planned site, a surrounding environment, or an adjacent building of the virtual architectural model.

Also, the first display unit or the second display unit may include a transparent display.

In addition, the first display unit or the second display unit outputs the virtual architectural model as colored, and outputs the real architectural model through the area excluding the virtual architectural model.

According to an embodiment of the present invention, there is provided an image processing method comprising: acquiring an image of a marker and a real building model through a first camera unit and outputting the image through a first display unit; Acquiring an image and outputting it through a second display unit; recognizing a marker and acquiring an actual coordinate system through a control unit; acquiring a virtual architectural model based on a physical coordinate system through a control unit in a position or direction Converting the virtual architectural model into a position or direction corresponding to the viewpoint of the second user based on the physical coordinate system and outputting the virtual architectural model through the second display unit through the control unit; Removing the image of the marker and the physical model of the first display unit, and removing the image of the marker of the second display unit The proposed architectural design verification method using augmented reality, comprising the step of removing the image of the real building model.

Herein, the virtual architectural model is an architectural digital model created through the 3D modeling program, and the physical architectural model may include at least one of the planned site, the surrounding environment, or the surrounding architecture of the virtual architectural model.

According to one embodiment of the present invention, it is possible to provide a plurality of users with an architectural design verification environment and improve collaboration efficiency. In addition, it simplifies the architectural design verification process and reduces the cost of verification of the architectural design.

1 shows a kind of an augmented reality system.
2 is an architecture design verification system using an augmented reality according to an embodiment of the present invention.
3 shows a main body and a display unit according to an embodiment of the present invention.
Figure 4 shows a transparent display in white and black according to one embodiment of the present invention.
5 shows a configuration of a control unit according to an embodiment of the present invention.
6 illustrates a viewpoint correction method according to one embodiment of the present invention.
FIG. 7 shows a viewpoint correction result according to one embodiment of the present invention.
Figure 8 shows image rejection according to one embodiment of the present invention.
Figure 9 shows before and after image removal according to one embodiment of the present invention.
FIG. 10 shows the rotation result of the marker of the augmented reality building with the viewpoint corrected according to one embodiment of the present invention.
11 is an actual implementation example of a building design verification system using an augmented reality according to an embodiment of the present invention.
12 is an augmented reality image output through a transparent display according to an embodiment of the present invention.
Figures 13-14 illustrate an extended architectural design verification system in accordance with one embodiment of the present invention.
15 is a method for verifying architectural design using an augmented reality according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG. The present invention may be embodied in many different forms and is not limited to the embodiments described herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and the same reference numerals are used for the same or similar components throughout the specification. In the case of publicly known technologies, a detailed description thereof will be omitted.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the term "part" in the description means a unit for processing at least one function or operation, which may be implemented by hardware, software, or a combination of hardware and software.

2 is an architecture design verification system using an augmented reality according to an embodiment of the present invention.

2, the architectural design verification system using the augmented reality includes a body 10, a marker and a real building model 20, camera units 31 and 32, an illumination unit 40, display units 51 and 52, And a control unit 60, as shown in FIG.

The main body 10 includes a first oblique surface on which the first display portion 51 is located and a second oblique surface on which the second display portion 52 is located. For example, the main body 10 includes a trapezoidal shape.

The marker and the real building model 20 are located inside the main body 10. In this case, the marker is an image used to calculate the direction and position of the virtual building model, and the physical building model means a model model including at least one of the planning site, the surrounding environment, or the surrounding building of the virtual building model.

At this time, the real building model can be rotated. Therefore, the virtual building model can be viewed from various directions in the augmented reality image that combines the virtual building model with the real building model, so that the reality can be enhanced.

The virtual architectural model refers to architectural digital models created through 3D modeling programs (3DS Max, SketchUp, Rhino, BIM). For example, when a building information modeling (BIM) model is discussed only through a building design verification system according to an embodiment of the present invention, model information Can be used as a virtual architectural model.

Table 1 below shows augmented reality tools according to the file format of the BIM program.

BIM Authoring Tool File Format AR Tool
REVIT
IFC D4AR, 4DStudio DAE (Collada file format) Unity3D
(Convert to add-ons) FBX BuildAR
ARmedia Plugin ArchiCAD
IFC D4AR, 4Dstudio VRML ARToolkit

The camera units 31 and 32 include a first camera unit 31 and a second camera unit 32 located at both ends of the upper portion of the main body 10, respectively.

The camera units 31 and 32 output the images of the marker and the real building model 20 acquired through the first camera 31 through the first display unit 51 and acquire the images through the second camera unit 32 The image of the one marker and the real building model 20 is output through the second display portion 52. [

The illumination unit 40 is located on the top of the main body 10 and provides light inside the main body 10. For example, the illumination portion 40 may include a 50 cm by 4 cm size, 18 W 500 K white, and 2100 lumens of LEDs (light emitting diodes).

The display units 51 and 52 include a first display unit 51 and a second display unit 52. The display units 51 and 52 include an image obtained through the camera units 31 and 32 or an augmented reality image .

For example, the first user performs design verification of the virtual architectural model based on the augmented reality image output through the first display unit 51, and the second user performs design verification of the augmented reality model output through the second display unit 52. [ The design verification of the virtual architectural model can be performed based on the image. Thus, in the design verification operation of the virtual architectural model, the same virtual architectural model and the actual architectural model can be provided according to each viewpoint of the first user and the second user, thereby improving the collaboration efficiency.

3 shows a main body and a display unit according to an embodiment of the present invention.

The main body 10-1 of FIG. 3 includes a first display portion 53, a second display portion 54, a third display portion 54, and a second display portion 52. The first display portion 53, the second oblique surface, the third oblique surface, (Not shown in FIG. 3), and a fourth display (not shown in FIG. 3).

3, the first user performs design verification of the virtual architecture model based on the augmented reality image output through the first display unit 53, and the second user performs design verification of the augmented reality image output through the second display unit 54 The third user performs the design verification of the virtual architecture model based on the augmented reality image output through the third display unit and the fourth user performs the design verification of the virtual architecture model based on the real image, And the design verification of the virtual architecture model is performed based on the augmented reality image output through the virtual reality model. As a result, the first to fourth users can perform collaboration for design verification of the virtual architecture model.

The display portions 51 and 52 include a transparent display.

Transparent displays realize transparency display with a transmission tendency close to 100% when displaying white due to their mechanical characteristics, and realize opaque display when displaying black.

Figure 4 shows a transparent display in white and black according to one embodiment of the present invention.

Fig. 4 shows a case (A) in which white is displayed through a transparent display under the condition that the illumination and the marker are the same, and a case (B) in which black is displayed.

4 (A) is a white display through a transparent display, and it can be seen that a marker inside the main body is seen through as it is.

The image of FIG. 4 (B) shows a black color through the transparent display, and the image inside the main body is completely blocked.

Through the characteristics of the transparent display, the architectural design verification system according to one embodiment of the present invention is realized as an optical see-through display, the portion where the virtual architectural model is displayed is colored, The part where the real building model is displayed is expressed in white so that the inside of the main body can be seen through.

5 shows a configuration of a control unit according to an embodiment of the present invention.

The control unit 60 is located inside or outside the main body 10 and includes a marker recognizing unit 61, a view correcting unit 62 and an image removing unit 63.

The marker recognition unit 61 recognizes the marker from the image acquired through the camera units 31 and 32 and acquires the real coordinate system.

The viewpoint correction unit 62 converts the virtual architectural model into a direction or position corresponding to the viewpoint of the user based on the physical coordinate system, and outputs the virtual architectural model through the display units 51 and 52. [

6 illustrates a viewpoint correction method according to one embodiment of the present invention.

Referring to FIG. 6, the virtual architectural model is created after changing the positions of the camera units 31 and 32 to the actual user's observation point positions based on the physical coordinate system acquired through the marker recognition unit 61. Specifically, you can use gluLookAt in ARToolKit to rotate the user's gaze up or down, or to move it forward or backward.

As a result, the user can confirm the augmented reality image in which the real world (real building model) and the virtual world (virtual building model) coincide with each other at his own viewpoint.

FIG. 7 shows a viewpoint correction result according to one embodiment of the present invention.

7 shows an image (A) of a transparent display and an image (B) of a transparent display after correcting the viewpoint of the user based on a real coordinate system acquired through a marker. At this time, both the image (A) and the image (B) are in a state in which the image obtained through the camera units 31 and 32 is removed, and the details of the image removal will be described with reference to FIG.

FIG. 7A shows an image obtained by directly outputting a virtual architectural model based on an image acquired through a camera, and a virtual architectural model and a marker are separated from each other.

7B is an image output after adjusting the position and direction corresponding to the viewpoint of the user before outputting the virtual architectural model, and it can be seen that the virtual architectural model and the marker coincide with each other.

Returning to the description of FIG. 5, the image removing unit 63 removes the image obtained through the camera units 31 and 32 from the image output through the display units 51 and 52.

Figure 8 shows image rejection according to one embodiment of the present invention.

8A is an image in which the image obtained through the camera units 31 and 32 is not removed, and FIG. 8C is an image obtained by removing the image acquired through the camera units 31 and 32. FIG. (B) is an image showing that the marker is overlapped when the user's eyes are adjusted upward when the image obtained through the camera units 31 and 32 is not removed.

Figure 9 shows before and after image removal according to one embodiment of the present invention.

9A is an image in which the image acquired through the camera is not removed when outputting a virtual architectural model in which the position or direction is corrected to the user's viewpoint in the transparent display, .

FIG. 9A shows that it is difficult to realize an augmented reality by outputting a marker through an image acquired through a camera.

FIG. 9B shows that the image obtained through the camera is removed, and a white background image is outputted to the part where the image is removed, so that the remaining part except for the part where the virtual architectural model is outputted is displayed transparently.

FIG. 10 shows the rotation result of the marker of the augmented reality building with the viewpoint corrected according to one embodiment of the present invention.

10 (A), (B), (C), and (D) show that the virtual architectural model rotates clockwise by 90 degrees by the rotation of the marker.

11 is an actual implementation example of a building design verification system using an augmented reality according to an embodiment of the present invention.

11 (A) is a photograph taken from the front diagonal direction of the building design verification system, and FIG. 11 (B) is a photograph taken from the side.

12 is an augmented reality image output through a transparent display according to an embodiment of the present invention.

FIG. 12A shows that an image acquired through a camera overlaps with a virtual architectural model viewed through a transparent display, FIG. 12B shows a case where an image acquired through a camera is removed in FIG. 12A, The position and orientation of the virtual architectural model are adjusted.

Fig. 12C shows that the virtual architectural model is rotated 90 DEG counterclockwise in Fig. 12B, and Fig. 12D shows that the virtual architectural model is rotated 90 DEG counterclockwise in Fig.

Figures 13-14 illustrate an extended architectural design verification system in accordance with one embodiment of the present invention.

13 is an ARToolKit-based extended architectural design verification system that provides augmented reality to two or more users through a plurality of computers and cameras. At this time, each display can be synchronized via a marker in an independent form.

FIG. 14 is an extended architecture design verification system based on ARToolKit, which provides augmented reality to a large number of users by recognizing a virtual world through one computer and a camera and generating a virtual image corresponding to various points of view.

15 is a method for verifying architectural design using an augmented reality according to an embodiment of the present invention.

First, an image of a marker and a real building model is acquired through the first camera unit 31 and the second camera unit 32, and the respective images are output through the first display unit 51 and the second display unit 52 (S10).

Thereafter, the marker is recognized in the image of step S10 and an actual coordinate system is obtained (S20).

After that, the position or direction of the virtual architectural model is converted by referring to the physical coordinate system of step S20, and then outputted through the first display unit 51 and the second display unit 52 (S30).

Thereafter, the image of step S10 is removed and the virtual building model of the main body 10 and the virtual architectural model of step S30 are output as the augmented reality image through the first display unit 51 and the second display unit 52 (S40) .

According to one embodiment of the present invention, the main body of FIG. 2 and the main body of FIG. 3 are disclosed. However, the present invention is not limited thereto and may be embodied as a body including a first oblique face, a second oblique face, Can provide the augmented reality image corresponding to each time point. Also, by implementing a main body including at least five oblique faces where the display unit is located, an augmented reality image can be provided to five or more users. In addition, a body including a curved display can be implemented to provide augmented reality images corresponding to each viewpoint to a plurality of users.

According to one embodiment of the present invention, when a viewpoint and a location of a user are changed using a viewpoint or location tracking technology, the location and direction of a virtual architectural model are changed in real time to provide an augmented reality image corresponding to a user's viewpoint .

According to one embodiment of the present invention, augmented reality is implemented using a real building model and a virtual building model, and utilized in the verification and design of a building design, thereby simplifying the verification process of the building design and reducing the verification cost.

According to one embodiment of the present invention, a plurality of users can directly select desired information at the viewpoint of the user by utilizing transparent display, and perform architectural design verification, thereby improving collaboration efficiency.

According to one embodiment of the present invention, since the display on which the augmented reality is implemented is not mounted on the user's body, the user's body and eyes can be freely used and the visual burden on the eye can be reduced.

According to one embodiment of the present invention, it is possible to evaluate only the own design of the building, or evaluate the design of the building in consideration of the relationship between the planned site of the building and the surrounding buildings.

According to one embodiment of the present invention, since it is implemented as an optical see-through display, unlike a video see-through display, Through computer and camera, multiple users can simultaneously perform architectural design and verification.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, Of the right.

10: Body 20: Marker and physical building model
31, 32: a camera section 40: a lighting section
51, 52: Display section 60:
61: marker recognition unit 62:
63: Image removal

Claims

A body including a first oblique plane and a second oblique plane,
A marker and a real building model located inside the main body,
At least one camera unit located inside the main body and acquiring an image of the marker and the real building model,
An illumination unit positioned in the main body,
A first display unit located on the first oblique surface and outputting a virtual architectural model previously stored and the physical architectural model;
A second display part located on the second oblique surface and outputting the virtual architectural model and the physical architectural model,
Architectural Design Verification System using Augmented Reality.

The method of claim 1,
A marker recognition unit for recognizing the marker based on the image of the marker and the real building model and acquiring a real coordinate system,
A viewpoint corrector for converting the virtual architectural model into a direction or position corresponding to a viewpoint of the user based on the physical coordinate system and outputting the virtual architectural model through the first display unit or the second display unit;
An image removal unit for removing the image of the marker and the real building model of the first display unit or the second display unit,
And a controller for controlling the building design verification system using the augmented reality.

3. The method according to claim 1 or 2,
The virtual architectural model is an architectural digital model generated through a 3D modeling program, and the physical architectural model is a model model including at least one of a planned site, a surrounding environment, Design verification system.

3. The method according to claim 1 or 2,
Wherein the first display unit or the second display unit includes a transparent display.

5. The method of claim 4,
Wherein the first display unit or the second display unit outputs the virtual architectural model as colored and outputs the physical architectural model through an area excluding the virtual architectural model.

Acquiring an image of a marker and a real building model through a first camera unit and outputting the image through a first display unit,
Acquiring an image of the marker and the real building model through the second camera unit and outputting the image through the second display unit,
Recognizing the marker through a control unit and obtaining an actual coordinate system,
Converting the virtual architectural model into a position or direction corresponding to the viewpoint of the first user based on the physical coordinate system through the control unit and outputting the virtual architectural model through the first display unit;
Converting the virtual architectural model into a position or direction corresponding to a viewpoint of a second user based on the physical coordinate system through the control unit and outputting the virtual architectural model through the second display unit;
Removing the image of the marker and the real building model of the first display unit through the control unit, and
Removing the image of the marker and the real building model of the second display unit through the control unit
Architectural Design Verification Method Using Augmented Reality.

The method of claim 6,
The virtual architectural model is an architectural digital model generated through a 3D modeling program. The physical architectural model is a model model including at least one of a planned land, a surrounding environment, Design verification method.

The method of claim 6,
Wherein the first display unit or the second display unit includes a transparent display.

9. The method of claim 8,
Wherein the first display unit or the second display unit outputs the virtual architectural model as colored and outputs the physical architectural model through a region excluding the virtual architectural model.