TWI680670B - Method and system for augmented reality comparison with real objects - Google Patents

Method and system for augmented reality comparison with real objects Download PDF

Info

Publication number
TWI680670B
TWI680670B TW107139217A TW107139217A TWI680670B TW I680670 B TWI680670 B TW I680670B TW 107139217 A TW107139217 A TW 107139217A TW 107139217 A TW107139217 A TW 107139217A TW I680670 B TWI680670 B TW I680670B
Authority
TW
Taiwan
Prior art keywords
virtual
dimensional
image
dimensional model
reference point
Prior art date
Application number
TW107139217A
Other languages
Chinese (zh)
Other versions
TW202019169A (en
Inventor
李易叡
Original Assignee
國立臺北科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立臺北科技大學 filed Critical 國立臺北科技大學
Priority to TW107139217A priority Critical patent/TWI680670B/en
Application granted granted Critical
Publication of TWI680670B publication Critical patent/TWI680670B/en
Publication of TW202019169A publication Critical patent/TW202019169A/en

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

本發明係一種擴增實境比對現實物體之方法及系統,其係將由一影像擷取裝置拍攝一現實物件,再將拍攝該現實物件之一影像傳送至一分析模組內與一虛擬三維模型進行疊合,其中該影像上設置一第一虛擬座標點,該虛擬三維模型上設置一第二虛擬座標點,該分析模組內之該影像與該虛擬三維模型疊合時,係將該第一虛擬座標點疊合於該第二虛擬座標點,接著再將疊合影像傳送至一顯示裝置上顯示,使用者就可依照該顯示裝置上之疊合影像判斷該影像與該虛擬三維模型之外觀與尺寸差異。The invention relates to a method and system for augmenting reality to compare real objects, which is to shoot a real object by an image capturing device, and then transmit an image of the real object to an analysis module and a virtual three-dimensional The model is superimposed, wherein a first virtual coordinate point is set on the image, and a second virtual coordinate point is set on the virtual three-dimensional model. When the image in the analysis module is overlapped with the virtual three-dimensional model, the The first virtual coordinate point is superimposed on the second virtual coordinate point, and then the superimposed image is transmitted to a display device for display. The user can judge the image and the virtual three-dimensional model according to the superimposed image on the display device. The difference in appearance and size.

Description

擴增實境比對現實物體之方法及系統Method and system for augmented reality comparison with real objects

本發明係關於一種擴增實境比對現實物體之方法及系統,其係用來比對。The present invention relates to a method and system for comparing real objects with augmented reality, which is used for comparison.

擴增實境(Augmented Reality,簡稱 AR),其指透過攝影機影像的位置及角度精算並加上圖像分析技術,讓螢幕上的虛擬世界能夠與現實世界場景或物體進行結合與互動的技術,其可用於生醫、化學以及室內設計等領域。 Augmented Reality ( AR ) refers to the technology that allows the virtual world on the screen to combine and interact with real-world scenes or objects through actuarial calculation of the position and angle of the camera image, plus image analysis technology. It can be used in the fields of biomedicine, chemistry and interior design.

一般傢俱從設計到生產製造,其中產品打樣係不可或缺的環節,當設計師繪製完產品設計圖交給打樣師進行產品打樣之過程中,設計師需要反覆的與打樣師進行溝通與討論,設計師需要將傢俱的設計圖或構想圖提供給打樣師來進行外觀打樣試做,之後與設計師確認其打樣之樣品均符合設計師要求後,就會將打樣之樣品送至傢具製造廠進行大量生產,其中,打樣師於打樣過程中,由於設計師與打樣師在三維空間視覺概念與二維圖面上的認知有落差,導致打樣的結果往往與設計師的構想有極大的差異,因此打樣師需要經過反覆的修正與調整該打樣品,才能夠貼近設計師所希望設計的形體外觀,但打樣出來的樣品大多只是貼近設計師所希望設計的形體外觀,而非與原先設計師所想的一致,於此,使用此方式進行打樣,不論對設計師或打樣師而言,都需要耗費大量的時間及金錢,其原因最主要在於二維(2D)圖面難以呈現出三維(3D)圖面的空間尺寸概念,打樣師雖然可以透過各側視角之二維圖面去進行比對,但二維圖片仍然會產生許多在三維外觀上的模糊空間與視覺落差,且現階段的打樣作業上,仍然無法有效地解決這個問題。From design to production of general furniture, product proofing is an indispensable link. When the designer completes the product design drawing and submits it to the proofer for product proofing, the designer needs to communicate and discuss with the proofer repeatedly. The designer needs to provide the design drawing or concept drawing of the furniture to the proofer to try out the appearance proofing. After confirming with the designer that the proofing samples meet the designer's requirements, the proofing samples will be sent to the furniture manufacturing factory. Mass production. Among them, during the proofing process, due to the gap between the designer and the proofer in the three-dimensional visual concept and the two-dimensional drawing, the proofing result is often greatly different from the designer's idea. The proofer needs to repeatedly modify and adjust the proofing sample to be able to get close to the appearance of the shape that the designer wants to design, but most of the proofed samples are only close to the shape of the shape that the designer wants to design, not the original designer It ’s the same. Here, using this method for proofing, no matter for the designer or the proofer, It takes a lot of time and money. The main reason is that the two-dimensional (2D) drawing is difficult to present the spatial dimension concept of the three-dimensional (3D) drawing. Although the proofer can compare the two-dimensional drawing from each side perspective However, two-dimensional pictures will still produce many blurred spaces and visual gaps in the three-dimensional appearance, and the current proofing operation still cannot effectively solve this problem.

在過去設計師與打樣師會透過二維圖面來進行家具討論與打樣的試做,其係設計師與打樣師之間溝通的方式,隨著繪圖軟體的成熟,現今設計師也透過3D繪圖軟體繪製3D立體圖面來與打樣師進行溝通,使打樣師能夠了解設計師所希望製作的家具外型與樣式,但這些3D圖面都僅能透過2D紙張輸出列印來呈現,且2D圖面往往欠缺實際空間參考尺寸與真實形體外觀,特別是於打樣傢俱時,傢俱於三維空間中彎曲的線條與造型,都難以在2D圖面中呈現,當打樣師於產品打樣時,一切僅能透過視覺上的反覆揣摩與打樣修正來完成設計圖上的產品,但其初步打樣出來的傢俱往往與設計師心目中的狀態有很大的落差,之後又得不斷地與設計師溝通來達成打樣的家具產品,其會耗費大量的時間以及金錢。In the past, designers and proofers would use two-dimensional drawings to conduct furniture discussions and proofing. This is the way of communication between designers and proofers. With the maturity of drawing software, today designers also use 3D drawing The software draws 3D three-dimensional graphics to communicate with the proofer, so that the proofer can understand the appearance and style of the furniture that the designer wants to make, but these 3D graphics can only be presented through 2D paper output printing, and the 2D graphics Often there is a lack of actual spatial reference dimensions and real physical appearance, especially when proofing furniture, the curved lines and shapes of furniture in three-dimensional space are difficult to present in the 2D graphics. When the proofer is proofing the product, everything can only pass through Visual repeated iterations and proofing corrections to complete the product on the design drawing, but the initial proofing of the furniture often has a big gap with the state of the designer's mind, and then continue to communicate with the designer to achieve the proofing Furniture products, which consume a lot of time and money.

綜上所述之習知傢俱打樣時有許多之處,因此本發明人經過長期的研究及發展,發明出一種擴增實境虛實比對現實物體之方法及系統,其係將擴增實境技術應用於傢俱打樣,利用擴增實境在空間視覺中在於虛實體感中的量體差異感受與虛實形體比對上具有明顯優勢,並透過擴增實境的方式,讓打樣師能夠於打樣傢俱時,同時透過虛擬傢俱形體的比對,拉近打樣模型與最終傢俱樣品間的落差,且現今擴增實境可真實呈現傢俱的空間形狀與彎曲形體的三維資訊以及材質表現,且擴增實境更能夠快速的呈現三維視覺畫面,提供設計師與打樣師更多元的討論空間,例如設計師能夠快速的更換家具組件(椅腳、椅背或是扶手等組件),這些零組件都能經由擴增實境的方式快速切換,減少設計師與打樣師在產品打樣過程的溝通時間,此外擴增實境還能夠快速的將三維的虛擬模型轉換成二維的虛擬圖面,幫助打樣師了解各側視圖中的型態樣貌,並且能夠將打樣中的半成品準確的與三維虛擬模型比對,判斷傢俱的打樣狀態,減少傢俱打樣時對於設計圖的誤判。In summary, the conventional furniture has many aspects when proofing. Therefore, the inventor has invented a method and system for augmenting reality to compare reality with actual objects through long-term research and development. The technology is applied to the proofing of furniture, and the use of augmented reality in spatial vision lies in the difference between the volume and volume of virtual reality and the comparison between virtual and real shapes. It also allows the proofing division to proof in the way of augmented reality. During the furniture, through the comparison of the virtual furniture shape at the same time, the gap between the proofing model and the final furniture sample is narrowed, and today's augmented reality can realistically present the three-dimensional information and material performance of the furniture's spatial shape and curved shape, and expand Reality can more quickly display three-dimensional visual pictures, providing designers and proofers with more discussion space. For example, designers can quickly replace furniture components (such as chair legs, chair backs, or armrests). These components are all It can quickly switch through augmented reality to reduce the communication time between designers and proofers in the product proofing process.In addition, augmented reality can also quickly The two-dimensional virtual model is converted into a two-dimensional virtual surface, which helps the proofer understand the shape and appearance in each side view, and can accurately compare the semi-finished product in the proof with the three-dimensional virtual model, judge the proofing state of the furniture, reduce Misjudgment of design drawings when proofing furniture.

本發明之主要目的,係提供一種擴增實境虛實比對現實物體之方法與系統,其係對一現實物件進行拍攝,並藉由拍攝到之一影像與一虛擬三維模型進行比對,其中該虛擬三維模型係為該現實物件的設計圖,接著將該影像疊合至該三維模型進行比對其相異處之外觀。The main object of the present invention is to provide a method and system for comparing real objects with augmented reality, which takes a real object and compares a captured image with a virtual three-dimensional model. The virtual three-dimensional model is a design drawing of the real object, and then the image is superimposed on the three-dimensional model to compare the appearance of its differences.

本發明之另一目的,係提供擴增實境虛實比對現實物體之方法與系統,其係由一資料庫內擷取至少一虛擬三維元件疊加於該虛擬三維模型上,並藉由疊加之該至少一虛擬三維元件來判斷該影像與該至少一虛擬三維元件之差異。Another object of the present invention is to provide a method and system for augmenting the real-world virtual-real comparison of real objects, which are obtained by superimposing at least one virtual three-dimensional element on a virtual three-dimensional model from a database, and by superimposing the The at least one virtual three-dimensional element is used to determine a difference between the image and the at least one virtual three-dimensional element.

為了達到上述之目的,本發明揭示了一種擴增實境虛實比對現實物體之方法,其步驟包含拍攝一現實物件,得到一影像,傳送該影像至一分析模組,並於該影像上設置一第一座標點以及於一虛擬三維模型上設置一第一虛擬座標點,再將該第一座標點疊合於該第一虛擬座標點,以及疊合該影像至該虛擬三維模型上後傳送並顯示於一顯示裝置上,其中該分析模組係先判斷該影像上之一第一邊長相對於該虛擬三維模型上之一第一虛擬邊長之一長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同。In order to achieve the above-mentioned object, the present invention discloses a method for augmenting reality to compare reality with real objects. The steps include shooting a real object, obtaining an image, transmitting the image to an analysis module, and setting the image on the image. A first coordinate point and setting a first virtual coordinate point on a virtual three-dimensional model, superimposing the first coordinate point on the first virtual coordinate point, and superimposing the image on the virtual three-dimensional model and transmitting And displayed on a display device, wherein the analysis module first determines a length ratio of a first side length on the image to a first virtual side length on the virtual three-dimensional model, and the virtual three-dimensional model is based on the length Scale up or down so that the ratio of the sides of the virtual 3D model is the same as the ratio of the sides of the image.

本發明之一實施例中,其亦揭露該分析模組於該影像之輪廓上分別設置一第一參考點及一第二參考點,且該第一參考點係相對於該第二參考點,以及於該虛擬三維模型上分別設置一第一虛擬參考點及一第二虛擬參考點,該第一虛擬參考點係依照該第一參考點設置於該影像之輪廓上對照設置於該虛擬三維模型之輪廓上,該第二虛擬參考點係依照該第二參考點設置於該影像之輪廓上對照設置於該虛擬三維模型之輪廓上,當該第一座標點疊合於該第一虛擬座標點,則該第一虛擬參考點以及該第二虛擬參考點則依照該第一參考點以及該第二參考點之相對位置疊合於該第一參考點以該第二參考點。In an embodiment of the present invention, it is also disclosed that the analysis module sets a first reference point and a second reference point on the contour of the image, respectively, and the first reference point is relative to the second reference point, And a first virtual reference point and a second virtual reference point are respectively set on the virtual three-dimensional model, and the first virtual reference point is set on the contour of the image according to the first reference point and is set on the virtual three-dimensional model. On the contour, the second virtual reference point is set on the contour of the image according to the second reference point and on the contour of the virtual three-dimensional model. When the first coordinate point is superimposed on the first virtual coordinate point , The first virtual reference point and the second virtual reference point are superimposed on the first reference point and the second reference point according to the relative positions of the first reference point and the second reference point.

本發明之一實施例中,其亦揭露該分析模組量測該影像之至少二邊長相交於一水平線之至少二夾角角度,該虛擬三維模型之至少二虛擬邊長與該水平線之至少二虛擬夾角角度與該至少二夾角角度相同。In one embodiment of the present invention, it is also disclosed that the analysis module measures at least two sides of the image intersecting at least two angles of a horizontal line, at least two virtual sides of the virtual three-dimensional model and at least two of the horizontal line. The virtual included angle is the same as the at least two included angles.

本發明之一實施例中,其亦揭露該虛擬三維模形與至少一虛擬三維元件進行疊加,並疊合於該影像。In one embodiment of the present invention, it is also disclosed that the virtual three-dimensional model is superimposed on at least one virtual three-dimensional element and is superimposed on the image.

為了達到上述之目的,本發明另外揭示了一種擴增實境比對現實物體之系統,其包含一影像擷取裝置,其對一現實物件進行拍攝,並得到一影像,一分析模組,其係連接該影像擷取裝置,該影像擷取裝置將該影像傳送至該分析模組並與一虛擬三維模形進行疊合,其中該影像上設置一第一座標點,且相對於該影像之該第一座標點之該虛擬三維模型上設置一第一虛擬座標點,該第一座標點係疊合於該第一虛擬座標點,以及一顯示裝置,其係連接該分析模組,並將該分析模組內之該虛擬三維模型與該影像顯示於該顯示裝置上。In order to achieve the above-mentioned object, the present invention further discloses a system for augmented reality comparison with a real object, which includes an image capturing device that shoots a real object and obtains an image, an analysis module, and Is connected to the image capture device, the image capture device transmits the image to the analysis module and overlaps with a virtual three-dimensional model, wherein a first coordinate point is set on the image, and relative to the image A first virtual coordinate point is set on the virtual three-dimensional model of the first coordinate point, the first coordinate point is superimposed on the first virtual coordinate point, and a display device is connected to the analysis module, and The virtual three-dimensional model and the image in the analysis module are displayed on the display device.

本發明之一實施例中,其亦揭露該擴增實境比對現實物體之系統,更進一步包含一比對模組,其係設置於該分析模組內,當該影像疊合於該虛擬三維模型後,該比對模組對該影像與該虛擬三維模型進行模型比對。In one embodiment of the present invention, it is also disclosed that the augmented reality comparison system with a real object further includes a comparison module, which is set in the analysis module, and when the image is superimposed on the virtual After the three-dimensional model, the comparison module performs a model comparison between the image and the virtual three-dimensional model.

本發明之一實施例中,其亦揭露該擴增實境比對現實物體之系統,更進一步包含一建模資料庫,該建模資料庫內包含至少一虛擬三維元件以及該虛擬三維模型,該建模資料庫係設置於該分析模組內,且該至少一虛擬三維元件疊加於該虛擬三維模型。In an embodiment of the present invention, it is also disclosed that the augmented reality comparison system with a real object further includes a modeling database, and the modeling database includes at least one virtual three-dimensional element and the virtual three-dimensional model. The modeling database is set in the analysis module, and the at least one virtual three-dimensional element is superimposed on the virtual three-dimensional model.

為使 貴審查委員對本發明之特徵及所達成之功效有更進一步之瞭解與認識,謹佐以較佳之實施例及配合詳細之說明,說明如後:In order to make the reviewing committee members have a better understanding and understanding of the features of the present invention and the effects achieved, we would like to provide a better embodiment and a detailed description with the following description:

本發明係針對習知技術之傢俱打樣的過程中,設計師與打樣師會透過二維圖面來進行家具討論與打樣的試做,但打樣傢俱時,傢俱於三維空間中彎曲的線條與造型,都難以在2D圖面中呈現,當打樣師於產品打樣時,一切僅能透過視覺上得揣摩與反覆打樣修正來完成設計圖上的產品,但其初步打樣出來的傢俱往往與設計師心目中的狀態有很大的落差,之後又得不斷地與設計師溝通來達成打樣的傢俱產品,其會耗費大量的時間以及金錢,故,本發明係為了能夠縮短傢俱打樣時所耗費的時間以及金錢,增加打樣師根據設計師提供之設計圖打樣時,其能夠快速的將打樣之半成品與設計師提供之一虛擬三維模型進行外觀之比對,進而判斷打樣之半成品與該虛擬三維模形之外觀之相異處,以及藉由擴增實境的技術快速的將三維的虛擬模型轉換成二維的虛擬圖面,幫助打樣師了解各側視圖中的型態樣貌,並且能夠將打樣中的半成品準確的與三維虛擬模型比對,判斷傢俱的打樣狀態,減少傢俱打樣時對於設計圖的誤判。The invention is directed at the process of proofing furniture based on the conventional technology. Designers and proofers use two-dimensional drawings to carry out discussions and proofing of furniture. However, when proofing furniture, the curved lines and shapes of the furniture in three-dimensional space , It is difficult to present in the 2D drawing. When the proofing division is proofing the product, everything can only be completed through visual guessing and repeated proofing corrections to complete the product on the design drawing, but the furniture that is initially proofed is often in the mind of the designer. There is a large gap in the state of the state, and then it is necessary to continuously communicate with the designer to achieve proofing furniture products, which will consume a lot of time and money. Therefore, the present invention is to reduce the time and cost of furniture proofing. Money, increase the proofing division When proofing according to the design drawings provided by the designer, it can quickly compare the appearance of the proofing semi-finished product with a virtual 3D model provided by the designer, and then judge the proofing semi-finished product and the virtual 3D model. Differences in appearance, and rapid transformation of 3D virtual models into 2D virtual drawings by augmented reality technology Proofing division to help each side understand the patterns of appearance, and can be in the semi-accurate proofing with a three-dimensional virtual model alignment, the state judge proofing furniture, reduce false positives for the design of furniture when proofing.

首先,請參閱第一圖,其係為本發明之一較佳實施例之步驟流程圖,如圖所示,其步驟包含: 步驟S10: 拍攝一現實物件; 其係使用一影像擷取裝置對一現實物件進行拍攝或影像影像的追蹤,且該影響擷取裝置拍攝該現實物件係能夠以不同角度進行拍攝。 步驟S12: 得到一影像; 當該影像擷取裝置拍攝或追蹤該現實物件後,該影像擷取裝置產生該影像,該影像係為數位影像,其檔案格式係為BMP、GIF、JPEG、PCX、TIFF、TGA、EXIF、FPX、OBJ、SVG、PSD、CDR、PCD、DXF、UFO、EPS或PNG等格式。 步驟S14: 傳送該影像至一分析模組,並於該影像上設置 一第一座標點以及於一虛擬三維模型上設置一第一虛擬座標點,再將該第一座標點疊合於該第一虛擬座標點; 該分析模組係連接該影像擷取裝置,其連接方式可為電信連接、網路連接或是藍芽連接等方式,該分析模組於該影像上標記/設置該第一座標點,且該分析模組內更包含一虛擬三維模型,該虛擬三維模型係事先用電腦繪圖軟體繪製完成,再將該虛擬三維模型上之一點定義為一第一虛擬座標點,且該分析模組係依照對該影像進行分析,判斷該影像係為該虛擬三維模型之視角角度後,將該虛擬三維模型調整成與該影像之同一視角,接著以該虛擬三維模型的該第一虛擬座標點為基準疊合於該影像之該第一座標點。 步驟S16: 疊合該影像至該虛擬三維模型上後傳送並顯示於至顯示裝置上,其中該分析模組係先判斷該影像上之一第一邊長相對於該虛擬三維模型上之一第一虛擬邊長之一長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同。 當該第一座標點疊合於該第一虛擬座標點後,其形成一疊合模型,並將該疊合模型傳送至該顯示裝置上,其中該分析模組接收到該影像後,會先判別該影像是否與該虛擬三維模形相似,如果相似再判斷該影像上之該第一邊長相對於該虛擬三維模型上之該第一虛擬邊長之該長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同,此外,該分析模組其係包含三維影像辨識演算法,其能夠針對該虛擬三維模型進行各角度之三維圖面進行演算,當該影像傳送至該分析模組後,該分析模組能夠即時將該虛擬三維模型進行分析,以取得與相對於該影像視角之該虛擬三維模型之三維圖面。First, please refer to the first figure, which is a flowchart of the steps of a preferred embodiment of the present invention. As shown in the figure, the steps include: Step S10: shooting a real object; it uses an image capture device to A real object is used for shooting or tracking of the image, and the influence capturing device can shoot the real object at different angles. Step S12: Obtain an image; after the image capturing device captures or tracks the real object, the image capturing device generates the image, the image is a digital image, and the file format is BMP, GIF, JPEG, PCX, TIFF, TGA, EXIF, FPX, OBJ, SVG, PSD, CDR, PCD, DXF, UFO, EPS or PNG. Step S14: transmitting the image to an analysis module, setting a first coordinate point on the image and setting a first virtual coordinate point on a virtual three-dimensional model, and superimposing the first coordinate point on the first A virtual coordinate point; the analysis module is connected to the image capture device, and the connection method can be a telecommunication connection, a network connection or a Bluetooth connection, etc., the analysis module marks / sets the first on the image Coordinate point, and the analysis module further includes a virtual three-dimensional model. The virtual three-dimensional model is drawn with a computer drawing software in advance, and then a point on the virtual three-dimensional model is defined as a first virtual coordinate point, and the analysis The module analyzes the image and determines that the image is the viewing angle of the virtual three-dimensional model, adjusts the virtual three-dimensional model to the same viewing angle as the image, and then uses the first virtual coordinate of the virtual three-dimensional model. The point is the first coordinate point superimposed on the image. Step S16: The image is superimposed on the virtual three-dimensional model and then transmitted and displayed on the display device, wherein the analysis module first judges that a first side length on the image is relative to a first on the virtual three-dimensional model. A length ratio of a virtual side length. The virtual three-dimensional model is enlarged or reduced according to the length ratio, so that the ratio of each side length of the virtual three-dimensional model is the same as the ratio of each side length of the image. When the first coordinate point is superimposed on the first virtual coordinate point, it forms a superimposed model, and transmits the superimposed model to the display device. After the analysis module receives the image, it will first Determine whether the image is similar to the virtual three-dimensional model, and if it is similar, then determine the ratio of the length of the first side length on the image to the first virtual side length on the virtual three-dimensional model, and the virtual three-dimensional model is based on the length Scale up or down so that the ratio of the sides of the virtual 3D model is the same as the ratio of the sides of the image. In addition, the analysis module includes a 3D image recognition algorithm that can perform various angles on the virtual 3D model. The three-dimensional map is calculated. After the image is transmitted to the analysis module, the analysis module can analyze the virtual three-dimensional model in real time to obtain a three-dimensional map of the virtual three-dimensional model relative to the perspective of the image.

接著,該分析模組為了更精確地分析該影像疊合於該虛擬三維模型上之位置,該分析模組係於該影像之輪廓上分別設置一第一參考點及一第二參考點,該第一參考點係相對於該第二參考點,其中該第一參考點與該第二參考點之選擇係選自該影像之至少二線段之焦點,接著該虛擬三維模型上分別設置一第一虛擬參考點以及一第二虛擬參考點,該第一虛擬參考點係依照該第一參考點設置於該影像之輪廓上之位置,而將該第一虛擬參考點設置於該虛擬三維模型之輪廓上之相對位置,該第二虛擬參考點係依照該第二參考點設置於該影像之輪廓上之位置,而將該第二虛擬參考點設置於該虛擬三維模型之輪廓上之相對位置,也就是說,當該分析模組判斷該影像為該虛擬三維模型之三維圖面後,即可將該第一虛擬參考點以及該第二虛擬參考點設置相對於該影像之該虛擬三維模型上,接著將該第一虛擬座標點疊合於該第一座標點後,則該第一虛擬參考點以及該第二虛擬參考點分別疊合於該第一參考點以及該第二參考點,且該第一虛擬參考點與該第二虛擬參考點疊合於該一參考點以及該第二參考點時,該虛擬三維模型之體積以及面積會隨該第一虛擬參考點以及該第二虛擬參考點疊合於該第一參考點以及該第二參考點變大或變小。Then, in order to more accurately analyze the position of the image superimposed on the virtual three-dimensional model, the analysis module sets a first reference point and a second reference point on the contour of the image, respectively. The first reference point is relative to the second reference point, wherein the selection of the first reference point and the second reference point is selected from the focus of at least two line segments of the image, and then a first A virtual reference point and a second virtual reference point, the first virtual reference point is set on the contour of the image according to the position of the first reference point, and the first virtual reference point is set on the contour of the virtual three-dimensional model Relative position, the second virtual reference point is a relative position set on the contour of the image according to the second reference point, and the second virtual reference point is set on the relative position of the contour of the virtual three-dimensional model, and That is, after the analysis module determines that the image is a three-dimensional surface of the virtual three-dimensional model, the first virtual reference point and the second virtual reference point can be set relative to the image. After superimposing the first virtual coordinate point on the virtual three-dimensional model, the first virtual reference point and the second virtual reference point are superimposed on the first reference point and the second The reference point, and when the first virtual reference point and the second virtual reference point are superimposed on the one reference point and the second reference point, the volume and area of the virtual three-dimensional model will vary with the first virtual reference point and the The second virtual reference point is superimposed on the first reference point and the second reference point becomes larger or smaller.

以及該分析模組分析量測該影像係為該虛擬三維模型之何種視角時,先將該第一座標點與該第一虛擬座標點疊合,接著量測該影像之至少二邊長相交於一水平線之至少二夾角角度,接著判斷該虛擬三維模型之至少二虛擬邊長係為該影像之該至少二邊長相交於該水平線上係為相同線段,則將該至少二虛擬邊長相對於該水平線之至少二虛擬夾角角度調整與該至少二夾角角度相同。And when the analysis module analyzes and measures the perspective of the virtual three-dimensional model, the first coordinate point is first overlapped with the first virtual coordinate point, and then at least two sides of the image are measured to intersect At least two included angles of a horizontal line, and then determine that at least two virtual side lengths of the virtual three-dimensional model are that the at least two side lengths of the image intersect on the horizontal line are the same line segment, then the at least two virtual side lengths are relative to The adjustment of at least two virtual included angles of the horizontal line is the same as the at least two included angles.

接著,該虛擬三維模型更能夠與至少一虛擬三維元件進行疊加,其係將該至少一虛擬三維元件設置於該虛擬三維模型上,例如,該虛擬三維模型係一把沒有椅背的椅子,該至少一虛擬三維元件則設置於該虛擬三維模型上,且該至少一虛擬三維元件能夠自由地設置於該虛擬三維模型上之任何地方,且該分析模組係依照該虛擬三維模型之視角將該至少一虛擬三維元件調整成與該虛擬三維模型相同之視角,該虛擬三維模型與該至少一虛擬三維元件進行疊加後,該虛擬三維模型之該第一虛擬座標點再疊合於該影像之該第一座標點,或者,該虛擬三維模型之該第一虛擬座標點先疊合於該影像之該第一座標點後,先判斷該虛擬三維模型與該影像之相異處,接著才將該至少一虛擬三維元件疊加於該虛擬三維模型上。Then, the virtual three-dimensional model can be superimposed with at least one virtual three-dimensional element, which is to set the at least one virtual three-dimensional element on the virtual three-dimensional model. For example, the virtual three-dimensional model is a chair without a chair back. At least one virtual three-dimensional element is disposed on the virtual three-dimensional model, and the at least one virtual three-dimensional element can be freely disposed anywhere on the virtual three-dimensional model, and the analysis module is configured to convert the virtual three-dimensional model according to the perspective of the virtual three-dimensional model. At least one virtual three-dimensional element is adjusted to the same perspective as the virtual three-dimensional model. After the virtual three-dimensional model is superimposed with the at least one virtual three-dimensional element, the first virtual coordinate point of the virtual three-dimensional model is superimposed on the image of the image. The first punctuation point, or the first virtual coordinate point of the virtual three-dimensional model is first superimposed on the first coordinate point of the image, then the difference between the virtual three-dimensional model and the image is judged first, and then the At least one virtual three-dimensional element is superimposed on the virtual three-dimensional model.

接著請繼續參閱第二圖,其係為本發明之一較佳實施例之步驟示意圖,第三圖,其係本發明之一較佳實施例之做動示意圖,第四圖,其係本發明之一較佳實施例之做動示意圖,其係為如圖所示,本發明係一種擴增實境虛實比對現實物體之系統1,其包含一影像擷取裝置2、一分析模組3以及一顯示裝置4。Then please continue to refer to the second diagram, which is a schematic diagram of the steps of a preferred embodiment of the present invention, the third diagram is a schematic diagram of the operation of a preferred embodiment of the present invention, and the fourth diagram is the present invention. A schematic diagram of the action of a preferred embodiment is shown in the figure. The present invention is a system 1 for augmenting the real-world virtual-real comparison of real objects, which includes an image capture device 2 and an analysis module 3 And a display device 4.

該影像擷取裝置2係連接該分析模組3,且該影像擷取裝置2係對該分析模組3電性連接、網路連接、或是藍芽連接等方式,該分析模組3內包含擴增實境技術之三維影像辨識演算法,其具有非常精確的空間座標運算能力以及圖像運算能力,能夠針對三維立體影像進行計算並進行渲染,透過擴增實境技術能夠用來輔助傢俱打樣,當該影像擷取裝置2對一現實物件22進行拍攝,該影像擷取裝置2會產生一影像24,接著該影像24會傳送至該分析模組3內,該分析模組3將對該影像24進行分析,接著再與一虛擬三維模型36進行疊合,其中該虛擬三維模型36係包含於該分析模組3內,該影像24上設置一第一座標點242,該第一座標點242定義於該影像24上可由該分析模組3進行定義或是由人工進行定義該第一座標點242於該影像24上之位置,接著相對於該影像24之該第一座標點24之該虛擬三維模型36上設置一第一虛擬座標點362,其中該分析模組3係先判斷該影像24是否為該虛擬三維模型36之該現實物件22之該影像24,如果該影像24係為該虛擬三維模型36,則將該第一座標點242疊合於該第一虛擬座標點362,以及該顯示裝置4係連接該分析模組3,且該顯示裝置4與該分析模組3之連接方式係為電性連接、網路連接或是藍芽連接等,當該虛擬三維模型36之該第一虛擬座標點362與該影像24之該第一座標點242疊合後,其會顯示於該顯示裝置4上,或是該分析模組3會與該顯示裝置4同步,當該分析模組分析完該影像24後則顯示於該顯示裝置4上,接著再將該虛擬三維模型36由該分析模組3內提取並顯示於該顯示裝置4上,接著該分析模組3再將該影像24與該虛擬三維模型36進行疊合,此外,該影像24與該虛擬三維模型36之疊合也可以由人工進行疊合,其中該虛擬三維模型36與該影像24之詳細之疊合方式係為上述之說明(本段落不再贅述)。The image capture device 2 is connected to the analysis module 3, and the image capture device 2 is connected to the analysis module 3 electrically, through a network connection, or via a Bluetooth connection. A 3D image recognition algorithm including augmented reality technology, which has very accurate spatial coordinate calculation capabilities and image calculation capabilities, can calculate and render 3D stereo images, and can be used to assist furniture through augmented reality technology Proofing, when the image capture device 2 shoots a real object 22, the image capture device 2 will generate an image 24, and then the image 24 will be transmitted to the analysis module 3, and the analysis module 3 will The image 24 is analyzed and then superimposed with a virtual three-dimensional model 36. The virtual three-dimensional model 36 is included in the analysis module 3. A first coordinate point 242 is set on the image 24. The definition of the punctuation point 242 on the image 24 can be defined by the analysis module 3 or manually to define the position of the first coordinate point 242 on the image 24, and then relative to the first coordinate point 24 of the image 24. The virtual A first virtual coordinate point 362 is set on the three-dimensional model 36. The analysis module 3 first determines whether the image 24 is the image 24 of the real object 22 of the virtual three-dimensional model 36. If the image 24 is the virtual For the three-dimensional model 36, the first coordinate point 242 is superimposed on the first virtual coordinate point 362, and the display device 4 is connected to the analysis module 3, and the display device 4 is connected to the analysis module 3. It is an electrical connection, a network connection, or a Bluetooth connection. When the first virtual coordinate point 362 of the virtual three-dimensional model 36 overlaps with the first coordinate point 242 of the image 24, it will be displayed in the On the display device 4, or the analysis module 3 will be synchronized with the display device 4, after the analysis module analyzes the image 24, it will be displayed on the display device 4, and then the virtual three-dimensional model 36 will be changed by the The analysis module 3 is extracted and displayed on the display device 4, and then the analysis module 3 overlaps the image 24 with the virtual three-dimensional model 36. In addition, the image 24 overlaps with the virtual three-dimensional model 36. Superposition can also be performed manually, where the virtual three Details of the model 36 the image 24 of the congruence system of above described (omitted in this paragraph).

接著,請繼續參閱第二圖至第四圖,如圖所示,該擴增實境比對現實物體之系統1更進一步包含一比對模組32,其係設置於該分析模組3內,並與該分析模組3連接,當該分析模組3將該影像24疊合於該虛擬三維模型36後,該比對模組32能夠比對該影像24與該虛擬三維模型36之外觀上差異,如第四圖所示,當該影像24與該虛擬三維模型36疊合後,該虛擬三維模型36之椅腳的外觀弧線較大,該影像24之椅腳的弧線較小,使得該影像24與該虛擬三維模型36在外觀上產生差異,接著請繼續參閱第四A圖,其係為本發明之一較佳實施例之做動示意圖,當該比對模組32比對該影像24與該虛擬三維模型36在外觀上產生差異時,該比對模組32會於該影像24與該虛擬三維模型36在外觀上之至少一差異點368上標記至少一符號369,並同步顯示於該顯示裝置4上。Next, please continue to refer to the second to fourth figures. As shown in the figure, the augmented reality comparison system 1 further includes a comparison module 32, which is arranged in the analysis module 3. And connected to the analysis module 3, after the analysis module 3 superimposes the image 24 on the virtual three-dimensional model 36, the comparison module 32 can compare the appearance of the image 24 and the virtual three-dimensional model 36 The difference, as shown in the fourth figure, when the image 24 is superimposed with the virtual three-dimensional model 36, the appearance arc of the foot of the virtual three-dimensional model 36 is larger, and the arc of the foot of the image 24 is smaller, so that The image 24 differs from the virtual three-dimensional model 36 in appearance, and then please continue to refer to FIG. 4A, which is a schematic diagram of an action of a preferred embodiment of the present invention. When there is a difference in appearance between the image 24 and the virtual three-dimensional model 36, the comparison module 32 will mark at least one symbol 369 on at least one difference point 368 in the appearance of the image 24 and the virtual three-dimensional model 36, and synchronize. Displayed on the display device 4.

請繼續參閱第五圖,其係本發明之一較佳實施例之做動示意圖,該分析模組3內更進一步包含一建模資料庫34,該建模資料庫34內包含該虛擬三維模型36以及至少一虛擬三維元件38,該分析模組3能夠從該建模資料庫34內將該虛擬三維模型36提取出來與該影像24進行疊合,其中為了增加該虛擬三維模型36之元件,其能夠即時從該建模資料庫34內將該至少一虛擬三維元件38提取至該分析模組3,並將該至少一虛擬三維元件38與該虛擬三維模型36連接,且同步顯示於該顯示裝置4上。Please continue to refer to the fifth figure, which is a schematic diagram of the operation of a preferred embodiment of the present invention. The analysis module 3 further includes a modeling database 34, and the modeling database 34 contains the virtual three-dimensional model. 36 and at least one virtual three-dimensional element 38. The analysis module 3 can extract the virtual three-dimensional model 36 from the modeling database 34 and overlap the image 24. In order to increase the components of the virtual three-dimensional model 36, It can immediately extract the at least one virtual three-dimensional element 38 from the modeling database 34 to the analysis module 3, and connect the at least one virtual three-dimensional element 38 to the virtual three-dimensional model 36, and simultaneously display it on the display. On device 4.

接著更進一步說明該擴增實境比對現實物體之系統1,請一併參閱第二圖至第五圖,如圖所示,本發明係用於家具打樣上,當設計師繪製完成一設計圖檔後,該設計圖檔會交給打樣師進行實體的打樣,而該設計圖檔即為該虛擬三維模型36,且該虛擬三維模型36係事先傳送至該分析模組3內,當打樣師依照該虛擬三維模型36打樣並完成該現實物件22時,其能夠使用該影像擷取裝置2對該現實物件22進行拍照,該影像擷取裝置2會產生一影像24,當該影像24傳送至該分析模組3後,該分析模組3對該影像24進行輪廓的分析,該分析模組3於該影像24上分別定義/設置一第一參考點244以及一第二參考點246,該第一參考點244係相對於該第二參考點246,其中該第一參考點244與該第二參考點246之選擇位置係選自該影像24之至少二線段248之交點,接著該虛擬三維模型36分別設置一第一虛擬參考點362以及一第二虛擬參考點364,該第一虛擬參考點362係依照該第一參考點244設置於該影像24之輪廓上之位置,而將該第一虛擬參考點362設置於該虛擬三維模型36之輪廓上之相對位置,該第二虛擬參考點364係依照該第二參考點246設置於該影像24之輪廓上之位置,而將該第二虛擬參考點364設置於該虛擬三維模型之輪廓上之相對位置,也就是說,當該分析模組3判斷該影像24為該虛擬三維模型36之三維圖面後,即可將該第一虛擬參考點362以及該第二虛擬參考點364設置相對於該影像24之該虛擬三維模型36上,接著該分析模組3將該第一虛擬座標點362疊合於該第一座標點242後,則該第一虛擬參考點364以及該第二虛擬參考點366分別疊合於該第一參考點244以及該第二參考點246,且該第一虛擬參考點364與該第二虛擬參考點366疊合於該第一參考點244以及該第二參考點246時,該虛擬三維模型36之體積以及面積會隨該第一虛擬參考點364以及該第二虛擬參考點366疊合於該第一參考點244以及該第二參考點246變大或變小,且該分析模組3係連接該顯示裝置4,使得該分析模組3能夠同步將該影像24顯示於該顯示裝置4上,並將該虛擬三維模型36疊合於該影像24上,使得打樣師能夠直接從顯示裝置4上辨認出該影像與該虛擬三維模型36之外觀差異。Next, the system 1 for comparing augmented reality with real objects will be further described. Please refer to the second to fifth figures together. As shown in the figure, the present invention is used for proofing furniture. When a designer draws a design After the drawing file, the design drawing file will be handed over to the proofing division for physical proofing, and the design drawing file is the virtual three-dimensional model 36, and the virtual three-dimensional model 36 is transmitted to the analysis module 3 in advance. When the teacher proofs according to the virtual three-dimensional model 36 and completes the real object 22, he can use the image capture device 2 to take a picture of the real object 22, the image capture device 2 will generate an image 24, and when the image 24 is transmitted After the analysis module 3, the analysis module 3 analyzes the contour of the image 24. The analysis module 3 defines / sets a first reference point 244 and a second reference point 246 on the image 24. The first reference point 244 is relative to the second reference point 246, wherein the selected position of the first reference point 244 and the second reference point 246 is selected from the intersection of at least two line segments 248 of the image 24, and then the virtual The three-dimensional model 36 is respectively provided with a first A virtual reference point 362 and a second virtual reference point 364. The first virtual reference point 362 is set on the contour of the image 24 according to the position of the first reference point 244, and the first virtual reference point 362 is set at Relative position on the outline of the virtual three-dimensional model 36, the second virtual reference point 364 is set on the outline of the image 24 according to the second reference point 246, and the second virtual reference point 364 is set on the The relative position on the outline of the virtual 3D model, that is, when the analysis module 3 determines that the image 24 is a 3D surface of the virtual 3D model 36, the first virtual reference point 362 and the second The virtual reference point 364 is set on the virtual three-dimensional model 36 relative to the image 24, and then the analysis module 3 superimposes the first virtual coordinate point 362 on the first coordinate point 242, then the first virtual reference point 364 and the second virtual reference point 366 are superimposed on the first reference point 244 and the second reference point 246, respectively, and the first virtual reference point 364 and the second virtual reference point 366 are superposed on the first reference Point 244 and the second reference At 246 hours, the volume and area of the virtual three-dimensional model 36 will become larger or smaller with the first virtual reference point 364 and the second virtual reference point 366 superimposed on the first reference point 244 and the second reference point 246. And the analysis module 3 is connected to the display device 4 so that the analysis module 3 can simultaneously display the image 24 on the display device 4 and superimpose the virtual three-dimensional model 36 on the image 24 so that The proofer can directly distinguish the appearance difference between the image and the virtual three-dimensional model 36 from the display device 4.

接著請繼續參閱第五圖,如圖所示,當設計師與打樣師討論打樣品之現實物件需要添加其他元件或設計時,設計師能夠將其他之設計元件之圖檔傳送至該分析模組3內,設計師繪製之其他之設計元件本實施方式定義為至少一虛擬三維元件38,其中該分析模組3包含擴增實境技術的三維影像辨識演算法,且該分析模組3內更包含該建模資料庫34,且該建模資料庫34能夠存取該虛擬三維模型36以及該至少一虛擬三維元件38,其中該虛擬三維影像36係具有正確之尺寸,該至少一虛擬三維元件38係由該建模資料庫34內取出,並設置於該虛擬三維模型36上,本實施方式係以椅子打樣進行說明,該虛擬三維模型36係為一張沒有椅背的椅子,該至少一虛擬三維元件係為椅子之椅背,設計師與打樣師討論後,希望椅子要有椅背,且為了使打樣師更能夠了解設計師的想法,於是由該建模資料庫34內將該至少一虛擬三維元件38取出,並疊加於該虛擬三維模型36上,且該分析模組3係依照該虛擬三維模型36之視角,將該至少一虛擬三維元件38調整成與該虛擬三維模型36相同之視角,其中該至少一虛擬三維元件38能夠自由地疊加於該虛擬三維模型36上,當該虛擬三維模型36與該至少一虛擬三維元件38疊加後,該虛擬三維模型36之該第一虛擬座標點362再疊合於該影像24之該第一座標點242,或者,該虛擬三維模型36之該第一虛擬座標點362先疊合於該第一座標點242後,先判斷該虛擬三維模型36與該影像24之相異處,接著才將該至少一虛擬三維元件38疊加於該虛擬三維模型36上。Then please continue to refer to the fifth figure. As shown in the figure, when the designer and the proofer discuss the actual objects of the sample and need to add other components or designs, the designer can transfer the drawings of other design components to the analysis module. 3, other design elements drawn by the designer. This embodiment is defined as at least one virtual three-dimensional element 38, where the analysis module 3 includes a three-dimensional image recognition algorithm of augmented reality technology, and the analysis module 3 includes more Contains the modeling database 34, and the modeling database 34 can access the virtual three-dimensional model 36 and the at least one virtual three-dimensional component 38, wherein the virtual three-dimensional image 36 has the correct size and the at least one virtual three-dimensional component 38 is taken from the modeling database 34 and set on the virtual three-dimensional model 36. This embodiment is described by proofing a chair. The virtual three-dimensional model 36 is a chair without a backrest. The at least one The virtual three-dimensional element is the back of the chair. After discussing with the proofer, the designer hopes that the chair will have a back, and in order to make the proofer better understand the designer's ideas, so The modeling database 34 takes out the at least one virtual three-dimensional element 38 and superimposes it on the virtual three-dimensional model 36, and the analysis module 3 is based on the perspective of the virtual three-dimensional model 36, the at least one virtual three-dimensional element 38 is adjusted to the same perspective as the virtual three-dimensional model 36, wherein the at least one virtual three-dimensional element 38 can be superposed freely on the virtual three-dimensional model 36. After the virtual three-dimensional model 36 and the at least one virtual three-dimensional element 38 are superimposed, The first virtual coordinate point 362 of the virtual three-dimensional model 36 is then superimposed on the first coordinate point 242 of the image 24, or the first virtual coordinate point 362 of the virtual three-dimensional model 36 is first superimposed on the first After the coordinate point 242, the difference between the virtual three-dimensional model 36 and the image 24 is determined, and then the at least one virtual three-dimensional element 38 is superimposed on the virtual three-dimensional model 36.

惟以上所述者,僅為本發明之較佳實施例而已,並非用來限定本發明實施之範圍,舉凡依本發明申請專利範圍所述之形狀、構造、特徵及精神所為之均等變化與修飾,均應包括於本發明之申請專利範圍內。However, the above are only preferred embodiments of the present invention, and are not intended to limit the scope of implementation of the present invention. For example, all changes and modifications of the shapes, structures, features, and spirits in accordance with the scope of the patent application for the present invention are made. Shall be included in the scope of patent application of the present invention.

1‧‧‧擴增實境比對現實物體之系統1‧‧‧ System for augmented reality comparison with real objects

2‧‧‧影像擷取裝置2‧‧‧Image capture device

22‧‧‧現實物件22‧‧‧Realistic Objects

24‧‧‧影像24‧‧‧Image

242‧‧‧第一座標點242‧‧‧ first coordinate point

244‧‧‧第一參考點244‧‧‧First reference point

246‧‧‧第二參考點246‧‧‧Second reference point

248‧‧‧二線段248‧‧‧Second Line Segment

3‧‧‧分析模組3‧‧‧analysis module

32‧‧‧比對模組32‧‧‧Comparison module

34‧‧‧建模資料庫34‧‧‧Modeling Database

36‧‧‧虛擬三維模型36‧‧‧Virtual 3D Model

362‧‧‧第一虛擬座標點362‧‧‧ the first virtual coordinate point

364‧‧‧第一虛擬參考點364‧‧‧First virtual reference point

366‧‧‧第二虛擬參考點366‧‧‧second virtual reference point

368‧‧‧差異點368‧‧‧ Differences

369‧‧‧符號369‧‧‧ symbol

38‧‧‧虛擬三維元件38‧‧‧Virtual 3D component

4‧‧‧顯示裝置4‧‧‧ display device

S10~S16‧‧‧步驟S10 ~ S16‧‧‧step

第一圖:其係為本發明之一較佳實施例之步驟流程圖; 第二圖:其係為本發明之一較佳實施例之步驟示意圖; 第三圖:其係為本發明之一較佳實施例之做動示意圖; 第四圖:其係為本發明之一較佳實施例之做動示意圖; 第四A圖:其係為本發明之一較佳實施例之做動示意圖;以及 第五圖:其係為本發明之一較佳實施例之做動示意圖。First picture: it is a flowchart of steps of a preferred embodiment of the present invention; second picture: it is a schematic diagram of steps of a preferred embodiment of the present invention; third picture: it is one of the present invention Schematic diagram of the action of the preferred embodiment; Figure 4: a schematic diagram of the action of a preferred embodiment of the present invention; Figure 4A: a schematic diagram of the action of a preferred embodiment of the present invention; And the fifth figure: it is a schematic diagram of operation of a preferred embodiment of the present invention.

Claims (7)

一種擴增實境虛實比對現實打樣物體之方法,其步驟包含:拍攝一現實物件,該現實物件為依據一虛擬三維模型打樣而成之實體半成品;得到一三維影像;傳送該三維影像至一分析模組,該分析模組包含該虛擬三維模型,並於該三維影像上設置一第一座標點以及於該虛擬三維模型上設置一第一虛擬座標點,再將該第一座標點疊合於該第一虛擬座標點;以及疊合該三維影像至該虛擬三維模型上後傳送並顯示於一顯示裝置上;其中該分析模組係先判斷該三維影像上之一第一邊長相對於該虛擬三維模型上之一第一虛擬邊長之一長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該三維影像各邊長之比例相同,以及當該三維影像疊合於該虛擬三維模型後,再判斷該三維影像與該虛擬三維模型之外觀之至少一相異處。A method for augmenting reality to compare objects with actual proofs, the steps include: photographing a real object, the real object is a solid semi-finished product proofed according to a virtual three-dimensional model; obtaining a three-dimensional image; transmitting the three-dimensional image to a An analysis module, which includes the virtual three-dimensional model, sets a first coordinate point on the three-dimensional image and a first virtual coordinate point on the virtual three-dimensional model, and then overlaps the first coordinate point At the first virtual coordinate point; and superimposing the three-dimensional image on the virtual three-dimensional model and transmitting and displaying it on a display device; wherein the analysis module first determines a first side length of the three-dimensional image relative to the A length ratio of a first virtual side length on a virtual three-dimensional model, the virtual three-dimensional model is enlarged or reduced according to the length ratio, so that the ratio of each side length of the virtual three-dimensional model is the same as the ratio of each side length of the three-dimensional image, and After the three-dimensional image is superimposed on the virtual three-dimensional model, it is judged that at least one of the appearances of the three-dimensional image and the virtual three-dimensional model are different. 如申請專利範圍第1項所述之擴增實境虛實比對現實打樣物體之方法,其中該分析模組於該三維影像之輪廓上分別設置一第一參考點及一第二參考點,且該第一參考點係相對於該第二參考點,以及於該虛擬三維模型上分別設置一第一虛擬參考點及一第二虛擬參考點,該第一虛擬參考點係依照該第一參考點設置於該三維影像之輪廓上對照設置於該虛擬三維模型之輪廓上,該第二虛擬參考點係依照該第二參考點設置於該三維影像之輪廓上對照設置於該虛擬三維模型之輪廓上,當該第一座標點疊合於該第一虛擬座標點,則該第一虛擬參考點以及該第二虛擬參考點則依照該第一參考點以及該第二參考點之相對位置疊合於該第一參考點以該第二參考點。According to the method of augmenting the real-world virtual-to-real proof object as described in item 1 of the scope of the patent application, wherein the analysis module sets a first reference point and a second reference point on the contour of the three-dimensional image, respectively, and The first reference point is relative to the second reference point, and a first virtual reference point and a second virtual reference point are respectively set on the virtual three-dimensional model, and the first virtual reference point is in accordance with the first reference point. The second virtual reference point is set on the contour of the three-dimensional image in contrast to the outline of the virtual three-dimensional model, and is set on the contour of the three-dimensional image. When the first coordinate point is superimposed on the first virtual coordinate point, the first virtual reference point and the second virtual reference point are superimposed on the relative positions of the first reference point and the second reference point. The first reference point is the second reference point. 如申請專利範圍第1項所述之擴增實境比對現實打樣物體之方法,其中該分析模組量測該三維影像之至少二邊長相交於一水平線之至少二夾角角度,該虛擬三維模型之至少二虛擬邊長與該水平線之至少二虛擬夾角角度與該至少二夾角角度相同。According to the method of augmented reality comparison with a real proof object as described in item 1 of the scope of patent application, wherein the analysis module measures at least two sides of the three-dimensional image intersecting at least two angles of a horizontal line, the virtual three-dimensional The at least two virtual sides of the model and the at least two virtual included angles of the horizontal line are the same as the at least two included angles. 如申請專利範圍第1項所述之擴增實境比對現實打樣物體之方法,其中該虛擬三維模型與至少一虛擬三維元件進行疊加,並疊合於該三維影像。According to the method of augmented reality comparison with a real proof object as described in item 1 of the scope of patent application, wherein the virtual three-dimensional model is superimposed with at least one virtual three-dimensional element and superimposed on the three-dimensional image. 一種擴增實境虛實比對現實打樣物體之系統,其包含:一影像擷取裝置,其對一現實物件進行拍攝得到一三維影像,該現實物件為依據一虛擬三維模型打樣而成之實體半成品;一分析模組,其係連接該影像擷取裝置,該影像擷取裝置將該三維影像傳送至該分析模組,並與該分析模組包含之該虛擬三維模型進行疊合,其中該三維影像上設置一第一座標點,且相對於該三維影像之該第一座標點之該虛擬三維模型上設置一第一虛擬座標點,該第一座標點係疊合於該第一虛擬座標點;以及一顯示裝置,其係連接該分析模組,並將該分析模組內之該虛擬三維模型與該三維影像顯示於該顯示裝置上。A system for augmenting a real-world virtual-to-real proof object includes: an image capture device that captures a real object to obtain a three-dimensional image, and the real object is a solid semi-finished product made based on a virtual three-dimensional model. ; An analysis module, which is connected to the image capture device, the image capture device transmits the three-dimensional image to the analysis module, and overlaps with the virtual three-dimensional model included in the analysis module, wherein the three-dimensional A first coordinate point is set on the image, and a first virtual coordinate point is set on the virtual three-dimensional model relative to the first coordinate point of the three-dimensional image. The first coordinate point is superimposed on the first virtual coordinate point. And a display device connected to the analysis module and displaying the virtual three-dimensional model and the three-dimensional image in the analysis module on the display device. 如申請專利範圍第5項所述之擴增實境比對現實打樣物體之系統,更進一步包含一比對模組,其係設置於該分析模組內,當該三維影像疊合於該虛擬三維模型後,該比對模組對該三維影像與該虛擬三維模型進行模型比對。The system for augmented reality comparison with a real proof object as described in item 5 of the scope of the patent application, further includes a comparison module, which is set in the analysis module. When the three-dimensional image is superimposed on the virtual After the three-dimensional model, the comparison module performs a model comparison between the three-dimensional image and the virtual three-dimensional model. 如申請專利範圍第5項所述之擴增實境比對現實打樣物體之系統,更進一步包含一建模資料庫,該建模資料庫內包含至少一虛擬三維元件以及該虛擬三維模型,該建模資料庫係設置於該分析模組內,且該至少一虛擬三維元件疊加於該虛擬三維模型。According to the system of augmented reality comparison with a real proof object described in item 5 of the scope of the patent application, the system further includes a modeling database. The modeling database includes at least one virtual three-dimensional element and the virtual three-dimensional model. The modeling database is set in the analysis module, and the at least one virtual three-dimensional element is superimposed on the virtual three-dimensional model.
TW107139217A 2018-11-05 2018-11-05 Method and system for augmented reality comparison with real objects TWI680670B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107139217A TWI680670B (en) 2018-11-05 2018-11-05 Method and system for augmented reality comparison with real objects

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107139217A TWI680670B (en) 2018-11-05 2018-11-05 Method and system for augmented reality comparison with real objects

Publications (2)

Publication Number Publication Date
TWI680670B true TWI680670B (en) 2019-12-21
TW202019169A TW202019169A (en) 2020-05-16

Family

ID=69582650

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107139217A TWI680670B (en) 2018-11-05 2018-11-05 Method and system for augmented reality comparison with real objects

Country Status (1)

Country Link
TW (1) TWI680670B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1271568C (en) * 2000-06-26 2006-08-23 株式会社岩根研究所 Information converting system
CN103959012A (en) * 2011-12-06 2014-07-30 赫克斯冈技术中心 Position and orientation determination in 6-dof
WO2017031889A1 (en) * 2015-08-25 2017-03-02 李万鸿 Method for measuring plan view size of object using mobile phone photographing function
CN206741556U (en) * 2017-05-22 2017-12-12 埃洛克航空科技(北京)有限公司 A kind of three-dimensional modeling data acquisition system based on dynamic object

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1271568C (en) * 2000-06-26 2006-08-23 株式会社岩根研究所 Information converting system
CN103959012A (en) * 2011-12-06 2014-07-30 赫克斯冈技术中心 Position and orientation determination in 6-dof
WO2017031889A1 (en) * 2015-08-25 2017-03-02 李万鸿 Method for measuring plan view size of object using mobile phone photographing function
CN206741556U (en) * 2017-05-22 2017-12-12 埃洛克航空科技(北京)有限公司 A kind of three-dimensional modeling data acquisition system based on dynamic object

Also Published As

Publication number Publication date
TW202019169A (en) 2020-05-16

Similar Documents

Publication Publication Date Title
US11354840B2 (en) Three dimensional acquisition and rendering
CN109919876B (en) Three-dimensional real face modeling method and three-dimensional real face photographing system
CN107993216B (en) Image fusion method and equipment, storage medium and terminal thereof
US10417829B2 (en) Method and apparatus for providing realistic 2D/3D AR experience service based on video image
JP4473754B2 (en) Virtual fitting device
US11399141B2 (en) Processing holographic videos
CN106373178B (en) Apparatus and method for generating artificial image
US10311508B2 (en) Garment modeling simulation system and process
Zhao et al. 3-D reconstruction of human body shape from a single commodity depth camera
CN106228507A (en) A kind of depth image processing method based on light field
WO2017183470A1 (en) Three-dimensional reconstruction method
CN104599317B (en) A kind of mobile terminal and method for realizing 3D scanning modeling functions
CN109816784B (en) Method and system for three-dimensional reconstruction of human body and medium
JP2004537082A (en) Real-time virtual viewpoint in virtual reality environment
JP2010250452A (en) Arbitrary viewpoint image synthesizing device
CN107862718B (en) 4D holographic video capture method
TWI750710B (en) Image processing method and apparatus, image processing device and storage medium
JPH11175762A (en) Light environment measuring instrument and device and method for shading virtual image using same
JP2017157208A (en) Three-dimensional model generation method, three-dimensional model generation device, three-dimensional model generation system, and program for generating three-dimensional model
CN111062869A (en) Curved screen-oriented multi-channel correction splicing method
WO2024125159A1 (en) Distortion coefficient calibration method and apparatus for extended reality device, and storage medium
KR20180000696A (en) A method and apparatus for creating a pair of stereoscopic images using least one lightfield camera
CN111047678B (en) Three-dimensional face acquisition device and method
TWI680670B (en) Method and system for augmented reality comparison with real objects
JP2012120080A (en) Stereoscopic photography apparatus