TW202019169A - Method and system for comparing real objects with augmented reality including superimposing an image of a real object with a virtual three-dimensional model - Google Patents
Method and system for comparing real objects with augmented reality including superimposing an image of a real object with a virtual three-dimensional model Download PDFInfo
- Publication number
- TW202019169A TW202019169A TW107139217A TW107139217A TW202019169A TW 202019169 A TW202019169 A TW 202019169A TW 107139217 A TW107139217 A TW 107139217A TW 107139217 A TW107139217 A TW 107139217A TW 202019169 A TW202019169 A TW 202019169A
- Authority
- TW
- Taiwan
- Prior art keywords
- virtual
- image
- dimensional model
- reference point
- dimensional
- Prior art date
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
Description
本發明係關於一種擴增實境比對現實物體之方法及系統,其係用來比對。The present invention relates to a method and system for comparing reality with augmented reality, which is used for comparison.
擴增實境(Augmented Reality,簡稱AR ),其指透過攝影機影像的位置及角度精算並加上圖像分析技術,讓螢幕上的虛擬世界能夠與現實世界場景或物體進行結合與互動的技術,其可用於生醫、化學以及室內設計等領域。Augmented Reality (Augmented Reality, referred to as AR ), which refers to the technology that allows the virtual world on the screen to combine and interact with the real world scene or object through the actuarial of the position and angle of the camera image and the addition of image analysis technology, It can be used in fields such as biomedicine, chemistry and interior design.
一般傢俱從設計到生產製造,其中產品打樣係不可或缺的環節,當設計師繪製完產品設計圖交給打樣師進行產品打樣之過程中,設計師需要反覆的與打樣師進行溝通與討論,設計師需要將傢俱的設計圖或構想圖提供給打樣師來進行外觀打樣試做,之後與設計師確認其打樣之樣品均符合設計師要求後,就會將打樣之樣品送至傢具製造廠進行大量生產,其中,打樣師於打樣過程中,由於設計師與打樣師在三維空間視覺概念與二維圖面上的認知有落差,導致打樣的結果往往與設計師的構想有極大的差異,因此打樣師需要經過反覆的修正與調整該打樣品,才能夠貼近設計師所希望設計的形體外觀,但打樣出來的樣品大多只是貼近設計師所希望設計的形體外觀,而非與原先設計師所想的一致,於此,使用此方式進行打樣,不論對設計師或打樣師而言,都需要耗費大量的時間及金錢,其原因最主要在於二維(2D)圖面難以呈現出三維(3D)圖面的空間尺寸概念,打樣師雖然可以透過各側視角之二維圖面去進行比對,但二維圖片仍然會產生許多在三維外觀上的模糊空間與視覺落差,且現階段的打樣作業上,仍然無法有效地解決這個問題。From design to production of general furniture, product proofing is an indispensable part. When the designer finishes drawing the product design drawing and gives it to the proofer for the process of product proofing, the designer needs to communicate and discuss with the proofer repeatedly. The designer needs to provide the design drawing or concept drawing of the furniture to the proofer for the appearance proofing trial, and then confirm with the designer that the proofing samples meet the designer's requirements, and then send the proofing samples to the furniture manufacturer for Mass production, in which, during the proofing process, the proofer has a gap between the visual concept of the three-dimensional space and the two-dimensional drawing of the designer and the proofer, resulting in a great difference between the proofing result and the designer's conception. The proofer needs to repeatedly correct and adjust the proofing sample to be able to get close to the appearance of the body that the designer wants to design, but most of the samples that are drawn are only close to the appearance of the body that the designer wants to design, not the original designer. It is consistent with this. Here, using this method for proofing requires a lot of time and money for designers or proofers. The main reason is that the two-dimensional (2D) surface is difficult to present three-dimensional (3D) The concept of the space size of the drawing, although the proofer can compare through the two-dimensional drawing of each side view, the two-dimensional picture will still produce a lot of fuzzy space and visual drop in the three-dimensional appearance, and the current proofing operation However, this problem cannot be solved effectively.
在過去設計師與打樣師會透過二維圖面來進行家具討論與打樣的試做,其係設計師與打樣師之間溝通的方式,隨著繪圖軟體的成熟,現今設計師也透過3D繪圖軟體繪製3D立體圖面來與打樣師進行溝通,使打樣師能夠了解設計師所希望製作的家具外型與樣式,但這些3D圖面都僅能透過2D紙張輸出列印來呈現,且2D圖面往往欠缺實際空間參考尺寸與真實形體外觀,特別是於打樣傢俱時,傢俱於三維空間中彎曲的線條與造型,都難以在2D圖面中呈現,當打樣師於產品打樣時,一切僅能透過視覺上的反覆揣摩與打樣修正來完成設計圖上的產品,但其初步打樣出來的傢俱往往與設計師心目中的狀態有很大的落差,之後又得不斷地與設計師溝通來達成打樣的家具產品,其會耗費大量的時間以及金錢。In the past, designers and proofers will use two-dimensional drawings to conduct furniture discussions and proofing. It is the way of communication between designers and proofers. With the maturity of drawing software, today's designers also draw through 3D drawings. The software draws a 3D three-dimensional drawing to communicate with the proofer, so that the proofer can understand the appearance and style of the furniture that the designer wants to make, but these 3D drawings can only be presented through 2D paper output printing, and the 2D drawing Often lacks the actual spatial reference size and real shape appearance, especially in the proofing furniture, the curved lines and shapes of the furniture in the three-dimensional space are difficult to show in the 2D drawing. When the proofer is proofing the product, everything can only pass through Visually repeating speculation and proofing correction to complete the product on the design drawing, but the initial proofing furniture often has a big gap with the state of the designer's mind, and then has to constantly communicate with the designer to achieve the proofing Furniture products consume a lot of time and money.
綜上所述之習知傢俱打樣時有許多之處,因此本發明人經過長期的研究及發展,發明出一種擴增實境虛實比對現實物體之方法及系統,其係將擴增實境技術應用於傢俱打樣,利用擴增實境在空間視覺中在於虛實體感中的量體差異感受與虛實形體比對上具有明顯優勢,並透過擴增實境的方式,讓打樣師能夠於打樣傢俱時,同時透過虛擬傢俱形體的比對,拉近打樣模型與最終傢俱樣品間的落差,且現今擴增實境可真實呈現傢俱的空間形狀與彎曲形體的三維資訊以及材質表現,且擴增實境更能夠快速的呈現三維視覺畫面,提供設計師與打樣師更多元的討論空間,例如設計師能夠快速的更換家具組件(椅腳、椅背或是扶手等組件),這些零組件都能經由擴增實境的方式快速切換,減少設計師與打樣師在產品打樣過程的溝通時間,此外擴增實境還能夠快速的將三維的虛擬模型轉換成二維的虛擬圖面,幫助打樣師了解各側視圖中的型態樣貌,並且能夠將打樣中的半成品準確的與三維虛擬模型比對,判斷傢俱的打樣狀態,減少傢俱打樣時對於設計圖的誤判。In summary, there are many points in the conventional furniture proofing. Therefore, after long-term research and development, the inventor has invented a method and system for augmenting reality and comparing reality with reality, which will augment reality The technology is applied to furniture proofing, and the use of augmented reality in space vision has a significant advantage in the comparison of the physical and physical feelings of the virtual and physical forms, and through the augmented reality, the proofer can make the proof For furniture, at the same time, through the comparison of virtual furniture shapes, the gap between the proofing model and the final furniture sample is narrowed, and today's augmented reality can truly display the spatial shape of the furniture and the three-dimensional information and material performance of the curved shape, and the expansion Reality can quickly display three-dimensional visual images, providing designers and proofers with more diverse discussion spaces. For example, designers can quickly replace furniture components (chair legs, chair backs, armrests and other components). These components are all Can be quickly switched through augmented reality, reducing the communication time between designers and proofers in the product proofing process. In addition, augmented reality can also quickly convert a three-dimensional virtual model into a two-dimensional virtual drawing to help proofing The teacher understands the shape and appearance of each side view, and can accurately compare the semi-finished products in the proofing with the three-dimensional virtual model to judge the proofing status of the furniture and reduce the misjudgment of the design drawings when the furniture is proofed.
本發明之主要目的,係提供一種擴增實境虛實比對現實物體之方法與系統,其係對一現實物件進行拍攝,並藉由拍攝到之一影像與一虛擬三維模型進行比對,其中該虛擬三維模型係為該現實物件的設計圖,接著將該影像疊合至該三維模型進行比對其相異處之外觀。The main objective of the present invention is to provide a method and system for comparing reality and reality with augmented reality, which is to shoot a real object and compare it with a virtual three-dimensional model by shooting an image. The virtual three-dimensional model is a design drawing of the real object, and then the image is superimposed on the three-dimensional model to compare the appearance of the difference.
本發明之另一目的,係提供擴增實境虛實比對現實物體之方法與系統,其係由一資料庫內擷取至少一虛擬三維元件疊加於該虛擬三維模型上,並藉由疊加之該至少一虛擬三維元件來判斷該影像與該至少一虛擬三維元件之差異。Another object of the present invention is to provide a method and system for comparing reality and reality with augmented reality, which captures at least one virtual three-dimensional element from a database and superimposes it on the virtual three-dimensional model, and The at least one virtual three-dimensional element determines the difference between the image and the at least one virtual three-dimensional element.
為了達到上述之目的,本發明揭示了一種擴增實境虛實比對現實物體之方法,其步驟包含拍攝一現實物件,得到一影像,傳送該影像至一分析模組,並於該影像上設置一第一座標點以及於一虛擬三維模型上設置一第一虛擬座標點,再將該第一座標點疊合於該第一虛擬座標點,以及疊合該影像至該虛擬三維模型上後傳送並顯示於一顯示裝置上,其中該分析模組係先判斷該影像上之一第一邊長相對於該虛擬三維模型上之一第一虛擬邊長之一長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同。In order to achieve the above purpose, the present invention discloses a method for augmenting reality to compare reality with reality. The steps include shooting a real object, obtaining an image, transmitting the image to an analysis module, and setting it on the image A first coordinate point and a first virtual coordinate point are set on a virtual three-dimensional model, and then the first coordinate point is superimposed on the first virtual coordinate point, and the image is superimposed on the virtual three-dimensional model and then transmitted And displayed on a display device, wherein the analysis module first determines the length ratio of a first side length on the image relative to a first virtual side length on the virtual 3D model, the virtual 3D model is based on the length Scale up or down to make the ratio of the sides of the virtual 3D model the same as the ratio of the sides of the image.
本發明之一實施例中,其亦揭露該分析模組於該影像之輪廓上分別設置一第一參考點及一第二參考點,且該第一參考點係相對於該第二參考點,以及於該虛擬三維模型上分別設置一第一虛擬參考點及一第二虛擬參考點,該第一虛擬參考點係依照該第一參考點設置於該影像之輪廓上對照設置於該虛擬三維模型之輪廓上,該第二虛擬參考點係依照該第二參考點設置於該影像之輪廓上對照設置於該虛擬三維模型之輪廓上,當該第一座標點疊合於該第一虛擬座標點,則該第一虛擬參考點以及該第二虛擬參考點則依照該第一參考點以及該第二參考點之相對位置疊合於該第一參考點以該第二參考點。In an embodiment of the invention, it is also disclosed that the analysis module sets a first reference point and a second reference point on the contour of the image, respectively, and the first reference point is relative to the second reference point, And a first virtual reference point and a second virtual reference point are respectively set on the virtual three-dimensional model, the first virtual reference point is set on the virtual three-dimensional model according to the first reference point set on the contour of the image The second virtual reference point is set on the contour of the image according to the second reference point on the contour of the virtual three-dimensional model, when the first coordinate point overlaps the first virtual coordinate point Then, the first virtual reference point and the second virtual reference point are superimposed on the first reference point and the second reference point according to the relative positions of the first reference point and the second reference point.
本發明之一實施例中,其亦揭露該分析模組量測該影像之至少二邊長相交於一水平線之至少二夾角角度,該虛擬三維模型之至少二虛擬邊長與該水平線之至少二虛擬夾角角度與該至少二夾角角度相同。In an embodiment of the invention, it also discloses that the analysis module measures at least two angles of intersection of at least two sides of the image at a horizontal line, at least two virtual sides of the virtual three-dimensional model and at least two of the horizontal lines The virtual included angle is the same as the at least two included angles.
本發明之一實施例中,其亦揭露該虛擬三維模形與至少一虛擬三維元件進行疊加,並疊合於該影像。In an embodiment of the invention, it is also disclosed that the virtual three-dimensional shape is superimposed on at least one virtual three-dimensional element and superimposed on the image.
為了達到上述之目的,本發明另外揭示了一種擴增實境比對現實物體之系統,其包含一影像擷取裝置,其對一現實物件進行拍攝,並得到一影像,一分析模組,其係連接該影像擷取裝置,該影像擷取裝置將該影像傳送至該分析模組並與一虛擬三維模形進行疊合,其中該影像上設置一第一座標點,且相對於該影像之該第一座標點之該虛擬三維模型上設置一第一虛擬座標點,該第一座標點係疊合於該第一虛擬座標點,以及一顯示裝置,其係連接該分析模組,並將該分析模組內之該虛擬三維模型與該影像顯示於該顯示裝置上。In order to achieve the above object, the present invention further discloses a system for augmented reality comparison with real objects, which includes an image capturing device that shoots a real object and obtains an image, an analysis module, which The image capturing device is connected to the image capturing device to transmit the image to the analysis module and superimpose with a virtual three-dimensional model, wherein a first coordinate point is set on the image and is relative to the image A first virtual coordinate point is set on the virtual three-dimensional model of the first coordinate point, the first coordinate point is superimposed on the first virtual coordinate point, and a display device is connected to the analysis module, and The virtual three-dimensional model and the image in the analysis module are displayed on the display device.
本發明之一實施例中,其亦揭露該擴增實境比對現實物體之系統,更進一步包含一比對模組,其係設置於該分析模組內,當該影像疊合於該虛擬三維模型後,該比對模組對該影像與該虛擬三維模型進行模型比對。In one embodiment of the present invention, it also discloses that the augmented reality system for comparing real objects further includes a comparison module, which is provided in the analysis module when the image is superimposed on the virtual After the three-dimensional model, the comparison module compares the image with the virtual three-dimensional model.
本發明之一實施例中,其亦揭露該擴增實境比對現實物體之系統,更進一步包含一建模資料庫,該建模資料庫內包含至少一虛擬三維元件以及該虛擬三維模型,該建模資料庫係設置於該分析模組內,且該至少一虛擬三維元件疊加於該虛擬三維模型。In an embodiment of the present invention, it also discloses that the augmented reality system for comparing real objects further includes a modeling database including at least one virtual three-dimensional element and the virtual three-dimensional model, The modeling database is set in the analysis module, and the at least one virtual three-dimensional element is superimposed on the virtual three-dimensional model.
為使 貴審查委員對本發明之特徵及所達成之功效有更進一步之瞭解與認識,謹佐以較佳之實施例及配合詳細之說明,說明如後:In order to make your reviewer have a better understanding and understanding of the features of the present invention and the achieved effects, the preferred embodiments and detailed descriptions are accompanied by the following explanations:
本發明係針對習知技術之傢俱打樣的過程中,設計師與打樣師會透過二維圖面來進行家具討論與打樣的試做,但打樣傢俱時,傢俱於三維空間中彎曲的線條與造型,都難以在2D圖面中呈現,當打樣師於產品打樣時,一切僅能透過視覺上得揣摩與反覆打樣修正來完成設計圖上的產品,但其初步打樣出來的傢俱往往與設計師心目中的狀態有很大的落差,之後又得不斷地與設計師溝通來達成打樣的傢俱產品,其會耗費大量的時間以及金錢,故,本發明係為了能夠縮短傢俱打樣時所耗費的時間以及金錢,增加打樣師根據設計師提供之設計圖打樣時,其能夠快速的將打樣之半成品與設計師提供之一虛擬三維模型進行外觀之比對,進而判斷打樣之半成品與該虛擬三維模形之外觀之相異處,以及藉由擴增實境的技術快速的將三維的虛擬模型轉換成二維的虛擬圖面,幫助打樣師了解各側視圖中的型態樣貌,並且能夠將打樣中的半成品準確的與三維虛擬模型比對,判斷傢俱的打樣狀態,減少傢俱打樣時對於設計圖的誤判。The present invention is directed to the process of furniture proofing of conventional technology. Designers and proofers will conduct furniture discussions and proofing trials through two-dimensional drawings. However, when proofing furniture, the curved lines and shapes of the furniture in three-dimensional space , It is difficult to present in the 2D drawing. When the proofer is proofing the product, everything can only be completed by visual speculation and repeated proofing correction to complete the product on the design drawing, but the furniture that the initial proofing often matches the designer’s mind There is a big gap in the state, and then you have to constantly communicate with the designer to achieve the proofing furniture product, which will consume a lot of time and money. Therefore, the present invention is to shorten the time spent on furniture proofing and Money, increase the proofer according to the design drawings provided by the designer, which can quickly compare the appearance of the semi-finished product with a virtual three-dimensional model provided by the designer, and then judge the semi-finished product of the proof and the virtual three-dimensional model The difference in appearance, and the rapid transformation of the three-dimensional virtual model into the two-dimensional virtual surface through the augmented reality technology helps the proofer understand the shape and appearance of each side view, and can The semi-finished products are accurately compared with the three-dimensional virtual model to judge the proofing status of the furniture and reduce the misjudgment of the design drawings when the furniture is proofed.
首先,請參閱第一圖,其係為本發明之一較佳實施例之步驟流程圖,如圖所示,其步驟包含: 步驟S10: 拍攝一現實物件; 其係使用一影像擷取裝置對一現實物件進行拍攝或影像影像的追蹤,且該影響擷取裝置拍攝該現實物件係能夠以不同角度進行拍攝。 步驟S12: 得到一影像; 當該影像擷取裝置拍攝或追蹤該現實物件後,該影像擷取裝置產生該影像,該影像係為數位影像,其檔案格式係為BMP、GIF、JPEG、PCX、TIFF、TGA、EXIF、FPX、OBJ、SVG、PSD、CDR、PCD、DXF、UFO、EPS或PNG等格式。 步驟S14: 傳送該影像至一分析模組,並於該影像上設置 一第一座標點以及於一虛擬三維模型上設置一第一虛擬座標點,再將該第一座標點疊合於該第一虛擬座標點; 該分析模組係連接該影像擷取裝置,其連接方式可為電信連接、網路連接或是藍芽連接等方式,該分析模組於該影像上標記/設置該第一座標點,且該分析模組內更包含一虛擬三維模型,該虛擬三維模型係事先用電腦繪圖軟體繪製完成,再將該虛擬三維模型上之一點定義為一第一虛擬座標點,且該分析模組係依照對該影像進行分析,判斷該影像係為該虛擬三維模型之視角角度後,將該虛擬三維模型調整成與該影像之同一視角,接著以該虛擬三維模型的該第一虛擬座標點為基準疊合於該影像之該第一座標點。 步驟S16: 疊合該影像至該虛擬三維模型上後傳送並顯示於至顯示裝置上,其中該分析模組係先判斷該影像上之一第一邊長相對於該虛擬三維模型上之一第一虛擬邊長之一長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同。 當該第一座標點疊合於該第一虛擬座標點後,其形成一疊合模型,並將該疊合模型傳送至該顯示裝置上,其中該分析模組接收到該影像後,會先判別該影像是否與該虛擬三維模形相似,如果相似再判斷該影像上之該第一邊長相對於該虛擬三維模型上之該第一虛擬邊長之該長度比例,該虛擬三維模型依照該長度比例放大或縮小,使該虛擬三維模型各邊長之比例與該影像各邊長之比例相同,此外,該分析模組其係包含三維影像辨識演算法,其能夠針對該虛擬三維模型進行各角度之三維圖面進行演算,當該影像傳送至該分析模組後,該分析模組能夠即時將該虛擬三維模型進行分析,以取得與相對於該影像視角之該虛擬三維模型之三維圖面。First, please refer to the first figure, which is a flow chart of steps of a preferred embodiment of the present invention. As shown in the figure, the steps include: Step S10: shooting a real object; it uses a pair of image capturing devices A real object is used for shooting or tracking of image images, and the effect capturing device can shoot the real object at different angles. Step S12: Obtain an image; after the image capture device captures or tracks the real object, the image capture device generates the image, the image is a digital image, and the file format is BMP, GIF, JPEG, PCX, TIFF, TGA, EXIF, FPX, OBJ, SVG, PSD, CDR, PCD, DXF, UFO, EPS or PNG formats. Step S14: Send the image to an analysis module, and set a first coordinate point on the image and a first virtual coordinate point on a virtual three-dimensional model, and then superimpose the first coordinate point on the first A virtual coordinate point; the analysis module is connected to the image capture device, and the connection method can be a telecommunication connection, a network connection, or a Bluetooth connection, etc., the analysis module marks/sets the first on the image Coordinate points, and the analysis module further includes a virtual three-dimensional model, the virtual three-dimensional model is drawn in advance using computer drawing software, and then a point on the virtual three-dimensional model is defined as a first virtual coordinate point, and the analysis The module analyzes the image and determines that the image is the angle of view of the virtual three-dimensional model, adjusts the virtual three-dimensional model to the same angle of view as the image, and then uses the first virtual coordinate of the virtual three-dimensional model The point is the first coordinate point superimposed on the image. Step S16: The image is superimposed on the virtual three-dimensional model and then transmitted and displayed on the display device, wherein the analysis module first determines the length of a first side on the image relative to the first on the virtual three-dimensional model A length ratio of the virtual side length, the virtual three-dimensional model is enlarged or reduced according to the length ratio, so that the ratio of each side length of the virtual three-dimensional model is the same as the ratio of each side length of the image. When the first coordinate point is superimposed on the first virtual coordinate point, it forms a superimposed model, and transmits the superimposed model to the display device, wherein after receiving the image, the analysis module will first Determine whether the image is similar to the virtual three-dimensional model, if it is similar, then determine the ratio of the length of the first side of the image relative to the length of the first virtual side of the virtual three-dimensional model, the virtual three-dimensional model according to the length Scale up or down to make the ratio of each side of the virtual 3D model the same as the ratio of each side of the image. In addition, the analysis module includes a 3D image recognition algorithm that can perform various angles on the virtual 3D model The three-dimensional image is calculated. After the image is sent to the analysis module, the analysis module can analyze the virtual three-dimensional model in real time to obtain the three-dimensional image of the virtual three-dimensional model with respect to the image perspective.
接著,該分析模組為了更精確地分析該影像疊合於該虛擬三維模型上之位置,該分析模組係於該影像之輪廓上分別設置一第一參考點及一第二參考點,該第一參考點係相對於該第二參考點,其中該第一參考點與該第二參考點之選擇係選自該影像之至少二線段之焦點,接著該虛擬三維模型上分別設置一第一虛擬參考點以及一第二虛擬參考點,該第一虛擬參考點係依照該第一參考點設置於該影像之輪廓上之位置,而將該第一虛擬參考點設置於該虛擬三維模型之輪廓上之相對位置,該第二虛擬參考點係依照該第二參考點設置於該影像之輪廓上之位置,而將該第二虛擬參考點設置於該虛擬三維模型之輪廓上之相對位置,也就是說,當該分析模組判斷該影像為該虛擬三維模型之三維圖面後,即可將該第一虛擬參考點以及該第二虛擬參考點設置相對於該影像之該虛擬三維模型上,接著將該第一虛擬座標點疊合於該第一座標點後,則該第一虛擬參考點以及該第二虛擬參考點分別疊合於該第一參考點以及該第二參考點,且該第一虛擬參考點與該第二虛擬參考點疊合於該一參考點以及該第二參考點時,該虛擬三維模型之體積以及面積會隨該第一虛擬參考點以及該第二虛擬參考點疊合於該第一參考點以及該第二參考點變大或變小。Then, in order to more accurately analyze the position of the image superimposed on the virtual three-dimensional model, the analysis module sets a first reference point and a second reference point on the contour of the image, respectively, the The first reference point is relative to the second reference point, wherein the selection of the first reference point and the second reference point is selected from the focal points of at least two line segments of the image, and then a first A virtual reference point and a second virtual reference point, the first virtual reference point is set according to the position of the first reference point on the contour of the image, and the first virtual reference point is set on the contour of the virtual three-dimensional model Relative position on the image, the second virtual reference point is set on the contour of the image according to the position of the second reference point, and the relative position of the second virtual reference point on the contour of the virtual three-dimensional model is also That is, after the analysis module determines that the image is a three-dimensional image of the virtual three-dimensional model, the first virtual reference point and the second virtual reference point can be set on the virtual three-dimensional model relative to the image, Then, after the first virtual coordinate point is superimposed on the first coordinate point, the first virtual reference point and the second virtual reference point are superimposed on the first reference point and the second reference point, respectively, and the When the first virtual reference point and the second virtual reference point coincide with the one reference point and the second reference point, the volume and area of the virtual three-dimensional model will follow the first virtual reference point and the second virtual reference point The first reference point and the second reference point become larger or smaller.
以及該分析模組分析量測該影像係為該虛擬三維模型之何種視角時,先將該第一座標點與該第一虛擬座標點疊合,接著量測該影像之至少二邊長相交於一水平線之至少二夾角角度,接著判斷該虛擬三維模型之至少二虛擬邊長係為該影像之該至少二邊長相交於該水平線上係為相同線段,則將該至少二虛擬邊長相對於該水平線之至少二虛擬夾角角度調整與該至少二夾角角度相同。And when the analysis module analyzes and measures the angle of view of the virtual three-dimensional model, first overlaps the first coordinate point with the first virtual coordinate point, and then measures the intersection of at least two sides of the image At least two included angles of a horizontal line, and then determine that at least two virtual side lengths of the virtual three-dimensional model are the same line segment where the at least two side lengths of the image intersect on the horizontal line, then the at least two virtual side lengths are relative to The adjustment of the at least two virtual included angles of the horizontal line is the same as the at least two included angles.
接著,該虛擬三維模型更能夠與至少一虛擬三維元件進行疊加,其係將該至少一虛擬三維元件設置於該虛擬三維模型上,例如,該虛擬三維模型係一把沒有椅背的椅子,該至少一虛擬三維元件則設置於該虛擬三維模型上,且該至少一虛擬三維元件能夠自由地設置於該虛擬三維模型上之任何地方,且該分析模組係依照該虛擬三維模型之視角將該至少一虛擬三維元件調整成與該虛擬三維模型相同之視角,該虛擬三維模型與該至少一虛擬三維元件進行疊加後,該虛擬三維模型之該第一虛擬座標點再疊合於該影像之該第一座標點,或者,該虛擬三維模型之該第一虛擬座標點先疊合於該影像之該第一座標點後,先判斷該虛擬三維模型與該影像之相異處,接著才將該至少一虛擬三維元件疊加於該虛擬三維模型上。Then, the virtual three-dimensional model can be superimposed on at least one virtual three-dimensional element. The virtual three-dimensional element is arranged on the virtual three-dimensional model. For example, the virtual three-dimensional model is a chair without a backrest. At least one virtual three-dimensional component is set on the virtual three-dimensional model, and the at least one virtual three-dimensional component can be freely set anywhere on the virtual three-dimensional model, and the analysis module is based on the virtual three-dimensional model perspective At least one virtual three-dimensional element is adjusted to the same viewing angle as the virtual three-dimensional model. After the virtual three-dimensional model and the at least one virtual three-dimensional element are superimposed, the first virtual coordinate point of the virtual three-dimensional model is superimposed on the image of the image The first punctuation point, or, the first virtual coordinate point of the virtual three-dimensional model is first superimposed on the first coordinate point of the image, and then the difference between the virtual three-dimensional model and the image is judged, and then the At least one virtual three-dimensional element is superimposed on the virtual three-dimensional model.
接著請繼續參閱第二圖,其係為本發明之一較佳實施例之步驟示意圖,第三圖,其係本發明之一較佳實施例之做動示意圖,第四圖,其係本發明之一較佳實施例之做動示意圖,其係為如圖所示,本發明係一種擴增實境虛實比對現實物體之系統1,其包含一影像擷取裝置2、一分析模組3以及一顯示裝置4。Then please continue to refer to the second figure, which is a schematic diagram of the steps of a preferred embodiment of the present invention, the third figure, which is an action diagram of a preferred embodiment of the present invention, and the fourth figure, which is the present invention A schematic diagram of the action of a preferred embodiment, as shown in the figure, the present invention is a
該影像擷取裝置2係連接該分析模組3,且該影像擷取裝置2係對該分析模組3電性連接、網路連接、或是藍芽連接等方式,該分析模組3內包含擴增實境技術之三維影像辨識演算法,其具有非常精確的空間座標運算能力以及圖像運算能力,能夠針對三維立體影像進行計算並進行渲染,透過擴增實境技術能夠用來輔助傢俱打樣,當該影像擷取裝置2對一現實物件22進行拍攝,該影像擷取裝置2會產生一影像24,接著該影像24會傳送至該分析模組3內,該分析模組3將對該影像24進行分析,接著再與一虛擬三維模型36進行疊合,其中該虛擬三維模型36係包含於該分析模組3內,該影像24上設置一第一座標點242,該第一座標點242定義於該影像24上可由該分析模組3進行定義或是由人工進行定義該第一座標點242於該影像24上之位置,接著相對於該影像24之該第一座標點24之該虛擬三維模型36上設置一第一虛擬座標點362,其中該分析模組3係先判斷該影像24是否為該虛擬三維模型36之該現實物件22之該影像24,如果該影像24係為該虛擬三維模型36,則將該第一座標點242疊合於該第一虛擬座標點362,以及該顯示裝置4係連接該分析模組3,且該顯示裝置4與該分析模組3之連接方式係為電性連接、網路連接或是藍芽連接等,當該虛擬三維模型36之該第一虛擬座標點362與該影像24之該第一座標點242疊合後,其會顯示於該顯示裝置4上,或是該分析模組3會與該顯示裝置4同步,當該分析模組分析完該影像24後則顯示於該顯示裝置4上,接著再將該虛擬三維模型36由該分析模組3內提取並顯示於該顯示裝置4上,接著該分析模組3再將該影像24與該虛擬三維模型36進行疊合,此外,該影像24與該虛擬三維模型36之疊合也可以由人工進行疊合,其中該虛擬三維模型36與該影像24之詳細之疊合方式係為上述之說明(本段落不再贅述)。The image capture device 2 is connected to the
接著,請繼續參閱第二圖至第四圖,如圖所示,該擴增實境比對現實物體之系統1更進一步包含一比對模組32,其係設置於該分析模組3內,並與該分析模組3連接,當該分析模組3將該影像24疊合於該虛擬三維模型36後,該比對模組32能夠比對該影像24與該虛擬三維模型36之外觀上差異,如第四圖所示,當該影像24與該虛擬三維模型36疊合後,該虛擬三維模型36之椅腳的外觀弧線較大,該影像24之椅腳的弧線較小,使得該影像24與該虛擬三維模型36在外觀上產生差異,接著請繼續參閱第四A圖,其係為本發明之一較佳實施例之做動示意圖,當該比對模組32比對該影像24與該虛擬三維模型36在外觀上產生差異時,該比對模組32會於該影像24與該虛擬三維模型36在外觀上之至少一差異點368上標記至少一符號369,並同步顯示於該顯示裝置4上。Next, please continue to refer to the second to fourth figures. As shown in the figure, the augmented reality comparison
請繼續參閱第五圖,其係本發明之一較佳實施例之做動示意圖,該分析模組3內更進一步包含一建模資料庫34,該建模資料庫34內包含該虛擬三維模型36以及至少一虛擬三維元件38,該分析模組3能夠從該建模資料庫34內將該虛擬三維模型36提取出來與該影像24進行疊合,其中為了增加該虛擬三維模型36之元件,其能夠即時從該建模資料庫34內將該至少一虛擬三維元件38提取至該分析模組3,並將該至少一虛擬三維元件38與該虛擬三維模型36連接,且同步顯示於該顯示裝置4上。Please continue to refer to the fifth figure, which is an action schematic diagram of a preferred embodiment of the present invention. The
接著更進一步說明該擴增實境比對現實物體之系統1,請一併參閱第二圖至第五圖,如圖所示,本發明係用於家具打樣上,當設計師繪製完成一設計圖檔後,該設計圖檔會交給打樣師進行實體的打樣,而該設計圖檔即為該虛擬三維模型36,且該虛擬三維模型36係事先傳送至該分析模組3內,當打樣師依照該虛擬三維模型36打樣並完成該現實物件22時,其能夠使用該影像擷取裝置2對該現實物件22進行拍照,該影像擷取裝置2會產生一影像24,當該影像24傳送至該分析模組3後,該分析模組3對該影像24進行輪廓的分析,該分析模組3於該影像24上分別定義/設置一第一參考點244以及一第二參考點246,該第一參考點244係相對於該第二參考點246,其中該第一參考點244與該第二參考點246之選擇位置係選自該影像24之至少二線段248之交點,接著該虛擬三維模型36分別設置一第一虛擬參考點362以及一第二虛擬參考點364,該第一虛擬參考點362係依照該第一參考點244設置於該影像24之輪廓上之位置,而將該第一虛擬參考點362設置於該虛擬三維模型36之輪廓上之相對位置,該第二虛擬參考點364係依照該第二參考點246設置於該影像24之輪廓上之位置,而將該第二虛擬參考點364設置於該虛擬三維模型之輪廓上之相對位置,也就是說,當該分析模組3判斷該影像24為該虛擬三維模型36之三維圖面後,即可將該第一虛擬參考點362以及該第二虛擬參考點364設置相對於該影像24之該虛擬三維模型36上,接著該分析模組3將該第一虛擬座標點362疊合於該第一座標點242後,則該第一虛擬參考點364以及該第二虛擬參考點366分別疊合於該第一參考點244以及該第二參考點246,且該第一虛擬參考點364與該第二虛擬參考點366疊合於該第一參考點244以及該第二參考點246時,該虛擬三維模型36之體積以及面積會隨該第一虛擬參考點364以及該第二虛擬參考點366疊合於該第一參考點244以及該第二參考點246變大或變小,且該分析模組3係連接該顯示裝置4,使得該分析模組3能夠同步將該影像24顯示於該顯示裝置4上,並將該虛擬三維模型36疊合於該影像24上,使得打樣師能夠直接從顯示裝置4上辨認出該影像與該虛擬三維模型36之外觀差異。Next, the
接著請繼續參閱第五圖,如圖所示,當設計師與打樣師討論打樣品之現實物件需要添加其他元件或設計時,設計師能夠將其他之設計元件之圖檔傳送至該分析模組3內,設計師繪製之其他之設計元件本實施方式定義為至少一虛擬三維元件38,其中該分析模組3包含擴增實境技術的三維影像辨識演算法,且該分析模組3內更包含該建模資料庫34,且該建模資料庫34能夠存取該虛擬三維模型36以及該至少一虛擬三維元件38,其中該虛擬三維影像36係具有正確之尺寸,該至少一虛擬三維元件38係由該建模資料庫34內取出,並設置於該虛擬三維模型36上,本實施方式係以椅子打樣進行說明,該虛擬三維模型36係為一張沒有椅背的椅子,該至少一虛擬三維元件係為椅子之椅背,設計師與打樣師討論後,希望椅子要有椅背,且為了使打樣師更能夠了解設計師的想法,於是由該建模資料庫34內將該至少一虛擬三維元件38取出,並疊加於該虛擬三維模型36上,且該分析模組3係依照該虛擬三維模型36之視角,將該至少一虛擬三維元件38調整成與該虛擬三維模型36相同之視角,其中該至少一虛擬三維元件38能夠自由地疊加於該虛擬三維模型36上,當該虛擬三維模型36與該至少一虛擬三維元件38疊加後,該虛擬三維模型36之該第一虛擬座標點362再疊合於該影像24之該第一座標點242,或者,該虛擬三維模型36之該第一虛擬座標點362先疊合於該第一座標點242後,先判斷該虛擬三維模型36與該影像24之相異處,接著才將該至少一虛擬三維元件38疊加於該虛擬三維模型36上。Then please continue to refer to the fifth figure. As shown in the figure, when the designer and the proofer discuss that the actual object of the sample needs to add other components or designs, the designer can send the drawing files of other design components to the analysis module Within 3, other design elements drawn by the designer are defined as at least one virtual three-
惟以上所述者,僅為本發明之較佳實施例而已,並非用來限定本發明實施之範圍,舉凡依本發明申請專利範圍所述之形狀、構造、特徵及精神所為之均等變化與修飾,均應包括於本發明之申請專利範圍內。However, the above are only the preferred embodiments of the present invention and are not intended to limit the scope of the implementation of the present invention. Any changes and modifications based on the shape, structure, features and spirit described in the patent application scope of the present invention , Should be included in the scope of the patent application of the present invention.
1:擴增實境比對現實物體之系統2:影像擷取裝置22:現實物件24:影像242:第一座標點244:第一參考點246:第二參考點248:二線段3:分析模組32:比對模組34:建模資料庫36:虛擬三維模型362:第一虛擬座標點364:第一虛擬參考點366:第二虛擬參考點368:差異點369:符號38:虛擬三維元件4:顯示裝置S10~S16:步驟1: Augmented reality comparison system for real objects 2: Image capture device 22: Real objects 24: Image 242: First coordinate point 244: First reference point 246: Second reference point 248: Second line segment 3: Analysis Module 32: Comparison module 34: Modeling database 36: Virtual three-dimensional model 362: First virtual coordinate point 364: First virtual reference point 366: Second virtual reference point 368: Difference point 369: Symbol 38: Virtual Three-dimensional element 4: display devices S10 to S16: steps
第一圖:其係為本發明之一較佳實施例之步驟流程圖; 第二圖:其係為本發明之一較佳實施例之步驟示意圖; 第三圖:其係為本發明之一較佳實施例之做動示意圖; 第四圖:其係為本發明之一較佳實施例之做動示意圖; 第四A圖:其係為本發明之一較佳實施例之做動示意圖;以及 第五圖:其係為本發明之一較佳實施例之做動示意圖。The first figure: it is a flow chart of the steps of a preferred embodiment of the present invention; the second figure: it is a schematic diagram of the steps of a preferred embodiment of the present invention; the third figure: it is one of the present invention The actuation diagram of the preferred embodiment; the fourth figure: it is the actuation diagram of a preferred embodiment of the invention; the fourth A: it is the actuation diagram of a preferred embodiment of the invention; And the fifth figure: it is a schematic diagram of actuation of a preferred embodiment of the present invention.
S10~S16:步驟 S10~S16: Step
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107139217A TWI680670B (en) | 2018-11-05 | 2018-11-05 | Method and system for augmented reality comparison with real objects |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107139217A TWI680670B (en) | 2018-11-05 | 2018-11-05 | Method and system for augmented reality comparison with real objects |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI680670B TWI680670B (en) | 2019-12-21 |
TW202019169A true TW202019169A (en) | 2020-05-16 |
Family
ID=69582650
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107139217A TWI680670B (en) | 2018-11-05 | 2018-11-05 | Method and system for augmented reality comparison with real objects |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI680670B (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI222039B (en) * | 2000-06-26 | 2004-10-11 | Iwane Lab Ltd | Information conversion system |
EP2602588A1 (en) * | 2011-12-06 | 2013-06-12 | Hexagon Technology Center GmbH | Position and Orientation Determination in 6-DOF |
CN105100495B (en) * | 2015-08-25 | 2018-04-13 | 李万鸿 | A kind of method using mobile phone camera functional measurement object plane size |
CN206741556U (en) * | 2017-05-22 | 2017-12-12 | 埃洛克航空科技(北京)有限公司 | A kind of three-dimensional modeling data acquisition system based on dynamic object |
-
2018
- 2018-11-05 TW TW107139217A patent/TWI680670B/en active
Also Published As
Publication number | Publication date |
---|---|
TWI680670B (en) | 2019-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11804027B2 (en) | Method for generating a customized/personalized head related transfer function | |
US11423556B2 (en) | Methods and systems to modify two dimensional facial images in a video to generate, in real-time, facial images that appear three dimensional | |
US11580697B2 (en) | Systems and methods for reconstruction and rendering of viewpoint-adaptive three-dimensional (3D) personas | |
JP7200439B1 (en) | Avatar display device, avatar generation device and program | |
KR102069964B1 (en) | Virtual reality-based apparatus and method to generate a three dimensional(3d) human face model using image and depth data | |
US10311508B2 (en) | Garment modeling simulation system and process | |
US11399141B2 (en) | Processing holographic videos | |
Zhao et al. | 3-D reconstruction of human body shape from a single commodity depth camera | |
KR20170019779A (en) | Method and Apparatus for detection of 3D Face Model Using Portable Camera | |
KR20150113751A (en) | Method and apparatus for acquiring three-dimensional face model using portable camera | |
JP2004537082A (en) | Real-time virtual viewpoint in virtual reality environment | |
CN104599317A (en) | Mobile terminal and method for achieving 3D (three-dimensional) scanning modeling function | |
TWI750710B (en) | Image processing method and apparatus, image processing device and storage medium | |
JPH10240908A (en) | Video composing method | |
CN110852934A (en) | Image processing method and apparatus, image device, and storage medium | |
TWI680670B (en) | Method and system for augmented reality comparison with real objects | |
CN104616287A (en) | Mobile terminal for 3D image acquisition and 3D printing and method | |
JP2014086773A (en) | Video communication system and video communication method | |
JP4984257B2 (en) | Venue setting simulation device, program, medium, simple image deformation synthesis method | |
CN104702937A (en) | Multi-camera 3D image acquisition and printing mobile terminal and method | |
Baek et al. | Gaze correction using feature-based view morphing and performance evaluation | |
Bai et al. | Research on custom-tailored swimming goggles applied to the internet | |
CN113658304A (en) | Animation method of target object and related device and equipment | |
TW201919386A (en) | Mixed reality projection apparatus and method thereof | |
KR20040067730A (en) | Creation system and method of Real-3D Picture Avatar that uses range scanner |