TWM592332U - An augmented reality multi-screen array integration system - Google Patents

An augmented reality multi-screen array integration system Download PDF

Info

Publication number
TWM592332U
TWM592332U TW108213798U TW108213798U TWM592332U TW M592332 U TWM592332 U TW M592332U TW 108213798 U TW108213798 U TW 108213798U TW 108213798 U TW108213798 U TW 108213798U TW M592332 U TWM592332 U TW M592332U
Authority
TW
Taiwan
Prior art keywords
module
screen
display
user
augmented reality
Prior art date
Application number
TW108213798U
Other languages
Chinese (zh)
Inventor
梁媛婷
姜崇熙
林峰輝
薛人俊
Original Assignee
維爾歐德股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 維爾歐德股份有限公司 filed Critical 維爾歐德股份有限公司
Priority to TW108213798U priority Critical patent/TWM592332U/en
Publication of TWM592332U publication Critical patent/TWM592332U/en

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

一種擴增實境多螢幕陣列整合系統,包含有至少一用戶系統與一展示系統,該用戶系統乃透過一互動裝置的鏡頭辨識實景本身,根據辨識與操作產生擴增於實境的虛擬物件或效果,並與實景互動產生結果;前述的展示系統與用戶系統連線,提供用戶系統辨識的畫面、用戶系統之所示結果為展示系統投放在實景的整合畫面以及將前述的整合資料或畫面資訊回傳到用戶系統,再者,展示系統具有自己演示畫面,透過連結投影設備將畫面投放在實景,當接收到用戶系統地同步資料,會將同步的資料經過運算整合於畫面,讓使用者與參與者一同感受實景、互動的結構。An augmented reality multi-screen array integrated system includes at least one user system and a display system. The user system recognizes the real scene itself through the lens of an interactive device, and generates virtual objects augmented in the real world according to the recognition and operation Effect, and interact with the real scene to produce results; the aforementioned display system connects with the user system to provide the screen recognized by the user system, and the results shown by the user system are the integrated screen of the live system displayed by the display system and the aforementioned integrated data or screen information Back to the user system, the display system has its own demonstration screen, the screen is projected into the real scene by connecting the projection device, when the user system synchronizes the data, the synchronized data will be integrated into the screen through calculation, allowing the user to Participants experience the real scene and interactive structure together.

Description

一種擴增實境多螢幕陣列整合系統Augmented reality multi-screen array integration system

本創作關於擴增實境領域,特別是指一種擴增實境多螢幕陣列整合系統,讓其他觀眾能感受使用者視覺體驗之設備者。This creation relates to the field of augmented reality, especially refers to an augmented reality multi-screen array integration system that allows other viewers to experience the user's visual experience.

隨著行動裝置運算能力增長,使得輕薄短小的手機除了可以拍攝影像外也可以播放影片。但是,在先前技術中靜態影像或動態影片只能顯示當時情景,無法與使用者進行任何互動。With the increase in computing power of mobile devices, thin and thin mobile phones can play videos in addition to shooting images. However, in the prior art, static images or dynamic videos can only display the scene at that time, and cannot perform any interaction with the user.

為了能提供互動功能,因此發展出擴增實境(Augmented Reality , AR)的功能,擴增實境是一種實時地計算(物流即時管理技術特別是用在AR)攝影機影像的位置及角度並加上相應圖像、影像、聲音或其他多媒體物件的技術,此種技術的目標是在顯示螢幕上將虛擬的物件套用在現實世界的影像,使用者可以與虛擬物件進行互動。In order to provide interactive functions, the function of Augmented Reality (AR) has been developed. Augmented reality is a real-time calculation (real-time logistics management technology, especially used in AR) of the position and angle of camera images. The corresponding image, video, sound or other multimedia object technology. The goal of this technology is to apply the virtual object to the real-world image on the display screen. The user can interact with the virtual object.

前述的系統運用於遊戲上,使用者(用戶)可以享受遊戲的樂趣,但是卻無法讓周遭的觀眾觀賞互動過程與互動中的遊戲畫面,讓前述技術運用上大打折扣。The aforementioned system is used in games. Users (users) can enjoy the fun of the game, but they cannot allow the surrounding audience to watch the interactive process and the interactive game screen, which greatly reduces the application of the aforementioned technology.

如何讓單一用戶或者多名用戶在互動過程進行整合與運算,同時藉著投影技術加以展示,讓觀眾一同享受遊戲的過程,乃業者積極開發之課題。How to allow a single user or multiple users to integrate and calculate in the interactive process, and at the same time display it through projection technology, so that the audience can enjoy the game process together, is a subject actively developed by the industry.

本創作之目的即在於改善上述之缺點,包含有至少一用戶系統與一展示系統,該用戶系統乃透過一互動裝置的鏡頭辨識實景本身,根據辨識與操作產生擴增於實境的虛擬物件或效果,並與實景互動產生結果;前述的展示系統與用戶系統連線,該展示系統投放給用戶系統互動辨識的畫面,同時整合及投放用戶系統的互動結果與相關資訊,再回傳到用戶系統的互動裝置之畫面。The purpose of this creation is to improve the above-mentioned shortcomings, including at least one user system and a display system. The user system recognizes the real scene itself through the lens of an interactive device, and generates virtual objects or augmented reality based on the recognition and operation Effects, and interact with the real scene to produce results; the aforementioned display system is connected to the user system, the display system is placed on the screen of the user system interaction recognition, and the interaction results and related information of the user system are integrated and placed, and then returned to the user system Of the interactive device.

可達到上述目的之結構者,主要包含有:至少一用戶系統(1)與一展示系統(2)所構成;The structure that can achieve the above purpose mainly includes: at least one user system (1) and a display system (2);

前述的用戶系統(1)具有一提供使用者操控裝置(10),該使用者操控裝置內設有一擴增實境模組(11)、一運算模組(12)、一操作模組(13)、一顯示模組(14)、一無線通訊模組(15);前述的擴增實境模組(11)將現實世界的圖像序列進行視覺分析所估計出的裝置姿態資訊結合,計算出虛擬世界與現實世界之間的映射;所述的運算模組(12)產生虛擬物件或效果,以及虛擬互動區域;所述的操作模組(13)透過觸碰該使用者操控裝置(10)顯示畫面、移動及旋轉裝置、或將該使用者操控裝置(10)將操作行為的訊息輸入;該顯示模組(14)整合攝影圖像、虛擬物件或效果、資訊介面等畫面輸出;該無線通訊模組(15)負責將運算資訊傳送展示系統(2),也會接受由展示系統(2)回傳送來的運算資訊;The aforementioned user system (1) has a user control device (10) provided with an augmented reality module (11), a computing module (12), and an operation module (13) ), a display module (14), a wireless communication module (15); the aforementioned augmented reality module (11) combines device posture information estimated by visual analysis of real-world image sequences to calculate Mapping between the virtual world and the real world; the computing module (12) generates virtual objects or effects and virtual interaction areas; the operating module (13) controls the device (10) by touching the user ) Display screen, moving and rotating device, or input information of operation behavior by the user control device (10); the display module (14) integrates the screen output of photographic images, virtual objects or effects, information interface, etc.; The wireless communication module (15) is responsible for transmitting the computing information to the display system (2), and also accepts the computing information transmitted from the display system (2)

該展示系統(2)與該用戶系統(1)連線,該展示系統(2)用於投放給用戶系統(1)互動辨識的畫面、接收用戶系統(1)所傳來的映射資訊以及將映射的實景回傳到用戶系統(1),該展示系統(2)包含有一伺服器模組(21)、一畫面展示模組(22)及一通信模組(23),該通信模組(23)與該無線通訊模組(15)連接,接收該無線通訊模組(15)的資訊後將資訊傳遞至該伺服器模組(21),該伺服器模組(21)用於整合該用戶系統(1)的畫面後提供到該畫面展示模組(22)及傳回用戶系統(1)。The display system (2) is connected to the user system (1). The display system (2) is used to display interactive identification screens to the user system (1), receive mapping information from the user system (1), and convert The mapped real scene is transmitted back to the user system (1). The display system (2) includes a server module (21), a picture display module (22), and a communication module (23). The communication module (23) 23) Connect with the wireless communication module (15), receive the information of the wireless communication module (15) and transmit the information to the server module (21), the server module (21) is used to integrate the The screen of the user system (1) is provided to the screen display module (22) and transmitted back to the user system (1).

據此,用戶系統(1)的內容可融合數位互動,應用場景多半在各類主題樂園、不限主題的展覽性場館、半開放或密閉性場所,以及公眾場域等設施。利用本創作的技術運用的範圍與產業也跟著日益擴大。According to this, the content of the user system (1) can be integrated with digital interaction, and the application scenarios are mostly in various theme parks, exhibition venues with unlimited themes, semi-open or closed places, and public venues and other facilities. The scope and industry of the technology used in this creation has also expanded.

在本創作的實施例中,該擴增實境模組(11)更包括有一攝影模組(111)、一影像處理模組(112)、一慣性量測模組(113)與一影像資料庫(114);該攝影模組(111)利用採集到的圖像傳送給該影像處理模組(112),該影像處理模組(112)將前述的攝影模組(111)傳遞的資料進行分析,該慣性量測模組(113)偵測該使用者操控裝置(10),依據三軸姿態角(或角速率)以及加速度產生不同畫面變化,該影像資料庫(114)用於辨識圖像的資料儲存庫。In the embodiment of the present invention, the augmented reality module (11) further includes a photography module (111), an image processing module (112), an inertial measurement module (113) and an image data Library (114); the photographing module (111) uses the collected images to transmit to the image processing module (112), the image processing module (112) carries out the data transmitted by the aforementioned photographing module (111) According to the analysis, the inertial measurement module (113) detects the user control device (10) and generates different screen changes according to the three-axis attitude angle (or angular rate) and acceleration, and the image database (114) is used to identify the image Like a data repository.

在本創作的實施例中,該伺服器模組(21)包含一伺服器運算組件(211)及一伺服器資料儲存區(212),該伺服器運算組件(211)主要接收用戶系統(1)的資訊產生互動內容並運算互動結果,該伺服器資料儲存區(212)乃為前述伺服器運算組件(211)互動內容的資料庫。In the embodiment of the present invention, the server module (21) includes a server computing component (211) and a server data storage area (212). The server computing component (211) mainly receives the user system (1) ) Information generates interactive content and computes interactive results. The server data storage area (212) is a database of interactive content of the aforementioned server computing component (211).

在本創作的實施例中,該無線通訊模組(15)與該通信模組(23)之間採用無線通訊技術傳輸資訊。In the embodiment of the present invention, wireless communication technology is used to transmit information between the wireless communication module (15) and the communication module (23).

在前述的實施例中,該無線通訊模組(15)與該通信模組(23)可採用藍芽傳輸或者WIFI傳輸。In the foregoing embodiment, the wireless communication module (15) and the communication module (23) may use Bluetooth transmission or WIFI transmission.

運用本創作的系統,可以得到下列的優點:Using the system of this creation, you can get the following advantages:

1.使用者透過用戶系統(1)、展示系統(2)能整合實景產生自己的操作畫面,增加互動效果,展示系統(2)產生互動辨識的畫面,用戶則依據畫面產生不同對應的動作,並且展示系統(1)接收到用戶系統(1)的資訊後一方面顯示於投影畫面上,另一方面回傳到用戶系統的使用者操控裝置(10)。1. The user can integrate the real scene to generate his own operation screen through the user system (1) and the display system (2) to increase the interactive effect, and the display system (2) generates the interactive recognition screen, and the user generates different corresponding actions according to the screen. And the display system (1) receives the information of the user system (1) and then displays it on the projection screen, on the other hand, it is transmitted back to the user control device (10) of the user system.

2.展示系統(2)在不消耗用戶系統(1)的資源下可展示出實景互動的演示畫面,當用戶系統(1)在互動的過程中有碰撞等互動動作時,在接收用戶系統(1)的資訊後,即時運算出互動反應與更新演示畫面與顯示結果,並且回傳到用戶系統(1)更新畫面及相關互動資訊。2. The display system (2) can display the real-world interactive demo screen without consuming the resources of the user system (1). When the user system (1) has interactive actions such as collisions during the interaction, the receiving user system (2) After the information of 1), the interactive reaction and the updated presentation screen and display result are calculated in real time, and then returned to the user system (1) The updated screen and related interactive information.

3.本創作更可結合擴充實景(AR)、廣告互動及創作體驗,以塗鴉遊戲來說,例如塗鴉的圖形是某廠商的商標、商品等,能在互動的過程中對使用者、觀眾直接行銷,大幅增加廣告效果。3. This creation can also be combined with augmented reality (AR), advertising interaction and creative experience. In the case of graffiti games, for example, the graphics of graffiti are the trademarks and commodities of a certain manufacturer, which can directly interact with users and audiences during the interaction process. Marketing, greatly increase the effectiveness of advertising.

4.本創作能運用在觀光景點、展覽會館、半開放或密閉區域、公共場所;舉例來說:國內每一家遊樂園都有不同的主題,廠商可以透過本創作所提供的系統讓關鍵決定者體驗,讓關鍵決定者決定出較佳的旅遊景點,減少客戶抱怨。4. This creation can be used in tourist attractions, exhibition halls, semi-open or confined areas, public places; for example: every amusement park in China has a different theme, and manufacturers can use the system provided by this creation to let key decision-makers Experience allows key decision-makers to decide on better tourist attractions and reduce customer complaints.

5.本創作可同時由多個使用者同時操控用戶系統(1),透過一組展示系統(2)將多屏畫面串聯整合後透過顯示模組(22)將畫面加以整合投影,並將映射資訊回傳,免除習用設備需要以複雜的線路接設造成的困擾。5. In this creation, multiple users can simultaneously control the user system (1), integrate multiple screens in series through a set of display systems (2), then integrate and project the screens through the display module (22), and map The information is transmitted back to avoid the trouble caused by the complicated wiring of conventional equipment.

請參閱第1至6圖,本創作一種擴增實境多螢幕陣列整合系統主要包含有:二組用戶系統(1)與一展示系統(2)所構成,在第1至6圖的說明主要以遊戲作為互動說明,但是本創作的系統功能並不局限於此,在此先行聲明。Please refer to Figures 1 to 6, the creation of an augmented reality multi-screen array integration system mainly includes: two groups of user systems (1) and a display system (2), the main descriptions in Figures 1 to 6 The game is used as an interactive description, but the system function of this creation is not limited to this, and it is declared here.

如第1、2、4、5圖所示,前述的用戶系統(1)具有一提供使用者操控裝置(10),該使用者操控裝置內設有一擴增實境模組(11)、一運算模組(12)、一操作模組(13)、一顯示模組(14)、一無線通訊模組(15);前述的擴增實境模組(11)將現實世界的圖像序列進行視覺分析所估計出的裝置姿態資訊結合,計算出虛擬世界與現實世界之間的映射;所述的運算模組(12)產生虛擬物件或效果,以及虛擬互動區域;所述的操作模組(13)透過觸碰該使用者操控裝置(10)顯示畫面、移動及旋轉裝置、或將該使用者操控裝置(10)將操作行為的訊息輸入;該顯示模組(14)整合攝影圖像、虛擬物件或效果、資訊介面等畫面輸出;該無線通訊模組(15)負責將運算資訊傳送展示系統(2),也會接受由展示系統(2)傳送來的運算資訊,並即時更新該顯示模組(14)的畫面。As shown in Figures 1, 2, 4, and 5, the aforementioned user system (1) has a user control device (10) provided with an augmented reality module (11), a Operation module (12), an operation module (13), a display module (14), a wireless communication module (15); the aforementioned augmented reality module (11) combines real-world image sequences Perform visual analysis to estimate the posture information of the device in combination to calculate the mapping between the virtual world and the real world; the computing module (12) generates virtual objects or effects, and a virtual interaction area; the operating module (13) Touch the user control device (10) to display the screen, move and rotate the device, or input the user control device (10) to the operation behavior information; the display module (14) integrates the photographic image , Virtual objects or effects, information interface and other screen output; the wireless communication module (15) is responsible for transmitting the computing information to the display system (2), and will also receive the computing information sent by the display system (2) and update the real-time The screen of the module (14) is displayed.

如第1、2圖所示,該擴增實境模組(11)更包括有一攝影模組(111)、一影像處理模組(112)、一慣性量測模組(113)與一影像資料庫(114);該攝影模組(111)利用採集到的圖像傳送給該影像處理模組(112),該影像處理模組(112)將前述的攝影模組(111)傳遞的資料進行分析,該慣性量測模組(113)偵測該使用者操控裝置(10),依據三軸姿態角、或者角速率、或者加速度產生不同畫面變化,該影像資料庫(114)用於辨識圖像的資料儲存庫。As shown in Figures 1 and 2, the augmented reality module (11) further includes a camera module (111), an image processing module (112), an inertial measurement module (113) and an image Database (114); the photographing module (111) uses the collected image to transmit to the image processing module (112), the image processing module (112) transfers the data transmitted by the aforementioned photographing module (111) For analysis, the inertial measurement module (113) detects the user control device (10) and generates different screen changes according to the three-axis attitude angle, or angular rate, or acceleration, and the image database (114) is used for identification Image data repository.

如第1、3圖所示,該展示系統(2)用於投放給用戶系統(1)互動辨識的畫面、接收用戶系統(1)所傳來的映射資訊以及將映射的實景回傳到用戶系統(1),該展示系統(2)包含有一伺服器模組(21)、一畫面展示模組(22)及一通信模組(23),該通信模組(23)與該無線通訊模組(15)連接,接收該無線通訊模組(15)的資訊後將資訊傳遞至該伺服器模組(21),該伺服器模組(21)用於整合該用戶系統(1)的畫面後提供到該畫面展示模組(22)以及回傳到該用戶系統(1)更新顯示模組(14)的畫面。As shown in Figures 1 and 3, the display system (2) is used to present to the user system (1) interactive identification screens, receive mapping information from the user system (1), and return the mapped real scene to the user System (1), the display system (2) includes a server module (21), a picture display module (22) and a communication module (23), the communication module (23) and the wireless communication module Group (15) connection, receiving the information of the wireless communication module (15) and transmitting the information to the server module (21), the server module (21) is used to integrate the screen of the user system (1) Then provide the screen to the screen display module (22) and return to the user system (1) to update the display module (14).

該伺服器模組(21)包含一伺服器運算組件(211)及一伺服器資料儲存區(212),該伺服器運算組件(211)主要接收用戶系統(1)的資訊產生互動內容並運算互動結果,該伺服器資料儲存區(212)乃為前述伺服器運算組件(211)互動內容的資料庫。The server module (21) includes a server computing component (211) and a server data storage area (212). The server computing component (211) mainly receives information from the user system (1) to generate interactive content and perform operations As a result of the interaction, the server data storage area (212) is a database of the interactive content of the aforementioned server computing component (211).

其中,該無線通訊模組(15)與該通信模組(23)之間採用無線通訊技術傳輸資訊;該無線通訊模組(15)與該通信模組(23)可採用藍芽傳輸或者WIFI傳輸。Among them, the wireless communication module (15) and the communication module (23) use wireless communication technology to transmit information; the wireless communication module (15) and the communication module (23) can use Bluetooth transmission or WIFI transmission.

如第4圖所示,係本創作主要的實施方式,該用戶系統(1)可以選用智慧型裝置、頭戴式顯示器等設備;該展示系統(2)可透過行動裝置、或者桌上型電腦、或者筆記型電腦並且配合一投影設備將該用戶系統(1)的畫面加以顯示。As shown in Figure 4, the main embodiment of this creation, the user system (1) can use smart devices, head-mounted displays and other equipment; the display system (2) can be through mobile devices or desktop computers Or a notebook computer and cooperate with a projection device to display the screen of the user system (1).

如第5圖所示係本創作的實際實施例;係應用在遊戲上,使用者透過用戶系統(1)的使用者操控裝置(10)對準該展示系統(2)所產生的一實景畫面,藉由該擴增實境模組(11)將實景進行圖像序列進行視覺分析,實際上從攝影模組(111)取得圖像,影像處理模組(112)將前述的圖像進行分析,在遊戲過程中,該使用者操控裝置(10)依據由係畫面有不同的姿勢利用該慣性量測模組(113)產生畫面翻轉、左右移動,而遊戲的畫面則從該影像資料庫(114)提出對應的圖像並產生對應的擴增實景畫面;利用運算模組(12)、操作模組(13)、顯示模組(14)產生互動的功能,例如:透過該擴增實境模組(11)對準一實景,該擴增實境模組(11)依據實景產生數個不同的區塊,並且有互動物件,使用者依據畫面的提示身體產生不同動作增加互動的刺激效果。其中,二組用戶系統(1)一同進行遊戲時,用戶之間彼此互相合作,且展示系統(2)將互動畫面、相關互動資料等資訊即時回傳到用戶系統(1)更新畫面,讓用戶系統(1)與展示系統(2)同步,增加趣味性。As shown in Figure 5, it is the actual embodiment of the creation; it is applied to the game, and the user aligns a real scene generated by the display system (2) through the user control device (10) of the user system (1) Through the augmented reality module (11), the real scene is subjected to image sequence for visual analysis, in fact, the image is obtained from the photography module (111), and the image processing module (112) analyzes the aforementioned image During the game, the user control device (10) uses the inertial measurement module (113) to generate a screen flip and move left and right according to the different postures of the system screen, and the game screen is taken from the image database ( 114) Propose corresponding images and generate corresponding augmented reality screens; use computing module (12), operation module (13), and display module (14) to generate interactive functions, for example, through the augmented reality The module (11) is aimed at a real scene. The augmented reality module (11) generates several different blocks according to the real scene, and there are interactive objects. The user generates different actions according to the prompts of the screen to increase the interactive stimulation effect. . Among them, when two groups of user systems (1) play games together, the users cooperate with each other, and the display system (2) returns the interactive screen, related interactive data and other information to the user system (1) to update the screen in real time, allowing users to The system (1) is synchronized with the display system (2) to increase the fun.

如第6圖所示,使用者利用用戶系統(1)進行遊戲,而周遭的觀眾、參與者感受使用者遊戲過程該展示系統(2)除了提供用於辨識的畫面,進一步該通信模組(23)接收來自該用戶系統(1)的資訊後,透過伺服器模組(21)對畫面進行計算後,利用該顯示模組(22)將遊戲畫面加以顯示;其中,展示系統(2)接收到用戶系統(1)的資訊後,經過計算分析後加以展示。因此,在不占用用戶系統(1)的資源,讓用戶系統(1)能夠順利進行;接著,展示系統(2)將運算後的資訊回傳到該用戶系統(1),更新該顯示模組(14)的畫面。As shown in Figure 6, the user uses the user system (1) to play games, and the surrounding audience and participants feel the user's game process. The display system (2) provides a screen for identification, and further the communication module ( 23) After receiving the information from the user system (1), after calculating the screen through the server module (21), the display module (22) is used to display the game screen; wherein, the display system (2) receives After the information of the user system (1) is reached, it is displayed after calculation and analysis. Therefore, without occupying the resources of the user system (1), the user system (1) can proceed smoothly; then, the display system (2) returns the calculated information to the user system (1) and updates the display module (14).

除了前述的遊戲方式外,亦可運用在觀光景點、廣告置入,能大幅提升產品行銷。In addition to the aforementioned game methods, it can also be used in sightseeing spots and advertisement placement, which can greatly improve product marketing.

綜上所述,本創作結構均未曾見於諸書刊或公開使用,誠符合新型專利申請要件,懇請 鈞局明鑑,早日准予專利,至為感禱。In summary, this creative structure has not been seen in various books or public use, since it meets the requirements of the new type of patent application, I urge the Jun Bureau to learn from it and grant the patent as soon as possible.

需陳明者,以上所述乃是本創作之具體實施立即所運用之技術原理,若依本創作之構想所作之改變,其所產生之功能仍未超出說明書及圖式所涵蓋之精神時,均應在本創作之範圍內,合予陳明。To be clear, the above is the technical principle immediately used in the specific implementation of this creation. If the changes made in accordance with the concept of this creation, the function produced does not exceed the spirit covered by the description and drawings, All should be within the scope of this creation, to Chen Ming.

(1):用戶系統 (10):使用者操控裝置 (11):擴增實境模組 (111):攝影模組 (112):影像處理模組 (113):慣性量測模組 (114):影像資料庫 (12):運算模組 (13):操作模組 (14):顯示模組 (15):無線通訊模組 (2):展示系統 (21):伺服器模組 (211):伺服器運算組件 (212):伺服器資料儲存區 (22):畫面展示模組 (23):通信模組(1): User system (10): User controls the device (11): Augmented reality module (111): Photography module (112): Image processing module (113): Inertial measurement module (114): Image database (12): Operation module (13): Operation module (14): Display module (15): Wireless communication module (2): Display system (21): Server module (211): Server computing component (212): Server data storage area (22): Screen display module (23): Communication module

第1圖係本創作的系統圖。 第2圖係用戶系統的動作流程圖。 第3圖係展示系統的動作流程圖。 第4圖係本創作較佳實施例的結構圖。 第5圖係本創作用戶系統的控制示意圖。 第6圖係本創作展示系統的控制示意圖。 Figure 1 is a system diagram of this creation. Figure 2 is a flowchart of the operation of the user system. Figure 3 is a flow chart showing the operation of the system. Figure 4 is a structural diagram of the preferred embodiment of the present creation. Figure 5 is a schematic diagram of the control of the authoring user system. Figure 6 is a schematic diagram of the control of this creative display system.

(1):用戶系統 (1): User system

(10):使用者操控裝置 (10): User controls the device

(11):擴增實境模組 (11): Augmented reality module

(111):攝影模組 (111): Photography module

(112):影像處理模組 (112): Image processing module

(113):慣性量測模組 (113): Inertial measurement module

(114):影像資料庫 (114): Image database

(12):運算模組 (12): Operation module

(13):操作模組 (13): Operation module

(14):顯示模組 (14): Display module

(15):無線通訊模組 (15): Wireless communication module

(2):展示系統 (2): Display system

(21):伺服器模組 (21): Server module

(211):伺服器運算組件 (211): Server computing component

(212):伺服器資料儲存區 (212): Server data storage area

(22):畫面展示模組 (22): Screen display module

(23):通信模組 (23): Communication module

Claims (7)

一種擴增實境多螢幕陣列整合系統,主要包含有:至少一用戶系統(1)與一展示系統(2)所構成; 前述的用戶系統(1)具有一提供使用者操控裝置(10),該使用者操控裝置內設有一擴增實境模組(11)、一運算模組(12)、一操作模組(13)、一顯示模組(14)、一無線通訊模組(15);前述的擴增實境模組(11)將現實世界的圖像序列進行視覺分析所估計出的裝置姿態資訊結合,計算出虛擬世界與現實世界之間的映射;所述的運算模組(12)產生虛擬物件或效果,以及虛擬互動區域;所述的操作模組(13)透過觸碰該使用者操控裝置(10)顯示畫面、移動及旋轉裝置、或將該使用者操控裝置(10)將操作行為的訊息輸入;該顯示模組(14)整合攝影圖像、虛擬物件或效果、資訊介面等畫面輸出;該無線通訊模組(15)負責將運算資訊傳送展示系統(2),也會接受由展示系統(2)回傳送來的運算資訊或者互動資料; 該展示系統(2)用於投放給用戶系統(1)互動辨識的畫面、接收用戶系統(1)所傳來的映射資訊以及將映射的實景回傳到用戶系統(1),該展示系統(2)包含有一伺服器模組(21)、一畫面展示模組(22)及一通信模組(23),該通信模組(23)與該無線通訊模組(15)連接,接收該無線通訊模組(15)的資訊後將資訊傳遞至該伺服器模組(21),該伺服器模組(21)用於整合該用戶系統(1)的畫面後提供到該畫面展示模組(22) 以及回傳資料到該用戶系統(1)更新顯示模組(14)的畫面。 An augmented reality multi-screen array integration system mainly includes: at least one user system (1) and one display system (2); The aforementioned user system (1) has a user control device (10) provided with an augmented reality module (11), a computing module (12), and an operation module (13) ), a display module (14), a wireless communication module (15); the aforementioned augmented reality module (11) combines device posture information estimated by visual analysis of real-world image sequences to calculate Mapping between the virtual world and the real world; the computing module (12) generates virtual objects or effects and virtual interaction areas; the operating module (13) controls the device (10) by touching the user ) Display screen, moving and rotating device, or input information of operation behavior by the user control device (10); the display module (14) integrates the screen output of photographic images, virtual objects or effects, information interface, etc.; The wireless communication module (15) is responsible for transmitting the computing information to the display system (2), and also accepts the computing information or interactive data sent back from the display system (2); The display system (2) is used to display images for interactive identification of the user system (1), receive mapping information from the user system (1), and return the mapped real scene to the user system (1). 2) It includes a server module (21), a picture display module (22) and a communication module (23). The communication module (23) is connected to the wireless communication module (15) to receive the wireless The information of the communication module (15) then transmits the information to the server module (21), which is used to integrate the screen of the user system (1) and provide it to the screen display module ( 22) And return the data to the user system (1) to update the display module (14) screen. 如申請專利範圍第1項所述之一種擴增實境多螢幕陣列整合系統,其中,該擴增實境模組(11)更包括有一攝影模組(111)、一影像處理模組(112)、一慣性量測模組(113)與一影像資料庫(114);該攝影模組(111)利用採集到的圖像傳送給該影像處理模組(112),該影像處理模組(112)將前述的攝影模組(111)傳遞的資料進行分析,該慣性量測模組(113)偵測該使用者操控裝置(10),依據三軸姿態角、或者角速率、或者加速度產生不同畫面變化,該影像資料庫(114)用於辨識圖像的資料儲存庫。An augmented reality multi-screen array integration system as described in item 1 of the patent scope, wherein the augmented reality module (11) further includes a photography module (111) and an image processing module (112) ), an inertial measurement module (113) and an image database (114); the photography module (111) uses the collected images to send to the image processing module (112), the image processing module ( 112) Analyze the data transmitted by the aforementioned photography module (111), the inertial measurement module (113) detects the user control device (10), and generates it according to the three-axis attitude angle, or angular rate, or acceleration Different image changes, the image database (114) is used to identify the image data repository. 如申請專利範圍第1項所述之一種擴增實境多螢幕陣列整合系統,其中,該伺服器模組(21)包含一伺服器運算組件(211)及一伺服器資料儲存區(212),該伺服器運算組件(211)主要接收用戶系統(1)的資訊產生互動內容並運算互動結果,該伺服器資料儲存區(212)乃為前述伺服器運算組件(211)互動內容的資料庫。An augmented reality multi-screen array integration system as described in item 1 of the patent scope, wherein the server module (21) includes a server computing component (211) and a server data storage area (212) The server computing component (211) mainly receives information from the user system (1) to generate interactive content and compute interactive results. The server data storage area (212) is a database of interactive content of the aforementioned server computing component (211) . 如申請專利範圍第1項所述之一種擴增實境多螢幕陣列整合系統,其中,該無線通訊模組(15)與該通信模組(23)之間採用無線通訊技術傳輸資訊。An augmented reality multi-screen array integration system as described in item 1 of the patent application scope, wherein wireless communication technology is used to transmit information between the wireless communication module (15) and the communication module (23). 如申請專利範圍第4項所述之一種擴增實境多螢幕陣列整合系統,其中,該無線通訊模組(15)與該通信模組(23)可採用藍芽傳輸或者WIFI傳輸。An augmented reality multi-screen array integration system as described in item 4 of the patent application scope, wherein the wireless communication module (15) and the communication module (23) may use Bluetooth transmission or WIFI transmission. 如申請專利範圍第1項所述之一種擴增實境多螢幕陣列整合系統,其中,該用戶系統(1)可以選用智慧型裝置、或者頭戴式顯示器。An augmented reality multi-screen array integrated system as described in item 1 of the scope of the patent application, wherein the user system (1) can select a smart device or a head-mounted display. 如申請專利範圍第1項所述之一種擴增實境多螢幕陣列整合系統,其中,該展示系統(2)可透過行動裝置、或者桌上型電腦、或者筆記型電腦並且配合一投影設備將該用戶系統(1)的畫面加以顯示。An augmented reality multi-screen array integration system as described in item 1 of the patent application scope, wherein the display system (2) can be connected to a projection device through a mobile device, or desktop computer, or notebook computer The screen of the user system (1) is displayed.
TW108213798U 2019-10-18 2019-10-18 An augmented reality multi-screen array integration system TWM592332U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW108213798U TWM592332U (en) 2019-10-18 2019-10-18 An augmented reality multi-screen array integration system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW108213798U TWM592332U (en) 2019-10-18 2019-10-18 An augmented reality multi-screen array integration system

Publications (1)

Publication Number Publication Date
TWM592332U true TWM592332U (en) 2020-03-21

Family

ID=70768555

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108213798U TWM592332U (en) 2019-10-18 2019-10-18 An augmented reality multi-screen array integration system

Country Status (1)

Country Link
TW (1) TWM592332U (en)

Similar Documents

Publication Publication Date Title
US11948260B1 (en) Streaming mixed-reality environments between multiple devices
US11669152B2 (en) Massive simultaneous remote digital presence world
CN110650354B (en) Live broadcast method, system, equipment and storage medium for virtual cartoon character
WO2018098720A1 (en) Virtual reality-based data processing method and system
CN102540464B (en) Head-mounted display device which provides surround video
US9077846B2 (en) Integrated interactive space
US10573060B1 (en) Controller binding in virtual domes
US20160225188A1 (en) Virtual-reality presentation volume within which human participants freely move while experiencing a virtual environment
CN114402276A (en) Teaching system, viewing terminal, information processing method, and program
US10740957B1 (en) Dynamic split screen
JP7496558B2 (en) Computer program, server device, terminal device, and method
US11587284B2 (en) Virtual-world simulator
CN109996060B (en) Virtual reality cinema system and information processing method
TWM592332U (en) An augmented reality multi-screen array integration system
JP7465737B2 (en) Teaching system, viewing terminal, information processing method and program
JP7465736B2 (en) Content control system, content control method, and content control program
Gobira et al. Expansion of uses and applications of virtual reality
CN112286355B (en) Interactive method and system for immersive content
WO2024016880A1 (en) Information interaction method and apparatus, and electronic device and storage medium
Harish et al. Augmented Reality Applications in Gaming
WO2021106463A1 (en) Content control system, content control method, and content control program
Chiday Developing a Kinect based Holoportation System
Yoon et al. Augmented Reality Musical Service Part 1 for Non-face-to-face Watching by Multiple Audiences
Freitas KAVE-Kinect Cave: design, tools and comparative analysis with other VR technologies
Dubnov Experiential Media: Using Machine Vision and Sensor-Input to Create Dynamic Real-Time Generated Media