TWM506428U - Display system for video stream on augmented reality - Google Patents

Display system for video stream on augmented reality Download PDF

Info

Publication number
TWM506428U
TWM506428U TW104202805U TW104202805U TWM506428U TW M506428 U TWM506428 U TW M506428U TW 104202805 U TW104202805 U TW 104202805U TW 104202805 U TW104202805 U TW 104202805U TW M506428 U TWM506428 U TW M506428U
Authority
TW
Taiwan
Prior art keywords
video
augmented reality
audio
display system
physical object
Prior art date
Application number
TW104202805U
Other languages
Chinese (zh)
Inventor
Wei-Tian Tang
Chih-Wei Pao
I-Wei Chu
Original Assignee
Wonderwave Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wonderwave Co Ltd filed Critical Wonderwave Co Ltd
Priority to TW104202805U priority Critical patent/TWM506428U/en
Publication of TWM506428U publication Critical patent/TWM506428U/en

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The utility model provides a display system for video stream on augmented reality, the system comprising a mobile device and a server. An identification module of the mobile device can identify an physical object to generate an identification information, such that an action match module of the server can search out video files according to the identification information. Thus, the video files can transmit to the mobile device and play on augmented reality. Therefore, this utility model can provide a better personalized interactive experience.

Description

擴增實境式串流影音顯示系統Augmented reality streaming video display system

本創作係有關一種串流影音顯示之技術領域,尤指一種以擴增實境形式呈現之串流影音顯示系統。The present invention relates to a technical field of streaming audio and video display, and more particularly to a streaming audio and video display system presented in an augmented reality form.

擴增實境(Augmented Reality)係為一種在真實世界中顯示原本即不存在現場的物件或景象的影像顯示技術,即於真實世界中擴增虛擬資訊或影像,而能讓使用者藉由擴增實境來取得相關資訊或影像。Augmented Reality is an image display technology that displays objects or scenes that are not present in the real world in the real world, that is, augmenting virtual information or images in the real world, allowing users to expand Add realms to get relevant information or images.

然而,目前擴增實境之影像顯示仍僅能事先建立,無法依據使用者需求來即時顯示並與使用者之行為產生互動。此外,在擴增實境之影像顯示中,仍僅能以固定內容來進行影像播放,導致擴增實境技術之使用過於單調、使用者體驗感不佳等問題。However, the current augmented reality image display can still only be established in advance, and cannot be displayed in real time according to the user's needs and interact with the user's behavior. In addition, in the image display of the augmented reality, the video playback can only be performed with the fixed content, which leads to problems such as the use of the augmented reality technology is too monotonous, and the user experience is not good.

是以,如何提供一種擴增實境式的影像顯示技術來解決上述問題,為此技術領域中亟待解決的課題之一。Therefore, how to provide an augmented reality image display technology to solve the above problems is one of the urgent problems to be solved in the technical field.

本創作之一目的在於提供一種擴增實境式串流影音顯示系統,包括:伺服器與行動裝置,其中,該伺服器包 括:影音資料庫,係儲存有複數個影音檔案;及行為配對模組,用以於該影音資料庫中搜索對應一辨識訊息之影音檔案,以獲得對應該辨識訊息的影音檔案路徑,而該行動裝置包括:通訊模組,用以透過網路連接該伺服器,以接收該影音檔案路徑;影像擷取模組,用以擷取一影像擷取範圍內的至少一實體物件,以產生該實體物件之影像資訊;辨識模組,用以辨識該影像資訊中該實體物件所具有的表面特徵,以產生對應於該表面特徵之影像錨點以及該辨識訊息,進而將該辨識訊息透過該通訊模組傳送給該伺服器之行為配對模組;及顯示模組,用以顯示一擴增實境畫面,該擴增實境畫面包括該實體物件之影像資訊及至少一虛擬螢幕,該虛擬螢幕係依據該影像錨點於該實體物件之影像資訊上進行定位,俾使該虛擬螢幕疊加在該實體物件之影像資訊上,進而以串流影音之方式播放該影音檔案路徑所指向的影音檔案。One of the aims of the present invention is to provide an augmented reality streaming audio and video display system, comprising: a server and a mobile device, wherein the server package The audio and video database stores a plurality of audio and video files; and the behavior matching module is configured to search the video library for a video file corresponding to an identification message to obtain a video file path corresponding to the identification message, and the The mobile device includes: a communication module, configured to connect the server through the network to receive the audio file path; and the image capturing module is configured to capture at least one physical object in an image capturing range to generate the The image information of the physical object; the identification module is configured to identify a surface feature of the physical object in the image information, to generate an image anchor point corresponding to the surface feature and the identification message, and then transmit the identification message through the communication And the display module is configured to display an augmented reality picture, where the augmented reality picture includes image information of the physical object and at least one virtual screen, the virtual screen Positioning the image anchor on the image information of the physical object, so that the virtual screen is superimposed on the image information of the physical object, In the streaming audio broadcast of the video archives video file path is directed.

藉由本創作之擴增實境式串流影音顯示系統,能夠使用行動裝置之辨識模組對實體物件進行辨識後,將辨識訊息傳送至伺服器,令伺服器之行為配對模組依據該辨識訊息搜索出影音檔案,俾使該影音檔案能回傳至該行動裝置中,並以擴增實境之方式於該實體物件之表面上進行播放。而在搜索影音檔案時,可根據使用者操作該行動裝置之記錄來進行搜索,使得影音檔案之播放能動態改變,解決使用者體驗感不佳之問題。With the augmented reality streaming video display system of the present invention, the identification device of the mobile device can be used to identify the physical object, and then the identification message is transmitted to the server, so that the behavior matching module of the server is based on the identification message. The video file is searched for, and the video file can be returned to the mobile device and played on the surface of the physical object in augmented reality. When searching for audio and video files, the user can operate the record of the mobile device to search, so that the playback of the audio and video files can be dynamically changed to solve the problem of poor user experience.

1‧‧‧擴增實境式串流影音顯示系統1‧‧‧Augmented reality streaming video display system

10‧‧‧伺服器10‧‧‧Server

11‧‧‧行為資料庫11‧‧‧ Behavioral Database

12‧‧‧影音資料庫12‧‧‧ Audio and video database

13‧‧‧行為配對模組13‧‧‧ Behavior Matching Module

14‧‧‧影音管理介面14‧‧‧Video Management Interface

20‧‧‧行動裝置20‧‧‧ mobile devices

21‧‧‧通訊模組21‧‧‧Communication Module

22‧‧‧影像擷取模組22‧‧‧Image capture module

23‧‧‧辨識模組23‧‧‧ Identification Module

24‧‧‧顯示模組24‧‧‧ display module

25‧‧‧擴增實境畫面25‧‧‧Augmented reality screen

251‧‧‧虛擬螢幕251‧‧‧Virtual Screen

252‧‧‧影像資訊252‧‧‧Image information

253‧‧‧影像錨點253‧‧•Image anchor

30‧‧‧實體物件30‧‧‧ physical objects

31‧‧‧表面特徵31‧‧‧ Surface features

40‧‧‧影像擷取範圍40‧‧‧Image capture range

第1圖係為本創作擴增實境式串流影音顯示系統之功能方塊圖;第2圖係為本創作擴增實境式串流影音顯示系統之運行示意圖。The first picture is a functional block diagram of the augmented reality streaming video and audio display system; the second picture is a schematic diagram of the operation of the augmented reality streaming video display system.

以下藉由特定之具體實施例加以說明本創作之實施方式,而熟悉此技術之人士可由本說明書所揭示之內容輕易地瞭解本創作之其他優點和功效,亦可藉由其他不同的具體實施例加以施行或應用。The embodiments of the present invention are described below by way of specific embodiments, and those skilled in the art can easily understand other advantages and functions of the present invention by the contents disclosed in the present specification, and may also use other different embodiments. Implement or apply.

請同時參閱第1、2圖,本創作之擴增實境式串流影音顯示系統1包括伺服器10及行動裝置20,其中,該行動裝置20可為智慧型手機、平板電腦等,本創作並不以此為限。Please refer to the first and second figures at the same time. The augmented reality streaming audio and video display system 1 of the present invention includes a server 10 and a mobile device 20, wherein the mobile device 20 can be a smart phone, a tablet computer, etc. Not limited to this.

該伺服器10包括行為資料庫11、影音資料庫12、行為配對模組13以及影音管理介面14,另該行動裝置20包括通訊模組21、影像擷取模組22、辨識模組23以及顯示模組24,其中,該顯示模組24可為智慧型手機、平板電腦的觸控式螢幕,或是外接於智慧型手機、平板電腦的投影設備或顯示螢幕,而該顯示模組24係用以顯示一擴增實境畫面25。The server 10 includes a behavior database 11, a video library 12, a behavior matching module 13 and a video management interface 14. The mobile device 20 includes a communication module 21, an image capturing module 22, an identification module 23, and a display. The module 24, wherein the display module 24 can be a touch screen of a smart phone or a tablet, or a projection device or a display screen connected to a smart phone or a tablet, and the display module 24 is used. To display an augmented reality picture 25.

該行動裝置20之通訊模組21係透過網路連接該伺服器10,使得該伺服器10與該行動裝置20之間能夠進行資料傳輸。所傳輸的資料例如為使用者操作該行動裝置20的操作記錄,且該操作記錄可透過通訊模組21傳送到伺服 器10之行為資料庫11中儲存,以供後端分析使用者之操作行為;或將該伺服器10之影音資料庫12所儲存的檔案傳送到該行動裝置20上。The communication module 21 of the mobile device 20 is connected to the server 10 via a network, so that data can be transmitted between the server 10 and the mobile device 20. The transmitted data is, for example, an operation record of the user operating the mobile device 20, and the operation record can be transmitted to the servo through the communication module 21. The behavior database 11 of the device 10 is stored for the back end to analyze the user's operation behavior; or the file stored in the video library 12 of the server 10 is transmitted to the mobile device 20.

該行動裝置20之影像擷取模組22係用以擷取一影像擷取範圍40內的至少一實體物件30,以產生該實體物件30之影像資訊252。於一實施例中,該影像擷取模組22可為智慧型手機、平板電腦的攝影鏡頭,或是外掛在智慧型手機、平板電腦上的攝影機。The image capturing module 22 of the mobile device 20 is configured to capture at least one physical object 30 in an image capturing range 40 to generate image information 252 of the physical object 30. In an embodiment, the image capturing module 22 can be a photographic lens of a smart phone or a tablet computer, or a camera attached to a smart phone or a tablet computer.

於另一實施例中,該影像擷取模組22可同時擷取一影像擷取範圍40內的複數個實體物件30,因此該影像資訊252中即會有複數個實體物件30。以下將以一個實體物件30進行說明。該實體物件30具有表面特徵31,該表面特徵31可為實體物件30之表面紋理、圖樣、文字或條碼,或是其他可供辨識的元件等,本創作並不以此為限。In another embodiment, the image capturing module 22 can simultaneously capture a plurality of physical objects 30 in an image capturing range 40. Therefore, the plurality of physical objects 30 are present in the image information 252. The following description will be made with one physical object 30. The physical object 30 has a surface feature 31, which may be the surface texture, pattern, text or bar code of the physical object 30, or other components that can be identified, and the present invention is not limited thereto.

該行動裝置20之辨識模組23用以辨識該影像資訊252中的實體物件30所具有的表面特徵31,以在影像資訊252中產生位置對應於該表面特徵31的影像錨點253,且在辨識完後產生一辨識訊息。該辨識訊息可包含影像資訊252、影像錨點253等資訊。The identification module 23 of the mobile device 20 is configured to identify the surface feature 31 of the physical object 30 in the image information 252 to generate an image anchor point 253 corresponding to the surface feature 31 in the image information 252, and After identification, an identification message is generated. The identification message may include information such as image information 252, image anchor point 253, and the like.

詳言之,行動裝置20透過影像擷取模組22拍攝在影像擷取範圍40內的具有一表面特徵31之實體物件30,以產生包括該實體物件30的影像資訊252。據此,行動裝置20即可在顯示模組24上的擴增實境畫面25內顯示該影像資訊252。接著,辨識模組23在辨識出表面特徵31在實 體物件30上的相對位置後,即在影像資訊252中對應該實體物件30之表面特徵31之處產生一影像錨點253。In detail, the mobile device 20 captures the physical object 30 having a surface feature 31 in the image capturing range 40 through the image capturing module 22 to generate image information 252 including the physical object 30. Accordingly, the mobile device 20 can display the video information 252 in the augmented reality screen 25 on the display module 24. Then, the identification module 23 recognizes that the surface feature 31 is in the real After the relative position on the object 30, an image anchor 253 is created in the image information 252 corresponding to the surface feature 31 of the physical object 30.

於一實施例中,該辨識模組23會針對實體物件30之表面特徵31的不同,採用不同的辨識方法。例如,表面特徵31為實體物件30之文字時,可採用光學字元辨識(Optical Character Recognition,OCR)之技術來進行辨識;表面特徵31為實體物件30之條碼時,可採條碼辨識系統來進行辨識;又表面特徵31為實體物件30之表面紋理或圖樣時,可將其與影音資料庫12中儲存之影音檔案所對應的資料進行圖形比對等,本創作並不以此為限。In an embodiment, the identification module 23 uses different identification methods for different surface features 31 of the physical object 30. For example, when the surface feature 31 is the text of the physical object 30, the optical character recognition (OCR) technology can be used for identification; when the surface feature 31 is the barcode of the physical object 30, the barcode identification system can be used for performing the barcode identification system. When the surface feature 31 is the surface texture or pattern of the physical object 30, it can be graphically compared with the data corresponding to the audio and video files stored in the audio-visual library 12, and the creation is not limited thereto.

在辨識模組23產生影像錨點253及辨識訊息後,該辨識訊息則透過通訊模組21傳送給伺服器10。具體言之,辨識訊息係傳送給伺服器10之行為配對模組13。而該行為配對模組31則用以於影音資料庫12中搜索對應該辨識訊息的影音檔案,以獲得對應該辨識訊息的影音檔案路徑。After the identification module 23 generates the image anchor point 253 and the identification message, the identification message is transmitted to the server 10 through the communication module 21. Specifically, the identification message is transmitted to the behavior matching module 13 of the server 10. The behavior matching module 31 is configured to search the video library 12 for the video file corresponding to the identification message to obtain a video file path corresponding to the identification message.

詳言之,該伺服器10之影音資料庫12係儲存有複數個影音檔案以及索引檔,其中,該索引檔之格式可為資料庫中的表格(table),或是文字檔等。而該索引檔之內容即是記錄對應各影音檔案的檢索資料,例如關鍵字、影音檔案簡介、影音檔案路徑、虛擬空間變動資訊等等。因此,該行為配對模組13即可根據該辨識訊息之內容,於影音資料庫12所儲存之索引檔中進行檢索,來找出對應該辨識訊息的影音檔案,進一步獲得該影音檔案的影音檔案路徑。而該影音檔案路徑則可透過網路使該行動裝置20之通訊 模組21所接收。In detail, the video library 12 of the server 10 stores a plurality of audio and video files and an index file, wherein the format of the index file may be a table in a database, or a text file. The content of the index file is to record the search data corresponding to each audio and video file, such as keywords, video file profiles, video file paths, virtual space changes, and the like. Therefore, the behavior matching module 13 can perform a search in the index file stored in the audio-visual database 12 according to the content of the identification message to find an audio-visual file corresponding to the identification message, and further obtain the audio-visual file of the audio-visual file. path. The video file path can communicate with the mobile device 20 via the network. Received by module 21.

行動裝置20之顯示模組24用以顯示一擴增實境畫面25,該擴增實境畫面25包括影像資訊252及至少一虛擬螢幕251。該虛擬螢幕251即是依據辨識模組23所產生的影像錨點253於該影像資訊252上進行定位,因此,該虛擬螢幕251經行動裝置20之處理器運算後,即以圖層疊加之方式重疊在影像資訊252上。而此一虛擬螢幕251之功能,則是在通訊模組21接收影音檔案路徑後,以串流影音(streaming media)之方式在虛擬螢幕251上播放該影音檔案路徑所指向的影音檔案。The display module 24 of the mobile device 20 is configured to display an augmented reality screen 25, which includes image information 252 and at least one virtual screen 251. The virtual screen 251 is positioned on the image information 252 according to the image anchor point 253 generated by the identification module 23. Therefore, after the virtual screen 251 is processed by the processor of the mobile device 20, the overlay is superimposed by layers. On the image information 252. The function of the virtual screen 251 is to play the video file pointed by the video file path on the virtual screen 251 in the form of streaming media after the communication module 21 receives the video file path.

於一實施例中,虛擬螢幕251可為複數個,並可依據影像錨點253之位置相對排序在影像資訊252上,例如圍繞著影像錨點253而排序成圓形、方形等,本創作並不以此為限。In one embodiment, the virtual screen 251 can be plural, and can be sorted into the image information 252 according to the position of the image anchor point 253, for example, rounded, square, etc. around the image anchor point 253. Not limited to this.

行為配對模組13在影音資料庫12中完成檢索時,可一併從影音資料庫12的索引檔中獲得對應該辨識訊息的虛擬空間變動資訊。所謂的虛擬空間變動資訊,係用以提供虛擬螢幕251改變其三維座標,進而使虛擬螢幕251之外形能夠對應該實體物件30之外形。因此,該虛擬空間變動資訊實可為該實體物件的外形資訊。舉例而言,實體物件30為一鞋子時,此一虛擬空間變動資訊即為記錄鞋子外形的三維座標,在虛擬螢幕251依據影像錨點253進行定位時,該虛擬螢幕251即能依據此一鞋子外形的三維座標進行調整,將虛擬螢幕251之外形調整成該鞋子外形,俾 使虛擬螢幕251能貼合在該實體物件30之影像資訊252之表面上。When the behavior matching module 13 completes the retrieval in the audiovisual database 12, the virtual space variation information corresponding to the identification message can be obtained from the index file of the audiovisual database 12. The so-called virtual space change information is used to provide the virtual screen 251 to change its three-dimensional coordinates, so that the outer shape of the virtual screen 251 can correspond to the shape of the physical object 30. Therefore, the virtual space change information can be the shape information of the physical object. For example, when the physical object 30 is a shoe, the virtual space change information is a three-dimensional coordinate for recording the shape of the shoe. When the virtual screen 251 is positioned according to the image anchor point 253, the virtual screen 251 can be based on the shoe. The three-dimensional coordinates of the shape are adjusted to adjust the shape of the virtual screen 251 to the shape of the shoe, The virtual screen 251 can be attached to the surface of the image information 252 of the physical object 30.

於一實施例中,該虛擬螢幕251之外形除了可符合實體物件30之外形外,亦可為彎曲平面、立體多邊形或圓滑曲面等不規則3D物件外形,本創作並不限制虛擬螢幕251之外形。In an embodiment, the virtual screen 251 is shaped to conform to the physical object 30, and may also be an irregular 3D object shape such as a curved plane, a solid polygon, or a smooth curved surface. The creation does not limit the shape of the virtual screen 251. .

在本實施例中,行為資料庫11所儲存的行動裝置20之操作記錄,能夠提供行為配對模組13在影音資料庫12中搜索時,作為過濾搜索結果的條件之一。例如,行為配對模組13在影音資料庫12中搜索出多個對應該辨識訊息之影音檔案,則可剔除有出現在操作記錄中的影音檔案,使得行為配對模組13所搜索出的影音檔案不會重複出現。據此,使用者就不會重複觀看先前已看過的影音檔案,而能給予使用者更棒的體驗。In this embodiment, the operation record of the mobile device 20 stored in the behavior database 11 can provide the behavior matching module 13 as one of the conditions for filtering the search result when searching in the video library 12. For example, the behavior matching module 13 searches for a plurality of video files corresponding to the identification information in the audio-visual database 12, and the audio-visual files appearing in the operation record can be deleted, so that the video file searched by the behavior matching module 13 is deleted. Will not repeat. According to this, the user will not repeatedly watch the video files that have been seen before, and can give the user a better experience.

於一實施例中,該伺服器10更包括影音管理介面14,可供管理者登入該伺服器10中,用以管理該影音資料庫12內的影音檔案,或是針對影音資料庫12的索引檔內容進行編輯。此外,該影音管理介面14更可設定該行為資料庫11中的互動事件資訊。所謂的互動事件資訊係行為配對模組13於影音資料庫12中搜索影音檔案時的搜尋條件,而此一搜尋條件為管理者所設定,可將實體物件30之特定的表面特徵連結到特定的影音檔案。舉例而言,實體物件30為一鞋子時,管理者可將襪子設定為互動事件資訊,讓使用者在擷取到實體物件30為鞋子時,能夠觀看到與襪子 有關的影音檔案。因此,藉由互動事件資訊的設定,使得管理者更能提供與實體物件30不同種類的影音檔案,突破以往固定內容的影音播放模式。In an embodiment, the server 10 further includes an audio-visual management interface 14 for the administrator to log in to the server 10 for managing audio and video files in the video library 12 or indexing the video library 12 The contents of the file are edited. In addition, the video management interface 14 can further set interactive event information in the behavior database 11. The so-called interactive event information is a search condition when the behavior matching module 13 searches for the audio and video files in the video library 12, and the search condition is set by the administrator to link the specific surface features of the physical object 30 to a specific one. Audio and video files. For example, when the physical object 30 is a shoe, the manager can set the socks as interactive event information, so that the user can view the socks when the physical object 30 is taken as a shoe. Related audio and video files. Therefore, by setting the interactive event information, the manager can provide different types of audio and video files with the physical object 30, and break through the audio and video playback mode of the fixed content in the past.

綜上所述,本創作之擴增實境式串流影音顯示系統,能夠在行動裝置之影像擷取模組擷取到一實體物件時,產生該實體物件之影像資訊並顯示在顯示模組所顯示之擴增實境畫面中。接著,辨識模組就會辨識該影像資訊中該實體物件的表面特徵,並產生對應該表面特徵之影像錨點以及辨識訊息。而該辨識訊息則透過通訊模組傳送至伺服器中,以令伺服器之行為配對模組搜索出對應該辨識訊息的影音檔案,俾使該影音檔案能夠回傳至行動裝置中,且於該擴增實境畫面中的虛擬螢幕上以串流影音之方式進行播放。據此達到個人化的影音互動體驗,提供個人化的真人廣告、電腦動畫及特效等影像內容,並使影音檔案之播放能動態改變,解決使用者體驗感不佳之問題。In summary, the augmented reality streaming audio and video display system of the present invention can generate image information of the physical object and display it in the display module when the image capturing module of the mobile device captures a physical object. In the augmented reality screen displayed. Then, the recognition module recognizes the surface features of the physical object in the image information, and generates an image anchor point corresponding to the surface feature and an identification message. The identification message is transmitted to the server through the communication module, so that the behavior matching module of the server searches for the audio and video file corresponding to the identification message, so that the video file can be transmitted back to the mobile device, and The virtual screen in the augmented reality picture is played in the form of streaming audio and video. According to this, personalized audio-visual interactive experience is provided, and personalized video content such as live-action advertisements, computer animations and special effects is provided, and the playback of audio-visual files can be dynamically changed to solve the problem of poor user experience.

上述實施形態僅為例示性說明本創作之技術原理、特點及其功效,並非用以限制本創作之可實施範疇,任何熟習此技術之人士均可在不違背本創作之精神與範疇下,對上述實施形態進行修飾與改變。然任何運用本創作所教示內容而完成之等效修飾及改變,均仍應為下述之申請專利範圍所涵蓋。而本創作之權利保護範圍,應如下述之申請專利範圍所列。The above embodiments are merely illustrative of the technical principles, features, and effects of the present invention, and are not intended to limit the scope of implementation of the present invention. Anyone skilled in the art can do so without departing from the spirit and scope of the present invention. The above embodiments are modified and changed. However, any equivalent modifications and alterations made using the teachings of this creation should be covered by the scope of the patent application below. The scope of protection of this creation shall be as set forth in the scope of the patent application below.

10‧‧‧伺服器10‧‧‧Server

20‧‧‧行動裝置20‧‧‧ mobile devices

24‧‧‧顯示模組24‧‧‧ display module

25‧‧‧擴增實境畫面25‧‧‧Augmented reality screen

251‧‧‧虛擬螢幕251‧‧‧Virtual Screen

252‧‧‧影像資訊252‧‧‧Image information

253‧‧‧影像錨點253‧‧•Image anchor

30‧‧‧實體物件30‧‧‧ physical objects

31‧‧‧表面特徵31‧‧‧ Surface features

40‧‧‧影像擷取範圍40‧‧‧Image capture range

Claims (10)

一種擴增實境式串流影音顯示系統,包括:伺服器,包括:影音資料庫,係儲存有複數個影音檔案;及行為配對模組,用以於該影音資料庫中搜索對應一辨識訊息之影音檔案,以獲得對應該辨識訊息的影音檔案路徑;以及行動裝置,包括:通訊模組,用以透過網路連接該伺服器,以接收該影音檔案路徑;影像擷取模組,用以擷取一影像擷取範圍內的至少一實體物件,以產生該實體物件之影像資訊;辨識模組,用以辨識該影像資訊中該實體物件所具有的表面特徵,以產生對應於該表面特徵之影像錨點以及該辨識訊息,進而將該辨識訊息透過該通訊模組傳送給該伺服器之行為配對模組;及顯示模組,用以顯示一擴增實境畫面,該擴增實境畫面包括該實體物件之影像資訊及至少一虛擬螢幕,該虛擬螢幕係依據該影像錨點於該實體物件之影像資訊上進行定位,俾使該虛擬螢幕疊加在該實體物件之影像資訊上,進而以串流影音之方式播放該影音檔案路徑所指向的影音檔 案。An augmented reality streaming audio and video display system, comprising: a server, comprising: a video and audio database, storing a plurality of audio and video files; and a behavior matching module for searching for a corresponding identification message in the video library And an audio and video file to obtain a video file path corresponding to the identified message; and a mobile device, comprising: a communication module, configured to connect the server through the network to receive the audio file path; and the image capturing module is configured to: Extracting at least one physical object within an image capture range to generate image information of the physical object; and an identification module for identifying a surface feature of the physical object in the image information to generate a surface feature corresponding to the surface feature The image anchor point and the identification message, and the identification message is transmitted to the behavior matching module of the server through the communication module; and the display module is configured to display an augmented reality picture, the augmented reality The screen includes image information of the physical object and at least one virtual screen, and the virtual screen is determined according to the image information of the image anchor point on the physical object. To enabling the virtual screen superimposed on the image information of the real object, and then to streaming audio and video of the broadcast of the video file path pointed to audio and video files case. 如申請專利範圍第1項所述之擴增實境式串流影音顯示系統,其中,該行為配對模組更獲得對應該辨識訊息的虛擬空間變動資訊,俾使該虛擬螢幕依據該影像錨點進行定位時,係參考該虛擬空間變動資訊進行該虛擬螢幕相對於該實體物件之影像資訊之三維座標的調整。The augmented reality streaming audio and video display system of claim 1, wherein the behavior matching module obtains virtual space change information corresponding to the identification message, so that the virtual screen is based on the image anchor point. When the positioning is performed, the virtual space change information is used to adjust the three-dimensional coordinates of the virtual screen relative to the image information of the physical object. 如申請專利範圍第2項所述之擴增實境式串流影音顯示系統,其中,該虛擬空間變動資訊為該實體物件之外形資訊。The augmented reality streaming audio and video display system according to claim 2, wherein the virtual space change information is the physical shape information of the physical object. 如申請專利範圍第1項所述之擴增實境式串流影音顯示系統,其中,該虛擬螢幕為彎曲平面、立體多邊形或圓滑曲面之不規則3D物件外形。The augmented reality streaming audio and video display system according to claim 1, wherein the virtual screen is an irregular 3D object shape of a curved plane, a solid polygon or a smooth curved surface. 如申請專利範圍第4項所述之擴增實境式串流影音顯示系統,其中,該表面特徵為該實體物件之表面紋理、圖樣、文字或條碼。The augmented reality streaming audio and video display system of claim 4, wherein the surface feature is a surface texture, a pattern, a text or a bar code of the physical object. 如申請專利範圍第5項所述之擴增實境式串流影音顯示系統,其中,該顯示模組為觸控式螢幕、外接於該行動裝置之投影設備或顯示螢幕。The augmented reality streaming audio and video display system of claim 5, wherein the display module is a touch screen, a projection device externally connected to the mobile device, or a display screen. 如申請專利範圍第1項所述之擴增實境式串流影音顯示系統,其中,該伺服器更包括行為資料庫,用以儲存該行動裝置的操作記錄。The augmented reality streaming audio and video display system of claim 1, wherein the server further comprises a behavior database for storing an operation record of the mobile device. 如申請專利範圍第7項所述之擴增實境式串流影音顯示系統,其中,該伺服器更包括影音管理介面,用以 管理該影音資料庫以及設定該行為資料庫中的互動事件資訊。The augmented reality streaming audio and video display system according to claim 7, wherein the server further comprises an audio and video management interface, Manage the video library and set up interactive event information in the behavior database. 如申請專利範圍第8項所述之擴增實境式串流影音顯示系統,其中,該互動事件資訊係作為該行為配對模組於該影音資料庫中搜索影音檔案時的搜索條件。The augmented reality streaming audio and video display system of claim 8, wherein the interactive event information is used as a search condition when the behavior matching module searches for the audiovisual file in the audiovisual database. 如申請專利範圍第9項所述之擴增實境式串流影音顯示系統,其中,該行為配對模組更依據該行動裝置的操作記錄以於該影音資料庫中搜索對應該辨識訊息之影音檔案,且所搜索出的影音檔案未出現在該操作記錄中。The augmented reality streaming audio and video display system according to claim 9, wherein the behavior matching module further searches for the audio and video information corresponding to the identification information according to the operation record of the mobile device. The file, and the searched video file does not appear in the operation record.
TW104202805U 2015-02-17 2015-02-17 Display system for video stream on augmented reality TWM506428U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW104202805U TWM506428U (en) 2015-02-17 2015-02-17 Display system for video stream on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW104202805U TWM506428U (en) 2015-02-17 2015-02-17 Display system for video stream on augmented reality

Publications (1)

Publication Number Publication Date
TWM506428U true TWM506428U (en) 2015-08-01

Family

ID=54339682

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104202805U TWM506428U (en) 2015-02-17 2015-02-17 Display system for video stream on augmented reality

Country Status (1)

Country Link
TW (1) TWM506428U (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107466477A (en) * 2015-11-12 2017-12-12 松下电器(美国)知识产权公司 Display methods, program and display device
US10389446B2 (en) 2014-11-14 2019-08-20 Panasonic Intellectual Property Corporation Of America Reproduction method for reproducing contents
US10504584B2 (en) 2015-12-17 2019-12-10 Panasonic Intellectual Property Corporation Of America Display method and display device
TWI771086B (en) * 2021-06-29 2022-07-11 新加坡商鴻運科股份有限公司 Method and system for showing objects in augmented reality environment
US11450074B1 (en) 2021-06-29 2022-09-20 Ambit Microsystems (Shanghai) Ltd. Method and system for showing objects in augmented reality environment

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10389446B2 (en) 2014-11-14 2019-08-20 Panasonic Intellectual Property Corporation Of America Reproduction method for reproducing contents
CN107466477A (en) * 2015-11-12 2017-12-12 松下电器(美国)知识产权公司 Display methods, program and display device
EP3376772A4 (en) * 2015-11-12 2018-11-21 Panasonic Intellectual Property Corporation of America Display method, program and display device
US10263701B2 (en) 2015-11-12 2019-04-16 Panasonic Intellectual Property Corporation Of America Display method, non-transitory recording medium, and display device
US10951309B2 (en) 2015-11-12 2021-03-16 Panasonic Intellectual Property Corporation Of America Display method, non-transitory recording medium, and display device
CN107466477B (en) * 2015-11-12 2021-08-10 松下电器(美国)知识产权公司 Display method, computer-readable recording medium, and display device
US10504584B2 (en) 2015-12-17 2019-12-10 Panasonic Intellectual Property Corporation Of America Display method and display device
TWI771086B (en) * 2021-06-29 2022-07-11 新加坡商鴻運科股份有限公司 Method and system for showing objects in augmented reality environment
US11450074B1 (en) 2021-06-29 2022-09-20 Ambit Microsystems (Shanghai) Ltd. Method and system for showing objects in augmented reality environment
US11776226B2 (en) 2021-06-29 2023-10-03 Ambit Microsystems (Shanghai) Ltd. Method and system for showing objects in augmented reality environment

Similar Documents

Publication Publication Date Title
US10083357B2 (en) Image-based item location identification
WO2021082668A1 (en) Bullet screen editing method, smart terminal, and storage medium
WO2022001593A1 (en) Video generation method and apparatus, storage medium and computer device
JP6410930B2 (en) Content item retrieval and association scheme with real world objects using augmented reality and object recognition
CN108140263B (en) AR display system and method applied to image or video
CN106664376B (en) Augmented reality device and method
US11741681B2 (en) Interaction analysis systems and methods
TW201631960A (en) Display system, method, computer readable recording medium and computer program product for video stream on augmented reality
US20160050465A1 (en) Dynamically targeted ad augmentation in video
WO2018036456A1 (en) Method and device for tracking and recognizing commodity in video image and displaying commodity information
TWI582710B (en) The method of recognizing the object of moving image and the interactive film establishment method of automatically intercepting target image
US20160110453A1 (en) System and method for searching choreography database based on motion inquiry
TWM506428U (en) Display system for video stream on augmented reality
KR20140082610A (en) Method and apaaratus for augmented exhibition contents in portable terminal
US9519355B2 (en) Mobile device event control with digital images
US8643672B2 (en) Instant message analytics of historical conversations in relation to present communication
US11334621B2 (en) Image search system, image search method and storage medium
EP3132597A1 (en) Marker-based pixel replacement
CN106778449B (en) Object identification method of dynamic image and interactive film establishment method for automatically capturing target image
US20220270368A1 (en) Interactive video system for sports media
US11902603B2 (en) Methods and systems for utilizing live embedded tracking data within a live sports video stream
CN110929056B (en) Multimedia file generating method, multimedia file playing method, multimedia file generating device and multimedia file playing device
TW201403499A (en) Method for corresponding to augmented reality content with the same code using universal coding method through image searching
CN116775924A (en) Image display control method, device and equipment
TWM542305U (en) Automatic multimedia servicing system

Legal Events

Date Code Title Description
MM4K Annulment or lapse of a utility model due to non-payment of fees