TW201239673A

TW201239673A - Method, manipulating system and processing apparatus for manipulating three-dimensional virtual object

Info

Publication number: TW201239673A
Application number: TW100110398A
Authority: TW
Inventors: Chia-Liang Hsu
Original assignee: Acer Inc
Priority date: 2011-03-25
Filing date: 2011-03-25
Publication date: 2012-10-01

Abstract

A method, a manipulating system and a processing apparatus for manipulating a three-dimensional (3D) virtual object are provided. In the method, a 3D image is displayed on a screen in which there is a depth of field between a virtual object of the 3D image and the screen. Next, an image in front of the screen is captured, and a gesture in the image is detected. Then, whether the gesture is close to the virtual object is determined and a specified operation corresponding to the gesture is performed when the gesture is close to the virtual object. Accordingly, a viewer of the 3D image may interact with the virtual object by the gesture.

Description

201239673 PNAI-AC-0052-TWXX 36937twf.doc/I 六、發明說明：【發明所屬之技術領域】本發明是有關於一種虛擬物件的操控方法、系統及裝置，且特別是有關於一種三維立體（three_dimensi〇nal , 3D ) 虛擬物件的操控方法、操控系統及處理裝置。【先前技術】隨著科技的日益進步，3D影像是繼高晝質（high definition，HD)影像後的最新發展趨勢。隨著3d顯示相關產業快速地囉起，未來3 D影片與3 D顯示器將可能普及到每個人的家中，甚至手機或遊戲機㈣像也可以用3D 的方式來呈現。 3D衫像包含分別提供給人類左眼及右眼觀賞的影像，此左右眼影像在兩眼視峨上呈現時會具有—定視差父ar:ll:X) ’而在被傳導到大腦皮質後，即會由大腦皮質中樞將其融合成具有層次和景深的單_ 產生立體感。杜現顯像技術能使觀賞者看到3D影像中的物 3D影像產生時的預設景深以虛擬物、1觀員者面前的不同距離，讓觀賞者烕受到中Λ位置、大小及角度。=上述定二也顯μ或3D影片等相關設備事先所預的卢二=2賞者看到呈現在眼前的3D立體影像中、亚、置、大小以及角度等等的影像變化皆是由 201239673201239673 PNAI-AC-0052-TWXX 36937twf.doc/I VI. Description of the Invention: [Technical Field] The present invention relates to a method, system and device for controlling a virtual object, and in particular to a three-dimensional ( Three_dimensi〇nal , 3D ) The manipulation method, control system and processing device of the virtual object. [Prior Art] With the advancement of technology, 3D images are the latest development trend after high definition (HD) images. As 3D shows that related industries are rapidly emerging, 3D movies and 3D displays will likely be popularized in everyone's homes, and even mobile phones or game consoles (4) can be presented in 3D. The 3D shirt image contains images that are respectively provided to the left eye and the right eye of the human being. The left and right eye images will have a fixed parallax father ar:ll:X) when presented on both eyes, and after being transmitted to the cerebral cortex It will be merged into a single layer with gradation and depth of field by the cerebral cortex. The display technology enables the viewer to see the 3D image. The preset depth of field when the 3D image is generated is the virtual object and the different distances in front of the viewer, so that the viewer can be subjected to the position, size and angle of the middle. = The above-mentioned two or other 3D movies and other related equipment are pre-predicted by Lu 2 = 2 Appreciators to see the 3D stereoscopic images presented in front of the eyes, sub-, set, size and angle, etc. are all changed by 201239673

FNA1-AC-0052-TWXX 36937twfdoc/I 3D顯示器顯示在觀賞者面前的固定位置搖桿或感應手套等裝置才能對其進行操作，使用者而言仍不夠直覺。、打於觀賞【發明内容】方法手勢所對應的操作，據此讓觀t者與细物件進行互動。 ^㈣提H維立體细物件㈣財法，在螢幕上顯示三維立體影像，使得此三維立體影的虎 =件與螢幕之間具有景深。接著，擷取#幕前方的影像， f偵測此影像中的手勢。然後，判斷手勢是否接近虛擬物 2 ’而當_手勢接近虛缝件時，崎虛缝件勢所對應的操作。 r在本發明之-實施例中，上述在螢幕上顯示三維立體影像，使得三維立體影像中的虛擬物件與螢幕之間具有景深的步驟更包括調整虛擬物件與螢幕之間的景深，;吏得虛擬物件呈現於觀賞者前方且位於觀賞者之手臂可及範圍之内。在本發明之一實施例中，上述判斷手勢是否接近虛擬物件的步驟包括根據虛擬物件與螢幕之間的景深，定義虛擬物件的操作區域，並且利用此操作區域判斷手勢是否接近虛擬物件。 4 201239673The FNA1-AC-0052-TWXX 36937twfdoc/I 3D display is displayed in a fixed position in front of the viewer. A device such as a rocker or induction glove can operate it, and the user is still not intuitive enough. [Inventive content] Method The operation corresponding to the gesture, according to which the viewer interacts with the fine object. ^ (4) The H-dimensional three-dimensional fine object (4) financial method, displaying a three-dimensional image on the screen, so that the three-dimensional shadow of the tiger = piece and the screen has a depth of field. Next, capture the image in front of the #screen, and f detect the gesture in the image. Then, it is judged whether the gesture is close to the virtual object 2' and when the _ gesture approaches the imaginary seam, the operation corresponding to the smudged seam potential. In the embodiment of the present invention, the step of displaying the three-dimensional stereoscopic image on the screen such that the depth of field between the virtual object and the screen in the three-dimensional stereoscopic image further comprises adjusting the depth of field between the virtual object and the screen; The virtual object is presented in front of the viewer and is within reach of the viewer's arm. In an embodiment of the invention, the step of determining whether the gesture is close to the virtual object comprises defining an operation area of the virtual object according to a depth of field between the virtual object and the screen, and using the operation area to determine whether the gesture is close to the virtual object. 4 201239673

PNAI-AC-0052-TWXX 36937twf.doc/I 在本發明之一實施例中，上述之操作區域包括涵蓋景深前後預設平面之f㈣立體空間，或是涵蓋虛擬物件周圍預設距離内的立體空間。在本發明之-實施例中，上述當判斷手勢接近虛擬物件時，對虛擬物·行手勢職的操麵步職括當判斷㈣進入操作區域内時，則對虛擬物件執行手勢所對應的綠你。在本發明之-實關巾，±騎_手勢接近虛擬物件時，對虛擬物件執行手勢對應的操作的步驟包括當判斷手勢進入操作區_且與虛擬物件之_轉小於預設距離時，則對虛擬物件執行手勢對應的操作。 n㈣之—實施财，以當騎手勢接近虛擬物擬物件執行手㈣應的操作的步驟包括當判斷 ==區域内且碰觸到虛擬物件時，對虛擬物件執仃手勢所對應的操作。 Μ 勺括ΐ發Γί提出—種三維立體虛擬物件的操控系統，其，括=裝置、影賴取打以及處縣置。其中，顯示早兀用以顯不三維立體影像，使由物件與顯示咖—維立體影像中的虛擬螢暮前方沾二B^厅、冰。影像擷取裝置則用以擷取擬物件，而在手勢接近卢此手勢是否接近虛所對應的操作。虛擬物件時，對纽物件執行手勢本^月又提出-種二維立體虛擬物件的處理裝置，適PNAI-AC-0052-TWXX 36937twf.doc/I In an embodiment of the invention, the operation area includes an f (four) stereoscopic space covering a preset plane before and after the depth of field, or a three-dimensional space covering a preset distance around the virtual object. . In the embodiment of the present invention, when the judgment gesture is close to the virtual object, when the virtual object and the gesture position are judged to be (4) entering the operation area, the green corresponding to the gesture of the virtual object is executed. you. In the case of the present invention, when the gesture is close to the virtual object, the step of performing a gesture corresponding operation on the virtual object includes: when it is determined that the gesture enters the operation area _ and the _ turn of the virtual object is less than the preset distance, then The operation corresponding to the gesture is performed on the virtual object. n (4) - The implementation of the operation to take the gesture close to the virtual object The execution of the object (4) should include the operation corresponding to the virtual object's gesture when the virtual object is judged in the == area. Μ 勺 ΐ 提出提出提出提出提出提出提出提出 — — — — — — — — — — — — — — 提出提出提出提出提出提出提出提出提出提出提出Among them, the display is used to display the three-dimensional stereoscopic image, so that the object and the virtual squirrel in the display-dimensional stereo image are immersed in the front and the ice. The image capture device is used to capture the object, and the gesture is close to whether the gesture is close to the virtual corresponding operation. When a virtual object is used, a gesture is performed on the object, and a processing device for the two-dimensional virtual object is proposed.

^-0052-TWXX 36937twf.doc/I 201239673 於操控顯示裝置所顯示的三維立體影像中的虛擬物件。此處理裝置包括辨識模組以及判斷模組。其中，辨識模組係用以接收影像擷取裝置所榻取之顯示裝置前方的影像，並辨識此影像中的手勢，其中顯示襄置所顯示之三維立體与像中的虛擬物件與顯示裝置之間具有景深。判斷模植係^ 以判斷手勢是轉近虛擬物件，並在手勢接近虛擬物件時，對虛擬物件執行手勢對應的操作。基於上述’本發明之三維立體虛擬物件的操控方法、操控系統及處理裝置能讓觀賞者藉由手勢變化盘三维立影f中的虛擬物件進行互動，例如移動、旋轉、放大或縮小虛擬物件等等。本發明能廣泛地應用於醫學、工程、娱樂、教育訓練等領域，從而提高裝置操作的便利性。、為讓本發明之上述特徵和優點能更明顯易懂，下舉貫施例，並配合所附圖式作詳細說明如下。、【實施方式】物株二二體影t最讓觀賞者感到驚奇的莫過於影像中的 #、1描I於眼前觸手可及的感覺，可惜地是，目前技術供觀賞者直接用手與3D立體影像 = ==景，S'根據三維立靖^ 者的手勢而執“動、 6 201239673^-0052-TWXX 36937twf.doc/I 201239673 The virtual object in the three-dimensional image displayed by the display device. The processing device includes an identification module and a determination module. The identification module is configured to receive an image in front of the display device on which the image capturing device is located, and recognize a gesture in the image, wherein the virtual object and the display device in the three-dimensional image and the image displayed by the device are displayed. There is depth of field between. The modeling system is judged to judge that the gesture is to approach the virtual object, and when the gesture approaches the virtual object, the operation corresponding to the gesture is performed on the virtual object. The control method, the control system and the processing device based on the above-mentioned three-dimensional virtual object of the present invention enable the viewer to interact with the virtual object in the three-dimensional standing image f by the gesture change, such as moving, rotating, enlarging or reducing the virtual object, etc. Wait. The invention can be widely applied to fields such as medicine, engineering, entertainment, education and training, thereby improving the convenience of the operation of the device. The above features and advantages of the present invention will be more apparent and understood from the following description. [Embodiment] The most interesting thing for the viewer is that the #1 and 1 in the image are at your fingertips. Unfortunately, the current technology is for the viewer to directly use the hand. 3D stereo image = == scene, S' according to the gesture of 3D Li Jing ^ person, "moving, 6 201239673

^NAl-AC-0052-TWXX 36937twf.doc/I 成上述功效且使本發明之内容更為_，町例作為本發明確實能夠據以實施的範例。只也圖1是依照本發明之-實施例所緣示之三維立體虛物件的#㈣統方塊1]。圖2是依照本發明之—實施例綠不^二維立體虛擬物件的操控系統示意圖。如圖工所不，二維立體虛擬物件的操控系統1〇〇可包括（但不侷限於）顯不裝置110、影像擷取裝置12〇以及處理裝置13〇。顯不裝置110例如是3D電視、3D顯示器或3D投影機，用以顯示三維立體影像，使得三維立體影像中的虛擬物件與顯示健11〇之間具有景深。搭配圖2作輔助說明，顯不裝置110例如是3D顯示器210,此3D顯示器210可顯示出二維立體影像，使得三維立體影像中的虛擬物件 240與3D顯示器210之間具有景深D。而觀賞者可透過配戴3D眼鏡260來觀賞3D顯示器210所顯示的三維立體影像。影像擷取裝置12〇例如是採用電荷耦合元件（Charge Coupled Device ’ CCD )或互補式金氧半導體 (Complementary Metal-Oxide Semiconductor，CMOS )元件的攝影機或紅外線攝影機，其係用以擷取顯示裝置u〇前方的影像。如圖2所示’影像擷取裝置120例如是3D 攝影機220。此3D攝影機220内可配置RGB攝影機與深度感測器（Depth sensor)，而用來拍攝3D顯示器210前方的影像’包括觀賞者的手250或觀賞者本身（未繪示）等等。以下則說明觀賞者如何透過手勢的變化與三維立體 201239673^NAl-AC-0052-TWXX 36937twf.doc/I The above-described effects and the contents of the present invention are further exemplified as examples in which the present invention can be carried out. 1 is a #(四) unified block 1] of a three-dimensional imaginary object according to an embodiment of the present invention. 2 is a schematic diagram of a control system for a green non-two-dimensional virtual object in accordance with an embodiment of the present invention. As shown in the figure, the control system 1 of the two-dimensional virtual object may include, but is not limited to, the display device 110, the image capturing device 12A, and the processing device 13A. The display device 110 is, for example, a 3D television, a 3D display, or a 3D projector for displaying a three-dimensional stereoscopic image such that the virtual object in the three-dimensional stereoscopic image has a depth of field with the display. As an aid to FIG. 2, the display device 110 is, for example, a 3D display 210. The 3D display 210 can display a two-dimensional stereoscopic image such that the virtual object 240 and the 3D display 210 in the three-dimensional image have a depth of field D. The viewer can view the three-dimensional image displayed by the 3D display 210 by wearing the 3D glasses 260. The image capturing device 12 is, for example, a camera or an infrared camera using a Charge Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS) component, which is used to capture a display device. The image in front of you. As shown in Fig. 2, the image capturing device 120 is, for example, a 3D camera 220. The RGB camera and the depth sensor (Depth sensor) can be disposed in the 3D camera 220, and the image used to capture the front of the 3D display 210 includes the viewer's hand 250 or the viewer itself (not shown) and the like. The following explains how viewers can change through gestures and three-dimensional. 201239673

riN/u-AU-0052-TWXX 36937twf.doc/I 影像中的虛擬物件240進行互動。你山置130用以伽影像榻取襄置120所擷取的影象中的手勢’判斷手勢的移動是否接近虛擬物件，並在手勢接近虛擬物件時，對虛擬物件執行手勢所對應的操作。搭配圖^作說明，處理裝置13〇例如是電腦⑽，其係作控系統的主要控制甲心，負責侧與分析3D攝衫機▲所拍攝到的影像，觀察影像中觀賞者的手250之化雷ί中，當觀#者的手25G的手勢接近虛擬物件 ~ 230即對虛擬物件24〇執行手勢所對應的操作。6之，電腦230中可事先定義基本的手勢，並可建 ’ J^行手勢分析並且執行手勢所對應圖3⑷、圖3⑻及圖3(c)是依照 2及/施例所繪不之手勢的示意圖。請同時參照圖单施P /主，當觀f者的手25G之手掌向箭頭方向310 一P代表向左移動，此時電腦23〇會對虛擬物件執订向左移動的操作；當觀賞者的手祝之手掌向卩^向右移動’此時電腦230會對虛擬物 ===。=_)所示，若取物狀，並且如前頭方向330做左右 ί 24=: 旋轉操作，此時電腦230會對虛擬物手250 又如圖3 (C)所示’若觀賞者的呈捏取物狀，且分別往箭頭方向34〇、35〇移動，則代表放大操作，此時電腦顶會對虛擬物件執行放大 8 201239673riN/u-AU-0052-TWXX 36937twf.doc/I The virtual object 240 in the image interacts. Your mountain set 130 uses the gesture in the image captured by the image capture device 120 to determine whether the movement of the gesture is close to the virtual object, and to perform a gesture corresponding to the virtual object when the hand is close to the virtual object. Referring to the figure, the processing device 13 is, for example, a computer (10), which is the main control center of the control system, responsible for the side and analysis of the image captured by the 3D camera ▲, and observes the viewer's hand 250 in the image. In the Thunder, the gesture of the hand 25G of the viewer is close to the virtual object ~ 230, that is, the operation corresponding to the gesture of the virtual object 24〇. In the computer 230, basic gestures can be defined in advance, and the gestures can be constructed and the gestures corresponding to FIG. 3(4), FIG. 3(8), and FIG. 3(c) are gestures according to the 2 and/or examples. Schematic diagram. Please refer to the chart at the same time to apply P / master. When the palm of the hand 25G is in the direction of the arrow 310, the P represents the movement to the left. At this time, the computer 23 will move the virtual object to the left; when the viewer The hand of the hand wishes the palm to move to the right ^ then the computer 230 will be a virtual object ===. =_), if the object is taken, and if the front direction 330 is left and right ί 24=: rotation operation, then the computer 230 will be the virtual object 250 as shown in Figure 3 (C) 'If the viewer's presentation Pinch the object shape and move it to the arrow direction 34〇, 35〇 respectively, which means the zoom operation, at this time the computer top will enlarge the virtual object 8 201239673

PNAI-AC-0052-TWXX 36937twf.doc/I 的動作。上述僅為本發明手勢操作的幾個實施例，但並不限於此，凡藉由偵測手勢變化而對虛擬物件執行相對應的操作即為本發明之精神所在。以下另舉一實施例來說明本發明操控方法的實施步驟圖4疋依照本發明之另一實施例所綠示之三維立體虛擬物件的操控方法的流程圖。圖5是依照本發明之另一實知例所缘示之二維立體虛擬物件的操控系統的方塊圖。三維立體虛擬物件的操控系統5〇〇可包括（但不侷限於）顯示裝置510、影像擷取裝置52〇以及處理裝置53〇。其中，處理裝置530包括辨識模組54〇以及判斷模組55〇。以下請同時配合參照圖4與圖5。 …首先’如步驟S410所示，顯示裝置51()於螢幕中顯不三維立體影像’使得此三維立體影像中的虛擬物件與螢幕之間具有景深。其中，處理裝置53G可調整虛擬㈣與螢幕之間的景深’使得虛擬物件呈現於觀#者前方且位於觀賞者之手臂可及範圍之内。 &痒=旦:ί ’處理裝置530可以負視差（negative paralIax) 角度奴影虛擬物件，並調整虛擬物件與螢幕之間的景深，使得虛擬物件位於觀賞者前方大約成人手臂伸長之距離，此為二維立體影像的最佳觀賞距離。此外，調整便觀賞者接下來湘手勢與虛擬物件進行互動。步驟期所示’影像搁取裝置別擷取螢幕且紀錄此影像中觀賞者的手的位置及景深專貝枓’並將資料傳給辨識模組540進行分析。其中，資Action of PNAI-AC-0052-TWXX 36937twf.doc/I. The foregoing is only a few embodiments of the gesture operation of the present invention, but is not limited thereto. The corresponding operation of the virtual object by detecting the change of the gesture is the spirit of the present invention. The following is another embodiment to illustrate the implementation of the control method of the present invention. FIG. 4 is a flow chart showing a method of controlling a three-dimensional virtual object in green according to another embodiment of the present invention. Figure 5 is a block diagram of a control system for a two-dimensional virtual object in accordance with another embodiment of the present invention. The control system 5 of the three-dimensional virtual object may include, but is not limited to, a display device 510, an image capture device 52A, and a processing device 53A. The processing device 530 includes an identification module 54A and a determination module 55A. Please refer to Figure 4 and Figure 5 together. ... firstly, as shown in step S410, the display device 51() displays a three-dimensional stereoscopic image in the screen such that there is a depth of field between the virtual object and the screen in the three-dimensional stereoscopic image. Wherein, the processing device 53G can adjust the depth of field between the virtual (four) and the screen such that the virtual object is presented in front of the viewer and within the reach of the viewer's arm. & Itching = Dan: ί 'Processing device 530 can negatively distract the negative object (negative paralIax) angle and adjust the depth of field between the virtual object and the screen, so that the virtual object is located in front of the viewer about the distance of the adult arm, this The best viewing distance for 2D stereo images. In addition, the adjustment allows the viewer to interact with the virtual object. In the step shown, the image capture device does not capture the screen and records the position and depth of field of the viewer's hand in the image and transmits the data to the identification module 540 for analysis. Among them, capital

2〇123翌〇〇一 36937twf.doc/I 料的傳送可利用有線方式（例如是通用序列匯流排傳輸）或無線方式（例如是藍芽傳輸）進行傳輸，在此不加以限制。辨識模組540接收影像擷取裝置52〇所擷取的影像及相關資料，據以偵測影像中的手勢（步驟S43〇)。在步驟S·’判斷模組55〇判斷手勢是否接近於虛擬物件。其巾，觸模組55G會先轉虛齡件與勞幕之間的景深’ ^義虛擬物件的操作區域，並且利用此操作區域判斷手勢是否接近於虛擬物件。此操作區域可涵後一預設平面之_立體如，或是涵蓋虛擬物件周= 設距離内的立體空間，在此不設限。一舉例來說，圖6是依照本發明之另一實施例所緣示之三維立體虛擬物件的操作區域示意圖。請參照圖6，螢幕 610與操作區域㈣之間的距離即為景深d，而操作區域 6。20係涵蓋景深D前後預設平面之間的立體空間。此操作區域620之範圍可由使用者事先設定。需注意的是，操作區域=範圍必須在影像擷取裝置520的視角裡。換句話，丄影像擷取裝置520所擷取的影像必須能夠用來界定出銳員者的手在操作區域620内的位置。圖7疋依照本發明之另一貫施例所繪示之三維立體虛擬物件的操作區域與影像擷取裝置的相對位置示意圖。如圖7=示’操作區域620之範圍係在影像擷取裝^52()的 μ角範圍630内，而虛擬物件640則位於操作區域620之，圍内在此需注意的是，雖然虛擬物件640不會出現在〜像擷取裝置52〇所擷取的影像中，但處理裝置$扣仍可The transmission of 2〇123翌〇〇36937twf.doc/I material can be transmitted by wired means (for example, universal serial bus transmission) or wirelessly (for example, Bluetooth transmission), and is not limited herein. The identification module 540 receives the image captured by the image capturing device 52 and related data, thereby detecting a gesture in the image (step S43A). At step S·', the determination module 55 determines whether the gesture is close to the virtual object. The towel, the touch module 55G first turns the depth of field between the imaginary piece and the screen, and the operation area of the virtual object is used, and the operation area is used to judge whether the gesture is close to the virtual object. This operation area can cover the stereoscopic space of a preset plane or the space of the virtual object week = set distance, and there is no limit here. For example, Figure 6 is a schematic illustration of the operational region of a three-dimensional virtual object in accordance with another embodiment of the present invention. Referring to FIG. 6, the distance between the screen 610 and the operation area (4) is the depth of field d, and the operation area 6.20 covers the three-dimensional space between the preset planes before and after the depth of field D. The range of this operating area 620 can be set by the user in advance. It should be noted that the operating area = range must be in the perspective of the image capturing device 520. In other words, the image captured by the image capture device 520 must be capable of defining the position of the sharp hand in the operating region 620. FIG. 7 is a schematic diagram showing the relative position of an operation area of a three-dimensional imaginary object and an image capturing device according to another embodiment of the present invention. 7 shows that the range of the operation area 620 is within the μ angle range 630 of the image capture device 52, and the virtual object 640 is located at the operation area 620. 640 does not appear in the image captured by the capture device 52, but the processing device $ buckle can still be

201239673 ^JMAl-A(J-0052-TWXX 36937twf.doc/I 從原先齡的三維立體影像情知趣物件64G 域620中的實際位置。 ” FL- 圖8是依照本發明之另一實施例所綠示之影像榻取裝置所操取影像的示意圖。請㈣參照圖5及圖8，例的處理裝置530可從影賴取裝置52Q所擷取的影像㈣中分析出觀賞者的手660之位置，而與虛擬物件64〇之細，區域62G的範圍進行比較’進而判斷出觀賞者的手 660是否接近虛擬物件64〇。回到圖4’在步驟S450,當處理裳置53〇判斷出，近於虛擬物件時，即對虛擬物件執行該手勢所對應的摔 I °其中’對於靖手勢是否接近於虛擬物二種不同的標準，—種是判斷手勢是否進 2乍區域内；一種是判斷手勢是否進入操作區域内且盥 f擬物件之_雜小於-預設轉；—種収判斷手勢疋否進入操作區域内且碰觸到虛擬物件。出觀在一實施例中’處縣置530是在判斷出視貝者的手_之手勢進人操作區域㈣内時，即對虛執行手勢所對應的操作；在另一實施例中，處裝置530是在判斷觀賞者的手_之手勢進入操作區娀 620内且與盧擬物件64〇之間的距離小於預設距離時 64G執行手勢所對應的操作，其中，預設距離依Γ情況事先設定，在此不加以限制;在又 ^ <理裝置530是在判斷觀賞者的手_之手勢進細作區域620内且碰觸到虛擬物件_時，對虛擬 11 201239673201239673 ^JMAl-A(J-0052-TWXX 36937twf.doc/I The actual position in the 64G domain 620 from the original 3D stereoscopic image object. ” FL- FIG. 8 is a green color according to another embodiment of the present invention. The schematic diagram of the image taken by the image reclining device is shown. (4) Referring to FIG. 5 and FIG. 8, the processing device 530 can analyze the position of the viewer's hand 660 from the image (4) captured by the image capturing device 52Q. And compared with the virtual object 64 ,, the range of the area 62G is compared 'and further determines whether the viewer's hand 660 is close to the virtual object 64 〇. Returning to FIG. 4', in step S450, when the processing is performed, the determination is made, near In the case of a virtual object, that is, the virtual object performs the gesture corresponding to the drop I ° which is 'two different standards for whether the Jing gesture is close to the virtual object, the kind is to judge whether the gesture is within the 2乍 area; one is the judgment gesture Whether it enters the operation area and the _f-like object is less than - the preset rotation; - the seeding judgment gesture 进入 does not enter the operation area and touches the virtual object. In an embodiment, the county 530 is In judging the hand of the viewer When the gesture enters the operation area (4), that is, the operation corresponding to the virtual execution gesture; in another embodiment, the device 530 determines that the gesture of the viewer's hand enters the operation area 620 and is related to the object. The operation corresponding to the 64G execution gesture when the distance between 64〇 is less than the preset distance, wherein the preset distance is set in advance according to the situation, and is not limited herein; and the device 530 is in the judgment of the viewer. Hand _ gesture into the fine area 620 and touch the virtual object _ when the virtual 11 201239673

riNm-/\^-0052-TWXX 36937twf.doc/I 物件640執行手勢所對應的操作。關於對虛擬物件64〇執行手勢所對應的操作在上述實施例中已有詳細描述，故在此不再贅述。至於手勢之分析技術主要可分成兩類，其一為手勢辨識（hand-shape recognition)，另一為手勢追蹤（hand_m〇ti〇n recognition)。以下舉例說明手勢辨識與手勢追蹤所使用的方法：手勢辨識可利用一種多尺度（multi scale)方法將所荒集到大量的㈣歸資料分錢組，對影像進行不同程度的糢糊化’藉此可除去影像間的微小差異，接著，將模糊化後的影像與手勢對·料庫進行反覆識出聂终丰熱。手勢追蹤可利用降維加速強健特徵（speeded-u feat刪，驗F)為祕，❹主量分析priNm-/\^-0052-TWXX 36937twf.doc/I The object 640 performs the operation corresponding to the gesture. The operation corresponding to the execution of the gesture on the virtual object 64 is described in detail in the above embodiment, and therefore will not be described again. As far as gesture analysis techniques are concerned, they can be mainly divided into two categories, one for hand-shape recognition and the other for hand_m〇ti〇n recognition. The following examples illustrate the methods used for gesture recognition and gesture tracking: Gesture recognition can use a multi-scale method to discard a large number of (4) data into groups, and to blur the images to varying degrees. The small difference between the images can be removed, and then the blurred image and the gesture pair library are repeatedly recognized. Gesture tracking can use the dimension reduction to accelerate the robust features (speeded-u feat delete, test F) as the secret, the main quantity analysis p

動，例如移動、旋轉、放大或本發明除了能翻於互動式電 12 201239673 PNAI-AC-0052-TWXX 36937twf.doc/I 影、互動式遊戲等以提升其娛樂功能外，& 工程以及教育訓練等領域’而提供使用者接二:於醫學、雖然本發明已以實施觸露如上，纽的便利性。本發明’任何所屬技術領域中具有通常知2以限定本發明之精神和範_，#可作些許^ 不脫離發明之保護範圍當視後附之申請專利範【圖式簡單說明】圖1是依照本發明之一實施例所繪示物件的操控系統的方塊圖。一.准立肢虛擬圖2是依照本發明之一實施例物件的操控系統的示意圖。•斤、會不之三維立體虛擬圖3 (a)至圖3 (c)是依照本發之手勢變化的示意圖。料月之-貫施例所繪示減2是依照本發明之另—實施例所繪示之=唯立體卢擬物件的獅綠麟程_。 -雜體虛圖5是依照本發明之另一實施例所綠擬物件的操控系統的方塊圖。 9 —維立體虛圖6是依照本發明之另一會擬物件的操作區域示意圖。彳“不之三維立體虛圖7是依照本發明之另一會尬一擬，取體虛置所擷取===之另—實施例所繪示之影像擷取裝 13 201239673Motion, such as moving, rotating, zooming in or in addition to being able to turn over interactive electric 12 201239673 PNAI-AC-0052-TWXX 36937twf.doc/I movies, interactive games, etc. to enhance their entertainment functions, & engineering and education In the field of training and the like, the user is provided with the following two: in medicine, although the present invention has been implemented to expose the convenience of the above. The present invention has the general knowledge of 2 in the art to limit the spirit and scope of the present invention, and # can be used as a part of the scope of protection of the invention. One embodiment of the present invention is a block diagram of a handling system for an article. 1. Quasi-Vertical Virtual Figure 2 is a schematic illustration of an operating system for an article in accordance with one embodiment of the present invention. • Three-dimensional virtual reality, Figure 3 (a) to Figure 3 (c) are schematic diagrams of changes in gestures in accordance with the present invention. The reduction of 2 is a lion green _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ - phantom virtual Figure 5 is a block diagram of a control system for a green object in accordance with another embodiment of the present invention. 9 - Dimensional Virtual Figure 6 is a schematic illustration of the operational area of another object in accordance with the present invention.彳 “No three-dimensional virtual figure 7 is another image according to the present invention, and the image is taken by the dummy === another embodiment of the image capture device 13 201239673

.-0052-TWXX.-0052-TWXX

36937twf.doc/I 【主要元件符號說明】 100、500 :三維立體虛擬物件的操控系統 110、510 :顯示裝置 120、520 :影像擷取裝置 130、530 :處理裝置 210 : 3D顯示器 220 : 3D攝影機 230 :處理器 240、640 :虛擬物件 250、660 :觀賞者的手 260 : 3D眼鏡 310〜350 :箭頭方向 540 :辨識模組 550 :判斷模組 610 :螢幕 620 :操作區域 630 :視角範圍 650 :影像 L_eye :左眼 R_eye :右眼 D :景深 S410〜S450 :步驟36937twf.doc/I [Main component symbol description] 100, 500: Three-dimensional virtual object manipulation system 110, 510: display device 120, 520: image capturing device 130, 530: processing device 210: 3D display 220: 3D camera 230: processor 240, 640: virtual object 250, 660: viewer's hand 260: 3D glasses 310 ~ 350: arrow direction 540: identification module 550: judgment module 610: screen 620: operation area 630: angle of view range 650 : Image L_eye : Left eye R_eye : Right eye D : Depth of field S410 ~ S450 : Step

Claims

^-0052-TWXX 36937twf doc/I 201239673 七、申請專利範圍： 1. 一種三驟：維立體虛擬物件的操控方法，包括下列步顯示一三維立體影像於一替篡中的-虛擬物件與該螢幕之間具有二維立體影像擷取該螢幕前方的一影像；、偵測該影像中的一手勢；判斷該手勢是否接近該虛擬物件；以及當判斷該手勢接近該虛擬該手勢對應的-㈣。對#擬物件執行 2.如申請專利範圍第1項所述之方法，其中顯… 維立體影像於該螢幕，使得該二 ·、·、 '^二件與該營幕之間具有該景;的;=像中的該虛擬物物件幕之㈣該纽，使得該虛擬圍且位於該觀賞者之-手臂可及範 3·如中請專利範圍第i項所述之方法，其勢是否接近該虛擬物件的步驟包括：斷。亥手根據該虛錄件與該螢幕之_歸深物件的-操作區域；以及心制虛擬利H操作區域判_手勢是否接近該虛擬物件。 .中請專利範圍第3項所述之方法，其中二包括:蓋該景深前後-預設平面之間的立體空:; 叫盎4业擬物件周圍—預設距離内的立體空間。3疋 15 201239673.u052.twxx 36937^ 5·如申請專利範圍第3項所述之方法，其中 ==件時’對該虚擬物件執行該“ 行該手1===該操作區域内時，對該虛擬物件執手勢第51貞所叙技’其中當判斷該 ===件時’對該虛擬物件執行該手勢對應的當判斷該手勢進人該操作區域内觸近該該操作的步驟包括：丁°亥手勢對應的件時：虛=二:作勢到該虛擬物 ===二包括：立體影像中的-虛擬物件與該維像;::像操取裝置’用簡取該崎置前;r影件’並在該手勢接近該虛婦件時 201239673 riNAi-AC-0052-TWXX 36937twf.doc/I 手勢對應的一操作。 9.如申請專利範圍第8項所、+、— 一的操作裝置，其中該處理裝俾^之^維立體虛擬物件之間的該景深4義該虛擬物^據件與該榮幕操作讀區域，並利用該作。制虛擬物件執行該手㈣應的該操的二圍第9項所述之三維立體虛擬物件 =於料人鋪作區域内且與該虛錄件之間的距到賴妓該手勢進人該難區域内且碰觸到該虛擬物件時，對該虛擬物件執行該手勢對應的該操作。 11.-種二維立體虛擬物件的處理裝置，適於操控— ·、.、頁不裝置所顯示的-三維立體影像中的—虛擬物件，包括. -辨識模組，用以接收1像触裝置賴取之該顯不褒置前方的-影像，並辨識該影像中的—手勢，Α中兮顯示裂置所顯示之該三維立體影像中的該虛擬物件與該^ 不裝置之間具有一景深；以及、—判斷模組，用以判斷該手勢是否接近該虛擬物件，並在該手勢接近該虛擬物件時，對該虛擬物件執行該對應的一操作。 17^-0052-TWXX 36937twf doc/I 201239673 VII. Patent application scope: 1. A three-step method: a method for controlling a three-dimensional virtual object, comprising the following steps: displaying a three-dimensional image in a substitute - a virtual object and the screen Having a two-dimensional stereo image capturing an image in front of the screen; detecting a gesture in the image; determining whether the gesture is close to the virtual object; and determining that the gesture is close to the virtual corresponding gesture - (4). 2. The method of claim 1, wherein the method of claim 1 is characterized in that the dimensional image is displayed on the screen such that the two, the two pieces and the scene have the scene; (4) the button in the virtual object object in the image, so that the virtual circle is located in the viewer's arm-arms. The method described in item i of the patent scope is close to the method. The steps of the virtual object include: Broken. According to the virtual record and the screen, the object-operating area is deepened, and the heart-shaped virtual H operation area judges whether the gesture is close to the virtual object. The method described in the third item of the patent scope, wherein the second method comprises: covering the front and back of the depth of field - the three-dimensional space between the preset planes:; surrounding the object around the object - the three-dimensional space within the preset distance. 3疋15 201239673.u052.twxx 36937^ 5. The method of claim 3, wherein == when the item is executed on the virtual object, the hand 1=== in the operation area, Performing the gesture of the virtual object, wherein the step of performing the gesture corresponding to the virtual object when determining the === piece, the step of determining that the gesture is entered in the operation area includes: : Ding ° Hai gesture corresponding to the piece: virtual = two: the trend to the virtual object === two include: - virtual object in the stereo image and the dimension image;:: like the operation device 'used to take the map Front; r shadow 'and an operation corresponding to the gesture when the gesture approaches the virtual woman 201239673 riNAi-AC-0052-TWXX 36937twf.doc/I. 9. As claimed in item 8, item +, - The operation device, wherein the depth of field between the three-dimensional virtual object of the processing device is defined by the virtual object and the window operation read area, and the virtual object is used to execute the hand (four) The three-dimensional virtual object described in item 9 of the second paragraph of the operation = in the material paving area And the distance between the virtual recording and the virtual recording is performed in the difficult area and the virtual object is touched, and the operation corresponding to the gesture is performed on the virtual object. The processing device for the object is adapted to operate - the virtual object in the three-dimensional image displayed by the device, including the - identification module, for receiving the display of the image sensor Positioning the front image and recognizing the - gesture in the image, and displaying a depth of field between the virtual object and the device in the three-dimensional image displayed by the splitting; and - determining module And determining whether the gesture is close to the virtual object, and performing the corresponding operation on the virtual object when the gesture approaches the virtual object.