TW201626168A - Gesture recognition devices and gesture recognition methods - Google Patents
Gesture recognition devices and gesture recognition methods Download PDFInfo
- Publication number
- TW201626168A TW201626168A TW104144450A TW104144450A TW201626168A TW 201626168 A TW201626168 A TW 201626168A TW 104144450 A TW104144450 A TW 104144450A TW 104144450 A TW104144450 A TW 104144450A TW 201626168 A TW201626168 A TW 201626168A
- Authority
- TW
- Taiwan
- Prior art keywords
- gesture
- predetermined portion
- recognition device
- determined based
- gesture recognition
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/593—Depth or shape recovery from multiple images from stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
各種實施例一般係關於手勢辨識裝置及手勢辨識方法。 Various embodiments are generally directed to gesture recognition devices and gesture recognition methods.
各種形式之手勢辨識系統已存在一段時間，然而，直到最近，該手勢辨識系統的用途仍局限於簡單手勢。就此點而論，可存在對於更先進手勢辨識的需要。 Various forms of gesture recognition systems have existed for some time, however, until recently, the use of the gesture recognition system was still limited to simple gestures. As such, there may be a need for more advanced gesture recognition.
根據各種實施例，可提供一種手勢辨識裝置。該手勢辨識裝置可包括：感測器，其配置來判定手勢辨識裝置的使用者之位置資訊；進展判定電路，其配置來基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及手勢判定電路，其配置來解析手勢並觸發該手勢引起的一次動作及二次動作。 According to various embodiments, a gesture recognition device can be provided. The gesture recognition apparatus can include: a sensor configured to determine location information of a user of the gesture recognition device; a progress determination circuit configured to determine whether at least a predetermined portion of the gesture has been performed by the user based on the location information; A gesture determination circuit configured to parse the gesture and trigger an action and a secondary action caused by the gesture.
根據各種實施例，可提供一種手勢辨識方法。該手勢 辨識方法可包括判定手勢辨識裝置的使用者之位置資訊；基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及基於手勢的至少預定部分來判定手勢。 According to various embodiments, a gesture recognition method can be provided. The gesture The identification method may include determining location information of a user of the gesture recognition device; determining whether at least a predetermined portion of the gesture has been performed by the user based on the location information; and determining the gesture based on at least a predetermined portion of the gesture.
100‧‧‧手勢辨識裝置 100‧‧‧ gesture recognition device
102‧‧‧感測器 102‧‧‧ sensor
104‧‧‧進展判定電路 104‧‧‧Development decision circuit
106‧‧‧手勢判定電路 106‧‧‧ gesture decision circuit
108‧‧‧線 108‧‧‧ line
110‧‧‧手勢辨識裝置 110‧‧‧ gesture recognition device
112‧‧‧資料庫 112‧‧‧Database
114‧‧‧傳送器 114‧‧‧transmitter
116‧‧‧線 116‧‧‧ line
118‧‧‧流程圖 118‧‧‧ Flowchart
120‧‧‧步驟 120‧‧‧Steps
122‧‧‧步驟 122‧‧‧Steps
124‧‧‧步驟 124‧‧‧Steps
200‧‧‧圖示 200‧‧‧ icon
202‧‧‧實例 202‧‧‧Instance
204‧‧‧實例 204‧‧‧Instance
206‧‧‧方塊 206‧‧‧ square
208‧‧‧方塊 208‧‧‧ square
210‧‧‧方塊 210‧‧‧ square
212‧‧‧方塊 212‧‧‧ square
214‧‧‧方塊 214‧‧‧ squares
216‧‧‧方塊 216‧‧‧ square
218‧‧‧方塊 218‧‧‧ square
300‧‧‧圖示 300‧‧‧ icon
302‧‧‧箭頭方塊 302‧‧‧ arrow square
304‧‧‧箭頭方塊 304‧‧‧ arrow square
306‧‧‧箭頭方塊 306‧‧‧arrow squares
308‧‧‧箭頭方塊 308‧‧‧ arrow squares
310‧‧‧箭頭方塊 310‧‧‧ arrow square
312‧‧‧箭頭方塊 312‧‧‧ arrow square
314‧‧‧箭頭方塊 314‧‧‧arrow squares
316‧‧‧箭頭方塊 316‧‧‧ arrow square
318‧‧‧箭頭方塊 318‧‧‧ arrow squares
在圖式中，在全部不同視圖中，相同元件符號一般係指相同部件。圖式未必按比例繪製，相反，重點通常是關注對本發明原理的例示。各種特徵或元件之尺寸可出於清晰度任意地擴展或縮減。在以下描述中，本發明之各種實施例係參考以下圖式來描述。 In the drawings, the same component symbols generally refer to the same components throughout the different views. The drawings are not necessarily to scale, the <RTIgt; The dimensions of the various features or elements can be arbitrarily expanded or reduced for clarity. In the following description, various embodiments of the invention are described with reference to the following drawings.
圖1A及圖1B顯示根據各種實施例之手勢辨識裝置。 1A and 1B show gesture recognition devices in accordance with various embodiments.
圖1C顯示例示根據各種實施例的手勢辨識方法的流程圖。 FIG. 1C shows a flow chart illustrating a gesture recognition method in accordance with various embodiments.
圖2顯示例示根據各種實施例的鍵控手勢(keying gesture)方塊圖及製程流程的圖表。 2 shows a diagram illustrating a keying gesture block diagram and a process flow in accordance with various embodiments.
圖3顯示例示根據各種實施例的手勢判定的圖表。 FIG. 3 shows a chart illustrating gesture determination in accordance with various embodiments.
以下詳細描述參照藉助於例示來顯示可實現本發明之特定細節及實施例的隨附圖式。足夠詳細地描述此等實 施例以允許熟習此項技術者實現本發明。可利用其他實施例，並且可在不脫離本發明之範疇的情況下進行結構及邏輯改變。各種實施例未必互相排斥，如一些實施例可與一或複數個其他實施例組合以形成新的實施例。 The following detailed description refers to the accompanying drawings, in which FIG. Describe these facts in sufficient detail The examples are intended to allow those skilled in the art to practice the invention. Other embodiments may be utilized and structural and logical changes may be made without departing from the scope of the invention. The various embodiments are not necessarily mutually exclusive, as some embodiments may be combined with one or more other embodiments to form a new embodiment.
在本文中，如此說明中所描述之手勢辨識裝置可包括記憶體，該記憶體例如使用於在該手勢辨識裝置中進行之製程。使用於實施例之記憶體可為依電性記憶體，例如DRAM(動態隨機存取記憶體)或非依電性記憶體，例如PROM(可程式化唯讀記憶體)、EPROM(可抹除PROM)、EEPROM(電子可抹除PROM)，或快閃記憶體，例如浮閘記憶體、電荷捕集記憶體、MRAM(磁電阻隨機存取記憶體)或PCRAM(相變隨機存取記憶體)。 Herein, the gesture recognition device described in the description may include a memory that is used, for example, in a process performed in the gesture recognition device. The memory used in the embodiment may be an electrical memory such as a DRAM (Dynamic Random Access Memory) or a non-electric memory such as a PROM (Programmable Read Only Memory) or an EPROM (Erasable) PROM), EEPROM (Electrically Erasable PROM), or flash memory, such as floating memory, charge trapping memory, MRAM (magnetoresistive random access memory) or PCRAM (phase change random access memory) ).
在實施例中，「電路」可理解為任何種類的邏輯實行實體，該邏輯實行實體可為執行儲存於記憶體中之軟體、韌體或其任何組合的專用電路或處理器。因此，在實施例中，「電路」可為硬連線邏輯電路或可程式化邏輯電路，諸如可程式化處理器，例如微處理器(例如複雜指令集電腦(CISC)處理器或精簡指令集電腦(RISC)處理器)。「電路」亦可為執行軟體的處理器，該軟體例如任何種類的電腦程式，例如使用虛擬機代碼(諸如例如Java)之電腦程式。將在以下更詳細地描述的各別功能之任何其他種類的實行方案亦可理解為根據替代實施例之「電路」。 In an embodiment, a "circuit" can be understood to be any kind of logically executing entity, which can be a dedicated circuit or processor that executes software, firmware, or any combination thereof stored in memory. Thus, in an embodiment, the "circuit" can be a hardwired logic circuit or a programmable logic circuit, such as a programmable processor, such as a microprocessor (eg, a complex instruction set computer (CISC) processor or a reduced instruction set. Computer (RISC) processor). The "circuit" can also be a processor that executes software, such as any kind of computer program, such as a computer program that uses virtual machine code such as, for example, Java. Any other type of implementation of the various functions that will be described in greater detail below may also be understood as "circuitry" in accordance with alternative embodiments.
在說明書中，應瞭解術語「包含」具有類似於術語「包括」之廣義意義，且將瞭解術語「包含」意指已陳述之整體或步驟或一個以上整體或步驟之組群的集合，但不排斥任何其他整體或步驟或一個以上整體或步驟之組群。此定義亦應用於術語「包含(comprising)」之變體，諸如「包含(comprise)」及「包含(comprises)」。 In the description, it should be understood that the term "comprising" has a broad meaning similar to the term "comprising", and it is understood that the term "comprising" means a set of the whole or steps or a group of more than one or a whole of the stated, but not Reject any other whole or step or group of more than one whole or step. This definition also applies to variants of the term "comprising" such as "comprise" and "comprises".
此說明書中提及之任何先前技術不視為且不應視為對所提及之先前技術形成在澳大利亞(或任何其他國家)之公知常識的部分之承認或任何形式之建議。 No prior art referred to in this specification is considered and should not be taken as an admission or any form of suggestion that the prior art referred to in the form of common general knowledge in Australia (or any other country).
為使本發明可易於理解且獲得實際效果，將以舉例且非限制之方式並參考圖式來描述特定實施例。 The specific embodiments are described by way of example and not limitation,
針對裝置已提供各種實施例，且針對方法已提供各種實施例。將理解的是，裝置之基本性質亦適用於方法，且反之亦然。因此，為簡潔起見，可省略此等性質之重複描述。 Various embodiments have been provided for the device, and various embodiments have been provided for the method. It will be understood that the basic nature of the device also applies to the method, and vice versa. Therefore, for the sake of brevity, repeated descriptions of such properties may be omitted.
將理解的是，本文針對特定裝置所描述之任何性質亦可適用於本文所描述之任何裝置。將理解的是，本文針對特定方法所描述之任何性質亦可適用於本文所描述之任何方法。此外，將理解的是，對於本文所描述之任何裝置 或方法而言，所描述之所有部件或步驟未必必須納入裝置或方法中，而可僅僅納入一些(但非所有)部件或步驟。 It will be understood that any of the properties described herein for a particular device may also be applicable to any of the devices described herein. It will be understood that any of the properties described herein for a particular method may also be applied to any of the methods described herein. Moreover, it will be understood that for any of the devices described herein By way of example, all of the components or steps described are not necessarily required to be included in the device or method, but only some, but not all, components or steps may be incorporated.
本文之術語「耦接」(或「連接」)可理解為電氣耦接或理解為機械耦接，例如附接或固定或附接，或僅在無任何固定之情況下接觸，且將理解的是，可提供直接耦接或間接耦接(換言之，在無直接接觸之情況下耦接)。 The term "coupled" (or "connected") herein is understood to mean electrically coupled or understood as mechanically coupled, such as attached or fixed or attached, or only in the absence of any fixation, and will be understood. Yes, direct or indirect coupling (in other words, coupling without direct contact) can be provided.
根據各種實施例，可提供一種鍵控手勢方法。根據各種實施例，可提供一種用於HMD(頭戴顯示器)及其他辨識系統的方法。 According to various embodiments, a keying gesture method can be provided. According to various embodiments, a method for an HMD (Head Mounted Display) and other identification systems can be provided.
手勢辨識系統的進步已引起HW(硬體)/SW(軟體)之已應用於各種使用模型的解決方案激增，該使用模型例如增強或增大用於電腦及遊戲系統的正常(鍵盤/滑鼠)HID(人機介面裝置)介面的獨立手部及/或獨立手指手勢辨識系統及整合辨識系統。 Advances in gesture recognition systems have led to a proliferation of HW (hardware)/SW (software) solutions that have been applied to various usage models, such as enhancing or increasing the normality of keyboards and mice for computers and gaming systems (keyboard/mouse) ) HID (Human Machine Interface Device) interface independent hand and / or independent finger gesture recognition system and integrated identification system.
根據各種實施例，可提供一種用於將全包式取徑(overarching approach)整合至在部分程度上藉由「鍵控手勢」來驅動之手勢辨識引擎/系統的方法。 In accordance with various embodiments, a method for integrating an overarching approach to a gesture recognition engine/system that is driven in part by a "keying gesture" may be provided.
各種形式之手勢辨識系統已存在一段時間，然而直到最近，其用途仍局限於例如包括手部及一些數目的手指之 簡單手勢。這些系統有以下負擔，在可對手勢進行識別、解析及作用之前必須對大型的手勢程式庫進行分類。處理手勢可經過大量處理循環(該循環可例如定義為「N」)。在手勢列表非常大及/或若手勢辨識引擎無法解析形成不良的手勢的情況下，處理時間可能是長的(例如可經過「N x Y」循環，其中「Y」可為大於1的因數)。當辨識引擎無法解析手勢時，可繼續對該手勢進行再檢查，直至解析為止，且此舉可導致高螢幕潛時以及不穩固及不可重複的製程。 Various forms of gesture recognition systems have existed for some time, but until recently their use was still limited to, for example, the hand and some number of fingers. Simple gestures. These systems have the burden of classifying large gesture libraries before they can recognize, parse, and act on gestures. Processing gestures can go through a number of processing loops (this loop can be defined, for example, as "N"). In the case where the gesture list is very large and/or if the gesture recognition engine cannot resolve the bad gesture, the processing time may be long (eg, through an "N x Y" loop, where "Y" may be a factor greater than 1) . When the recognition engine is unable to resolve the gesture, the gesture can be re-examined until parsing, and this can result in high screen latency and unstable and non-repeatable processes.
即使改良處理器、加入本地處理及大大減小手勢程式庫之規模，所涉及的潛時也不允許先進應用程式及/或遊戲使用模型。 Even with improved processors, added local processing, and greatly reduced the size of the gesture library, the latency involved does not allow advanced applications and/or game usage models.
儘管手勢辨識系統之進步持續發生，但對具有良好效能(例如具有潛時)的穩固及可靠的手勢辨識系統的需要可為允許總體上更廣泛採用並用於諸如頭戴顯示器(Head Mounted Display；HMD)的各種高層次應用程式中之關鍵。潛時必須經保持最小，尤其對桌上、視訊、控制台以及HMD遊戲應用程式而言。當前，基於螢幕前部之實行方案的潛時可在許多情況下過高，可導致不理想或不可行之電玩經驗。 While advances in gesture recognition systems continue to occur, the need for robust and reliable gesture recognition systems with good performance (eg, with latency) may allow for wider adoption in general and for use in, for example, head mounted displays (HMD). ) The key to the various high-level applications. Latency must be kept to a minimum, especially for desktop, video, console, and HMD gaming applications. Currently, the latency of implementations based on the front of the screen can be too high in many cases, leading to unsatisfactory or infeasible gaming experiences.
根據各種實施例，可提供關於鍵控手勢(換言之，鍵 (key)手勢)、快速手勢、HMD手勢、用於HMD的手勢、短格式手勢以及觸發手勢的裝置及方法。 According to various embodiments, a keying gesture can be provided (in other words, a key (key) gestures, fast gestures, HMD gestures, gestures for HMD, short format gestures, and means and methods for triggering gestures.
鍵控手勢可定義為手部及/或手指的來源於「自然手部」位置之姿勢，該位置如在使用者訪問他或她的電腦系統及觸及鍵盤時發生，亦即，使用者在鍵盤上打字之前置於鍵盤或桌的掌托上時手部所在的位置。使用者可隨後形成由各種各樣的人所普遍辨識的特定手勢。「拇指朝上」及「食指指向」可為兩個實例。 The keying gesture can be defined as the gesture of the "natural hand" position of the hand and/or the finger, which occurs when the user accesses his or her computer system and touches the keyboard, that is, the user is on the keyboard. The position of the hand when placed on the palm rest of the keyboard or table before typing. The user can then form a particular gesture that is widely recognized by a wide variety of people. "Thighs up" and "index finger" can be two examples.
根據各種實施例，可提供一種辨識系統，該辨識系統允許更快的手勢辨識(且因此允許更低的潛時)，因為該系統可在複雜手勢(例如拇指朝上手部手勢或涉及兩隻手外加手指的手勢)部分形成(>50%)時解析該複雜手勢。該系統可針對頭戴顯示器上的面朝下攝影機來設計，以便減少臂部疲勞且允許更多自然手勢及臂部位置。 According to various embodiments, an identification system can be provided that allows for faster gesture recognition (and thus lower latency) because the system can be in complex gestures (eg, thumb up hand gestures or involving both hands) The gesture of the finger is applied to the partial gesture (>50%) to resolve the complex gesture. The system can be designed for face down cameras on head mounted displays to reduce arm fatigue and allow for more natural gestures and arm positions.
根據各種實施例，可提供一種手勢辨識裝置。該手勢辨識裝置可包括感測器，其配置來判定手勢辨識裝置的使用者之位置資訊；進展判定電路，其配置來基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及手勢判定電路，其配置來解析手勢並觸發該手勢引起的一次動作及二次動作。 According to various embodiments, a gesture recognition device can be provided. The gesture recognition device can include a sensor configured to determine location information of a user of the gesture recognition device; a progress determination circuit configured to determine whether at least a predetermined portion of the gesture has been performed by the user based on the location information; and a gesture A decision circuit configured to parse the gesture and trigger an action and a second action caused by the gesture.
根據各種實施例，可提供裝置及方法，以甚至在由使用者完全擺出/形成手勢之前偵測手勢。 In accordance with various embodiments, apparatus and methods can be provided to detect a gesture even before the gesture is fully popped/formed by the user.
根據各種實施例，可提供一種手勢辨識裝置。該手勢辨識裝置可包括感測器，其配置來判定手勢辨識裝置的使用者的資訊(例如位置資訊、前臂放置資訊以及單個手指放置資訊)；進展判定電路，其配置來基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及手勢判定電路，其配置來基於手勢之至少預定部分來判定手勢。 According to various embodiments, a gesture recognition device can be provided. The gesture recognition device can include a sensor configured to determine information of a user of the gesture recognition device (eg, location information, forearm placement information, and single finger placement information); a progress determination circuit configured to determine whether based on the location information At least a predetermined portion of the gesture has been performed by the user; and a gesture determination circuit configured to determine the gesture based on at least a predetermined portion of the gesture.
圖1A顯示根據各種實施例之手勢辨識裝置100。手勢辨識裝置100可包括感測器102，該感測器配置來判定手勢辨識裝置100的使用者的位置資訊。手勢辨識裝置100可進一步包括進展判定電路104，該進展判定電路配置來基於位置資訊以判定是否已由使用者執行手勢的至少預定部分。手勢辨識裝置100可進一步包括手勢判定電路106，該手勢判定電路配置來基於手勢的至少預定部分以判定手勢。感測器102、進展判定電路104以及手勢判定電路106可彼此耦接，如藉由線108所指示，該耦接例如電氣耦接及/或機械耦接，該電氣耦接例如使用線或電纜。 FIG. 1A shows a gesture recognition device 100 in accordance with various embodiments. The gesture recognition device 100 can include a sensor 102 configured to determine location information of a user of the gesture recognition device 100. The gesture recognition apparatus 100 can further include a progress determination circuit 104 configured to determine whether at least a predetermined portion of the gesture has been performed by the user based on the location information. The gesture recognition apparatus 100 can further include a gesture determination circuit 106 configured to determine a gesture based on at least a predetermined portion of the gesture. The sensor 102, the progress determination circuit 104, and the gesture determination circuit 106 can be coupled to one another, as indicated by line 108, such as an electrical coupling and/or a mechanical coupling, such as using a wire or cable. .
換言之，根據各種實施例的手勢辨識系統可在使用者實際上完成執行該手勢之前解析使用者的鍵控手勢(換言 之，判定鍵控手勢)。 In other words, the gesture recognition system according to various embodiments may parse the user's keying gesture before the user actually performs the gesture (in other words) It determines the keying gesture).
圖1B顯示根據各種實施例的手勢辨識裝置110。類似於圖1A的手勢辨識裝置100，手勢辨識裝置110可包括感測器102，該感測器配置來判定手勢辨識裝置110的使用者的位置資訊。類似於圖1A的手勢辨識裝置100，手勢辨識裝置110可進一步包括進展判定電路104，該進展判定電路配置來基於位置資訊以判定是否已由使用者執行手勢的至少預定部分。類似於圖1A的手勢辨識裝置100，手勢辨識裝置110可進一步包括手勢判定電路106，該手勢判定電路配置來基於手勢的至少預定部分以判定手勢。手勢辨識裝置110可進一步包括資料庫112，如將在以下更詳細地描述。手勢辨識裝置110可進一步包括傳送器114，如將在以下更詳細地描述。感測器102、進展判定電路104、手勢判定電路106、資料庫112以及傳送器114可彼此耦接，如藉由線116所指示，該耦接例如電氣耦接及/或機械耦接，該電氣耦接例如使用線或電纜。 FIG. 1B shows gesture recognition device 110 in accordance with various embodiments. Similar to the gesture recognition device 100 of FIG. 1A, the gesture recognition device 110 can include a sensor 102 configured to determine location information of a user of the gesture recognition device 110. Similar to the gesture recognition device 100 of FIG. 1A, the gesture recognition device 110 can further include a progress determination circuit 104 configured to determine whether at least a predetermined portion of the gesture has been performed by the user based on the location information. Similar to the gesture recognition device 100 of FIG. 1A, the gesture recognition device 110 can further include a gesture determination circuit 106 configured to determine a gesture based on at least a predetermined portion of the gesture. Gesture recognition device 110 may further include a library 112, as will be described in greater detail below. Gesture recognition device 110 may further include a transmitter 114 as will be described in greater detail below. The sensor 102, the progress determination circuit 104, the gesture determination circuit 106, the database 112, and the transmitter 114 can be coupled to each other, as indicated by the line 116, such as electrical coupling and/or mechanical coupling, Electrical coupling, for example using wires or cables.
根據各種實施例，資料庫112可經配置來儲存資訊，該資訊指示複數個預定手勢。根據各種實施例，手勢判定電路106可進一步經配置來基於資料庫112以判定手勢。 According to various embodiments, the repository 112 may be configured to store information indicative of a plurality of predetermined gestures. According to various embodiments, the gesture determination circuit 106 may be further configured to determine a gesture based on the database 112.
根據各種實施例，手勢判定電路106可進一步經配置來基於手勢之至少預定部分與判定手勢匹配的機率來判 定該手勢。 According to various embodiments, the gesture determination circuit 106 may be further configured to determine based on the probability that at least a predetermined portion of the gesture matches the determined gesture Set this gesture.
根據各種實施例，傳送器114可經配置來傳送資訊，該資訊指示基於手勢的至少預定部分來判定的手勢。 According to various embodiments, the transmitter 114 may be configured to transmit information indicative of a gesture determined based on at least a predetermined portion of the gesture.
根據各種實施例，進展判定電路104可進一步經配置來判定使用者是否已完成手勢。 According to various embodiments, the progress decision circuit 104 may be further configured to determine whether the user has completed the gesture.
根據各種實施例，手勢判定電路106可進一步經配置來判定基於手勢之至少預定部分所判定的手勢與完成手勢是否匹配。 According to various embodiments, the gesture decision circuit 106 may be further configured to determine whether the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture.
根據各種實施例，傳送器114可進一步經配置來在手勢判定電路106判定基於手勢之至少預定部分所判定的手勢與完成手勢不匹配的情況下，傳送廢止指示，該廢止指示指示基於手勢之至少預定部分所判定的手勢與完成手勢不匹配。 According to various embodiments, the transmitter 114 may be further configured to transmit an abolition indication indicating that the gesture based signal is at least based on the gesture if the gesture determination circuit 106 determines that the gesture determined based on at least a predetermined portion of the gesture does not match the completion gesture The gesture determined by the predetermined portion does not match the completion gesture.
根據各種實施例，傳送器114可進一步經配置來在手勢判定電路106判定基於手勢之至少預定部分所判定的手勢與完成手勢匹配的情況下，傳送確認指示，該確認指示指示基於手勢之至少預定部分所判定的手勢與完成手勢匹配。 According to various embodiments, the transmitter 114 may be further configured to transmit a confirmation indication, when the gesture determination circuit 106 determines that the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture, the confirmation indication indicating at least a predetermined based on the gesture The part of the determined gesture matches the completion gesture.
根據各種實施例，感測器102可包括或可為或可包括於以下中之至少一種：深度感測器、攝影機、三維掃描器、三維攝影機或距離感測器。 According to various embodiments, the sensor 102 may include or may be or may be included in at least one of: a depth sensor, a camera, a three-dimensional scanner, a three-dimensional camera, or a distance sensor.
根據各種實施例，手勢辨識裝置110可提供於頭戴顯示器上及/或頭戴顯示器中。 According to various embodiments, the gesture recognition device 110 can be provided on a head mounted display and/or in a head mounted display.
根據各種實施例，手勢判定電路106可進一步經配置來判定是否已執行鍵控手勢。根據各種實施例，手勢判定電路106進一步經配置來基於鍵控手勢以判定用於後續手勢判定之一組候選手勢(換言之，泳道)。 According to various embodiments, the gesture decision circuit 106 may be further configured to determine whether a keying gesture has been performed. According to various embodiments, the gesture determination circuit 106 is further configured to determine a set of candidate gestures (in other words, lanes) for subsequent gesture determination based on the keying gesture.
根據各種實施例，鍵控手勢可包括或可為或可包括於拇指朝上手勢、握拳手勢或和平標誌手勢。 According to various embodiments, the keying gesture may include or may be or may be included in a thumb up gesture, a fist gesture, or a peace sign gesture.
圖1C顯示例示根據各種實施例的手勢辨識方法的流程圖118。在步驟120中，可判定手勢辨識裝置的使用者之位置資訊。在步驟122中，可基於位置資訊來判定是否已由使用者執行手勢的至少預定部分。在步驟124中，可基於手勢之至少預定部分來判定手勢。 FIG. 1C shows a flowchart 118 illustrating a gesture recognition method in accordance with various embodiments. In step 120, the location information of the user of the gesture recognition device can be determined. In step 122, it may be determined based on the location information whether at least a predetermined portion of the gesture has been performed by the user. In step 124, the gesture can be determined based on at least a predetermined portion of the gesture.
根據各種實施例，手勢辨識方法可進一步包括在資料庫中儲存指示複數個預定手勢的資訊，且基於該資料庫判定手勢。 According to various embodiments, the gesture recognition method may further include storing information indicating a plurality of predetermined gestures in the database, and determining the gesture based on the database.
根據各種實施例，手勢辨識方法可進一步包括基於手勢之至少預定部分與判定手勢匹配的機率來判定該手勢。 According to various embodiments, the gesture recognition method may further include determining the gesture based on a probability that at least a predetermined portion of the gesture matches the determined gesture.
根據各種實施例，手勢辨識方法可進一步包括傳送資訊，該資訊指示基於手勢的至少預定部分來判定的手勢。 According to various embodiments, the gesture recognition method may further include transmitting information indicating a gesture determined based on at least a predetermined portion of the gesture.
根據各種實施例，手勢辨識方法可進一步包括判定使用者是否已完成手勢。 According to various embodiments, the gesture recognition method may further include determining whether the user has completed the gesture.
根據各種實施例，手勢辨識方法可進一步包括判定基於手勢之至少預定部分所判定的手勢與完成手勢是否匹配。 According to various embodiments, the gesture recognition method may further include determining whether the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture.
根據各種實施例，手勢辨識方法可進一步包括在判定基於手勢之至少預定部分所判定的手勢與完成手勢不匹配的情況下，傳送廢止指示，該廢止指示指示基於手勢之至少預定部分所判定的手勢與完成手勢不匹配。 According to various embodiments, the gesture recognition method may further include transmitting an abolition indication indicating a gesture determined based on at least a predetermined portion of the gesture, in a case where it is determined that the gesture determined based on at least a predetermined portion of the gesture does not match the completion gesture Does not match the completion gesture.
根據各種實施例，手勢辨識方法可進一步包括在判定基於手勢之至少預定部分所判定的手勢與完成手勢匹配的情況下，傳送確認指示，該確認指示指示基於手勢之至少預定部分所判定的手勢與完成手勢匹配。 According to various embodiments, the gesture recognition method may further include transmitting, in the case of determining that the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture, the confirmation indication indicating a gesture determined based on at least a predetermined portion of the gesture Complete the gesture match.
根據各種實施例，判定位置資訊可包括基於以下中之至少一種來判定位置資訊：深度感測器、攝影機、三維掃描器、三維攝影機或距離感測器。 According to various embodiments, determining location information may include determining location information based on at least one of: a depth sensor, a camera, a three-dimensional scanner, a three-dimensional camera, or a distance sensor.
根據各種實施例，手勢辨識方法可使用安裝於頭戴顯示器上或頭戴顯示器中的例如一組感測器的感測器中之至少一種來執行。 According to various embodiments, the gesture recognition method may be performed using at least one of a sensor mounted on a head mounted display or in a head mounted display, such as a set of sensors.
根據各種實施例，手勢辨識方法可進一步包括判定是否已執行鍵控手勢；以及基於鍵控手勢判定用於後續手勢判定之一組候選手勢。 According to various embodiments, the gesture recognition method may further include determining whether a keying gesture has been performed; and determining a group candidate gesture for the subsequent gesture determination based on the keying gesture.
根據各種實施例，鍵控手勢可包括或可為或可包括於拇指朝上手勢、握拳手勢或和平標誌手勢。 According to various embodiments, the keying gesture may include or may be or may be included in a thumb up gesture, a fist gesture, or a peace sign gesture.
圖2顯示例示根據各種實施例的鍵控手勢方塊圖及製程流程的圖示200。已顯示鍵控手勢之實例202、實例204。在方塊206中，可檢查鍵控手勢。在方塊208中，可判定手勢姿勢是否已完成50%以上(換言之「>」50%，換言之「至少50%」)。在方塊210中，Windows 8 touchless(視窗作業系統8非觸控)可訪問對應的手勢程式庫(方塊212)。在方塊214中，定製遊戲或應用程式可訪問對應的手勢程式庫(方塊216)。在方塊218中，可訪問常用的手勢程式庫。在圖2中，方塊206指代如藉由感 測器所感知的所擺出手勢的光學捕獲。方塊208指代辨識引擎如何基於所形成手勢的>50%來解析所擺出手勢。方塊210指代預定義Windows 8 touchless手勢姿勢及/或移動的組合。方塊210亦指代各種實施例中所提及的「泳道」中之一者。方塊212指代Windows 8 touchless手勢的特定程式庫，特定而言，辨識引擎將在記憶體中的哪一區域尋找，以發現比較手勢及/或移動。方塊214指代使用者定義及儲存將用於應用程式或遊戲以觸發遊戲事件中的特定動作或反應的手勢。方塊214亦指代各種實施例中所提及的兩個「泳道」中之一者。方塊216指代應用程式的特定程式庫或遊戲特定手勢，以及記憶體中的特定區域，辨識引擎將尋找該區域以發現比較手勢及/或移動的組合。 2 shows an illustration 200 illustrating a keying gesture block diagram and a process flow in accordance with various embodiments. Example 202, instance 204 of the keying gesture has been displayed. In block 206, the keying gesture can be checked. In block 208, it can be determined whether the gesture gesture has been completed by more than 50% (in other words, ">" 50%, in other words "at least 50%"). In block 210, Windows 8 touchless (Windows operating system 8 non-touch) can access the corresponding gesture library (block 212). In block 214, the customized game or application can access the corresponding gesture library (block 216). In block 218, a library of commonly used gesture programs is accessed. In Figure 2, block 206 refers to the sense of Optical capture of the gestures perceived by the detector. Block 208 refers to how the recognition engine parses the gestures based on >50% of the formed gesture. Block 210 refers to a combination of predefined Windows 8 touchless gesture gestures and/or movements. Block 210 also refers to one of the "lanes" referred to in the various embodiments. Block 212 refers to a particular library of Windows 8 touchless gestures, in particular, which region of the memory the recognition engine will look for in order to find comparison gestures and/or movements. Block 214 refers to a user defining and storing gestures that will be used by an application or game to trigger a particular action or reaction in a game event. Block 214 also refers to one of the two "lanes" mentioned in the various embodiments. Block 216 refers to a particular library or game specific gesture of the application, as well as a particular area in the memory that the recognition engine will look for to find a combination of comparison gestures and/or movements.
根據各種實施例，辨識引擎可偵測及解析手勢。根據各種實施例，「鍵控手勢」可在部分程度上基於變化的自然手部位置及手指位置來形成，其中攝影機定位於上方且俯視使用者手部，如將在HMD應用程式中所為。此途徑亦可解決當使用者之臂部及手部太長時間處於不自然/抬高位置時存在的「金剛臂效應」或疲勞因素。根據各種實施例，改進方法可評估形成/擺出的手勢，且之後鍵控手勢形成50%以上(>50%)，辨識引擎可隨後基於針對當前可能待執行的手勢組(亦可稱為當前所使用的「泳道」)之最可能的手勢來解析該手勢。例如，所有候選手勢可分類 為兩組(換言之，兩個種類，亦可稱為兩個「泳道」)手勢。最可能的手勢可為含有於分派給兩個「泳道」中任一個的子手勢組內的那些手勢。(例如Windows 8 touchless手勢/或DT導航或應用程式/遊戲特定手勢，如將參照以下的圖3所描述)。將瞭解，可提供用於已知應用程式以及一次動作組及二次動作組之小且集中的鍵控手勢程式庫。一次動作可定義為起因於將使用者置於特定泳道中之鍵控手勢的動作，該泳道如參照以下的圖3更詳細地描述。二次動作可定義為專用於應用程式或遊戲，或Windows 8 touchless手勢中之一個及該手勢引起之子動作的動作。鍵控手勢可將辨識引擎有意置放至若干特定路徑中之一個中，以使得可更快速地辨識及解析該手勢，從而可減少潛時。諸如涉及兩隻手外加手指之那些手勢的複雜手勢可大大受益於此途徑。假定使用者處於Windows 8 Touchless手勢「泳道」中，一次動作可為藉由Windows所限定以允許打開文件夾的唯一手勢中之任一個，該打開繼之以二次動作，該二次動作可為具有標的文件夾之應用程式的啟動。在假定使用者已在應用程式泳道/遊戲泳道中的情況下，一次動作可為應用程式或遊戲的啟動。二次動作可為對應用程式特定設定進行選擇及設定或在遊戲內執行武器切換或拼寫框。 According to various embodiments, the recognition engine can detect and resolve gestures. According to various embodiments, the "keying gesture" may be formed in part based on varying natural hand position and finger position, wherein the camera is positioned above and overlooks the user's hand, as would be done in an HMD application. This approach also solves the "golden arm effect" or fatigue factor that occurs when the user's arms and hands are in an unnatural/uplift position for too long. According to various embodiments, the improved method may evaluate the gesture of forming/spreading, and then the keying gesture forms more than 50% (>50%), and the recognition engine may then be based on the set of gestures that may be currently pending (also referred to as current The most likely gesture of the "lane" used to resolve the gesture. For example, all candidate gestures can be classified For both groups (in other words, two categories, also known as two "lanes") gestures. The most likely gesture may be those gestures contained within a sub-gesture group assigned to either of the two "lanes." (For example, Windows 8 touchless gestures/or DT navigation or application/game specific gestures, as will be described with reference to Figure 3 below). It will be appreciated that a small and centralized set of keyed gesture libraries for known applications as well as one action group and second action group can be provided. An action can be defined as an action resulting from a keyed gesture that places the user in a particular lane, which is described in more detail with reference to Figure 3 below. A secondary action can be defined as an action dedicated to an application or game, or one of the Windows 8 touchless gestures and the child action caused by the gesture. The keying gesture can intentionally place the recognition engine into one of a number of specific paths so that the gesture can be recognized and resolved more quickly, thereby reducing latency. Complex gestures such as those involving two hands plus fingers can greatly benefit from this approach. Assuming that the user is in the Windows 8 Touchless gesture "lane", one action may be any one of the only gestures defined by Windows to allow opening of the folder, the opening followed by a secondary action, which may be The launch of an application with the target folder. In the case of assuming that the user is already in the application lane/game lane, one action can be the launch of the application or game. The secondary action can be to select and set application specific settings or to perform a weapon switching or spelling box within the game.
不存在已確立的除當下正使用的基於面向前途徑的傳統使用模型之外的針對手勢使用的方法或管理標準。向 前途徑可定義為攝影機/感測器朝向使用者而安裝於膝上電腦上(與攝影機/感測器安裝於HMD上且朝向下方，聚焦於使用者的前臂及手部相比較)。根據各種實施例，方法可提供各種應用程式中之容易的使用，諸如當將手勢辨識解決方案應用於HMD應用程式時。根據各種實施例的裝置及方法可特定地修改以滿足特定產品的設計目標，且確保未來發展及/或使用者或第三方方案提供者，即遊戲ISV(獨立軟體供應商)創造定製鍵控手勢的能力。 There are no established methods or management criteria for gesture usage other than the traditional usage model based on the forward path currently being used. to The pre-route can be defined as the camera/sensor mounted to the laptop towards the user (as compared to the camera/sensor mounted on the HMD and facing downward, focusing on the user's forearm and hand). According to various embodiments, the method can provide ease of use in a variety of applications, such as when a gesture recognition solution is applied to an HMD application. Apparatus and methods in accordance with various embodiments may be specifically modified to meet the design goals of a particular product, and to ensure future development and/or user or third party solution providers, ie, game ISVs (independent software vendors) to create custom keying The ability to gesture.
圖3顯示例示根據各種實施例的手勢判定的圖示300。在箭頭方塊302中，處理可進入桌上導航路線(箭頭方塊304)。在箭頭方塊306中，處理可進入應用程式導航路線/遊戲導航路線(箭頭方塊308)。當鍵控手勢形成至允許辨識引擎解析手勢的百分比時，手勢將經解析。辨識引擎將使用者置入兩個「泳道」中之一個中，(換言之，置入最可能執行複數個候選組中的一組之模式中)，且辨識引擎隨後將瞭解其將僅須搜尋更小及更特定的手勢組，當偵測到該手勢時，將觸發一次動作及隨後觸發二次動作。使用者可保持於指定泳道中，直至箭頭方塊310中形成道切換手勢之時為止(此時在箭頭方塊312或箭頭方塊314中將進行「泳道」改變)。該製程在其他泳道內重複，且直至偵測到「泳道」手勢之時為止。 FIG. 3 shows an illustration 300 illustrating gesture determination in accordance with various embodiments. In arrow block 302, processing can enter the table navigation route (arrow block 304). In arrow block 306, processing may enter the application navigation route/game navigation route (arrow block 308). When the keying gesture is formed to allow the recognition engine to resolve the percentage of the gesture, the gesture will be resolved. The recognition engine places the user in one of the two "lanes" (in other words, placed in the mode most likely to execute one of the plurality of candidate groups), and the recognition engine will then understand that it will only have to search for more Small and more specific gesture groups, when detected, trigger an action and then trigger a second action. The user can remain in the designated lane until the lane switching gesture is formed in arrow block 310 (in this case, the "lane" change will be made in arrow block 312 or arrow block 314). The process repeats in other lanes until the "lane" gesture is detected.
根據各種實施例，可提供小的鍵控手勢組，其他手勢 可為泳道或使用模型之獨有，且可位於唯一所含有程式庫內，如參照以上的圖2所描述。根據各種實施例，在已知泳道或使用模型內，非鍵控手勢可為多目的的。 According to various embodiments, a small set of keying gestures can be provided, other gestures It can be unique to the swim lane or model, and can be located in a unique library, as described in Figure 2 above. According to various embodiments, non-keyed gestures may be multi-purpose within known lanes or usage models.
根據各種實施例，可提供兩個以上泳道。泳道可等於「使用模型」，在該使用模型中，可創造一組預定手勢以允許泳道或使用模型內之更快速及更可預料的相互作用。 According to various embodiments, more than two lanes may be provided. A swim lane can be equal to a "use model" in which a set of predetermined gestures can be created to allow for faster and more predictable interactions within the swim lane or using the model.
根據各種實施例，可於已知泳道/使用模型內提供明顯不同的相互作用。優點可為，一旦使用者處於泳道中，則辨識引擎可僅須搜尋及解析確立用於該泳道/使用模型的手勢。 According to various embodiments, significantly different interactions can be provided within known lane/use models. An advantage may be that once the user is in the lane, the recognition engine may only have to search and parse the gestures established for the lane/use model.
根據各種實施例，可存在基本上一個預定鍵控手勢，用於改變或切換泳道，例如「握拳」手勢。再起始此手勢可作為切換且將使用者自一個泳道移動至另一個泳道。該手勢可唯一地創造但可保持於適當位置直至創造該手勢且若創造該手勢則可保持於適當位置，但一旦確立，可未必有道改變的再創造。 According to various embodiments, there may be substantially one predetermined keying gesture for changing or switching lanes, such as a "fist" gesture. Start this gesture again to switch and move the user from one lane to another. The gesture can be uniquely created but can be held in place until the gesture is created and if the gesture is created, it can be held in place, but once established, there may not be a re-creation of the change.
根據各種實施例，除非擺出鍵控手勢，否則最初未必進入泳道或自泳道退出。例如，可設定拇指朝上以允許使用者進入Windows 8 Touchless手勢泳道，而最初食指指向手勢可將使用者置於應用程式/遊戲特定泳道中。如以 上所詳述，退出泳道可藉由不同手勢起始，且可考慮道改變。 According to various embodiments, the swim lane may not initially enter or exit from the swim lane unless a keying gesture is placed. For example, the thumb can be set up to allow the user to enter the Windows 8 Touchless gesture lane, while the initial index finger pointing gesture can place the user in an application/game specific lane. Such as As detailed above, exiting the lane can be initiated by different gestures and can be considered in the course of a change.
根據各種實施例，鍵控手勢可為特定的且可以完全相同的方式藉由任意數目的人來形成/擺出。可不存在由使用者引起中斷的餘地。其他鍵控手勢可為握拳或和平標誌。 According to various embodiments, the keying gestures may be formed/spread by any number of people in a particular and possibly identical manner. There may be no room for interruption by the user. Other keying gestures can be a fist or a peace sign.
以下實例係關於其他實施例。 The following examples are related to other embodiments.
實例1為一種手勢辨識裝置，該手勢辨識裝置包含感測器，其配置來判定手勢辨識裝置的使用者之位置資訊；進展判定電路，其配置來基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及手勢判定電路，其配置來基於手勢之至少預定部分來判定手勢。 Example 1 is a gesture recognition device including a sensor configured to determine location information of a user of the gesture recognition device; a progress determination circuit configured to determine whether a gesture has been performed by the user based on the location information At least a predetermined portion; and a gesture determination circuit configured to determine the gesture based on at least a predetermined portion of the gesture.
在實例2中，實例1之標的可視需要包括資料庫，其配置來儲存資訊，該資訊指示複數個預定手勢；其中手勢判定電路進一步配置來基於資料庫以判定手勢。 In Example 2, the visual need for the subject of Example 1 includes a database configured to store information indicative of a plurality of predetermined gestures; wherein the gesture determination circuitry is further configured to determine a gesture based on the database.
在實例3中，實例2之標的可視需要包括手勢判定電路進一步配置來基於手勢的至少預定部分與判定手勢匹配的機率來判定手勢。 In Example 3, the visual need for the subject of Example 2 includes the gesture determination circuit being further configured to determine the gesture based on a probability that at least a predetermined portion of the gesture matches the determined gesture.
在實例4中，實例1至3中任一者之標的可視需要包括傳送器，其配置來傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定。 In Example 4, the visual need of the subject of any of Examples 1 to 3 includes a transmitter configured to transmit information indicative of a gesture that is determined based on at least a predetermined portion of the gesture.
在實例5中，實例1至4中任一者之標的可視需要包括進展判定電路進一步經配置來判定使用者是否已完成手勢。 In Example 5, the visual need for the subject of any of Examples 1 through 4 includes the progress determination circuit being further configured to determine if the user has completed the gesture.
在實例6中，實例5之標的可視需要包括手勢判定電路經配置來判定基於手勢之至少預定部分所判定的手勢與完成手勢是否匹配。 In Example 6, the visual need for the subject matter of Example 5 includes the gesture determination circuit being configured to determine whether the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture.
在實例7中，實例6之標的可視需要包括傳送器，其配置來傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定；其中傳送器進一步經配置來在手勢判定電路判定基於手勢之至少預定部分所判定的手勢與完成手勢不匹配的情況下，傳送廢止指示，該廢止指示指示基於手勢之至少預定部分所判定的手勢與完成手勢不匹配。 In Example 7, the visual need of the example 6 includes a transmitter configured to transmit information indicative of a gesture that is determined based on at least a predetermined portion of the gesture; wherein the transmitter is further configured to determine the gesture based on the gesture determination circuit In the case where the gesture determined by at least the predetermined portion does not match the completion gesture, the abolition indication is indicated, the indication indicating that the gesture determined based on at least a predetermined portion of the gesture does not match the completion gesture.
在實例8中，實例6至7中任一者之標的可視需要包括傳送器，其配置來傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定；其中傳送器進一步經配置來在手勢判定電路判定基於手勢之至少預定部分所判定的手勢與完成手勢匹配的情況下，傳送確認指示，該確認指 示指示基於手勢之至少預定部分所判定的手勢與完成手勢匹配。 In Example 8, the visual need of any of Examples 6-7 includes a transmitter configured to transmit information indicative of a gesture that is determined based on at least a predetermined portion of the gesture; wherein the transmitter is further configured to The gesture determination circuit determines that the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture, and transmits a confirmation indication, the confirmation finger The gesture indicating that the gesture is determined based on at least a predetermined portion of the gesture matches the completion gesture.
在實例9中，實例1至8中任一者之標的可視需要包括該感測器包含以下中的至少一種：深度感測器、攝影機、三維掃描器、三維攝影機或距離感測器。 In Example 9, the visual need for the subject matter of any of Examples 1-8 includes the sensor comprising at least one of: a depth sensor, a camera, a three-dimensional scanner, a three-dimensional camera, or a distance sensor.
在實例10中，實例1至9中任一者之標的可視需要包括手勢辨識裝置提供於頭戴顯示器上或頭戴顯示器中。 In Example 10, the visual needs of the subject matter of any of Examples 1-9 include the gesture recognition device being provided on the head mounted display or in the head mounted display.
在實例11中，實例1至10中任一者之標的可視需要包括手勢判定電路進一步經配置來判定是否已執行鍵控手勢；其中該手勢判定電路進一步經配置來基於鍵控手勢以判定用於後續手勢判定之一組候選手勢。 In Example 11, the visual need of the subject of any of Examples 1 to 10 includes the gesture determination circuit being further configured to determine whether a keying gesture has been performed; wherein the gesture determination circuit is further configured to determine based on the keying gesture for The subsequent gesture determines one of the group of candidate gestures.
在實例12中，實例11之標的可視需要包括鍵控手勢包含選自以下的至少一個手勢：拇指朝上手勢、握拳手勢或和平標誌手勢。 In Example 12, the visual need for the subject matter of Example 11 includes the keying gesture comprising at least one gesture selected from the group consisting of a thumb up gesture, a fist gesture, or a peace sign gesture.
實例13為一種手勢辨識方法，該手勢辨識方法包含判定手勢辨識裝置的使用者之位置資訊；基於位置資訊來判定是否已由使用者執行手勢之至少預定部分；以及基於手勢的至少預定部分來判定手勢。 Example 13 is a gesture recognition method, including determining location information of a user of the gesture recognition device; determining, based on the location information, whether at least a predetermined portion of the gesture has been performed by the user; and determining based on at least a predetermined portion of the gesture gesture.
在實例14中，實例13之標的可視需要包括於資料庫中儲存指示複數個預定手勢的資訊；以及基於資料庫來判定手勢。 In Example 14, the visual need of the subject of Example 13 includes storing information indicative of a plurality of predetermined gestures in a database; and determining a gesture based on the database.
在實例15中，實例14之標的可視需要包括基於手勢的至少預定部分與判定手勢匹配之機率來判定手勢。 In Example 15, the visual need for the subject of Example 14 includes determining a gesture based on the probability that at least a predetermined portion of the gesture matches the determined gesture.
在實例16中，實例13至15中任一者之標的可視需要包括傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定。 In Example 16, the visual need of the subject of any of Examples 13-15 includes transmitting information indicative of a gesture that is determined based on at least a predetermined portion of the gesture.
在實例17中，實例13至16中任一者之標的可視需要包括判定使用者是否已完成手勢。 In Example 17, the visual need of the subject of any of Examples 13-16 includes determining whether the user has completed the gesture.
在實例18中，實例17之標的可視需要包括判定基於手勢的至少預定部分所判定的手勢與完成手勢是否匹配。 In Example 18, the visual need of the subject of Example 17 includes determining whether the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture.
在實例19中，實例18之標的可視需要包括傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定；以及在已判定基於手勢之至少預定部分所判定的手勢與完成手勢不匹配的情況下，傳送廢止指示，該廢止指示指示基於手勢之至少預定部分所判定的手勢與完成手勢不匹配。 In Example 19, the visual need of the subject of Example 18 includes transmitting information indicative of a gesture that is determined based on at least a predetermined portion of the gesture; and determining that the gesture determined based on at least a predetermined portion of the gesture does not match the completion gesture In the case, the abolition indication is indicated, the indication indicating that the gesture determined based on at least a predetermined portion of the gesture does not match the completion gesture.
在實例20中，實例18至19中任一者之標的可視需要包括傳送指示手勢的資訊，該手勢基於該手勢之至少預定部分來判定；以及在已判定基於手勢之至少預定部分所判定的手勢與完成手勢匹配的情況下，傳送確認指示，該確認指示指示基於手勢之至少預定部分所判定的手勢與完成手勢匹配。 In Example 20, the visual need of the subject of any of Examples 18-19 includes transmitting information indicative of a gesture that is determined based on at least a predetermined portion of the gesture; and a gesture that has been determined based on at least a predetermined portion of the gesture In the case of matching the completion gesture, a confirmation indication is transmitted indicating that the gesture determined based on at least a predetermined portion of the gesture matches the completion gesture.
在實例21中，實例13至20中任一者之標的可視需要包括判定位置資訊包含基於以下中的至少一種來判定位置資訊：深度感測器、攝影機、三維掃描器、三維攝影機或距離感測器。 In Example 21, the visual need of the subject of any of Examples 13-20 includes determining that the location information comprises determining location information based on at least one of: a depth sensor, a camera, a three-dimensional scanner, a three-dimensional camera, or a distance sensing Device.
在實例22中，實例13至21中任一者之標的可視需要包括手勢辨識方法係使用安裝於頭戴顯示器上或頭戴顯示器中的感測器或攝影機中的至少一種來執行。 In Example 22, the subject matter of any of Examples 13-21 includes a gesture recognition method that is performed using at least one of a sensor or a camera mounted on a head mounted display or in a head mounted display.
在實例23中，實例13至22中任一者之標的可視需要包括判定是否已執行鍵控手勢；以及基於鍵控手勢判定用於後續手勢判定之一組候選手勢。 In Example 23, the visual need of the subject of any of Examples 13-22 includes determining whether a keying gesture has been performed; and determining a set of candidate gestures for subsequent gesture determination based on the keying gesture.
在實例24中，實例23之標的可視需要包括鍵控手勢包含選自以下的至少一個手勢：拇指朝上手勢、握拳手勢或和平標誌手勢。 In Example 24, the visual need for the subject of Example 23 includes the keying gesture comprising at least one gesture selected from the group consisting of a thumb up gesture, a fist gesture or a peace sign gesture.
雖然已參考特定實施例詳細地顯示及描述本發明，但熟習此項技術者應瞭解的是，在不脫離藉由隨附申請專利範圍限定的本發明之精神及範疇的情況下，可對這些實施例中之形式及細節做出各種改變。本發明之範疇因此藉由隨附申請專利範圍來表示，且落入請求項之同類者的含義及範圍內之所有改變因此均欲涵蓋於本發明中。 Although the present invention has been shown and described with reference to the particular embodiments of the present invention, it will be understood by those skilled in the art that the invention may be practiced without departing from the spirit and scope of the invention as defined by the appended claims Various changes are made in the form and details of the embodiments. The scope of the invention is therefore intended to be embraced by the scope of the claims
100‧‧‧手勢辨識裝置 100‧‧‧ gesture recognition device
102‧‧‧感測器 102‧‧‧ sensor
104‧‧‧進展判定電路 104‧‧‧Development decision circuit
106‧‧‧手勢判定電路 106‧‧‧ gesture decision circuit
108‧‧‧線 108‧‧‧ line
Claims (24)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/SG2015/000004 WO2016111641A1 (en) | 2015-01-09 | 2015-01-09 | Gesture recognition devices and gesture recognition methods |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201626168A true TW201626168A (en) | 2016-07-16 |
Family
ID=56356225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104144450A TW201626168A (en) | 2015-01-09 | 2015-12-30 | Gesture recognition devices and gesture recognition methods |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US20180267617A1 (en) |
| EP (1) | EP3243120A4 (en) |
| CN (1) | CN107430431B (en) |
| AU (1) | AU2015375530B2 (en) |
| SG (1) | SG11201705579QA (en) |
| TW (1) | TW201626168A (en) |
| WO (1) | WO2016111641A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11113890B2 (en) | 2019-11-04 | 2021-09-07 | Cognizant Technology Solutions India Pvt. Ltd. | Artificial intelligence enabled mixed reality system and method |
| US11418863B2 (en) | 2020-06-25 | 2022-08-16 | Damian A Lynch | Combination shower rod and entertainment system |
| US11594089B2 (en) * | 2021-04-16 | 2023-02-28 | Essex Electronics, Inc | Touchless motion sensor systems for performing directional detection and for providing access control |
Family Cites Families (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8684839B2 (en) * | 2004-06-18 | 2014-04-01 | Igt | Control of wager-based game using gesture recognition |
| GB2419433A (en) * | 2004-10-20 | 2006-04-26 | Glasgow School Of Art | Automated Gesture Recognition |
| US7725547B2 (en) * | 2006-09-06 | 2010-05-25 | International Business Machines Corporation | Informing a user of gestures made by others out of the user's line of sight |
| US20090265671A1 (en) * | 2008-04-21 | 2009-10-22 | Invensense | Mobile devices with motion gesture recognition |
| CA2748037C (en) * | 2009-02-17 | 2016-09-20 | Omek Interactive, Ltd. | Method and system for gesture recognition |
| CN101661556A (en) * | 2009-09-25 | 2010-03-03 | 哈尔滨工业大学深圳研究生院 | Static gesture identification method based on vision |
| KR101373285B1 (en) * | 2009-12-08 | 2014-03-11 | 한국전자통신연구원 | A mobile terminal having a gesture recognition function and an interface system using the same |
| US9019201B2 (en) * | 2010-01-08 | 2015-04-28 | Microsoft Technology Licensing, Llc | Evolving universal gesture sets |
| JP5601045B2 (en) * | 2010-06-24 | 2014-10-08 | ソニー株式会社 | Gesture recognition device, gesture recognition method and program |
| US9135503B2 (en) * | 2010-11-09 | 2015-09-15 | Qualcomm Incorporated | Fingertip tracking for touchless user interface |
| US9619035B2 (en) * | 2011-03-04 | 2017-04-11 | Microsoft Technology Licensing, Llc | Gesture detection and recognition |
| CN103105926A (en) * | 2011-10-17 | 2013-05-15 | 微软公司 | Multi-sensor posture recognition |
| EP2769335B1 (en) * | 2011-10-18 | 2018-04-18 | Nokia Technologies Oy | Methods and apparatuses for gesture recognition |
| CN102426480A (en) * | 2011-11-03 | 2012-04-25 | 康佳集团股份有限公司 | Man-machine interactive system and real-time gesture tracking processing method for same |
| US20130211843A1 (en) * | 2012-02-13 | 2013-08-15 | Qualcomm Incorporated | Engagement-dependent gesture recognition |
| CN102799273B (en) * | 2012-07-11 | 2015-04-15 | 华南理工大学 | Interaction control system and method |
| US9019174B2 (en) * | 2012-10-31 | 2015-04-28 | Microsoft Technology Licensing, Llc | Wearable emotion detection and feedback system |
| CN102981742A (en) * | 2012-11-28 | 2013-03-20 | 无锡市爱福瑞科技发展有限公司 | Gesture interaction system based on computer visions |
| TWI456430B (en) * | 2012-12-07 | 2014-10-11 | Pixart Imaging Inc | Gesture recognition apparatus, operating method thereof, and gesture recognition method |
| WO2014106823A2 (en) * | 2013-01-03 | 2014-07-10 | Meta Company | Extramissive spatial imaging digital eye glass apparatuses, methods and systems for virtual or augmediated vision, manipulation, creation, or interaction with objects, materials, or other entities |
| US9459697B2 (en) * | 2013-01-15 | 2016-10-04 | Leap Motion, Inc. | Dynamic, free-space user interactions for machine control |
| US9164588B1 (en) * | 2013-02-05 | 2015-10-20 | Google Inc. | Wearable computing device with gesture recognition |
| US9436288B2 (en) * | 2013-05-17 | 2016-09-06 | Leap Motion, Inc. | Cursor mode switching |
| US9383894B2 (en) * | 2014-01-08 | 2016-07-05 | Microsoft Technology Licensing, Llc | Visual feedback for level of gesture completion |
-
2015
- 2015-01-09 SG SG11201705579QA patent/SG11201705579QA/en unknown
- 2015-01-09 AU AU2015375530A patent/AU2015375530B2/en active Active
- 2015-01-09 CN CN201580077445.2A patent/CN107430431B/en active Active
- 2015-01-09 US US15/542,308 patent/US20180267617A1/en not_active Abandoned
- 2015-01-09 EP EP15877227.7A patent/EP3243120A4/en not_active Withdrawn
- 2015-01-09 WO PCT/SG2015/000004 patent/WO2016111641A1/en active Application Filing
- 2015-12-30 TW TW104144450A patent/TW201626168A/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| EP3243120A1 (en) | 2017-11-15 |
| AU2015375530B2 (en) | 2021-04-15 |
| WO2016111641A1 (en) | 2016-07-14 |
| EP3243120A4 (en) | 2018-08-22 |
| CN107430431B (en) | 2021-06-04 |
| SG11201705579QA (en) | 2017-08-30 |
| AU2015375530A1 (en) | 2017-07-27 |
| CN107430431A (en) | 2017-12-01 |
| US20180267617A1 (en) | 2018-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10592050B2 (en) | Systems and methods for using hover information to predict touch locations and reduce or eliminate touchdown latency | |
| JP5187280B2 (en) | Operation control device and operation control method | |
| US8059111B2 (en) | Data transfer using hand-held device | |
| US10282090B2 (en) | Systems and methods for disambiguating intended user input at an onscreen keyboard using dual strike zones | |
| CN103562820B (en) | Target ambiguities are eliminated and correction | |
| TW201224850A (en) | Gesture recognition | |
| JP7233109B2 (en) | Touch-sensitive surface-display input method, electronic device, input control method and system with tactile-visual technology | |
| JP2012511774A (en) | Software keyboard control method | |
| US20150185850A1 (en) | Input detection | |
| CN104769601A (en) | Method for recognition of user identity and electronic equipment | |
| US9619134B2 (en) | Information processing device, control method for information processing device, program, and information storage medium | |
| TW201626168A (en) | Gesture recognition devices and gesture recognition methods | |
| KR101548872B1 (en) | Fingers recognition method and system using image processing | |
| TWI662452B (en) | Portable electronic device and unlocking method | |
| KR102026882B1 (en) | Method and apparatus for distinguishing five fingers in electronic device including touch screen | |
| WO2017045277A1 (en) | Search method, device and apparatus, and non-volatile computer storage medium | |
| JP2016066254A (en) | Electronic device with touch detection apparatus | |
| WO2017193748A1 (en) | Application program data processing method and device | |
| Kim et al. | Tapboard 2: Simple and effective touchpad-like interaction on a multi-touch surface keyboard | |
| US9720513B2 (en) | Apparatus and method for receiving a key input | |
| US20170053161A1 (en) | Handwriting recognition with natural user input on multitouch surfaces | |
| WO2021012096A1 (en) | Media resource pushing apparatus and method, electronic device and storage medium | |
| HANI | Detection of Midair Finger Tapping Gestures and Their Applications | |
| CN115657921A (en) | Touch method and device, electronic equipment and computer readable storage medium | |
| CN116166161A (en) | Interaction method based on multi-level menu and related equipment |