WO2012051770A1 - 一种识别硬件手势的方法及移动终端 - Google Patents
一种识别硬件手势的方法及移动终端 Download PDFInfo
- Publication number
- WO2012051770A1 WO2012051770A1 PCT/CN2010/079696 CN2010079696W WO2012051770A1 WO 2012051770 A1 WO2012051770 A1 WO 2012051770A1 CN 2010079696 W CN2010079696 W CN 2010079696W WO 2012051770 A1 WO2012051770 A1 WO 2012051770A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- gesture
- hardware
- information
- mobile terminal
- finger
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
Definitions
- the present invention relates to gesture recognition technology in the field of mobile terminals, and in particular, to a method for identifying hardware gestures and a mobile terminal. Background technique
- FIG. 1 is a schematic structural diagram of a system for implementing gesture recognition on an android platform in the prior art. As shown in FIG. 1 , a two-finger split or close action is performed, assuming that the driver layer reports data to the architecture layer at a frequency of 80 Hz, per second architecture.
- the architecture layer preprocesses the information of a complete event and puts it in the motion class. Because the driver layer reports data to the architecture layer at 80 Hz, it generates up to 80 motions per second, and then sends the data in the motion class after each pre-processing to the gesture algorithm processing layer. Gesture algorithm processing layer processing once every 28ms, it probably is calculated 35 times per second.
- the generated gesture is calculated by a certain algorithm according to the coordinate information of each finger, and the gesture recognition method is relatively complicated, and multiple calculations are needed, so that the recognition efficiency of the gesture is low.
- the main object of the present invention is to provide a method for recognizing hardware gestures and a mobile terminal, which can quickly and efficiently implement recognition of hardware gestures of the mobile terminal.
- the present invention provides a method for identifying hardware gestures, including:
- Hardware gestures are identified based on pre-processed data.
- the touch information of the finger on the touch screen of the mobile terminal is: the chip in the driving layer of the mobile terminal acquires the touch information of the finger on the touch screen of the mobile terminal in real time, and sends the touch information to the architecture layer;
- the touch information includes: a coordinate value of a finger in a coordinate system whose origin is the upper left corner of the touch screen of the mobile terminal, a finger width value of the finger, a pressure of the finger on the touch screen, a pressed touch value of the finger, and hardware gesture information;
- the hardware gesture information includes: direction information of two fingers closed or separated and amplitude information of two fingers closed or separated, or direction information of two fingers left-handed or right-handed, and angle information of two-finger rotation, or amplitude information of hardware gestures.
- the preprocessing the data in the touch information is:
- the architecture layer of the mobile terminal records the motion state information of the finger to the object of the motion class according to the data of the touch information; the architecture layer records the data in the touch information and the time of generating the hardware gesture into the object of the motion class, and Sending data in the object of the motion class to the gesture algorithm processing layer;
- the motion state information includes: a finger is in motion, a finger is bounced, and a finger is pressed.
- the hardware gesture is identified according to the preprocessed data: the gesture algorithm processing layer of the mobile terminal obtains the motion state of the finger on the touch screen according to the preprocessed data, and when the motion state is determined, the finger is on the touch screen.
- the gesture algorithm processing layer identifies the hardware gesture according to the hardware gesture information of the touch information in the received motion class.
- the gesture algorithm processing layer is based on the touch information in the received motion class.
- Hardware gesture information, identifying hardware gestures as:
- the hardware gesture is a pinch gesture
- the gesture algorithm processing layer calculates the intensity coefficient of the hardware gesture according to the hardware gesture information of the touch information in the received motion class, and sends the strength coefficient of the hardware gesture to the application layer of the mobile terminal;
- the hardware gesture is a rotate gesture
- the gesture algorithm processing layer reads the hardware gesture information of the touch information in the received motion class, and sends the read direction information and the angle information of the hardware gesture to the application layer of the mobile terminal.
- the hardware gesture is a palm reject gesture
- the gesture algorithm processing layer reads the hardware gesture information of the touch information in the received motion class, and determines the amplitude information and the threshold of the preset palm reject, if the amplitude information If the threshold is greater than or equal to the threshold of the palm reject, the process ends; if the amplitude information is smaller than the threshold of the palm reject, the corresponding processing is performed.
- the method further includes: implementing a function corresponding to the hardware gesture on the mobile terminal according to the recognition result.
- the function corresponding to implementing the hardware gesture on the mobile terminal according to the recognition result is:
- the strength coefficient of the hardware gesture is less than 1, and the reduction of the image is implemented on the mobile terminal, and the scale of the reduction is determined according to the strength coefficient of the hardware gesture; the strength coefficient of the hardware gesture is greater than 1, and is implemented on the mobile terminal.
- the enlargement of the picture determines the scale of the enlargement according to the size of the intensity coefficient of the hardware gesture; if it is equal to 1, no operation is performed.
- the function corresponding to implementing the hardware gesture on the mobile terminal according to the recognition result is:
- the present invention also provides a mobile terminal that recognizes a hardware gesture, including: a driver layer, an architecture layer, and a gesture algorithm processing layer;
- a driving layer configured to acquire touch information of a finger on a touch screen of the mobile terminal
- An architecture layer configured to preprocess data in the touch information
- the gesture algorithm processing layer is configured to identify hardware gestures according to the preprocessed data.
- the mobile terminal further includes:
- the application layer is configured to implement a function corresponding to the hardware gesture on the mobile terminal according to the recognition result.
- the method for identifying a hardware gesture and the mobile terminal acquires touch information of a finger on a touch screen of the mobile terminal, and preprocesses data in the touch information; and hardware of the mobile terminal according to the preprocessed data Gesture recognition; at the same time, the gesture algorithm processing layer only needs to calculate the intensity coefficient of the hardware gesture, or directly send the read data to the application layer without performing calculation, thereby realizing the application of the hardware gesture, thus greatly reducing the gesture algorithm
- the calculation amount of the processing layer improves the response speed of the mobile terminal, and can quickly and efficiently identify the hardware gestures, thereby bringing a good user experience to the mobile terminal user using the touch screen, and making the user operation more convenient and faster.
- the invention retains the application of simple gestures in the original system, does not need to extend a lot of hardware gesture interfaces, and is convenient for maintenance; on the other hand, directly acquires hardware gesture information from the chip of the touch screen of the mobile terminal, thereby saving complicated hardware gestures. Identifying and calculating time increases the efficiency of the mobile terminal.
- FIG. 1 is a schematic structural diagram of a system for implementing gesture recognition on an android platform in the prior art
- FIG. 2 is a schematic flowchart of a method for realizing recognition of a hardware gesture according to the present invention
- FIG. 3 is a schematic diagram of a data format when a hardware gesture is generated in the present invention.
- FIG. 4 is a schematic structural diagram of a mobile terminal that implements a hardware gesture recognition according to the present invention. detailed description
- the basic idea of the present invention is: acquiring touch information of a finger on a touch screen of a mobile terminal, and pre-processing data in the touch information; and identifying hardware gestures according to the pre-processed data.
- FIG. 2 is a schematic flowchart of a method for realizing a hardware gesture according to the present invention. As shown in FIG. 2, the method includes the following steps:
- Step 201 Acquire touch information of a finger on a touch screen of the mobile terminal.
- the chip in the driving layer of the mobile terminal acquires the touch information of the finger on the touch screen of the mobile terminal from the chip of the touch screen of the mobile terminal in real time; wherein, if the gesture on the touch screen of the mobile terminal is a simple gesture, such as a finger Gestures, such as clicking, double-clicking, long-pressing or dragging, etc., the touch information includes: in the coordinate system with the top left corner of the touch screen of the mobile terminal as the origin, the coordinate value of the finger, the finger width value w of the finger, and the finger Pressure p; If the gesture on the touch screen of the mobile terminal is a more complicated gesture of two fingers or more, that is, a hardware gesture, the touch information includes: in a coordinate system in which the upper left corner of the touch screen of the mobile terminal is the origin, in the hardware gesture The coordinate value of any one finger, the finger width value w of the finger, the pressure p of the finger on the touch screen, and the hardware gesture information of the hardware gesture;
- the hardware gesture information includes direction information 0 of two fingers closed or separated, and amplitude information A of two fingers closed or separated; if the hardware gesture is a rotate gesture, the hardware gesture information includes two fingers left or right Rotation direction information 0, and angle information of two-finger rotation. If the hardware gesture is a palm reject gesture, the hardware gesture information includes amplitude information A of the hardware gesture; wherein, the driver layer may be determined according to the content of the message sent by the chip of the touch screen of the mobile terminal.
- the type of hardware gesture is a pinch gesture, the hardware gesture information includes direction information 0 of two fingers closed or separated, and amplitude information A of two fingers closed or separated; if the hardware gesture is a rotate gesture, the hardware gesture information includes two fingers left or right Rotation direction information 0, and angle information of two-finger rotation. If the hardware gesture is a palm reject gesture, the hardware gesture information includes amplitude information A of the hardware gesture; wherein, the driver layer may be determined according to the content of the message sent by the chip of the touch screen of the mobile terminal.
- the driving layer encapsulates the touch information according to a certain data format, wherein a certain data format is as shown in FIG. 3, and FIG. 3 is a data format when the hardware gesture is generated in the present invention.
- the driver layer sends the encapsulated touch information to the architecture layer through the transmission channel connected to the driver layer and the architecture layer; wherein the driver layer sends the packaged touch information to the architecture layer at a certain frequency. This frequency is also called the interrupt frequency.
- Different touch screen manufacturers provide different interrupt frequencies, usually 60Hz to 80Hz, and some up to 250Hz.
- Step 202 Perform pre-processing on data in the acquired touch information.
- the architecture layer of the mobile terminal receives the touch information sent by the driver layer according to the data format of the touch information sent by the driver layer, for example: the driver layer according to the coordinate value x, the coordinate value y, the finger width value w, the finger
- the touch information is sent in the order of the pressure p of the touch screen and the hardware gesture information, and the architecture layer is reversed according to the hardware gesture information, the pressure p of the finger on the touch screen, the finger width value w of the finger, the coordinate value y, and the coordinate value X. Parsing touch information;
- the architecture layer preprocesses the data in the received touch information, that is, according to the data in the received touch information, identifies the number of fingers, and moves the finger according to the change of the number of fingers.
- the status information is recorded into the motion class; wherein, the motion state information includes: ACTION - MOVE, ACTION - UP, ACTION - DOWN, ACTION - MOVE indicates that there is a finger in motion, ACTION - UP indicates that all fingers are bouncing, ACTION — DOWN indicates that a finger is pressed;
- the architecture layer records the data in the touch information to the object of the motion class. If the gesture is a hardware gesture, the touch information already carries the hardware gesture information, and the time for generating the hardware gesture needs to be recorded to the The object of the motion class; the architecture layer sends the data in the motion class to the gesture algorithm processing layer; the motion class is a class programming language, and a class of the same type of data is stored in a motion class, in the present invention motion
- the class is equivalent to a storage medium for storing touch information and pre-processing the touch information.
- the coordinate value X of any one of the hardware gestures in the touch information acquired in step 201, the finger width value w of the finger, and the pressure p of the finger on the touch screen are the hardware gesture information used to carry the hardware gesture and
- the time at which the hardware gesture is generated that is, the implementation of hardware gesture information and production
- the time at which the hardware gesture is generated is transparently transmitted to the gesture algorithm processing layer.
- Step 203 Identify hardware gestures according to the preprocessed data.
- the gesture algorithm processing layer of the mobile terminal receives the data in the motion class sent by the architecture layer. If the hardware gesture information is not included and the time when the hardware gesture is generated, indicating that the gesture on the touch screen of the mobile terminal is a simple gesture, the execution is simple.
- the processing flow of the gesture the processing flow belongs to the prior art, and details are not described herein again.
- the gesture algorithm processing layer of the mobile terminal receives the data in the motion class sent by the architecture layer, if the data includes the hardware gesture information and the time when the hardware gesture is generated, indicating that the gesture on the touch screen of the mobile terminal is a more complicated gesture,
- the gesture algorithm processing layer can know the motion state of the finger on the touch screen according to the received motion state information; the gesture algorithm processing layer obtains the motion state information of the finger according to the data in the motion class, and if it is ACTION_UP or ACTION_DOWN, the finger is All lifted up, or just pressed, so the finger does not move on the mobile terminal, no hardware gestures are generated, so there is no need to identify the hardware gesture, and the process ends;
- the gesture algorithm processing layer determines that the number of fingers moving on the touch screen is two fingers, it determines the time of generating the hardware gesture in the received motion class and the hardware gesture generated in the last received motion class. Whether the time is consistent, if they are inconsistent, it means that a new hardware gesture is generated, and the hardware gesture is identified according to the hardware gesture information in the received motion class; if they are consistent, the new hardware gesture is not generated, and the process ends.
- the gesture algorithm processing layer identifies the hardware gesture according to the pre-processed data, that is, the hardware gesture information of the touch information in the received motion class, specifically:
- the gesture algorithm processing layer reads the hardware gesture information of the touch information in the received motion class, wherein the direction information 0 is a positive value, indicating that the two fingers are separated, and if the direction information 0 is a negative value, Indicates that the two fingers are closed, and the intensity coefficient of the hardware gesture is calculated according to the formula Math.abs (A/30+1), and the gesture algorithm processing layer will recognize the result, that is, the calculated hardware hand
- the intensity coefficient of the potential is sent to the application layer of the mobile terminal; wherein the parameter A includes the direction information 0 and the amplitude information A, and the parameter A can be either a positive value or a negative value, and the intensity coefficient can be applied to the picture as a multiple of one enlargement or reduction.
- Library pinch gestures are mainly used in image libraries, browsers, and *** maps;
- the gesture algorithm processing layer reads the hardware gesture information of the touch information in the received motion class, and reads the direction information 0 therein. If the direction information 0 is a positive value, the two fingers rotate clockwise. If the direction information 0 is a negative value, it means that the two fingers rotate counterclockwise, and the angle information of the two-finger rotation is read.
- the gesture algorithm processing layer will recognize the result, that is, the direction information 0 and the angle information of the read hardware gesture are sent to the mobile The application layer of the terminal; the main application of the rotate gesture and the focus function of the picture library and the camera;
- the hardware gesture is a palm reject gesture
- the threshold of the palm reject is preset according to the user's requirement
- the gesture algorithm processing layer reads the hardware gesture information of the touch information in the received motion class, and reads the amplitude information A therein, if the amplitude If the information A is greater than or equal to the threshold of the preset palm reject, it means that the hardware gesture contact area on the touch screen is too large, and no processing is performed, and the process ends; if the amplitude information A is smaller than the threshold of the preset palm reject, the touch screen is displayed.
- the hardware gestures on the interface are small, for example, single-finger, two-finger, etc., and the corresponding processing is performed.
- the processing for the single-finger belongs to the prior art, and will not be described here.
- the processing for the two-finger can be utilized.
- the method of the embodiment is processed;
- the above processing method for the palm reject gesture is mainly for preventing the erroneous operation. For example, when the user dials or receives the mobile terminal with the touch screen, the face is attached to the touch screen. If the processing method is not taken, the mobile terminal may be based on the user's Touching the capture operation, causing a misoperation, affecting the user's answering or dialing. If the above processing method is used, even if the user's face is attached to the touch screen, the hardware gesture is invalid due to the large contact area, the mobile terminal The operation will not be taken according to the user's touch to avoid misoperation.
- Step 204 Implement a function corresponding to the hardware gesture on the mobile terminal according to the recognition result; Specifically, the application layer of the mobile terminal receives the recognition result sent by the gesture algorithm processing layer; if the hardware gesture is a pinch gesture, the strength coefficient of the hardware gesture is less than 1, indicating that the two fingers are closed, for example, the reduction of the image can be implemented on the mobile terminal.
- the intensity coefficient of the hardware gesture is greater than 1, indicating that the two fingers are separated, for example, the function of zooming in the image can be implemented on the mobile terminal, according to the size of the intensity coefficient of the hardware gesture
- the ratio of magnification if equal to 1, it means that the two fingers are not moving on the touch screen of the mobile terminal, and no operation is performed;
- the function of the picture rotation can be implemented on the mobile terminal. If the direction information 0 is greater than 0, the two fingers rotate clockwise. For example, the clockwise rotation function of the picture can be implemented on the mobile terminal, according to two Refers to the rotation angle information "determine the rotation angle. If the direction information 0 is less than 0, it means that the two fingers rotate counterclockwise. For example, the function of counterclockwise rotation of the picture can be realized on the mobile terminal, according to the angle information of the rotation of the two fingers.” Determine the size of the rotation angle. If the direction information 0 is equal to 0, it means that the two fingers are not moving on the touch screen of the mobile terminal, and no operation is performed.
- the present invention can be applied to various operating systems, such as the Windows Mobile operating system, the Symbian operating system, and the Android operating system, and can also be applied to a global positioning system.
- FIG. 4 is a schematic structural diagram of a mobile terminal for implementing a hardware gesture according to the present invention.
- the mobile terminal includes: a driver layer 41, an architecture. Layer 42, a gesture algorithm processing layer 43; wherein
- the driving layer 41 is configured to acquire touch information of the finger on the touch screen of the mobile terminal;
- the architecture layer 42 is configured to preprocess data in the touch information.
- the gesture algorithm processing layer 43 is configured to identify hardware gestures based on the preprocessed data.
- the mobile terminal further includes: an application layer 44, configured to implement a function corresponding to the hardware gesture on the mobile terminal according to the recognition result.
- the touch information of the acquiring finger on the touch screen of the mobile terminal is: a driving layer of the mobile terminal
- the chip in 41 acquires the touch information of the finger on the touch screen of the mobile terminal in real time, and sends the touch information to the architecture layer 42;
- the touch information includes: a coordinate value of a finger in a coordinate system whose origin is the upper left corner of the touch screen of the mobile terminal, a finger width value of the finger, a pressure of the finger on the touch screen, a pressed touch value of the finger, and hardware gesture information;
- the hardware gesture information includes: direction information of two fingers closed or separated and amplitude information of two fingers closed or separated, or direction information of two fingers left or right hand and angle information of two fingers rotation, or amplitude information of hardware gestures .
- the pre-processing of the data in the touch information is: the architecture layer 42 of the mobile terminal records the motion state information of the finger into the object of the motion class according to the data of the touch information; the architecture layer 42 touch information The data in the data and the time when the hardware gesture is generated are recorded in the object of the motion class, and the data in the object of the motion class is sent to the gesture algorithm processing layer 43;
- the motion state information includes: a finger is in motion, a finger is bounced, and a finger is pressed.
- the hardware gesture is identified according to the preprocessed data: the gesture algorithm processing layer 43 of the mobile terminal obtains the motion state of the finger on the touch screen according to the preprocessed data, and when the motion state is determined, the finger moves on the touch screen, and When it is determined that a new hardware gesture is generated, the gesture algorithm processing layer 43 identifies the hardware gesture according to the hardware gesture information of the touch information in the received motion class.
- the gesture algorithm processing layer 43 identifies the hardware gesture according to the hardware gesture information of the touch information in the received motion class: if the hardware gesture is a pinch gesture, the gesture algorithm processing layer 43 is based on the received motion class.
- the hardware gesture information of the touch information calculates an intensity coefficient of the hardware gesture, and sends the strength coefficient of the hardware gesture to the application layer 44 of the mobile terminal.
- the gesture algorithm processing layer 43 identifies the hardware gesture according to the hardware gesture information of the touch information in the received motion class: if the hardware gesture is a rotate gesture, the gesture algorithm processing layer 43 reads the received motion class. Touch gesture hardware gesture information that will be read out of the hardware The direction information and angle information of the gesture are sent to the application layer 44 of the mobile terminal.
- the gesture algorithm processing layer 43 identifies the hardware gesture according to the hardware gesture information of the touch information in the received motion class: if the hardware gesture is a palm reject gesture, the gesture algorithm processing layer 43 reads the received motion class.
- the hardware gesture information of the touch information in the middle determining the magnitude information of the touch information and the threshold of the preset palm reject. If the amplitude information is greater than or equal to the threshold of the palm reject, the process ends; if the amplitude information is smaller than the palm reject For the threshold, the corresponding processing is performed.
- the function of implementing the hardware gesture corresponding to the mobile terminal according to the recognition result is: if the hardware gesture is a pinch gesture, the strength coefficient of the hardware gesture is less than 1, and the reduction of the image is implemented on the mobile terminal, and the size of the strength coefficient of the hardware gesture is determined.
- the function of implementing the hardware gesture corresponding to the mobile terminal according to the recognition result is: if the hardware gesture is a rotate gesture, if the direction information is greater than 0, the clockwise rotation of the picture is implemented on the mobile terminal, if the direction information is less than 0, in the mobile terminal The counterclockwise rotation of the picture is implemented, and the rotation angle is determined according to the angle information of the rotation of the two fingers. If the direction information is equal to 0, no operation is performed.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明公开一种识别硬件手势的方法,包括:获取手指在移动终端触摸屏上的触控信息,并对所述触控信息中的数据进行预处理;根据预处理后的数据对硬件手势进行识别;本发明还提供一种识别硬件手势的移动终端。根据本发明的技术方案,能够快捷、高效地实现移动终端的硬件手势的识别。
Description
一种识别硬件手势的方法及移动终端 技术领域
本发明涉及移动终端领域的手势识别技术, 尤其涉及一种识别硬件手 势的方法及移动终端。 背景技术
移动通讯的迅速发展, 引起整个社会方方面面的不同程度的改变, 目 前移动终端已成为绝大多数人生活中不可或缺的一部分。 未来移动终端的 人机交互将以自然性、 多通道性、 协作性为主要发展方向, 试图通过手势、 语音、 表情等人类自然的交流方式形成多通道、 多模式的用户与移动终端 的自然对话, 以提高用户的体验效果。 移动终端的用户界面 (UI , User Interface ) 由 "以技术为中心" 向 "以用户为中心" 发展的趋势, 使自然直 观的自然人机交互成为用户界面发展的必然趋势。 其中, 手势交互这一交 互方式作为适应自然交互趋势的 UI交互形式, 正逐渐受到大家的重视, 应 用的广泛性日益扩大。
移动终端的厂商已经在 UI技术上花费了很多精力, 包括 UI设计、 鼠 标、 键盘、 轨迹球、 重力传感器等。 随着智能移动终端的普及, 触摸屏的 功能越来越不可替代, 手势也因其新奇性、 方便性、 易用性, 成为人机交 互新技术。 基于自然手势的可双指触摸的人机交互, 是用户与移动终端之 间自然和谐对话的一种新的交互技术。 这种方式是 "以用户为中心" 的交 互, 与传统的触摸屏只能单个指头的操作不同, 这种方式允许用户多个手 指同时操作一个移动终端, 甚至可以让多个用户同时操作。 但是多个手指 同时操作意味着允许处理更加复杂的任务, 因此如何既快速、 又高效的实 现手势交互是移动终端制造商迫在眉睫要解决的问题。
目前为止, 苹果公司在做这方面研究, 已经实现的功能主要有滑动解 锁、 缩放和翻转等, 但是主要集中在 UI的设计方面。 此外, 还有一些触摸 屏厂商做的底层手势交互处理, 主要研究一些底层的算法和结构, 能够直 接提供给移动终端一些复杂的硬件手势, 例如缩放(pinch ) 手势、 旋转 ( rotate )手势、 大面积拒绝( palm reject )手势等, 这些硬件手势可以直接 从触摸屏的芯片中获取, 不需要利用复杂的算法经过计算得到。
图 1是现有技术中 android平台上实现手势识别的***结构示意图, 如 图 1所示, 做一次两指分离或者合拢的动作, 假设驱动层以 80Hz的频率上 报数据给架构层, 每秒架构层需要进行 80*N次的计算, 其中 N代表一次 完整事件所需要手指的触点信息, 触点信息主要包括: 以移动终端屏幕左 上角为原点的 X坐标的值和 y坐标的值, 手指的指宽 w, 手指对屏幕的压 力 p,多点同步上才艮( SY —MT— REPORT, Synchronize Multi-Touch Report ) 的值, 同步上报(SY — REPORT, Synchronize Report )的值; 如果是单指, 则 N=6, 如果是两指, 则 N=l l , 如果是 M个指头, 则 N = 5*M+1 ; 架构 层把一次完整事件的信息进行预处理,放在 motion类中,因为驱动层以 80Hz 的频率上报数据给架构层, 所以每秒最多产生 80次 motion, 然后将每次预 处理后的 motion类中的数据发送给手势算法处理层进行处理, 手势算法处 理层每 28ms处理一次, 所以每秒大概计算 35次。
上述方法中, 对于产生的手势是根据各个指头的坐标信息通过一定的 算法计算得到的, 手势的识别方法比较复杂, 而且需要进行多次计算, 使 得手势的识别效率较低。 发明内容
有鉴于此, 本发明的主要目的在于提供一种识别硬件手势的方法及移 动终端, 能够快捷、 高效地实现移动终端的硬件手势的识别。
为达到上述目的, 本发明的技术方案是这样实现的:
本发明提供一种识别硬件手势的方法, 包括:
获取手指在移动终端触摸屏上的触控信息, 并对所述触控信息中的数 据进行预处理;
根据预处理后的数据对硬件手势进行识别。
上述方法中, 所述获取手指在移动终端触摸屏上的触控信息为: 移动 终端的驱动层中的芯片实时获取手指在移动终端触摸屏上的触控信息, 将 触控信息发送给架构层;
所述触控信息包括: 以移动终端触摸屏左上角为原点的坐标系中手指 的坐标值、 手指的指宽值、 手指对触摸屏的压力、 手指的按压触摸值和硬 件手势信息;
所述硬件手势信息包括: 两指合拢或分离的方向信息和两指合拢或分 离的幅度信息, 或两指左旋或右旋的方向信息以及两指旋转的角度信息, 或硬件手势的幅度信息。
上述方法中, 所述对所述触控信息中的数据进行预处理为:
移动终端的架构层根据触控信息的数据, 将手指的运动状态信息记录 到 motion类的对象中; 架构层将触控信息中的数据和产生硬件手势的时间 记录到 motion类的对象中,并将 motion类的对象中的数据发送给手势算法 处理层;
所述运动状态信息包括: 有手指在运动、 手指都弹起和有手指按下。 上述方法中, 所述根据预处理后的数据对硬件手势进行识别为: 移动终端的手势算法处理层根据预处理后的数据得到触摸屏上手指的 运动状态, 当确定运动状态是有手指在触摸屏上运动, 且确定产生新的硬 件手势时, 手势算法处理层根据收到的 motion类中的触控信息的硬件手势 信息, 对硬件手势进行识别。
上述方法中, 所述手势算法处理层根据收到的 motion类中的触控信息
的硬件手势信息, 对硬件手势进行识别为:
硬件手势是 pinch手势, 则手势算法处理层根据收到的 motion类中的 触控信息的硬件手势信息计算硬件手势的强度系数, 将所述硬件手势的强 度系数发送给移动终端的应用层;
或, 硬件手势是 rotate手势, 则手势算法处理层读取收到的 motion类 中的触控信息的硬件手势信息, 将读取出的硬件手势的方向信息和角度信 息发送给移动终端的应用层;
或,硬件手势是 palm reject手势,则手势算法处理层读取收到的 motion 类中的触控信息的硬件手势信息,判断其中的幅度信息与预设的 palm reject 的门限的大小, 如果幅度信息大于或等于所述 palm reject的门限, 结束流 程; 如果幅度信息小于所述 palm reject的门限, 则进行与其对应的处理。
上述方法中, 该方法还包括: 根据识别结果在移动终端上实现硬件手 势对应的功能。
上述方法中, 所述根据识别结果在移动终端上实现硬件手势对应的功 能为:
如果硬件手势是 pinch手势, 硬件手势的强度系数小于 1 , 在移动终端 上实现图片的缩小, 根据硬件手势的强度系数的大小确定缩小的比例; 硬 件手势的强度系数大于 1 , 在移动终端上实现图片的放大,根据硬件手势的 强度系数的大小确定放大的比例; 如果等于 1 , 不执行任何操作。
上述方法中, 所述根据识别结果在移动终端上实现硬件手势对应的功 能为:
如果硬件手势是 rotate手势, 如果方向信息大于 0, 在移动终端上实现 图片的顺时针旋转, 如果方向信息小于 0, 在移动终端上实现图片的逆时针 旋转,根据两指旋转的角度信息确定旋转角度的大小,如果方向信息等于 0, 不执行任何操作。
本发明还提供一种识别硬件手势的移动终端, 包括: 驱动层、 架构层、 手势算法处理层; 其中,
驱动层, 用于获取手指在移动终端触摸屏上的触控信息;
架构层, 用于对所述触控信息中的数据进行预处理;
手势算法处理层, 用于根据预处理后的数据对硬件手势进行识别。 上述移动终端中, 该移动终端还包括:
应用层, 用于根据识别结果在移动终端上实现硬件手势对应的功能。
本发明提供的识别硬件手势的方法及移动终端, 获取手指在移动终端 触摸屏上的触控信息, 并对所述触控信息中的数据进行预处理; 根据预处 理后的数据对移动终端的硬件手势进行识别; 同时, 在手势算法处理层只 需要计算硬件手势的强度系数, 或不进行计算直接将读取的数据发送给应 用层, 即可实现硬件手势的应用, 如此, 大大降低了手势算法处理层的计 算量, 提高了移动终端的反应速度, 能快捷、 高效地进行硬件手势的识别, 进而给使用触摸屏的移动终端用户带来良好的使用体验, 使用户操作更方 便、 更快捷。
此外, 本发明保留了原有***中简单手势的应用, 不需要扩展很多硬 件手势接口, 方便维护; 另一方面, 直接从移动终端触摸屏的芯片中获取 硬件手势信息, 节省了复杂的硬件手势的识别和计算时间, 提高了移动终 端的工作效率。 附图说明
图 1是现有技术中 android平台上实现手势识别的***的结构示意图; 图 2是本发明实现识别硬件手势的方法的流程示意图;
图 3是本发明中硬件手势产生时的数据格式的示意图;
图 4是本发明实现识别硬件手势的移动终端的结构示意图。
具体实施方式
本发明的基本思想是: 获取手指在移动终端触摸屏上的触控信息, 并 对所述触控信息中的数据进行预处理; 根据预处理后的数据对硬件手势进 行识别。
下面通过附图及具体实施例对本发明再做进一步的详细说明。
本发明提供一种识别硬件手势的方法, 图 2是本发明实现识别硬件手 势的方法的流程示意图, 如图 2所示, 该方法包括以下步骤:
步骤 201 , 获取手指在移动终端触摸屏上的触控信息;
具体为, 移动终端的驱动层中的芯片从移动终端触摸屏的芯片中, 实 时获取手指在移动终端触摸屏上的触控信息; 其中, 如果移动终端触摸屏 上的手势是简单的手势, 例如一个指头的手势, 如点击、 双击、 长按或拖 拽等, 则触控信息包括: 以移动终端触摸屏的左上角为原点的坐标系中, 该手指的坐标值 和 、 手指的指宽值 w和手指的压力 p; 如果移动终端触 摸屏上的手势是两指或两指以上的较复杂的手势, 即硬件手势, 则触控信 息包括: 以移动终端触摸屏的左上角为原点的坐标系中, 硬件手势中任意 一个手指的坐标值 和 、 手指的指宽值 w、 手指对触摸屏的压力 p, 以及 该硬件手势的硬件手势信息;
如果该硬件手势是 pinch手势,硬件手势信息包括两指合拢或分离的方 向信息 0, 以及两指合拢或分离的幅度信息 A; 如果该硬件手势是 rotate手 势, 硬件手势信息包括两指左旋或右旋的方向信息 0 , 以及两指旋转的角 度信息 如果该硬件手势是 palm reject手势,硬件手势信息包括硬件手势 的幅度信息 A; 其中, 驱动层可以根据移动终端触摸屏的芯片发送的消息 的内容确定硬件手势的类型;
这里, 驱动层按照一定的数据格式对触控信息进行封装处理, 其中, 一定的数据格式如图 3所示, 图 3是本发明中硬件手势产生时的数据格式
的示意图; 驱动层将封装处理后的触控信息通过驱动层和架构层连接的传 输通道发送给架构层; 其中, 驱动层是以一定的频率将封装处理后的触控 信息发送给架构层的, 该频率又称为中断频率, 不同的触摸屏生产厂商提 供的中断频率不同, 通常釆用 60Hz至 80Hz, 有的高达 250Hz。
步骤 202, 对获取的触控信息中的数据进行预处理;
具体的, 移动终端的架构层按照驱动层发送的触控信息的数据格式, 接收驱动层发送的触控信息, 例如: 驱动层按照坐标值 x、 坐标值 y、 手指 的指宽值w、 手指对触摸屏的压力 p和硬件手势信息的顺序发送触控信息, 架构层就按照硬件手势信息、 手指对触摸屏的压力 p、 手指的指宽值 w、 坐 标值 y、 坐标值 X的顺序, 反向解析触控信息;
这里, 架构层对收到的触控信息中的数据进行预处理, 即: 根据收到 的触控信息中的数据, 识别出手指的个数, 根据手指的个数的变化, 将手 指的运动状态信息记录到 motion类中; 其中, 所述运动状态信息包括: ACTION— MOVE、 ACTION— UP、 ACTION— DOWN, ACTION— MOVE表示 有手指在运动, ACTION— UP表示所有的手指都弹起, ACTION— DOWN表 示有手指按下;
同时, 架构层将触控信息中的数据记录到 motion类的对象中, 如果该 手势是硬件手势, 则触控信息中已经携带有硬件手势信息, 还需要将产生 该硬件手势的时间记录到该 motion类的对象中; 架构层将 motion类中的数 据发送给手势算法处理层; 所述 motion类是一种 class程序语言, 一类性质 相同的数据存储到一个 motion类中,在本发明中 motion类相当于用于存储 触控信息以及对触控信息进行预处理后的一种存储介质。
在步骤 201中获取的触控信息中的硬件手势中任意一个手指的坐标值 X 和 、 手指的指宽值 w、 手指对触摸屏的压力 p的作用是, 用来携带硬件手 势的硬件手势信息和产生该硬件手势的时间, 即实现将硬件手势信息和产
生该硬件手势的时间透明传输给手势算法处理层。
步骤 203 , 根据预处理后的数据对硬件手势进行识别;
具体的, 移动终端的手势算法处理层收到架构层发送的 motion类中的 数据如果没有包括硬件手势信息及产生该硬件手势的时间, 表示移动终端 触摸屏上的手势是简单的手势, 则执行简单的手势的处理流程, 该处理流 程属于现有技术, 这里不再赘述。
如果移动终端的手势算法处理层收到架构层发送的 motion类中的数 据, 所述数据如果包括硬件手势信息及产生该硬件手势的时间, 表示移动 终端触摸屏上的手势是较复杂的手势, 则手势算法处理层根据收到的运动 状态信息可以知道触摸屏上手指的运动状态; 手势算法处理层根据 motion 类中的数据得到手指的运动状态信息, 如果是 ACTION— UP 或 ACTION— DOWN, 表示手指是全部抬起, 或者只是按下, 因此手指并没有 在移动终端上运动, 不会产生硬件手势, 所以不需要对硬件手势进行识别, 结束流程;
如果是 ACTION— MOVE, 当手势算法处理层确定触摸屏上运动的手指 的数量是两指时, 判断收到的 motion类中的产生硬件手势的时间与上一次 收到的 motion类中的产生硬件手势的时间是否一致, 如果不一致, 则说明 产生了一个新的硬件手势, 则根据收到的 motion类中的硬件手势信息对硬 件手势进行识别; 如果一致, 则说明没有产生新的硬件手势, 结束流程; 手势算法处理层根据预处理后的数据, 即收到的 motion类中的触控信 息的硬件手势信息, 对硬件手势进行识别具体为:
如果硬件手势是 pinch手势, 手势算法处理层读取收到的 motion类中 的触控信息的硬件手势信息, 其中的方向信息 0为正值, 表示两指分离, 如果方向信息 0为负值, 表示两指合拢, 根据公式 Math.abs ( A/30+1 )计 算硬件手势的强度系数, 手势算法处理层将识别结果, 即计算出的硬件手
势的强度系数发送给移动终端的应用层; 其中参数 A包含方向信息 0和幅 度信息 A, 参数 A既可以是正值也可以是负值, 强度系数可以作为一次放 大或缩小的倍数应用在图片库; pinch 手势主要应用于图片库、 浏览器和 *** map;
如果硬件手势是 rotate手势, 手势算法处理层读取收到的 motion类中 的触控信息的硬件手势信息, 读取其中的方向信息 0 , 如果方向信息 0为 正值, 表示两指顺时针旋转, 如果方向信息 0为负值, 表示两指逆时针旋 转, 读取两指旋转的角度信息 手势算法处理层将识别结果, 即读取出的 硬件手势的方向信息 0和角度信息《发送给移动终端的应用层; rotate手势 主要应用与图片库和 camera的聚焦功能;
如果硬件手势是 palm reject手势, 根据用户需求预先设置 palm reject 的门限; 手势算法处理层读取收到的 motion类中的触控信息的硬件手势信 息, 读取其中的幅度信息 A, 如果该幅度信息 A 大于或等于预设的 palm reject的门限,则表示触摸屏上的硬件手势接触面积过大,不进行任何处理, 结束流程; 如果该幅度信息 A小于预设的 palm reject的门限, 则表示触摸 屏上的硬件手势接触面积较小, 例如单指、 两指等, 则进行与其对应的处 理, 针对单指的处理过程属于现有技术, 这里不再进行赘述, 针对两指的 处理过程可以利用本实施例的方法进行处理;
针对 palm reject手势的上述处理方法主要是为了防止误操作, 例如, 用户在拨打或接听具有触摸屏的移动终端时, 脸部贴到触摸屏上, 如果不 釆取上述处理方法, 移动终端会根据用户的触摸釆取操作, 产生误操作, 影响用户的接听或拨打, 如果釆用上述处理方法, 即使用户的脸部贴到触 摸屏上, 但是由于接触的面积较大, 导致此次硬件手势无效, 移动终端不 会根据用户的触摸釆取操作, 避免产生误操作。
步骤 204, 根据识别结果在移动终端上实现硬件手势对应的功能;
具体的, 移动终端的应用层接收手势算法处理层发送的识别结果; 如果硬件手势是 pinch手势, 硬件手势的强度系数小于 1 , 表示两指合 拢, 例如, 可在移动终端上实现图片的缩小的功能, 根据硬件手势的强度 系数的大小确定缩小的比例, 硬件手势的强度系数大于 1 , 表示两指分离, 例如可在移动终端上实现图片的放大的功能, 根据硬件手势的强度系数的 大小确定放大的比例; 如果等于 1 ,说明两指没有在移动终端的触摸屏上运 动, 不执行任何操作;
如果硬件手势是 rotate手势, 可在移动终端上实现图片旋转的功能,如 果方向信息 0 大于 0, 表示两指顺时针旋转, 例如, 可在移动终端上实现 图片的顺时针旋转的功能, 根据两指旋转的角度信息《确定旋转角度的大 小, 如果方向信息 0小于 0, 表示两指逆时针旋转, 例如, 可在移动终端 上实现图片的逆时针旋转的功能,根据两指旋转的角度信息《确定旋转角度 的大小, 如果方向信息 0等于 0, 说明两指没有在移动终端的触摸屏上运 动, 不执行任何操作。
此外,本发明可以应用于多种操作***,如 Windows Mobile操作***、 Symbian操作***以及 Android操作***等, 还可以应用于全球定位***。
为实现上述方法, 本发明还提供一种识别硬件手势的移动终端, 图 4 是本发明实现识别硬件手势的移动终端的结构示意图, 如图 4所示, 该移 动终端包括: 驱动层 41、 架构层 42、 手势算法处理层 43; 其中,
驱动层 41 , 用于获取手指在移动终端触摸屏上的触控信息;
架构层 42, 用于对所述触控信息中的数据进行预处理;
手势算法处理层 43, 用于根据预处理后的数据对硬件手势进行识别。 该移动终端进一步包括: 应用层 44, 用于根据识别结果在移动终端上 实现硬件手势对应的功能。
所述获取手指在移动终端触摸屏上的触控信息为: 移动终端的驱动层
41 中的芯片实时获取手指在移动终端触摸屏上的触控信息, 将触控信息发 送给架构层 42;
所述触控信息包括: 以移动终端触摸屏左上角为原点的坐标系中手指 的坐标值、 手指的指宽值、 手指对触摸屏的压力、 手指的按压触摸值和硬 件手势信息;
所述硬件手势信息包括: 两指合拢或分离的方向信息和两指合拢或分 离的幅度信息, 或两指左旋或右旋的方向信息和及两指旋转的角度信息, 或硬件手势的幅度信息。
所述对所述触控信息中的数据进行预处理为: 移动终端的架构层 42根 据触控信息的数据, 将手指的运动状态信息记录到 motion类的对象中; 架 构层 42将触控信息中的数据和产生硬件手势的时间记录到 motion类的对象 中, 并将 motion类的对象中的数据发送给手势算法处理层 43 ;
所述运动状态信息包括: 有手指在运动、 手指都弹起和有手指按下。 所述根据预处理后的数据对硬件手势进行识别为: 移动终端的手势算 法处理层 43根据预处理后的数据得到触摸屏上手指的运动状态, 当确定运 动状态是有手指在触摸屏上运动, 且确定产生新的硬件手势时, 手势算法 处理层 43根据收到的 motion类中的触控信息的硬件手势信息,对硬件手势 进行识别。
所述手势算法处理层 43根据收到的 motion类中的触控信息的硬件手势 信息, 对硬件手势进行识别为: 如果硬件手势是 pinch手势, 手势算法处理 层 43根据收到的 motion类中的触控信息的硬件手势信息计算硬件手势的强 度系数, 将所述硬件手势的强度系数发送给移动终端的应用层 44。
所述手势算法处理层 43根据收到的 motion类中的触控信息的硬件手势 信息, 对硬件手势进行识别为: 如果硬件手势是 rotate手势, 手势算法处理 层 43读取收到的 motion类中的触控信息的硬件手势信息,将读取出的硬件
手势的方向信息和角度信息发送给移动终端的应用层 44。
所述手势算法处理层 43根据收到的 motion类中的触控信息的硬件手势 信息, 对硬件手势进行识别为: 如果硬件手势是 palm reject手势, 手势算 法处理层 43读取收到的 motion类中的触控信息的硬件手势信息,判断其中 的幅度信息与预设的 palm reject的门限的大小, 如果幅度信息大于或等于 所述 palm reject的门限, 结束流程; 如果幅度信息小于所述 palm reject的 门限, 则进行与其对应的处理。
所述根据识别结果在移动终端上实现硬件手势对应的功能为: 如果硬 件手势是 pinch手势, 硬件手势的强度系数小于 1 , 在移动终端上实现图片 的缩小, 根据硬件手势的强度系数的大小确定缩小的比例; 硬件手势的强 度系数大于 1 , 在移动终端上实现图片的放大,根据硬件手势的强度系数的 大小确定放大的比例; 如果等于 1 , 不执行任何操作。
所述根据识别结果在移动终端上实现硬件手势对应的功能为: 如果硬 件手势是 rotate手势, 如果方向信息大于 0, 在移动终端上实现图片的顺时 针旋转, 如果方向信息小于 0, 在移动终端上实现图片的逆时针旋转, 根据 两指旋转的角度信息确定旋转角度的大小, 如果方向信息等于 0, 不执行任 何操作。
以上所述, 仅为本发明的较佳实施例而已, 并非用于限定本发明的保 护范围, 凡在本发明的精神和原则之内所作的任何修改、 等同替换和改进 等, 均应包含在本发明的保护范围之内。
Claims
1、 一种识别硬件手势的方法, 其特征在于, 该方法包括:
获取手指在移动终端触摸屏上的触控信息, 并对所述触控信息中的数 据进行预处理;
根据预处理后的数据对硬件手势进行识别。
2、 根据权利要求 1所述的方法, 其特征在于, 所述获取手指在移动终 端触摸屏上的触控信息为: 移动终端的驱动层中的芯片实时获取手指在移 动终端触摸屏上的触控信息, 将触控信息发送给架构层;
所述触控信息包括: 以移动终端触摸屏左上角为原点的坐标系中手指 的坐标值、 手指的指宽值、 手指对触摸屏的压力、 手指的按压触摸值和硬 件手势信息;
所述硬件手势信息包括: 两指合拢或分离的方向信息和两指合拢或分 离的幅度信息, 或两指左旋或右旋的方向信息以及两指旋转的角度信息, 或硬件手势的幅度信息。
3、 根据权利要求 1所述的方法, 其特征在于, 所述对所述触控信息中 的数据进行预处理为:
移动终端的架构层根据触控信息的数据, 将手指的运动状态信息记录 到 motion类的对象中; 架构层将触控信息中的数据和产生硬件手势的时间 记录到 motion类的对象中,并将 motion类的对象中的数据发送给手势算法 处理层;
所述运动状态信息包括: 有手指在运动、 手指都弹起和有手指按下。
4、 根据权利要求 1所述的方法, 其特征在于, 所述根据预处理后的数 据对硬件手势进行识别为:
移动终端的手势算法处理层根据预处理后的数据得到触摸屏上手指的 运动状态, 当确定运动状态是有手指在触摸屏上运动, 且确定产生新的硬 件手势时, 手势算法处理层根据收到的 motion类中的触控信息的硬件手势 信息, 对硬件手势进行识别。
5、 根据权利要求 4所述的方法, 其特征在于, 所述手势算法处理层根 据收到的 motion类中的触控信息的硬件手势信息,对硬件手势进行识别为: 硬件手势是缩放(pinch )手势, 则手势算法处理层根据收到的 motion 类中的触控信息的硬件手势信息计算硬件手势的强度系数, 将所述硬件手 势的强度系数发送给移动终端的应用层;
或,硬件手势是旋转( rotate )手势,则手势算法处理层读取收到的 motion 类中的触控信息的硬件手势信息, 将读取出的硬件手势的方向信息和角度 信息发送给移动终端的应用层;
或, 硬件手势是大面积拒绝(palm reject )手势, 则手势算法处理层读 取收到的 motion类中的触控信息的硬件手势信息, 判断其中的幅度信息与 预设的 palm reject的门限的大小,如果幅度信息大于或等于所述 palm reject 的门限, 结束流程; 如果幅度信息小于所述 palm reject的门限, 则进行与 其对应的处理。
6、 根据权利要求 1至 5任一项所述的方法, 其特征在于, 该方法还包 括: 根据识别结果在移动终端上实现硬件手势对应的功能。
7、 根据权利要求 6所述的方法, 其特征在于, 所述根据识别结果在移 动终端上实现硬件手势对应的功能为:
如果硬件手势是 pinch手势, 硬件手势的强度系数小于 1 , 在移动终端 上实现图片的缩小, 根据硬件手势的强度系数的大小确定缩小的比例; 硬 件手势的强度系数大于 1 , 在移动终端上实现图片的放大,根据硬件手势的 强度系数的大小确定放大的比例; 如果等于 1 , 不执行任何操作。
8、 根据权利要求 6所述的方法, 其特征在于, 所述根据识别结果在移 动终端上实现硬件手势对应的功能为: 如果硬件手势是 rotate手势, 如果方向信息大于 0, 在移动终端上实现 图片的顺时针旋转, 如果方向信息小于 0, 在移动终端上实现图片的逆时针 旋转,根据两指旋转的角度信息确定旋转角度的大小,如果方向信息等于 0, 不执行任何操作。
9、 一种识别硬件手势的移动终端, 其特征在于, 该移动终端包括: 驱 动层、 架构层、 手势算法处理层; 其中,
驱动层, 用于获取手指在移动终端触摸屏上的触控信息;
架构层, 用于对所述触控信息中的数据进行预处理;
手势算法处理层, 用于根据预处理后的数据对硬件手势进行识别。
10、 根据权利要求 9所述的移动终端, 其特征在于, 该移动终端还包 括:
应用层, 用于根据识别结果在移动终端上实现硬件手势对应的功能。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10858558.9A EP2631788A4 (en) | 2010-10-22 | 2010-12-13 | Method and mobile terminal for recognizing hardware gestures |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201010516703.1A CN101980153B (zh) | 2010-10-22 | 2010-10-22 | 一种识别硬件手势的方法及移动终端 |
CN201010516703.1 | 2010-10-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012051770A1 true WO2012051770A1 (zh) | 2012-04-26 |
Family
ID=43600657
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2010/079696 WO2012051770A1 (zh) | 2010-10-22 | 2010-12-13 | 一种识别硬件手势的方法及移动终端 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP2631788A4 (zh) |
CN (1) | CN101980153B (zh) |
WO (1) | WO2012051770A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2730996A3 (en) * | 2012-11-09 | 2016-06-01 | Giga-Byte Technology Co., Ltd. | Touch method for palm rejection and electronic device using the same |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102855074A (zh) * | 2011-06-30 | 2013-01-02 | 安凯(广州)微电子技术有限公司 | 一种触屏操作方法 |
JP2014525611A (ja) * | 2011-08-09 | 2014-09-29 | サーク・コーポレーション | 線形センサまたは単一層センサ上の2本指ジェスチャ |
TWI447630B (zh) * | 2011-11-25 | 2014-08-01 | Wistron Corp | 觸控信號之處理方法及其計算機裝置 |
CN103309596B (zh) * | 2012-03-13 | 2016-12-14 | 深圳市世纪光速信息技术有限公司 | 一种输入法键盘的调整方法及其移动终端 |
CN103428558A (zh) * | 2012-05-23 | 2013-12-04 | 深圳市同洲电子股份有限公司 | 分享节目的方法及装置 |
CN102799376A (zh) * | 2012-07-11 | 2012-11-28 | 广东欧珀移动通信有限公司 | 一种触控设备的快捷功能设定方法 |
CN103874010A (zh) * | 2012-12-12 | 2014-06-18 | 方正国际软件(北京)有限公司 | 一种基于手势的多移动终端数据交换*** |
WO2014113923A1 (zh) * | 2013-01-22 | 2014-07-31 | 华为终端有限公司 | 基于触摸屏的物理按键模拟方法及装置 |
CN103269398A (zh) * | 2013-05-07 | 2013-08-28 | 深圳市卡卓无线信息技术有限公司 | 手势识别方法及智能移动终端 |
CN104750404B (zh) * | 2013-12-31 | 2018-11-09 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
WO2015180124A1 (zh) * | 2014-05-30 | 2015-12-03 | 华为技术有限公司 | 终端设备显示方法和终端设备 |
CN104090724B (zh) * | 2014-07-24 | 2017-10-24 | 广东欧珀移动通信有限公司 | 一种智能终端中通过双指手势操作文件的方法及装置 |
CN105653085B (zh) * | 2015-12-23 | 2018-07-24 | 小米科技有限责任公司 | 触摸响应方法和装置 |
CN107688432A (zh) * | 2017-09-04 | 2018-02-13 | 中国电子科技集团公司第四十研究所 | 一种基于触控技术的电子测量仪器人机交互***架构 |
CN107831997A (zh) * | 2017-10-23 | 2018-03-23 | 武汉华星光电技术有限公司 | 柔性面板折叠后的图像自适应转换方法及装置 |
CN109144396B (zh) * | 2018-09-05 | 2021-06-15 | 广州视源电子科技股份有限公司 | 一种触摸信息处理方法、装置、设备和存储介质 |
CN111124241B (zh) * | 2019-12-10 | 2021-07-09 | 深圳市创易联合科技有限公司 | 基于红外触控屏的书写触摸识别方法、装置及可读存储介质 |
CN112416236A (zh) * | 2020-03-23 | 2021-02-26 | 上海幻电信息科技有限公司 | 基于web页面的手势封装、交互方法、设备和存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999014540A1 (fr) * | 1997-09-18 | 1999-03-25 | Matsushita Refrigeration Company | Appareil d'autodiagnostic pour refrigerateur |
JP2004113681A (ja) * | 2002-09-30 | 2004-04-15 | Fuji Electric Retail Systems Co Ltd | メンテナンス時期判定方法、故障診断装置、プログラム |
JP2005274059A (ja) * | 2004-03-25 | 2005-10-06 | Hitachi Home & Life Solutions Inc | 冷蔵庫の診断方法およびその診断方法が適用されてなる冷蔵庫 |
JP2006057906A (ja) * | 2004-08-19 | 2006-03-02 | Sharp Corp | 冷蔵庫管理システム,冷蔵庫,冷蔵庫管理装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8526767B2 (en) * | 2008-05-01 | 2013-09-03 | Atmel Corporation | Gesture recognition |
US8390577B2 (en) * | 2008-07-25 | 2013-03-05 | Intuilab | Continuous recognition of multi-touch gestures |
CN101719032B (zh) * | 2008-10-09 | 2014-07-02 | 联想(北京)有限公司 | 一种多点触摸***及其方法 |
CN101853128A (zh) * | 2010-05-08 | 2010-10-06 | 杭州惠道科技有限公司 | 触摸圆轮人机界面的多点触控的方法 |
CN101853133B (zh) * | 2010-05-31 | 2013-03-20 | 中兴通讯股份有限公司 | 一种自动识别手势的方法及移动终端 |
-
2010
- 2010-10-22 CN CN201010516703.1A patent/CN101980153B/zh not_active Expired - Fee Related
- 2010-12-13 WO PCT/CN2010/079696 patent/WO2012051770A1/zh active Application Filing
- 2010-12-13 EP EP10858558.9A patent/EP2631788A4/en not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999014540A1 (fr) * | 1997-09-18 | 1999-03-25 | Matsushita Refrigeration Company | Appareil d'autodiagnostic pour refrigerateur |
JP2004113681A (ja) * | 2002-09-30 | 2004-04-15 | Fuji Electric Retail Systems Co Ltd | メンテナンス時期判定方法、故障診断装置、プログラム |
JP2005274059A (ja) * | 2004-03-25 | 2005-10-06 | Hitachi Home & Life Solutions Inc | 冷蔵庫の診断方法およびその診断方法が適用されてなる冷蔵庫 |
JP2006057906A (ja) * | 2004-08-19 | 2006-03-02 | Sharp Corp | 冷蔵庫管理システム,冷蔵庫,冷蔵庫管理装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2730996A3 (en) * | 2012-11-09 | 2016-06-01 | Giga-Byte Technology Co., Ltd. | Touch method for palm rejection and electronic device using the same |
Also Published As
Publication number | Publication date |
---|---|
EP2631788A4 (en) | 2017-05-31 |
CN101980153B (zh) | 2015-07-22 |
CN101980153A (zh) | 2011-02-23 |
EP2631788A1 (en) | 2013-08-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2012051770A1 (zh) | 一种识别硬件手势的方法及移动终端 | |
AU2021290349B2 (en) | Devices, methods, and graphical user interfaces for wireless pairing with peripheral devices and displaying status information concerning the peripheral devices | |
US10775999B2 (en) | Device, method, and graphical user interface for displaying user interface objects corresponding to an application | |
WO2012051766A1 (zh) | 一种自动识别旋转手势的方法及移动终端 | |
EP2939097B1 (en) | Device, method, and graphical user interface for navigating user interface hierarchies | |
EP3435220B1 (en) | Device, method and graphical user interface for transitioning between touch input to display output relationships | |
WO2011150607A1 (zh) | 一种自动识别手势的方法及移动终端 | |
EP2939095B1 (en) | Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics | |
WO2021032097A1 (zh) | 一种隔空手势的交互方法及电子设备 | |
TWI629636B (zh) | 用於控制一電子器件之方法、電子器件及非暫時性電腦可讀儲存媒體 | |
US8823749B2 (en) | User interface methods providing continuous zoom functionality | |
WO2013189224A1 (zh) | 光标显示位置的确定方法及装置 | |
WO2012041234A1 (zh) | 基于摄像头的信息输入方法及终端 | |
WO2015058566A1 (zh) | 屏幕图像的截取方法及设备 | |
JP6433923B2 (ja) | デバイスへの特定のオブジェクト位置の提供 | |
CN107450824A (zh) | 一种对象删除方法和终端 | |
WO2012151952A1 (zh) | 一种响应屏幕触摸事件的方法、装置及通讯终端 | |
JP2022547667A (ja) | ヒューマンコンピュータインタラクション方法、装置、及びシステム | |
CN108762746A (zh) | 一种移动手势优化方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10858558 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010858558 Country of ref document: EP |