WO2012155784A1 - 一种多点触摸设备及信息显示方法及应用处理装置 - Google Patents

一种多点触摸设备及信息显示方法及应用处理装置 Download PDF

Info

Publication number
WO2012155784A1
WO2012155784A1 PCT/CN2012/074824 CN2012074824W WO2012155784A1 WO 2012155784 A1 WO2012155784 A1 WO 2012155784A1 CN 2012074824 W CN2012074824 W CN 2012074824W WO 2012155784 A1 WO2012155784 A1 WO 2012155784A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
virtual
virtual keyboard
screen
finger contact
Prior art date
Application number
PCT/CN2012/074824
Other languages
English (en)
French (fr)
Inventor
曹恒
林兵
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012155784A1 publication Critical patent/WO2012155784A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Definitions

  • Multi-touch device information display method and application processing device
  • the present invention belongs to the field of mobile terminal technologies, and in particular, to a multi-touch device, an information display method, and an application processing device.
  • the method uses software to recognize the user's handwritten input strokes on the screen, and then judges the information input by the user, thereby inputting information such as letters, numbers, symbols, and the like.
  • the method requires user handwriting, stroke recognition, and user click confirmation, and the information input speed of the method is generally slow due to the limitation of the information processing speed of the mobile terminal.
  • the method uses software to simulate and display a rectangular standardized keyboard on the screen, enabling the user to input information by clicking a button on the screen.
  • the key distribution of the standardized keyboard is similar to the physical keyboard, and the information input speed is faster, due to the limitation of the screen size of the mobile terminal, the size of the standardized keyboard is much smaller than the actual physical keyboard, resulting in the user inputting information.
  • the limitations and inconveniences of hand activities, such as the wrist is prone to fatigue, the fingers are easy to click on the button.
  • the information input methods of the above two mobile terminal products equipped with multi-touch screens have certain disadvantages, resulting in inconvenience of user information input.
  • the technical problem to be solved by the present invention is to provide a multi-touch device, an information display method, and an application processing device, which solves the problem that the input of information using the existing virtualized keyboard is likely to cause wrist fatigue and slow input speed.
  • an embodiment of the present invention provides a multi-touch device, including a touch recognition module (10), an application processing module (11), and an image display module (12) connected in sequence;
  • the touch recognition module (10) is configured to send the detected screen touch operation information to the application processing module (11), and the application processing module (11) is configured to send the screen display information to the image.
  • the image display module (12) is configured to display the on-screen display information on a touch screen, wherein the application processing module (11) is configured to tap a finger in the operation information according to the screen
  • the contact position generates virtual keyboard information, and determines virtual key information input through the virtual keyboard, and sends the virtual keyboard information and/or virtual key information as sub-information of the display information;
  • the virtual keyboard information includes The screen touches a plurality of virtual key areas within a preset range centered on each finger contact position in the operation information, and virtual key information corresponding to each key area.
  • the foregoing device may also have the following features:
  • the application processing module (11) includes a determining unit (111), a virtual keyboard generating unit (112), and a virtual keyboard input identifying unit (113);
  • the determining unit (111) is configured to send a virtual keyboard generation triggering instruction to the virtual keyboard generating unit (112) when determining that the screen tapping operation information satisfies the virtual keyboard generating condition;
  • the virtual keyboard generating unit (112) is configured to determine the virtual keyboard information after receiving the trigger indication, where the virtual keyboard information is centered on each finger contact position in the screen touch operation information. a plurality of virtual button areas in the preset range and virtual button information corresponding to each button area, and the virtual keyboard information is sent as sub-information of the screen display information;
  • the virtual keyboard generating unit (112) is further configured to send the virtual keyboard information to the virtual keyboard input identifying unit (113);
  • the virtual keyboard input recognition unit (113) is configured to determine, according to the received screen touch operation information, that the virtual button area is touched when the image display module (12) displays the virtual keyboard information, and determine the corresponding virtual The button information is sent, and the virtual button information is sent as input content information in the screen display information.
  • the foregoing device may also have the following features:
  • the image display module (12) is configured to display a virtual button area and corresponding virtual button information in the virtual keyboard information on the touch screen, and display virtual button information in the virtual keyboard information on the virtual button information
  • the virtual button area corresponding to the button information may also have the following features:
  • the virtual button area within the preset range centered on the finger contact position includes N virtual button areas distributed around the center point of the finger contact position and any virtual button area
  • the line connecting the center point to the center point of the finger contact position and the line connecting the center point of the adjacent virtual button area and the center point of the finger contact position are the same;
  • the virtual button area in the preset range centered on the finger contact position includes a virtual button area located at the finger contact position in addition to the N virtual button areas;
  • N is an integer greater than one.
  • the foregoing device may also have the following features:
  • the virtual keyboard generation condition is that the screen touch operation information includes X contact positions and the touch time lengths of the X contact positions exceed a preset duration, and X is an integer greater than 1; the virtual keyboard a generating unit (112) configured to determine ten finger contact center positions in the virtual keyboard information according to the X contact positions in the screen tap operation information;
  • the virtual keyboard generating condition is that the screen tap operation information includes a screen tap operation satisfying a preset condition for a consecutive Y times, Y is an integer greater than 1; the virtual keyboard generating unit (112) is set to The preset ten finger contact center positions are taken as the ten finger contact center positions in the virtual keyboard information.
  • the foregoing device may also have the following features:
  • the determining unit (111) is configured to send a virtual keyboard revocation triggering instruction to the virtual keyboard generating unit (112) when determining that the screen tapping operation information satisfies the virtual keyboard revocation condition; the virtual keyboard generating unit (112), After receiving the trigger indication, the screen display information that does not include the virtual keyboard information is sent.
  • an embodiment of the present invention further provides an application processing device, where
  • the application processing device includes a determining unit (111), a virtual keyboard generating unit (112), and a virtual keyboard input identifying unit (113);
  • the determining unit (111) is configured to send a trigger indication to the virtual keyboard generating unit (112) when determining that the screen tapping operation information satisfies the virtual keyboard generating condition;
  • the virtual keyboard generating unit (112) is configured to: after receiving the trigger indication, determine virtual keyboard information, where the virtual keyboard information includes a preset centered on each finger contact position in the screen tap operation information. a plurality of virtual button areas in the range and virtual button information corresponding to each button area, and the virtual keyboard information is sent as sub-information of the screen display information;
  • the virtual keyboard generating unit (112) is further configured to send the virtual keyboard information to the virtual keyboard input identifying unit (113);
  • the virtual keyboard input recognition unit (113) is configured to determine, according to the screen touch operation information, that the virtual key area is touched, determine the corresponding virtual key information, and use the virtual key information as the input content information in the screen display information. send.
  • an embodiment of the present invention further provides a multi-touch device information display method, wherein, when the multi-touch device determines that the screen tap operation information satisfies a virtual keyboard generation condition, the virtual keyboard information is determined.
  • the virtual keyboard information includes a plurality of virtual button regions within a preset range centered on each finger contact position in the screen tap operation information, and virtual button information corresponding to each button region, and the virtual keyboard information is displayed. .
  • the foregoing information display method may further have the following features:
  • the virtual keyboard information When the virtual keyboard information is displayed, it is determined that the virtual key area is touched according to the received screen touch operation information, and the corresponding virtual key information is determined, and the virtual key information is displayed as the input content.
  • the foregoing information display method may further have the following features:
  • the virtual button area within the preset range centered on the finger contact position includes N virtual button areas distributed around the center point of the finger contact position and any virtual button area
  • the line connecting the center point to the center point of the finger contact position and the line connecting the center point of the adjacent virtual button area and the center point of the finger contact position are the same;
  • the virtual button area in the preset range centered on the finger contact position includes a virtual button area located at the finger contact position in addition to the N virtual button areas;
  • N is an integer greater than one.
  • the foregoing information display method may further have the following features:
  • the virtual keyboard generation condition is that the screen touch operation information includes X contact positions and And the touch duration of the X contact positions exceeds a preset duration, and X is an integer greater than 1; ten fingers in the virtual keyboard information are determined according to the X contact positions in the screen touch operation information.
  • the virtual keyboard generation condition is that the screen tap operation information includes a screen touch operation that satisfies a preset condition for a consecutive Y times, Y is an integer greater than 1; the preset ten finger contact center positions are used as the The center position of the ten finger contacts in the virtual keyboard information.
  • the scheme breaks the rendering mode of the original standardized virtual keyboard, so that the positions of the letters, numbers, symbols and even the function keys on the keyboard are not limited to the original standardized layout, and the layout is re-arranged on the touch screen, so that the new layout of each button can conform to the human body.
  • the principle of engineering, and can build a layout that meets the needs of different users according to the hand shape and usage habits of different users, so that the user can input information more comfortably, quickly and easily, and greatly improve the user experience.
  • FIG. 1 is a functional structural diagram of a multi-touch device according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a virtual button combination layout for a single finger contact position in an embodiment of the present invention
  • the multi-touch device includes a touch recognition module 10, an application processing module 11, and an image display module 12 that are sequentially connected.
  • the touch recognition module 10 is responsible for recognizing the real-time multi-touch operation of the user on the screen, and adopting a multi-touch all-point (Multi-Touch All-Point) method, using a touch screen row and a column cross-point separate scanning detection method. And identifying and outputting a specific coordinate position of the touch point for transmitting the detected screen touch operation information to the application processing module 11.
  • the application processing module 11 is set to display the screen Information is sent to the image display module 12.
  • the image display module 12 is responsible for human-computer interaction with the user, and is configured to display the on-screen display information on the touch screen.
  • the application processing module 11 is improved in the solution, the application processing module 11 is configured to generate virtual keyboard information according to the finger contact position in the screen touch operation information, and determine the virtual input through the virtual keyboard. Key information, the virtual keyboard information and/or virtual key information is sent as sub-information of the screen display information; the virtual keyboard information includes a preset range centered on each finger contact position in the screen touch operation information. A plurality of virtual button areas and virtual button information corresponding to each button area.
  • the application processing module 11 includes a judging unit 111, a virtual keyboard generating unit 112, and a virtual keyboard input recognizing unit 113.
  • the determining unit 111 is configured to send a virtual keyboard generation triggering instruction to the virtual keyboard generating unit 112 when it is determined that the screen tapping operation information satisfies the virtual keyboard generating condition;
  • the virtual keyboard generating unit 112 is configured to: after receiving the trigger indication, determine virtual keyboard information, where the virtual keyboard information includes a preset range centered on each finger contact position in the screen tap operation information. a virtual button area and virtual button information corresponding to each button area, and the virtual keyboard information is sent as sub-information of the screen display information;
  • the virtual keyboard generating unit 112 is further configured to send the virtual keyboard information to the virtual keyboard input identifying unit 113;
  • the virtual keyboard input recognition unit 113 is configured to determine, according to the received screen touch operation information, that the virtual button area is touched, determine the corresponding virtual button information, and set the virtual button according to the received screen touch operation information.
  • the information is sent as input content information in the on-screen information.
  • the virtual button area in the preset range centered on the finger contact position includes N virtual button areas, and the N virtual button areas are distributed around the center point of the finger contact position and any virtual button
  • the line connecting the center point of the area to the center point of the finger contact position and the line connecting the center point of the adjacent virtual button area and the center point of the finger contact position are the same, and N is an integer greater than 1.
  • the virtual button area within a preset range centered on the finger contact position includes, in addition to the N virtual button areas, a finger contact The virtual button area of the location.
  • the distribution of the N virtual button areas may be a m-shaped, a square, a hexagonal, and other types.
  • the distribution of the N virtual button areas may not be limited to the connection between the center point of any virtual button area and the center point of the finger contact position and the center point of the adjacent virtual button area and the center point of the finger contact position.
  • the condition that the angles of the lines are all the same is as long as it satisfies the preset range centered on the position of the finger contact, and may also be in an irregular distribution state, or a distribution state more beneficial to the user input habit, FIG. 2
  • the distribution states shown are merely illustrative of the alternative states of the present scheme.
  • the image display module 12 displays the virtual button area and the corresponding virtual button information in the virtual keyboard information on the touch screen
  • the virtual button information in the virtual keyboard information is displayed on the virtual button information.
  • the virtual button area Within the virtual button area.
  • the key information in the virtual keyboard information includes various keyboard information (including alphabet keys, number keys, enter keys, SHIFT keys, CTRL keys, ALT keys, etc.) in the standard virtual keyboard, or only some of them, or preferred ones. Commonly used buttons.
  • the correspondence between the button and the different virtual button regions of different finger positions can be set according to the user's habits, and is not limited to the case shown in FIG.
  • the image display module 13 keeps the layout mode and the displayed position of each button area in the virtual keyboard unchanged. During the information input process by the user, the user still does not move when moving horizontally or vertically at the fingertip of the screen. change.
  • the image display module 13 displays the touch effect of the user on the button area after the user inputs the information by using the virtual keyboard, for example, displaying the button area touched by the user as another color, or displaying the button area as a depression or the like.
  • a function button can be set.
  • the determination unit 111 detects the touch, and determines that the virtual keyboard generation condition is satisfied.
  • the screen touch operation information includes X contact positions, and the touch durations of the X contact positions exceed the preset duration, and X is an integer greater than 1;
  • the generating unit 112 is configured to determine ten finger contact center positions in the virtual keyboard information according to the X contact positions in the screen tap operation information. For example, the user naturally presses ten fingers on the touch screen for a certain period of time (for example, 3 seconds), the judging unit 111 determines that the virtual keyboard generating condition is satisfied, and the virtual keyboard generating unit 112 separates the contact positions of the ten fingers of the user respectively. As the center position of the ten finger contacts in the virtual keyboard information.
  • the determining unit 111 determines that the virtual keyboard generating condition is satisfied, and the virtual keyboard generating unit 112 calculates two based on the eight touch positions.
  • the position of the thumb, the position of the eight touch points and the position of the two thumbs are respectively used as the center position of the ten finger contacts in the virtual keyboard information.
  • the user naturally presses one hand on the touch screen for a certain period of time, the judging unit 111 determines that the virtual keyboard generating condition is satisfied, and the virtual keyboard generating unit 112 calculates the other hand symmetry according to the five touch positions.
  • the position of the touch point, the position of the 10 touch points and the position of the two thumbs are respectively used as the center position of the ten finger contacts in the virtual keyboard information.
  • the user naturally presses four fingers other than the thumb on the touch screen for a certain period of time, and the determining unit 111 determines that the virtual keyboard generating condition is satisfied, and the virtual keyboard generating unit 112 calculates the only one based on the four touch positions.
  • the position of the thumb of the hand, and then calculate the five touch positions of the other hand symmetrical, and the positions of the 10 touch positions and the two thumbs are respectively used as the center position of the ten finger contacts in the virtual keyboard information. . It is not listed here.
  • the screen touch operation information includes a screen touch operation that satisfies a preset condition for a consecutive Y times, and Y is an integer greater than 1; the virtual keyboard generation unit 112 is configured to
  • the preset ten finger contact center positions are the ten finger contact center positions in the virtual keyboard information. For example, when the user connects the same position multiple times on the screen, the virtual keyboard is directly triggered, or the user directly triggers the virtual keyboard when the user connects the same position clockwise or counterclockwise in a certain range on the screen.
  • the generated, class method is no longer listed, and the virtual keyboard information is a series of standard positions preset by the system.
  • the determining unit 111 is configured to send a virtual keyboard revocation triggering instruction to the virtual keyboard generating unit 112 when the screen tapping operation information satisfies the virtual keyboard revocation condition; the virtual keyboard generating unit 112 is configured to receive the trigger indication, and the sending does not include the The on-screen information of the virtual keyboard information.
  • the virtual keyboard can be revoked in a variety of conditions, similar to the virtual keyboard generation conditions, can be set to a dedicated undo function key, or a variety of ways, such as no touch operation within a certain length of time, directly trigger the virtual keyboard Undo, for example, when the user connects multiple times in the same position on the screen, the virtual keyboard is directly triggered to be revoked, or the user directly triggers the same position in the clockwise or counterclockwise direction within a certain range on the screen.
  • the virtual keyboard is revoked, and the class method is no longer listed.
  • the solution of this embodiment can support the production of only the key modules in the above device, that is, the application processing device corresponds to the application processing module 11 in FIG. 1.
  • the application processing device includes a determining unit 111, a virtual keyboard generating unit 112, and a virtual keyboard input identifying unit. 113;
  • the determining unit 111 is configured to send a trigger indication to the virtual keyboard generating unit 112 when it is determined that the screen tapping operation information satisfies the virtual keyboard generating condition;
  • the virtual keyboard generating unit 112 is configured to: after receiving the trigger indication, determine virtual keyboard information, where the virtual keyboard information includes a preset range centered on each finger contact position in the screen tap operation information. a virtual button area and virtual button information corresponding to each button area, and the virtual keyboard information is sent as sub-information of the screen display information;
  • the virtual keyboard generating unit 112 is further configured to send the virtual keyboard information to the virtual keyboard input identifying unit 113;
  • the virtual keyboard input recognition unit 113 is configured to determine, according to the screen tap operation information, that the virtual button area is touched, determine the corresponding virtual button information, and send the virtual button information as the input content information in the screen display information.
  • the method for displaying information by using the foregoing device includes: determining that the virtual keyboard information is determined when the screen touch operation information satisfies the virtual keyboard generation condition, where the virtual keyboard information includes the touch operation information in the screen
  • the virtual key information is displayed in a plurality of virtual key areas within a preset range centered on each finger contact position and virtual key information corresponding to each key area.
  • the virtual keyboard information After the virtual keyboard information is displayed, it is determined that the virtual key area is touched according to the received screen touch operation information, and the corresponding virtual key information is determined, and the virtual key information is displayed as the input content.
  • the user has a tablet product that is ready to use it to browse the web.
  • the tablet parameters are:
  • the user opens the IE (Internet Explorer) browser, clicks the IE address bar, the screen will display the "Input Method Selection” prompt box, the user clicks on the "fingertip keyboard input method” option and determines, the operation enablement determining unit 111,
  • the functions of the virtual keyboard generating unit 112 and the virtual keyboard input identifying unit 113 enable the tablet product to support the virtual keyboard input technology in the present solution.
  • the touch screen controller circuit detects the mutual capacitance change at the intersection of the row and the column of the touch screen by sensing the row driving driving signal and the column of the touch screen.
  • Touch screen control circuit The bottom left corner of the touch screen is used as the origin of the touch point position coordinates, that is, the coordinates (0, 0), and the coordinates of the top right corner of the touch screen are (1280, 800).
  • the contact coordinates of the ten fingertips are: (90,350), (230,440), (330,450), (410,400), (490,100), (798,110), (870,97) , (962, 445), (1020, 452), (1202, 338).
  • the touch screen control circuit periodically refreshes the contact coordinates of the user's fingertips and transmits their coordinate information to the application processing module 11 via the SPI (Serial Peripheral Interface) interface.
  • the application processing module 11 After receiving the ten-finger fingertip coordinates, the application processing module 11 gives a virtual button area and a combination based on the fingertips of each finger according to the setting condition of the "fingertip keyboard input method", as shown in FIG.
  • the user selects the click and enters the letter "H" according to the virtual button assigned by each fingertip.
  • the user finds that the letter button is on the button combination of the fingertip of the right index finger, as shown in FIG. 3, the user's right index finger will click the letter button.
  • the touch recognition module 10 recognizes the position change of the fingertip of the right index finger of the user, and transmits the position coordinate to the application processor.
  • the application processing module 11 will use the judgment The coordinate change of the fingertip of the right index finger of the right hand, and whether the changed fingertip coordinate is within the corresponding button area of the virtual keyboard, etc., comprehensively determine whether the user clicks the letter key.
  • the user then inputs letters or characters such as "t”, “t”, “p” ":”, and finally enters the address of the IE address bar web page, that is, "http://www.sohu.com ".
  • the application processing module 11 judges If the user has left the screen, the screen prompts the user whether to exit the input mode. When the user clicks on the screen prompt box and confirms to exit the input method, the screen display content other than the IE address bar information will be restored to the state before entering the "finger keyboard input method” mode.
  • the application processing module 12 of the tablet in the above scenario may be combined with the baseband processing chip of the tablet, so that the baseband processing chip of the tablet also has the related functions of the application processing module.
  • the above technical solution breaks the rendering mode of the original standardized virtual keyboard, so that the positions of letters, numbers, symbols and even function keys on the keyboard are not limited to the original standardized layout, and the layout is re-arranged on the touch screen, so that the new layout of each button can be more consistent.
  • the ergonomic principle and the layout of different users can be constructed according to the hand shape and usage habits of different users, so that the user can input information more comfortably, quickly and easily, and greatly improve the user experience.

Abstract

一种多点触摸设备及信息显示方法及应用处理装置,多点触摸设备判断屏幕点触操作信息满足虚拟键盘生成条件时,确定虚拟键盘信息其包括以屏幕点触操作信息中各手指触点位置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按键信息,显示所述虚拟键盘信息并根据收到的屏幕点触操作信息判断虚拟按键区域被点触时确定相应虚拟按键信息,将所述虚拟按键信息作为输入内容显示。本方案打破原有标准虚拟键盘的呈现模式,使字母、数字、符号、功能键的位置不局限于原标准化布局,使各按键的新布局更符合人体工学原理,针对不同用户的手型以及使用习惯构建满足不同用户需求的布局,使用户输入信息时更加舒适、快捷、轻松。

Description

一种多点触摸设备及信息显示方法及应用处理装置
技术领域
本发明属于移动终端技术领域, 尤其涉及一种多点触摸设备及信息显示 方法及应用处理装置。
背景技术
配备多点触控屏幕的移动终端产品, 如平板电脑、 手机等, 当需要进行 信息输入时, 通常有以下两种实现方法:
一, 通过屏幕手写识别输入。 该方法利用软件识别用户在屏幕上的手写 输入笔画, 进而判断用户输入的信息, 从而实现字母、 数字、 符号等信息的 输入。 但是, 该方法要经过用户手写、 笔画识别及用户点击确认等过程, 并 由于移动终端信息处理速度的限制,造成了该方法的信息输入速度一般较慢。
二, 通过软件虚拟的标准化键盘输入。 该方法利用软件在屏幕上模拟并 显示出矩形标准化键盘, 使用户通过点击屏幕上的按键实现信息输入。 虽然 该标准化键盘的按键分布类似于物理键盘, 同时信息输入速度较快, 但是, 由于移动终端屏幕尺寸的限制, 使该标准化键盘的尺寸大大小于实际的物理 键盘, 从造成用户在信息输入过程中, 手部活动的局限和不便, 如手腕容易 疲劳、 手指容易误点击按键等。
以上两种配备多点触控屏幕的移动终端产品的信息输入方法, 均存在着 一定的缺点, 造成用户信息输入的不便。
发明内容
本发明要解决的技术问题是提供一种多点触摸设备及信息显示方法及应 用处理装置, 解决使用现有虚拟化键盘输入信息容易造成手腕疲劳以及输入 速度较慢的问题。
为了解决上述技术问题, 本发明的实施例提供了一种多点触摸设备, 包 括依次相连的触控识别模块( 10 )、应用处理模块( 11 )、图像显示模块( 12 ); 所述触控识别模块(10 )设置为将检测到的屏幕点触操作信息发送至所述应 用处理模块( 11 ) , 所述应用处理模块 ( 11 )设置为将屏显信息发送至所述 图像显示模块(12 ) , 所述图像显示模块(12 )设置为在触摸屏上显示所述 屏显信息, 其中, 所述应用处理模块(11 ) , 设置为根据所述屏幕点触操作 信息中的手指触点位置生成虚拟键盘信息, 以及确定通过所述虚拟键盘输入 的虚拟按键信息, 将所述虚拟键盘信息和 /或虚拟按键信息作为屏显信息的子 信息发送; 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位 置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按 键信息。
可选地, 上述设备还可以具有以下特点:
所述应用处理模块( 11 )包括判断单元( 111 )、虚拟键盘生成单元( 112 )、 虚拟键盘输入识别单元(113 ) ;
所述判断单元(111 ) , 设置为判断屏幕点触操作信息满足虚拟键盘生成 条件时, 向所述虚拟键盘生成单元(112 )发送虚拟键盘生成触发指示;
所述虚拟键盘生成单元(112 ) , 设置为收到所述触发指示后, 确定所述 虚拟键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触 点位置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚 拟按键信息 , 将所述虚拟键盘信息作为屏显信息的子信息发送;
所述虚拟键盘生成单元(112 ) , 还设置为将所述虚拟键盘信息发送至所 述虚拟键盘输入识别单元( 113 ) ;
所述虚拟键盘输入识别单元(113 ) , 设置为在所述图像显示模块(12 ) 显示所述虚拟键盘信息期间, 根据收到的屏幕点触操作信息判断虚拟按键区 域被点触时确定相应虚拟按键信息, 并将此虚拟按键信息作为屏显信息中的 输入内容信息发送。
可选地, 上述设备还可以具有以下特点:
所述图像显示模块(12 ) , 设置为在所述触摸屏上显示所述虚拟键盘信 息中的虚拟按键区域以及对应的虚拟按键信息, 并将所述虚拟键盘信息中虚 拟按键信息显示于与此虚拟按键信息对应的虚拟按键区域内。 可选地, 上述设备还可以具有以下特点:
以手指触点位置为中心的预设范围内的虚拟按键区域包括 N个虚拟按键 区域, 所述 N个虚拟按键区域以所述手指触点位置的中心点为中心分布并且 任一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚拟按键 区域的中心点与手指触点位置的中心点的连线构成的角度均相同;
或者, 以手指触点位置为中心的预设范围内的虚拟按键区域除包括所述 N个虚拟按键区域外还包括一位于所述手指触点位置的虚拟按键区域;
N为大于 1的整数。
可选地, 上述设备还可以具有以下特点:
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括 X个触点位置并 且所述 X个触点位置的点触时长均超过预设时长, X为大于 1的整数; 所述 虚拟键盘生成单元(112 ) , 设置为根据所述屏幕点触操作信息中 X个触点 位置确定所述虚拟键盘信息中的十个手指触点中心位置;
或者, 所述虚拟键盘生成条件是所述屏幕点触操作信息中包括连续 Y次 满足预设条件的屏幕点触操作, Y为大于 1的整数; 所述虚拟键盘生成单元 ( 112 ) ,设置为将预设的十个手指触点中心位置作为所述虚拟键盘信息中的 十个手指触点中心位置。
可选地, 上述设备还可以具有以下特点:
所述判断单元(111 ) , 设置为判断屏幕点触操作信息满足虚拟键盘撤销 条件时, 向所述虚拟键盘生成单元(112 )发送虚拟键盘撤销触发指示; 所述虚拟键盘生成单元(112 ) , 设置为收到所述触发指示后, 发送不包 含所述虚拟键盘信息的屏显信息。
为了解决上述技术问题, 本发明的实施例还提供了一种应用处理装置, 其中,
所述应用处理装置包括判断单元(111 ) 、 虚拟键盘生成单元(112 ) 、 虚拟键盘输入识别单元(113 ) ;
所述判断单元(111 ) , 设置为判断屏幕点触操作信息满足虚拟键盘生成 条件时, 向所述虚拟键盘生成单元(112 )发送触发指示; 所述虚拟键盘生成单元(112 ) , 设置为收到所述触发指示后, 确定虚拟 键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位 置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按 键信息, 将所述虚拟键盘信息作为屏显信息的子信息发送;
所述虚拟键盘生成单元( 112 ) , 还设置为将所述虚拟键盘信息发送至所 述虚拟键盘输入识别单元(113 ) ;
所述虚拟键盘输入识别单元( 113 ) , 设置为根据所述屏幕点触操作信息 判断虚拟按键区域被点触时确定相应虚拟按键信息, 并将此虚拟按键信息作 为屏显信息中的输入内容信息发送。
为了解决上述技术问题, 本发明的实施例还提供了一种多点触摸设备信 息显示方法, 其中, 所述多点触摸设备判断屏幕点触操作信息满足虚拟键盘 生成条件时, 确定虚拟键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操 作信息中各手指触点位置为中心的预设范围内的多个虚拟按键区域以及与各 按键区域对应的虚拟按键信息, 显示所述虚拟键盘信息。
可选地, 上述信息显示方法还可以具有以下特点:
显示所述虚拟键盘信息时, 根据收到的屏幕点触操作信息判断虚拟按键 区域被点触时确定相应虚拟按键信息, 将所述虚拟按键信息作为输入内容显 示。
可选地, 上述信息显示方法还可以具有以下特点:
以手指触点位置为中心的预设范围内的虚拟按键区域包括 N个虚拟按键 区域, 所述 N个虚拟按键区域以所述手指触点位置的中心点为中心分布并且 任一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚拟按键 区域的中心点与手指触点位置的中心点的连线构成的角度均相同;
或者, 以手指触点位置为中心的预设范围内的虚拟按键区域除包括所述 N个虚拟按键区域外还包括一位于所述手指触点位置的虚拟按键区域 ;
N为大于 1的整数。
可选地, 上述信息显示方法还可以具有以下特点:
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括 X个触点位置并 且所述 X个触点位置的点触时长均超过预设时长, X为大于 1的整数; 根据 所述屏幕点触操作信息中 X个触点位置确定所述虚拟键盘信息中的十个手指 触点中心位置;
或者,
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括连续 Y次满足预 设条件的屏幕点触操作, Y为大于 1的整数; 将预设的十个手指触点中心位 置作为所述虚拟键盘信息中的十个手指触点中心位置。
本方案打破原有标准化虚拟键盘的呈现模式, 使键盘上的字母、 数字、 符号乃至于功能键的位置不局限于原标准化布局, 在触摸屏上重新布局, 使 各按键的新布局能够更符合人体工学原理, 并且可以针对不同用户的手型以 及使用习惯构建满足不同用户需求的布局,使用户进行信息输入时更加舒适、 快捷、 轻松, 大大提高用户体验。
附图概述
图 1是本发明实施例中多点触摸设备的功能结构图;
图 2是本发明实施例中针对单个手指触点位置的虚拟按键组合布局示意 图;
本发明的较佳实施方式
下文中将结合附图对本发明的实施例进行详细说明。 需要说明的是, 在 不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互任意组合。 如图 1所示, 多点触摸设备包括依次相连的触控识别模块 10、 应用处理模块 11、 图像显示模块 12。
触控识别模块 10负责识别用户对屏幕的实时的多点触控操作,釆用多点 触摸手指位置识别技术(Multi-Touch All-Point ) , 釆用触摸屏行、 列交叉点 单独扫描检测的办法, 识别并输出触摸点的具体坐标位置, 用于将检测到的 屏幕点触操作信息发送至应用处理模块 11。 应用处理模块 11设置为将屏显 信息发送至所述图像显示模块 12。 图像显示模块 12 负责与用户进行人机交 互, 设置为在触摸屏上显示所述屏显信息。
本方案中对应用处理模块 11进行了改进, 所述应用处理模块 11 , 设置 为根据所述屏幕点触操作信息中的手指触点位置生成虚拟键盘信息, 以及确 定通过所述虚拟键盘输入的虚拟按键信息, 将所述虚拟键盘信息和 /或虚拟按 键信息作为屏显信息的子信息发送; 所述虚拟键盘信息包括以所述屏幕点触 操作信息中各手指触点位置为中心的预设范围内的多个虚拟按键区域以及与 各按键区域对应的虚拟按键信息。
应用处理模块 11包括判断单元 111、 虚拟键盘生成单元 112、 虚拟键盘 输入识别单元 113。
判断单元 111 , 设置为判断屏幕点触操作信息满足虚拟键盘生成条件时, 向虚拟键盘生成单元 112发送虚拟键盘生成触发指示;
虚拟键盘生成单元 112, 设置为收到所述触发指示后, 确定虚拟键盘信 息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位置为中 心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按键信 息, 将所述虚拟键盘信息作为屏显信息的子信息发送;
虚拟键盘生成单元 112, 还设置为将所述虚拟键盘信息发送至虚拟键盘 输入识别单元 113;
虚拟键盘输入识别单元 113 , 设置为在图像显示模块 12显示所述虚拟键 盘信息期间, 根据收到的屏幕点触操作信息判断虚拟按键区域被点触时确定 相应虚拟按键信息, 并将此虚拟按键信息作为屏显信息中的输入内容信息发 送。
其中, 以手指触点位置为中心的预设范围内的虚拟按键区域包括 N个虚 拟按键区域, 所述 N个虚拟按键区域以所述手指触点位置的中心点为中心分 布并且任一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚 拟按键区域的中心点与手指触点位置的中心点的连线构成的角度均相同, N 为大于 1的整数。 或者, 如图 2所示, 以手指触点位置为中心的预设范围内 的虚拟按键区域除包括所述 N个虚拟按键区域外还包括一位于所述手指触点 位置的虚拟按键区域。 如图 2所示, N个虚拟按键区域的分布可以是米字型, 正方形, 六边型以及其它类型。 N个虚拟按键区域的分布也可以不局限于任 一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚拟按键区 域的中心点与手指触点位置的中心点的连线构成的角度均相同这一条件, 只 要满足在手指触点位置为中心的预设范围内即可, 也可以呈不规则的分布状 态, 或者是更有益于用户输入习惯的分布状态, 图 2所示的分布状态只是用 于说明本方案的可选的状态。
如图 2所示,图像显示模块 12在触摸屏上显示所述虚拟键盘信息中的虚 拟按键区域以及对应的虚拟按键信息时, 将所述虚拟键盘信息中虚拟按键信 息显示于与此虚拟按键信息对应的虚拟按键区域内。
虚拟键盘信息中的按键信息包括标准虚拟键盘中各键盘信息 (包括字母 键, 数字键, 回车键, SHIFT键, CTRL键, ALT键等) , 或者只包括其中 一部分, 或者是优选出来的较为常用的按键。 按键与不同手指位置的不同虚 拟按键区域的对应关系, 可以根据用户习惯设定, 并不局限于图 2所示的情 况。
其中,图像显示模块 13对虚拟键盘中各按键区域的布局方式和显示的位 置保持不变, 在用户进行信息输入过程中, 用户按在屏幕的指尖发生横向或 纵向的位置移动时仍保持不变。
图像显示模块 13在用户使用虚拟键盘输入信息后,还显示用户对按键区 域的触控效果, 例如将用户点触的按键区域显示为其它颜色, 或将此按键区 域显示为凹陷等。
对于虚拟键盘生成条件的设置, 可以设置一功能按键, 用户点触此功能 按键时, 判断单元 111检测到此点触, 则判定满足虚拟键盘生成条件。
对于虚拟键盘生成条件的设置, 还可以是屏幕点触操作信息中包括 X个 触点位置并且所述 X个触点位置的点触时长均超过预设时长, X为大于 1的 整数; 虚拟键盘生成单元 112设置为根据所述屏幕点触操作信息中 X个触点 位置确定所述虚拟键盘信息中的十个手指触点中心位置。 例如, 用户将十个 手指自然按压在触摸屏上一定时长 (例如 3秒) , 判断单元 111判定满足虚 拟键盘生成条件, 虚拟键盘生成单元 112将用户的十个手指的触点位置分别 作为虚拟键盘信息中的十个手指触点中心位置。 再例如, 用户将除两个拇指 之外的 8个手指, 自然按压在触摸屏上一定时长, 判断单元 111判定满足虚 拟键盘生成条件, 虚拟键盘生成单元 112根据此 8个点触位置计算出两个拇 指的位置, 将 8个点触位置以及两个拇指的位置分别作为虚拟键盘信息中的 十个手指触点中心位置。 再例如, 用户将一只手自然按压在触摸屏上一定时 长, 判断单元 111判定满足虚拟键盘生成条件, 虚拟键盘生成单元 112根据 此 5个点触位置计算出与之对称的另一只手的 5个点触位置,将此 10个点触 位置以及两个拇指的位置分别作为虚拟键盘信息中的十个手指触点中心位 置。 再例如, 用户将一只手除拇指之外的 4个手指自然按压在触摸屏上一定 时长, 判断单元 111判定满足虚拟键盘生成条件, 虚拟键盘生成单元 112根 据此 4个点触位置计算出此只手的拇指位置, 再计算出与之对称的另一只手 的 5个点触位置,将此 10个点触位置以及两个拇指的位置分别作为虚拟键盘 信息中的十个手指触点中心位置。 此处不再列举。
对于虚拟键盘生成条件的设置, 还可以是所述屏幕点触操作信息中包括 连续 Y次满足预设条件的屏幕点触操作, Y为大于 1的整数; 所述虚拟键盘 生成单元 112设置为将预设的十个手指触点中心位置作为所述虚拟键盘信息 中的十个手指触点中心位置。 例如, 用户在屏幕上同一位置连点多次时, 便 直接触发虚拟键盘生成, 或者用户在屏幕上某一范围内按顺时针或逆时针方 向同一位置连点多次时, 便直接触发虚拟键盘生成, 类例方法不再列举, 其 中虚拟键盘信息是***预设的一系列标准位置,
本设备还支持对虚拟键盘功能的撤销。 判断单元 111设置为判断屏幕点 触操作信息满足虚拟键盘撤销条件时, 向虚拟键盘生成单元 112发送虚拟键 盘撤销触发指示; 虚拟键盘生成单元 112设置为收到所述触发指示后, 发送 不包含所述虚拟键盘信息的屏显信息。 其中, 虚拟键盘撤销条件可以有多种, 与虚拟键盘生成条件同理, 可以设置专用的撤销功能键, 也可以多种方式, 例如一定时长内未检测到任何点触操作, 则直接触发虚拟键盘撤销, 再例如 用户在屏幕上同一位置连点多次时, 便直接触发虚拟键盘撤销, 或者用户在 屏幕上某一范围内按顺时针或逆时针方向同一位置连点多次时, 便直接触发 虚拟键盘撤销, 类例方法不再列举。 本实施例的方案可以支持只生产上述设备中关键模块, 即应用处理装置 对应于图 1中的应用处理模块 11 , 此应用处理装置包括判断单元 111、 虚拟 键盘生成单元 112、 虚拟键盘输入识别单元 113;
判断单元 111 , 设置为判断屏幕点触操作信息满足虚拟键盘生成条件时, 向所述虚拟键盘生成单元 112发送触发指示;
虚拟键盘生成单元 112, 设置为收到所述触发指示后, 确定虚拟键盘信 息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位置为中 心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按键信 息, 将所述虚拟键盘信息作为屏显信息的子信息发送;
虚拟键盘生成单元 112, 还设置为将所述虚拟键盘信息发送至所述虚拟 键盘输入识别单元 113;
虚拟键盘输入识别单元 113 , 设置为根据所述屏幕点触操作信息判断虚 拟按键区域被点触时确定相应虚拟按键信息, 并将此虚拟按键信息作为屏显 信息中的输入内容信息发送。
判断单元 111、 虚拟键盘生成单元 112和虚拟键盘输入识别单元 113的 其它功能与描述上述设备时的功能相同, 此处不再赘述。
在上述设备的描述基础上, 使用上述设备进行信息显示方法包括: 判断 屏幕点触操作信息满足虚拟键盘生成条件时, 确定虚拟键盘信息, 所述虚拟 键盘信息包括以所述屏幕点触操作信息中各手指触点位置为中心的预设范围 内的多个虚拟按键区域以及与各按键区域对应的虚拟按键信息, 显示所述虚 拟键盘信息。
显示所述虚拟键盘信息后, 根据收到的屏幕点触操作信息判断虚拟按键 区域被点触时确定相应虚拟按键信息, 将所述虚拟按键信息作为输入内容显 示。
关于虚拟键盘的虚拟按键区域分布方式, 相应虚拟键盘生成条件, 应虚 拟键盘撤销条件等特征, 与上述设备中描述相同, 此处不再赘述。 下面通过一使用实体从用户使用角度详细说明本方案。
用户有一台平板电脑产品, 准备利用它来浏览网页。 该平板电脑参数为:
10.1英寸 1280x800分辨率 TFT材质电容式多点触摸屏 (支持多点触摸手指 位置识别技术)、 Android V3.0操作***、应用处理器为 Cortex A9核心芯片、 触摸屏控制器为 mXT1386、 外观尺寸 240x 160x 1 lmm、 支持 802.11b/g/n无线 协议等。
用户打开 IE ( Internet Explorer )浏览器, 点击 IE地址栏, 屏幕将显示出 "输入法选择" 提示框, 用户点击其中的 "指尖键盘输入法" 选项并确定, 此操作使能判断单元 111、 虚拟键盘生成单元 112、 虚拟键盘输入识别单元 113的功能, 使此平板电脑产品支持本方案中的虚拟键盘输入技术。
如图 3所示, 用户将十指自由的按压在平板电脑 10.1英寸的屏幕上一定 时长。 此时, 触摸屏控制器电路通过对触摸屏的行加驱动激励信号、 列进行 感应的方式, 检测到了触摸屏行、 列交叉处的互电容变化。 触摸屏控制电路 将触摸屏的左下角顶点作为触控点位置坐标的原点, 即坐标(0,0 ) , 而触摸 屏右上角顶点坐标为 ( 1280,800 ) 。 经过触控识别模块(10 ) 的检测, 十指 指尖所触点坐标分别为: ( 90,350 )、 ( 230,440 )、 ( 330,450 )、 ( 410,400 )、 ( 490,100 )、 (798,110 )、 ( 870,97 )、 (962,445 )、 ( 1020, 452 )、 ( 1202,338 )。 触摸屏控制电路会定时刷新用户十指指尖的触点坐标, 并将它们的坐标信息 通过 SPI ( Serial Peripheral Interface )接口传送到应用处理模块 11。 应用处理 模块 11接收到十指指尖坐标后, 会根据 "指尖键盘输入法" 的设置情况, 给 出基于各手指指尖为中心的虚拟按键区域和组合, 如图 2所示的米字型, 并 将虚拟按键区域坐标范围及其中应显示的按键信息, 通过并行数据接口发送 给图像显示模块 12进行显示。 此时, 从用户角度可以看到, 他放置在屏幕上 的手指指尖周围都会出现虚拟按键, 如图 3所示。
用户根据各指尖分配的虚拟按键情况, 选择点击和输入字母 "H" 。 用 户发现该字母按键在右手食指指尖的按键组合上, 如图 3所示, 则用户右手 食指将点击该字母按键。 此时, 触控识别模块 10识别到了用户右手食指指尖 的位置变化, 并将该位置坐标传送至应用处理器。 应用处理模块 11将判断用 户右手食指指尖的坐标变化情况, 以及变化后的指尖坐标是否在虚拟键盘的 对应按键区域内等, 来综合判断用户是否点击了该字母按键。 应用处理模块
11依据判断条件, 确认用户点击了该字母按键, 通知图像显示模块 12用户 输入的内容为 'Ή" , 图像显示模块 12显示用户点击 "H" 按键后的点击效 果及输入结果。 从而用户完成了对字母 "H" 的输入。
如上所述过程, 用户接着依次输入了 "t" 、 "t" 、 "p" ":" 等字母或 字符, 最终对 IE地址栏网页地址的输入, 即" http://www.sohu.com"。
用户完成以上信息输入后, 则希望退出 "指尖键盘输入法" 模式, 根据 "指尖键盘输入法" 的设置情况, 如果用户的十指指尖均离开屏幕, 一段时 长后, 应用处理模块 11判断用户十指已离开屏幕, 则通过屏幕提示用户是否 退出该输入法模式。 当用户点击屏幕提示框, 确认退出该输入法后, 除 IE地 址栏信息外的屏幕显示内容, 将恢复至进入 "指尖键盘输入法" 模式前的情 况。
上述场景中的所述的平板电脑的应用处理模块 12, 可以与平板电脑的基 带处理芯片进行合并, 使平板电脑的基带处理芯片也具有该应用处理模块的 相关功能。
上述场景代表了本发明实施例的典型应用, 但并不仅限于此。 工程技术 人员可以很容易的将其扩展到其他类似应用场景, 此处不再赘述。
当然, 本发明还可有其他多种实施例, 在不背离本发明精神及其实质的 变形,但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成, 所述程序可以存储于计算机可读存储介质中, 如只读 存储器、 磁盘或光盘等。 可选地, 上述实施例的全部或部分步骤也可以使用 一个或多个集成电路来实现。 相应地, 上述实施例中的各模块 /单元可以釆用 硬件的形式实现, 也可以釆用软件功能模块的形式实现。 本发明实施方式不 限制于任何特定形式的硬件和软件的结合。 工业实用性
上述技术方案打破原有标准化虚拟键盘的呈现模式, 使键盘上的字母、 数字、 符号乃至于功能键的位置不局限于原标准化布局, 在触摸屏上重新布 局, 使各按键的新布局能够更符合人体工学原理, 并且可以针对不同用户的 手型以及使用习惯构建满足不同用户需求的布局, 使用户进行信息输入时更 加舒适、 快捷、 轻松, 大大提高用户体验。

Claims

权 利 要 求 书
1、 一种多点触摸设备, 包括依次相连的触控识别模块( 10 )、 应用处理 模块( 11 ) 、 图像显示模块( 12 ) ; 所述触控识别模块( 10 )设置为将检测 到的屏幕点触操作信息发送至所述应用处理模块(11 ) , 所述应用处理模块 ( 11 )设置为将屏显信息发送至所述图像显示模块( 12 ) , 所述图像显示模 块(12 )设置为在触摸屏上显示所述屏显信息, 其中,
所述应用处理模块(11 )还设置为, 根据所述屏幕点触操作信息中的手 指触点位置生成虚拟键盘信息, 以及确定通过所述虚拟键盘输入的虚拟按键 信息, 将所述虚拟键盘信息和 /或虚拟按键信息作为屏显信息的子信息发送; 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位置为中心的 预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按键信息。
2、 如权利要求 1所述的设备, 其中,
所述应用处理模块( 11 )包括判断单元( 111 )、虚拟键盘生成单元( 112 ) 和虚拟键盘输入识别单元(113 ) ;
所述判断单元( 111 )设置为, 判断屏幕点触操作信息满足虚拟键盘生成 条件时, 向所述虚拟键盘生成单元(112 )发送虚拟键盘生成触发指示;
所述虚拟键盘生成单元(112 )设置为, 收到所述触发指示后, 确定所述 虚拟键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触 点位置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚 拟按键信息, 将所述虚拟键盘信息作为屏显信息的子信息发送;
所述虚拟键盘生成单元( 112 )还设置为, 将所述虚拟键盘信息发送至所 述虚拟键盘输入识别单元(113 ) ;
所述虚拟键盘输入识别单元(113 )设置为, 在所述图像显示模块(12 ) 显示所述虚拟键盘信息期间, 根据收到的屏幕点触操作信息判断虚拟按键区 域被点触时确定相应虚拟按键信息, 并将此虚拟按键信息作为屏显信息中的 输入内容信息发送。
3、 如权利要求 1或 2所述的设备, 其中, 所述图像显示模块(12 )设置 为在所述触摸屏上显示所述虚拟键盘信息中的虚拟按键区域以及对应的虚拟 按键信息, 并将所述虚拟键盘信息中虚拟按键信息显示于与此虚拟按键信息 对应的虚拟按键区域内。
4、 如权利要求 1或 2所述的设备, 其中,
以手指触点位置为中心的预设范围内的虚拟按键区域包括 N个虚拟按键 区域, 所述 N个虚拟按键区域以所述手指触点位置的中心点为中心分布并且 任一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚拟按键 区域的中心点与手指触点位置的中心点的连线构成的角度均相同;
或者, 以手指触点位置为中心的预设范围内的虚拟按键区域除包括所述 N个虚拟按键区域外还包括一位于所述手指触点位置的虚拟按键区域;
N为大于 1的整数。
5、 如权利要求 2所述的设备, 其中,
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括 X个触点位置并 且所述 X个触点位置的点触时长均超过预设时长, X为大于 1的整数; 所述 虚拟键盘生成单元(112 )还设置为根据所述屏幕点触操作信息中 X个触点 位置确定所述虚拟键盘信息中的十个手指触点中心位置;
或者,
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括连续 Y次满足预 设条件的屏幕点触操作, Y为大于 1的整数; 所述虚拟键盘生成单元(112 ) 还设置为将预设的十个手指触点中心位置作为所述虚拟键盘信息中的十个手 指触点中心位置。
6、 如权利要求 2所述的设备, 其中,
所述判断单元( 111 )设置为, 判断屏幕点触操作信息满足虚拟键盘撤销 条件时, 向所述虚拟键盘生成单元(112 )发送虚拟键盘撤销触发指示;
所述虚拟键盘生成单元( 112 )还设置为收到所述触发指示后, 发送不包 含所述虚拟键盘信息的屏显信息。
7、 一种应用处理装置,包括判断单元(111 )、虚拟键盘生成单元(112 )、 虚拟键盘输入识别单元(113 ) ; 其中, 所述判断单元( 111 )设置为, 判断屏幕点触操作信息满足虚拟键盘生成 条件时, 向所述虚拟键盘生成单元(112 )发送触发指示;
所述虚拟键盘生成单元(112 )设置为, 收到所述触发指示后, 确定虚拟 键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指触点位 置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的虚拟按 键信息, 将所述虚拟键盘信息作为屏显信息的子信息发送;
所述虚拟键盘生成单元( 112 )还设置为, 将所述虚拟键盘信息发送至所 述虚拟键盘输入识别单元(113 ) ;
所述虚拟键盘输入识别单元 ( 113 )设置为, 根据所述屏幕点触操作信息 判断虚拟按键区域被点触时确定相应虚拟按键信息, 并将此虚拟按键信息作 为屏显信息中的输入内容信息发送。
8、 一种多点触摸设备信息显示方法, 包括:
所述多点触摸设备判断屏幕点触操作信息满足虚拟键盘生成条件时, 确 定虚拟键盘信息, 所述虚拟键盘信息包括以所述屏幕点触操作信息中各手指 触点位置为中心的预设范围内的多个虚拟按键区域以及与各按键区域对应的 虚拟按键信息, 显示所述虚拟键盘信息。
9、 如权利要求 8所述的信息显示方法, 其中,
所述显示所述虚拟键盘信息的步骤包括: 根据收到的屏幕点触操作信息 判断虚拟按键区域被点触时确定相应虚拟按键信息, 将所述虚拟按键信息作 为输入内容显示。
10、 如权利要求 8或 9所述的信息显示方法, 其中,
以手指触点位置为中心的预设范围内的虚拟按键区域包括 N个虚拟按键 区域, 所述 N个虚拟按键区域以所述手指触点位置的中心点为中心分布并且 任一虚拟按键区域的中心点与手指触点位置的中心点的连线与相邻虚拟按键 区域的中心点与手指触点位置的中心点的连线构成的角度均相同;
或者, 以手指触点位置为中心的预设范围内的虚拟按键区域除包括所述 N个虚拟按键区域外还包括一位于所述手指触点位置的虚拟按键区域 ;
N为大于 1的整数。
11、 如权利要求 8或 9所述的信息显示方法, 其中,
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括 X个触点位置并 且所述 X个触点位置的点触时长均超过预设时长, X为大于 1的整数; 所述 方法还包括: 根据所述屏幕点触操作信息中 X个触点位置确定所述虚拟键盘 信息中的十个手指触点中心位置;
或者,
所述虚拟键盘生成条件是所述屏幕点触操作信息中包括连续 Y次满足预 设条件的屏幕点触操作, Y为大于 1的整数; 所述方法还包括: 将预设的十 个手指触点中心位置作为所述虚拟键盘信息中的十个手指触点中心位置。
PCT/CN2012/074824 2012-02-28 2012-04-27 一种多点触摸设备及信息显示方法及应用处理装置 WO2012155784A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210047327.5A CN102629164B (zh) 2012-02-28 2012-02-28 一种多点触摸设备及信息显示方法及应用处理装置
CN201210047327.5 2012-02-28

Publications (1)

Publication Number Publication Date
WO2012155784A1 true WO2012155784A1 (zh) 2012-11-22

Family

ID=46587426

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/074824 WO2012155784A1 (zh) 2012-02-28 2012-04-27 一种多点触摸设备及信息显示方法及应用处理装置

Country Status (2)

Country Link
CN (1) CN102629164B (zh)
WO (1) WO2012155784A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10092569B2 (en) 2014-02-21 2018-10-09 Principia Biopharma Inc. Salts and solid form of a BTK inhibitor

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102007651B1 (ko) * 2012-12-21 2019-08-07 삼성전자주식회사 터치스크린 키보드를 구성하는 방법, 장치 및 이를 수행하는 프로그램을 저장하는 컴퓨터로 읽을 수 있는 저장 매체
CN104077065A (zh) * 2013-03-27 2014-10-01 百度在线网络技术(北京)有限公司 触摸屏终端显示虚拟键盘的方法及触摸屏终端
CN104182155B (zh) * 2013-05-21 2017-11-03 上海斐讯数据通信技术有限公司 触摸屏自动调整键盘显示区块的方法
CN103645854A (zh) * 2013-11-29 2014-03-19 广州视源电子科技股份有限公司 在触控屏幕任意位置唤出虚拟按键ui的方法
CN105988634A (zh) * 2015-03-06 2016-10-05 纬创资通(中山)有限公司 触控装置及判断虚拟键盘按键的方法
CN106814957A (zh) * 2015-11-30 2017-06-09 东莞酷派软件技术有限公司 输入方法、输入装置及智能终端
CN107656687B (zh) * 2016-07-26 2020-04-24 南宁富桂精密工业有限公司 虚拟键盘生成的方法及***
CN107390998B (zh) * 2017-08-18 2018-07-06 中山叶浪智能科技有限责任公司 一种虚拟键盘中按键的设置方法及***
CN111007977A (zh) * 2018-10-04 2020-04-14 邱波 智能虚拟交互方法及装置
CN111325063B (zh) * 2018-12-14 2024-01-05 航天信息股份有限公司 识别虚拟数字键盘的方法、装置和存储介质
CN112035901B (zh) * 2020-09-03 2023-09-12 北京元心科技有限公司 信息输入方法、装置、电子设备及介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1666170A (zh) * 2002-07-04 2005-09-07 皇家飞利浦电子股份有限公司 自适应虚拟键盘
JP2007183787A (ja) * 2006-01-06 2007-07-19 Hitachi High-Technologies Corp ソフトウェアキーボード表示装置
CN102117164A (zh) * 2009-12-30 2011-07-06 乐金电子(中国)研究开发中心有限公司 一种虚拟键盘的实现方法、装置和设备
CN102246134A (zh) * 2008-12-09 2011-11-16 微软公司 软键盘控制

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1666170A (zh) * 2002-07-04 2005-09-07 皇家飞利浦电子股份有限公司 自适应虚拟键盘
JP2007183787A (ja) * 2006-01-06 2007-07-19 Hitachi High-Technologies Corp ソフトウェアキーボード表示装置
CN102246134A (zh) * 2008-12-09 2011-11-16 微软公司 软键盘控制
CN102117164A (zh) * 2009-12-30 2011-07-06 乐金电子(中国)研究开发中心有限公司 一种虚拟键盘的实现方法、装置和设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10092569B2 (en) 2014-02-21 2018-10-09 Principia Biopharma Inc. Salts and solid form of a BTK inhibitor

Also Published As

Publication number Publication date
CN102629164A (zh) 2012-08-08
CN102629164B (zh) 2017-06-27

Similar Documents

Publication Publication Date Title
WO2012155784A1 (zh) 一种多点触摸设备及信息显示方法及应用处理装置
US9030424B2 (en) Method and electronic device for virtual keyboard with haptic/tactile feedback
US10209885B2 (en) Method and device for building virtual keyboard
WO2012070682A1 (ja) 入力装置及び入力装置の制御方法
JP5730667B2 (ja) デュアルスクリーン上のユーザジェスチャのための方法及びデュアルスクリーンデバイス
KR101471267B1 (ko) 터치 키보드의 동적 생성 방법 및 장치
US20100253630A1 (en) Input device and an input processing method using the same
US20110095992A1 (en) Tools with multiple contact points for use on touch panel
US20150185953A1 (en) Optimization operation method and apparatus for terminal interface
CN104731497B (zh) 管理防误触的多个触摸源的设备和方法
CN102467330A (zh) 一种虚拟键盘装置及其操作方法
TWI421731B (zh) 電子裝置之滑鼠功能執行方法及其電子裝置
WO2015161715A1 (zh) 一种移动终端
JP5461488B2 (ja) タッチ表示装置上に表示されるキーボードレイアウトの表示外観を調節する方法
EP2474890A1 (en) Virtual keyboard configuration putting fingers in rest positions on a multitouch screen, calibrating key positions thereof
TWI452494B (zh) 將至少兩個觸控訊號結合於電腦系統中的方法
CN202110523U (zh) 终端设备及其图标位置互换装置
KR20160097410A (ko) 동작 인식을 통한 비접촉식 입력 인터페이스 제공 방법 및 그 장치
CN101470575A (zh) 电子装置及其输入方法
US20150309601A1 (en) Touch input system and input control method
TW201128451A (en) Input device
WO2016019811A1 (zh) 一种触感型控制器
TWI410860B (zh) 具有虛擬鍵盤之觸控裝置及其形成虛擬鍵盤之方法
TWI511021B (zh) 虛擬鍵盤的操作方法
US11301066B2 (en) Method and a device for interacting with a touch sensitive surface

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12785898

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12785898

Country of ref document: EP

Kind code of ref document: A1