WO2015127731A1 - 软键盘布局调整方法及装置 - Google Patents

软键盘布局调整方法及装置 Download PDF

Info

Publication number
WO2015127731A1
WO2015127731A1 PCT/CN2014/080319 CN2014080319W WO2015127731A1 WO 2015127731 A1 WO2015127731 A1 WO 2015127731A1 CN 2014080319 W CN2014080319 W CN 2014080319W WO 2015127731 A1 WO2015127731 A1 WO 2015127731A1
Authority
WO
WIPO (PCT)
Prior art keywords
soft keyboard
user
coordinate value
finger
finger tip
Prior art date
Application number
PCT/CN2014/080319
Other languages
English (en)
French (fr)
Inventor
曾慧琼
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015127731A1 publication Critical patent/WO2015127731A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a soft keyboard layout adjustment method and apparatus. Background technique
  • a mobile device equipped with a touch screen usually adopts a soft keyboard input mode, and the soft keyboard layout can select a full keyboard or a traditional 12-key keyboard.
  • a traditional 12-key keyboard one button is shared by three to four letters, often multiple clicks to filter the target value.
  • the full keyboard layout each letter has a separate button corresponding to it, and the target value can be obtained with a single click, which improves the input efficiency.
  • the individual keys of the full keyboard are usually too narrow.
  • portable electronic computing devices with limited width such as mobile phones.
  • the narrow button size is easy to cause the wrong button to be pressed, which improves the input error rate and reduces the input efficiency.
  • the present invention has been made in order to provide a soft keyboard layout adjustment method and apparatus.
  • the embodiment of the invention provides a soft keyboard layout adjustment method, including:
  • the finger movement information when the user inputs the soft keyboard is collected, the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set. ;
  • the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved is determined, and the keys in the target soft keyboard area are enlarged, and the keys in the remaining soft keyboard areas are reduced. And display it.
  • the information about the finger movement when the user inputs the soft keyboard includes: Adjusting the terminal's own camera is capable of capturing the soft keyboard input angle, and taking the action of the user's fingertip when taking the soft keyboard input by the self-contained camera to form the finger movement information of the video data format.
  • the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set, specifically: calculating the video data by using a graphic processing algorithm The coordinate value of the user's finger pointing end of each frame of video data, and acquiring a coordinate value set of the user's finger finger movement within a predetermined time, and determining the displacement direction of the user's finger finger end on the soft keyboard according to the coordinate value set.
  • determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:
  • the target soft keyboard area to which the user's fingertip is to be moved is determined.
  • the above method further comprises: turning off or turning on the soft keyboard layout adjustment function of the terminal according to the operation of the user.
  • the embodiment of the invention further provides a soft keyboard layout adjusting device, comprising:
  • the collection module is configured to collect finger movement information when the user inputs the soft keyboard in the terminal;
  • the calculation module is configured to calculate a coordinate value set of the movement of the fingertip of the user within a predetermined time according to the movement information of the finger, and determine according to the coordinate value set The direction of displacement of the user's finger on the soft keyboard;
  • the processing module is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button in the button is zoomed out and displayed.
  • the collection module is specifically configured to: adjust the terminal self-contained camera to be able to capture the soft keyboard input angle, and take the action of the user's fingertip when the soft keyboard input is performed by the self-contained camera to form the finger movement information of the video data format.
  • the calculating module is specifically configured to: calculate, by using a graphics processing algorithm, coordinate values of a user's fingertips of each frame of video data in the video data, and acquire coordinates of the fingertip movement of the user within a predetermined time
  • the set of values, and the direction of displacement of the fingertip of the user on the soft keyboard is determined according to the set of coordinate values.
  • the processing module is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; according to the current user The soft keyboard area where the finger is pointed and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.
  • the device further includes: a selection module, configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to a user operation.
  • a selection module configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to a user operation.
  • the error of the full keyboard input caused by the narrow key is solved in the prior art.
  • the problem can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input.
  • FIG. 1 is a flowchart of a method for adjusting a soft keyboard layout according to an embodiment of the present invention
  • FIG. 2 is a flowchart of detailed processing of a soft keyboard layout adjustment method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the left button in the embodiment of the present invention
  • FIG. 5 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the right button in the embodiment of the present invention
  • FIG. 6 is a soft keyboard according to an embodiment of the present invention
  • Schematic diagram of the layout adjustment device
  • the present invention provides a soft keyboard layout adjustment method and device.
  • the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. . It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • FIG. 1 is a flowchart of a soft keyboard layout adjustment method according to an embodiment of the present invention, which includes the following processing:
  • Step 101 Collect finger movement information when the user inputs the soft keyboard, calculate a coordinate value set of the finger movement of the user finger within a predetermined time according to the finger movement information, and collect according to the coordinate value
  • the finger movement information of the user when performing the soft keyboard input specifically includes: adjusting the terminal self-contained camera to be able to capture the soft keyboard input angle, and photographing the user finger when performing the soft keyboard input by the self-contained camera
  • the action of the fingertip forms the finger movement information in the video data format.
  • step 101 the set of coordinate values of the fingertip movement of the user within a predetermined time is calculated according to the finger movement information, and the direction of displacement of the fingertip of the user on the soft keyboard according to the coordinate value set specifically includes:
  • Step 102 Determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button is zoomed out and displayed.
  • step 102 according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:
  • the target soft keyboard area to which the user's fingertip is to be moved is determined.
  • the soft keyboard layout adjustment function of the terminal may be turned off or on according to the operation of the user.
  • the terminal must have at least the following components: a touch sensitive display (ie, a touch screen), a camera, and a computing control module.
  • a touch sensitive display ie, a touch screen
  • the camera is located above the touch screen and can be rotated; if the camera is not rotatable, but the angle is fixed to an angle at which the touch screen can be captured.
  • the above computing control module includes one or more calculators, controllers, and memories of the device. The technical solution of the embodiment of the present invention preliminarily judges the input intention by photographing the finger motion, and then dynamically adjusts the soft keyboard layout.
  • the camera located above the touch screen collects video data that the finger moves on the keyboard.
  • the video data of the finger movement collected by the ⁇ is sent to the calculation control module, and the coordinate value of the finger finger end in the single frame video is calculated by the graphics processing algorithm.
  • the calculation control module calculates the recorded array of fingertip coordinate values, and calculates the displacement direction of the fingertip coordinates for a continuous period of time, thereby judging that the finger is moving in the direction of the screen.
  • the calculation control module determines which area of the screen the fingertip is located by comparing the fingertip coordinate value with the screen partition coordinate value. And combined with the direction of the finger displacement obtained before, comprehensively determine which area of the screen the finger will move.
  • the calculation control module adjusts the layout of the soft keyboard, enlarges the button of the target area where the finger is moved, and the keys of the remaining areas are correspondingly reduced, and the adjusted layout is refreshed, and the new keyboard layout is displayed by the touch screen.
  • whether the keyboard layout is dynamically adjusted at the time of input can be selectively turned on or off by the user.
  • the soft keyboard dynamically adjusts the button size according to the pre-divided keyboard partition, and the sub-area is uniformly and dynamically adjusted, that is, the button size of the target area is uniformly enlarged, and the button size of other non-target areas is uniformly reduced.
  • the partition can be determined based on the camera module's collection speed and the processor's calculation speed. Generally, the higher the processing speed of image collection and system, the more partitions can be divided, and the number of buttons in a single area is small. Therefore, the size of a single button can be enlarged. On the contrary, the number of partitions is small, and the number of buttons in a single area is large. The size that can be enlarged will be smaller.
  • the design principle is to ensure that the keyboard partition is minimized and the burden of the computing system is reduced by ensuring that a single button is zoomed in to greatly reduce the false touch rate.
  • FIG. 2 is a flowchart of detailed processing of a method for adjusting a soft keyboard layout according to an embodiment of the present invention. As shown in FIG. 2, the following specifically includes the following processing:
  • Step 201 The system detects that the text input box obtains focus, and starts the soft keyboard startup process. Turn the camera above the touch screen to a predetermined angle and turn on the camera. The predetermined angle is designed to ensure that the camera can capture the soft keyboard area below the screen.
  • Step 202 displaying a soft keyboard interface.
  • Step 203 The camera captures a finger motion image.
  • the collected video data is sent to the processor for corresponding graphics algorithm calculation.
  • Step 204 Acquire coordinate values of the fingertips in the image by calculation and record them in an array. Steps 203 and 204 are executed cyclically, and the coordinate data of the finger end is continuously acquired and the coordinate value array is updated.
  • Step 205 Calculate the finger end displacement direction by using a plurality of coordinate points continuously recorded.
  • Step 206 Determine whether the finger end horizontal coordinate is to the left of the screen horizontal center line and whether the current finger end displacement direction is to the left. If the result of the determination is true, then the process proceeds to step 207, and the result of the determination is otherwise to step 208.
  • Step 207 If the result of the determination in step 206 is true, the system determines that the user wants to click the button on the left side of the keyboard, and automatically adjusts the full keyboard layout.
  • FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention.
  • the keyboard is divided into two areas, left and right, which are respectively identified by black and white colors.
  • the middle gray area is the area where the left and right areas overlap.
  • the buttons on the left white area and the middle gray area in the keyboard layout of Fig. 3 are widened, and the keys on the right black area are narrowed. The result is shown in Fig. 4. Then go back to step 205.
  • Step 208 Determine whether the finger end horizontal coordinate is on the right side of the screen horizontal center line and whether the current finger end displacement direction is to the right. If the result of the determination is true, the process goes to step 209, and the result of the determination is otherwise, and the process returns to step 205.
  • Step 209 If the result of the determination in step 208 is true, the system determines that the user wants to click the button on the right side of the keyboard, and automatically adjusts the full keyboard layout. In the keyboard layout of Figure 3, the buttons on the right black area and the middle gray area will be widened, and the buttons on the left white area will be narrowed. The result is shown in Figure 5. Then go back and repeat step 205.
  • the technical solution described in the embodiment of the present invention can pre-determine the intention of the user's button, and dynamically increase the local button of the keyboard according to the user's intention, widen the target button, and reduce the probability of the user pressing the wrong button. Improve the efficiency of text input.
  • FIG. 6 is a schematic structural diagram of a soft keyboard layout adjustment apparatus according to an embodiment of the present invention. As shown in FIG. 6, the soft keyboard layout adjustment according to an embodiment of the present invention is shown.
  • the device includes: a collection module 60, a calculation module 62, and a processing module 64. The respective modules of the embodiments of the present invention are described in detail below.
  • the collection module 60 is configured to collect finger movement information when the user inputs the soft keyboard at the terminal; preferably, the collection module 60 is specifically configured to: adjust the terminal self-equipped camera to be able to capture the soft keyboard The input angle is used to capture the movement of the finger of the user in the video data format by taking the action of the user's fingertip when the soft keyboard is input.
  • the calculating module 62 is configured to calculate a coordinate value set of the fingertip movement of the user within a predetermined time according to the finger movement information, and determine a displacement direction of the finger finger end of the user on the soft keyboard according to the coordinate value set; 5 preferably, the calculation module 62 is specifically configured to: calculate a coordinate value of a user finger finger end of each frame of video data in the video data by using a graphics processing algorithm, and acquire a coordinate value set of the finger finger movement of the user within a predetermined time, and determine the user finger finger according to the coordinate value set; The direction of displacement on the soft keyboard.
  • the processing module 64 is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and press the 10 key in the target soft keyboard area to enlarge the rest.
  • the buttons in the soft keyboard area are zoomed out and displayed.
  • the processing module 64 is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; The soft keyboard area where the user's fingertip is located, and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.
  • the apparatus according to the embodiment of the present invention further comprises: a selection module for selecting to disable or turn on the soft keyboard layout adjustment function of the terminal according to the user's operation.
  • the terminal has at least the following components, and the collection module can be a touch-sensitive display (ie, a touch screen) and a camera; the calculation module, the processing module, and the selection module can be one or more calculators, controllers, and Memory.
  • the camera is located above the touch screen and can be rotated; if the camera is not rotated, the angle is fixed to the angle at which the touch screen can be captured.
  • the technical solution of the embodiment of the present invention determines the target soft keyboard area to which the user's fingertip is to be moved according to the finger movement information when the user inputs the soft keyboard at the terminal, and performs the release of the target soft keyboard area.
  • the full keyboard input is easy to input and error caused by the narrow button, which can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

公开了一种软键盘布局调整方法及装置，其中，方法包括：采集用户在终端进行软键盘输入时的手指移动信息，根据所述手指移动信息计算预定时间内用户手指指端移动的坐标值集合，并根据所述坐标值集合判断用户手指指端在所述软键盘上的位移方向；根据预先划分的软键盘分区、所述坐标值集合以及所述位移方向，确定用户手指指端将要移动到的目标软键盘区域，并将所述目标软键盘区域中的按键放大，将其余软键盘区域中的按键缩小，并进行显示。

Description

软键盘布局调整方法及装置 技术领域
本发明涉及计算机技术领域，特别是涉及一种软键盘布局调整方法及装置。 背景技术
在现有技术中， 配备触摸屏的移动设备通常釆用软键盘输入的方式， 软键 盘布局可以选择全键盘，也可以选择传统的 12键键盘。在传统的 12键键盘中， 一个按键由三至四个字母共用， 经常要多次点击才能筛选到目标值。 在全键盘 布局下，每一个字母都有独立的按键与之对应， 只需点击一次即可获取目标值， 提高了输入效率。
受限于屏幕的宽度， 全键盘的单个按键通常过于窄小。 特别是像手机这样 宽度有限的便携式电子计算设备。 按键窄小容易引发按错键， 提升了输入的错 误率， 降低了输入的效率。 发明内容
鉴于现有技术中全键盘输入因按键窄小而引发的易输错的问题， 提出了本 发明以便提供一种软键盘布局调整方法及装置。
本发明实施例提供一种软键盘布局调整方法， 包括：
釆集用户在终端进行软键盘输入时的手指移动信息， 根据手指移动信息计 算预定时间内用户手指指端移动的坐标值集合， 并根据坐标值集合判断用户手 指指端在软键盘上的位移方向；
根据预先划分的软键盘分区、 坐标值集合以及位移方向， 确定用户手指指 端将要移动到的目标软键盘区域， 并将目标软键盘区域中的按键放大， 将其余 软键盘区域中的按键缩小， 并进行显示。
优选地， 釆集用户在进行软键盘输入时的手指移动信息具体包括： 调整终端自带摄像头为能够拍摄到软键盘输入角度， 通过自带摄像头拍摄 在进行软键盘输入时用户手指指端的动作，形成视频数据格式的手指移动信息。
优选地， 才艮据手指移动信息计算预定时间内用户手指指端移动的坐标值集 合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向具体包括： 通过图形处理算法计算视频数据中每一帧视频数据的用户手指指端的坐标 值， 并获取预定时间内用户手指指端移动的坐标值集合， 并根据坐标值集合判 断用户手指指端在软键盘上的位移方向。
优选地， 根据预先划分的软键盘分区、 坐标值集合以及位移方向， 确定用 户手指指端将要移动到的目标软键盘区域具体包括：
根据坐标值集合中当前用户手指指端所处的坐标值、 以及预先划分的软键 盘分区的坐标值判断当前用户手指指端所处软键盘区域；
根据当前用户手指指端所处软键盘区域、 以及位移方向， 确定用户手指指 端将要移动到的目标软键盘区域。
优选地， 上述方法进一步包括： 根据用户的操作关闭或开启终端的软键盘 布局调整功能。
本发明实施例还提供了一种软键盘布局调整装置， 包括：
釆集模块， 用于釆集用户在终端进行软键盘输入时的手指移动信息； 计算模块， 用于根据手指移动信息计算预定时间内用户手指指端移动的坐 标值集合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向；
处理模块， 用于根据预先划分的软键盘分区、 坐标值集合以及位移方向， 确定用户手指指端将要移动到的目标软键盘区域， 并将目标软键盘区域中的按 键放大， 将其余软键盘区域中的按键缩小， 并进行显示。
优选地， 釆集模块具体用于： 调整终端自带摄像头为能够拍摄到软键盘输 入角度， 通过自带摄像头拍摄在进行软键盘输入时用户手指指端的动作， 形成 视频数据格式的手指移动信息。
优选地， 计算模块具体用于： 通过图形处理算法计算视频数据中每一帧视 频数据的用户手指指端的坐标值， 并获取预定时间内用户手指指端移动的坐标 值集合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向。
优选地， 处理模块具体用于： 根据坐标值集合中当前用户手指指端所处的 坐标值、 以及预先划分的软键盘分区的坐标值判断当前用户手指指端所处软键 盘区域； 根据当前用户手指指端所处软键盘区域、 以及位移方向， 确定用户手 指指端将要移动到的目标软键盘区域。
优选地， 上述装置进一步包括： 选择模块， 用于根据用户的操作选择关闭 或开启终端的软键盘布局调整功能。
本发明实施例有益效果如下：
通过根据用户在终端进行软键盘输入时的手指移动信息确定用户手指指端 将要移动到的目标软键盘区域并进行放大， 解决了现有技术中全键盘输入因按 键窄小而引发的易输错的问题， 能够减少用户按错键的几率， 提高用户文本输 入的效率。
上述说明仅是本发明技术方案的概述， 为了能够更清楚了解本发明的技术 手段， 而可依照说明书的内容予以实施， 并且为了让本发明的上述和其它目的、 特征和优点能够更明显易懂， 以下特举本发明的具体实施方式。 附图说明
通过阅读下文优选实施方式的详细描述， 各种其他的优点和益处对于本领 域普通技术人员将变得清楚明了。 附图仅用于示出优选实施方式的目的， 而并 不认为是对本发明的限制。 而且在整个附图中， 用相同的参考符号表示相同的 部件。 在附图中：
图 1是本发明实施例的软键盘布局调整方法的流程图；
图 2是本发明实施例的软键盘布局调整方法的详细处理的流程图； 图 3是本发明实施例的软键盘分区示意图；
图 4是本发明实施例的软键盘自动调整为左边按键放大的布局示意图； 图 5是本发明实施例的软键盘自动调整为右边按键放大的布局示意图； 图 6是本发明实施例的软键盘布局调整装置的结构示意图。 具体实施方式
下面将参照附图更详细地描述本公开的示例性实施例。 虽然附图中显示了 本公开的示例性实施例， 然而应当理解， 可以以各种形式实现本公开而不应被 这里阐述的实施例所限制。 相反， 提供这些实施例是为了能够更透彻地理解本 5 公开， 并且能够将本公开的范围完整的传达给本领域的技术人员。
为了解决现有技术中全键盘输入因按键窄小而引发的易输错的问题， 本发 明提供了一种软键盘布局调整方法及装置， 以下结合附图以及实施例， 对本发 明进行进一步详细说明。 应当理解， 此处所描述的具体实施例仅仅用以解释本 发明， 并不限定本发明。
10 方法实施例、
根据本发明的实施例， 提供了一种软键盘布局调整方法， 图 1是本发明实 施例的软键盘布局调整方法的流程图， 包括如下处理：
步骤 101， 釆集用户在终端进行软键盘输入时的手指移动信息， 根据手指 移动信息计算预定时间内用户手指指端移动的坐标值集合， 并根据坐标值集合
15 判断用户手指指端在软键盘上的位移方向；
在本发明实施例中， 釆集用户在进行软键盘输入时的手指移动信息具体包 括： 调整终端自带摄像头为能够拍摄到软键盘输入角度， 通过自带摄像头拍摄 在进行软键盘输入时用户手指指端的动作，形成视频数据格式的手指移动信息。
当然， 除了上述通过终端自带摄像头釆集手指移动信息以外， 还可以釆用
!0 其他方式进行釆集。 上述通过终端自带摄像头釆集手指移动信息仅仅是本发明 的一个优选实施方式。
在步骤 101 中， 根据手指移动信息计算预定时间内用户手指指端移动的坐 标值集合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向具体包 括：
!5 通过图形处理算法计算视频数据中每一帧视频数据的用户手指指端的坐标 值， 并获取预定时间内用户手指指端移动的坐标值集合， 并根据坐标值集合判 断用户手指指端在软键盘上的位移方向。
步骤 102， 根据预先划分的软键盘分区、 坐标值集合以及位移方向， 确定 用户手指指端将要移动到的目标软键盘区域， 并将目标软键盘区域中的按键放 大， 将其余软键盘区域中的按键缩小， 并进行显示。
在步骤 102中， 根据预先划分的软键盘分区、 坐标值集合以及位移方向， 确定用户手指指端将要移动到的目标软键盘区域具体包括：
根据坐标值集合中当前用户手指指端所处的坐标值、 以及预先划分的软键 盘分区的坐标值判断当前用户手指指端所处软键盘区域；
根据当前用户手指指端所处软键盘区域、 以及位移方向， 确定用户手指指 端将要移动到的目标软键盘区域。
优选地， 在本发明实施例中， 还可以根据用户的操作关闭或开启终端的软 键盘布局调整功能。
下面以通过通过终端自带摄像头釆集用户在软键盘进行单手输入时的手指 移动信息为例， 对本发明实施例的技术方案进行详细说明。
在本发明实施中，终端至少要具备以下几个组件：触敏显示屏（即触摸屏）、 摄像头、 以及计算控制模块。 优选地， 摄像头位于触摸屏的上方， 并且可以旋 转； 如果摄像头不可以旋转， 但是角度固定到可以拍摄到触摸屏的角度。 上述 计算控制模块包括设备的一个或多个计算器、 控制器、 存储器。 本发明实施例 的技术方案摄像头通过拍摄手指动作， 对输入意图进行预先判断， 进而动态调 整软键盘布局的方法。
具体地， 用户通过全键盘进行单手输入时， 位于触摸屏上方的摄像头釆集 手指在键盘上移动的视频数据。 釆集到的手指移动的视频数据会被送到计算控 制模块， 通过图形处理算法计算出单帧视频中手指指端的坐标值。 计算控制模 块对记录下来的指端坐标值数组进行计算， 算出在一段连续时间内指端坐标的 位移方向， 从而判断出手指正在向屏幕的那个方向移动。 计算控制模块通过比 较指端坐标值和屏幕分区坐标值， 从而判断出指端位于屏幕的哪一块区域。 并 结合之前获取的手指位移方向， 综合判断出手指会向屏幕的哪个区域移动。 最 后， 计算控制模块调整软键盘的布局， 将手指移动的目的区域的按键放大， 其 余区域的按键相应缩小， 并将调整后的布局刷新， 由触摸屏显示新的键盘布局。
在本发明实施例中， 优选地， 是否在输入时动态调整键盘布局是可以由用 户选择性开启或关闭的。
需要说明的是， 软键盘动态调整按键大小是按照预先划分的键盘分区， 分 区域统一动态调整的， 即统一放大目标区域的按键尺寸， 统一缩小其他非目标 区域的按键尺寸。 分区可以根据摄像模块的釆集速度和处理器的计算速度来确 定。 通常图像釆集和***的处理速度越高， 分区可以划分更多更细， 单个区域 内按键数量少， 因此单个按键可放大尺寸越大； 反之则分区少， 单个区域内按 键数量多， 单个按键可放大尺寸会小一些。 设计的原则是保证单个按键放大到 极大幅度减小误触率的前提下尽量少划分键盘分区， 减小计算***负担。此外， 在本发明实施例中， 键盘各个区域之间应该有重叠部分， 保证区域间的临界范 围内的按键能够正常显示。
上述实施例中主要是以单手输入为例进行说明， 但是本发明实施例的技术 方案同样适用于双手输入， 其处理步骤与单手输入相似， 在此不再赘述。
以下结合附图， 对本发明实施例的上述技术方案进行详细说明。
图 2是本发明实施例的软键盘布局调整方法的详细处理的流程图， 如图 2 所示， 具体包括如下处理：
步骤 201， ***检测到文本输入框获取聚焦， 开始软键盘启动流程。 转动 触目屏上方摄像头到预定角度并开启摄像。 预定角度设计为保证摄像头可以拍 摄到屏幕下方的软键盘区域。
步骤 202， 显示软键盘界面。
步骤 203， 摄像头捕捉手指动作影像。 将釆集到的视频数据送到处理器进 行相应的图形算法计算。
步骤 204， 通过计算获取图像中指端的坐标值并记录到一个数组中。 步骤 203和步骤 204会循环执行， 不断获取指端的坐标数据并更新坐标值数组。
步骤 205， 通过连续记录的多个坐标点计算指端位移方向。 步骤 206， 判断指端水平坐标是否在屏幕水平中线左边并且当前指端位移 方向是否向左。 如果判定结果为真则转向步骤 207， 判定结果为否则转向步骤 208。
步骤 207， 如果步骤 206 中判定结果为真， ***判定用户想要点击键盘左 部的按键， 则自动调整全键盘布局。
图 3是本发明实施例的软键盘分区示意图， 如图 3所示， 在本发明实施例 中， 键盘被划分为左、 右两个区域， 分别以黑、 白两种颜色标识。 中间灰色区 域是左右两个区域重叠的区域。 在步骤 207中图 3键盘布局中左边白色区域及 中间灰色区域的按键会增宽， 右边黑色区域的按键会缩窄， 结果如图 4所示。 然后返回重复执行步骤 205。
步骤 208， 判断指端水平坐标是否在屏幕水平中线右边并且当前指端位移 方向是否向右。 如果判定结果为真则转向步骤 209， 判定结果为否则返回重复 执行步骤 205。
步骤 209， 如果步骤 208中判定结果为真， ***判定用户想要点击键盘右 部的按键， 则自动调整全键盘布局。 图 3键盘布局中右边黑色区域及中间灰色 区域的按键会增宽， 左边白色区域的按键会缩窄， 结果如图 5所示。 然后返回 重复执行步骤 205。
综上所述，釆用本发明实施例所述的技术方案可以预先判定用户按键意图， 并根据用户意图使键盘局部按键动态变大， 增宽目标按键， 减小了用户按错键 的几率， 从提高了文本输入的效率。
装置实施例
根据本发明的实施例， 提供了一种软键盘布局调整装置， 图 6是本发明实 施例的软键盘布局调整装置的结构示意图， 如图 6所示， 根据本发明实施例的 软键盘布局调整装置包括： 釆集模块 60、 计算模块 62、 以及处理模块 64， 以 下对本发明实施例的各个模块进行详细的说明。
釆集模块 60， 用于釆集用户在终端进行软键盘输入时的手指移动信息； 优选地，釆集模块 60具体用于： 调整终端自带摄像头为能够拍摄到软键盘 输入角度， 通过自带摄像头拍摄在进行软键盘输入时用户手指指端的动作， 形 成视频数据格式的手指移动信息。
计算模块 62， 用于才艮据手指移动信息计算预定时间内用户手指指端移动的 坐标值集合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向； 5 优选地，计算模块 62具体用于： 通过图形处理算法计算视频数据中每一帧 视频数据的用户手指指端的坐标值， 并获取预定时间内用户手指指端移动的坐 标值集合， 并根据坐标值集合判断用户手指指端在软键盘上的位移方向。
处理模块 64，用于根据预先划分的软键盘分区、坐标值集合以及位移方向， 确定用户手指指端将要移动到的目标软键盘区域， 并将目标软键盘区域中的按 10 键放大， 将其余软键盘区域中的按键缩小， 并进行显示。
优选地，处理模块 64具体用于： 根据坐标值集合中当前用户手指指端所处 的坐标值、 以及预先划分的软键盘分区的坐标值判断当前用户手指指端所处软 键盘区域； 根据当前用户手指指端所处软键盘区域、 以及位移方向， 确定用户 手指指端将要移动到的目标软键盘区域。
Ϊ5 优选地， 根据本发明实施例的装置进一步包括： 选择模块， 用于根据用户 的操作选择关闭或开启终端的软键盘布局调整功能。
终端至少要具备以下几个组件， 所述釆集模块可以为触敏显示屏（即触摸 屏）、摄像头；所述计算模块、处理模块和选择模块均可以为一个或多个计算器、 控制器、 存储器。 优选地， 摄像头位于触摸屏的上方， 并且可以旋转； 如果摄 !0 像头不可以旋转， 但是角度固定到可以拍摄到触摸屏的角度。
上述各个模块的详细处理步骤参照上述方法实施例中的相应描述进行理 解， 在此不再赘述。
综上所述， 本发明实施例的技术方案通过根据用户在终端进行软键盘输入 时的手指移动信息确定用户手指指端将要移动到的目标软键盘区域并进行放 !5 大， 解决了现有技术中全键盘输入因按键窄小而引发的易输错的问题， 能够减 少用户按错键的几率， 提高用户文本输入的效率。 明的精神和范围。 这样， 倘若本发明的这些修改和变型属于本发明权利要求及 其等同技术的范围之内， 则本发明也意图包含这些改动和变型在内。

Claims

权利要求书
1、 一种软键盘布局调整方法， 包括：
釆集用户在终端进行软键盘输入时的手指移动信息， 根据所述手指移动信 息计算预定时间内用户手指指端移动的坐标值集合， 并根据所述坐标值集合判 断用户手指指端在所述软键盘上的位移方向；
根据预先划分的软键盘分区、 所述坐标值集合以及所述位移方向， 确定用 户手指指端将要移动到的目标软键盘区域， 并将所述目标软键盘区域中的按键 放大， 将其余软键盘区域中的按键缩小， 并进行显示。
2、 如权利要求 1所述的方法， 其中， 釆集用户在进行软键盘输入时的手指 移动信息具体包括：
调整终端自带摄像头为能够拍摄到软键盘输入角度， 通过所述自带摄像头 拍摄在进行软键盘输入时用户手指指端的动作， 形成视频数据格式的手指移动 信息。
3、 如权利要求 2所述的方法， 其中， 根据所述手指移动信息计算预定时间 内用户手指指端移动的坐标值集合， 并根据所述坐标值集合判断用户手指指端 在所述软键盘上的位移方向具体包括：
通过图形处理算法计算所述视频数据中每一帧视频数据的用户手指指端的 坐标值， 并获取预定时间内用户手指指端移动的坐标值集合， 并根据所述坐标 值集合判断用户手指指端在所述软键盘上的位移方向。
4、 如权利要求 1所述的方法， 其中， 根据预先划分的软键盘分区、 所述坐 标值集合以及所述位移方向， 确定用户手指指端将要移动到的目标软键盘区域 具体包括：
根据所述坐标值集合中当前用户手指指端所处的坐标值、 以及预先划分的 软键盘分区的坐标值判断当前用户手指指端所处软键盘区域；
根据所述当前用户手指指端所处软键盘区域、 以及所述位移方向， 确定用 户手指指端将要移动到的目标软键盘区域。
5、 如权利要求 1所述的方法， 其中， 所述方法还包括： 根据用户的操作关 闭或开启终端的软键盘布局调整功能。
6、 一种软键盘布局调整装置， 包括：
釆集模块， 配置为釆集用户在终端进行软键盘输入时的手指移动信息； 计算模块， 配置为根据所述手指移动信息计算预定时间内用户手指指端移 动的坐标值集合， 并根据所述坐标值集合判断用户手指指端在所述软键盘上的 位移方向；
处理模块， 配置为根据预先划分的软键盘分区、 所述坐标值集合以及所述 位移方向， 确定用户手指指端将要移动到的目标软键盘区域， 并将所述目标软 键盘区域中的按键放大， 将其余软键盘区域中的按键缩小， 并进行显示。
7、 如权利要求 6所述的装置， 其中， 所述釆集模块， 配置为调整终端自带 摄像头为能够拍摄到软键盘输入角度， 通过所述自带摄像头拍摄在进行软键盘 输入时用户手指指端的动作， 形成视频数据格式的手指移动信息。
8、 如权利要求 7所述的装置， 其中， 所述计算模块， 配置为通过图形处理 算法计算所述视频数据中每一帧视频数据的用户手指指端的坐标值， 并获取预 定时间内用户手指指端移动的坐标值集合， 并根据所述坐标值集合判断用户手 指指端在所述软键盘上的位移方向。
9、 如权利要求 6所述的装置， 其中， 所述处理模块， 配置为根据所述坐标 值集合中当前用户手指指端所处的坐标值、 以及预先划分的软键盘分区的坐标 值判断当前用户手指指端所处软键盘区域； 根据所述当前用户手指指端所处软 键盘区域、 以及所述位移方向， 确定用户手指指端将要移动到的目标软键盘区 域。
10、 如权利要求 6所述的装置， 其中， 所述装置还包括： 选择模块， 配置 为根据用户的操作选择关闭或开启终端的软键盘布局调整功能。
PCT/CN2014/080319 2014-02-27 2014-06-19 软键盘布局调整方法及装置 WO2015127731A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410069278.4 2014-02-27
CN201410069278.4A CN104881200A (zh) 2014-02-27 2014-02-27 软键盘布局调整方法及装置

Publications (1)

Publication Number Publication Date
WO2015127731A1 true WO2015127731A1 (zh) 2015-09-03

Family

ID=53948714

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/080319 WO2015127731A1 (zh) 2014-02-27 2014-06-19 软键盘布局调整方法及装置

Country Status (2)

Country Link
CN (1) CN104881200A (zh)
WO (1) WO2015127731A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105242825B (zh) * 2015-09-09 2018-11-20 北京新美互通科技有限公司 终端控制方法及装置
CN105404456B (zh) * 2015-12-22 2019-01-22 厦门美图移动科技有限公司 一种移动终端拨号键盘管理方法及装置
CN107239218A (zh) * 2017-04-28 2017-10-10 努比亚技术有限公司 移动终端的控制方法、移动终端及计算机可读存储介质
CN108363541A (zh) * 2018-02-09 2018-08-03 长沙联远电子科技有限公司 触控屏输入控制方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050110756A1 (en) * 2003-11-21 2005-05-26 Hall Bernard J. Device and method for controlling symbols displayed on a display device
CN101630223A (zh) * 2009-07-25 2010-01-20 深圳华为通信技术有限公司 一种调整界面的方法及终端
CN102360249A (zh) * 2011-09-29 2012-02-22 上海汉翔信息技术有限公司 分立式键盘布局***和设置方法、相应的便携电子设备及控制方法
CN103150105A (zh) * 2013-01-17 2013-06-12 苏州佳世达电通有限公司 虚拟键盘的调整方法及***
CN103577033A (zh) * 2012-08-07 2014-02-12 百度在线网络技术（北京）有限公司 一种输入法面板的设置方法和***

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050020325A1 (en) * 2003-07-24 2005-01-27 Motorola, Inc. Multi-configuration portable electronic device and method for operating the same
US20050071778A1 (en) * 2003-09-26 2005-03-31 Nokia Corporation Method for dynamic key size prediction with touch displays and an electronic device using the method
CN101142617B (zh) * 2005-02-23 2012-06-20 杰龙公司 数据输入方法和装置
CN101589355A (zh) * 2006-11-08 2009-11-25 库比克设计工作室有限责任公司 非对称性重组的键盘
CN102681670A (zh) * 2012-04-09 2012-09-19 中兴通讯股份有限公司 一种移动终端及移动终端虚拟键盘的设置方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050110756A1 (en) * 2003-11-21 2005-05-26 Hall Bernard J. Device and method for controlling symbols displayed on a display device
CN101630223A (zh) * 2009-07-25 2010-01-20 深圳华为通信技术有限公司 一种调整界面的方法及终端
CN102360249A (zh) * 2011-09-29 2012-02-22 上海汉翔信息技术有限公司 分立式键盘布局***和设置方法、相应的便携电子设备及控制方法
CN103577033A (zh) * 2012-08-07 2014-02-12 百度在线网络技术（北京）有限公司 一种输入法面板的设置方法和***
CN103150105A (zh) * 2013-01-17 2013-06-12 苏州佳世达电通有限公司 虚拟键盘的调整方法及***

Also Published As

Publication number Publication date
CN104881200A (zh) 2015-09-02

Similar Documents

Publication Publication Date Title
US10565437B2 (en) Image processing device and method for moving gesture recognition using difference images
US9933850B2 (en) Information processing apparatus and program
CN109428969B (zh) 双屏终端的边缘触控方法、装置及计算机可读存储介质
US10628010B2 (en) Quick review of captured image data
US20150035746A1 (en) User Interface Device
US20150220150A1 (en) Virtual touch user interface system and methods
US20130257736A1 (en) Gesture sensing apparatus, electronic system having gesture input function, and gesture determining method
JP2009140368A (ja) 入力装置、表示装置、入力方法、表示方法及びプログラム
US10095384B2 (en) Method of receiving user input by detecting movement of user and apparatus therefor
WO2017059734A1 (zh) 一种图片缩放方法及电子设备
CN112565613B (zh) 预览图像显示控制方法、装置、电子设备及介质
CN104898880B (zh) 一种控制方法及电子设备
US20150241968A1 (en) Method for Processing Information and Electronic Device
US20180260044A1 (en) Information processing apparatus, information processing method, and program
CN105824553A (zh) 一种触控方法及移动终端
WO2015127731A1 (zh) 软键盘布局调整方法及装置
US10656746B2 (en) Information processing device, information processing method, and program
CN112911147A (zh) 显示控制方法、显示控制装置及电子设备
CN113655929A (zh) 界面显示的适配处理方法、装置和电子设备
CN105302459B (zh) 终端的单手控制方法及装置
US10318131B2 (en) Method for scaling down effective display area of screen, and mobile terminal
CN112702517B (zh) 显示控制方法、装置及电子设备
WO2023169499A1 (zh) 触摸屏的单手控制方法、控制装置、电子设备和存储介质
WO2019201223A1 (zh) 屏幕显示的切换方法以及装置及存储介质
KR20110066545A (ko) 터치스크린을 이용하여 이미지를 표시하기 위한 방법 및 단말

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14883739

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14883739

Country of ref document: EP

Kind code of ref document: A1