WO2012163124A1

WO2012163124A1 - Spatial motion-based input method and terminal

Info

Publication number: WO2012163124A1
Application number: PCT/CN2012/072063
Authority: WO
Inventors: 赛斌; 郑伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-05-31
Filing date: 2012-03-07
Publication date: 2012-12-06
Also published as: CN102810015B; CN102810015A

Abstract

The present invention relates to a spatial motion-based input method and system. The method comprises: an operator moving an input terminal in a space according to the shape of an object to be identified, the input terminal executing the following steps: collecting effective motion trail data, the motion trail data at least comprising three-dimensional spatial data; projecting the motion trail data respectively onto three two-dimensional planes that are orthogonal to one another, so as to obtain three groups of motion trail projection data; calculating an area occupied by a corresponding motion trail projection according to the motion trail projection data, determining the two-dimensional plane where the motion trail projection having the largest area locates as an effective plane; and identifying an input object according to the motion trail projection of the effective plane or a mirror image of the motion trail projection. The method and system in the present invention overcome the application limit of the conventional input method.

Description

基于空间运动的输入方法及终端 Input method and terminal based on space motion

技术领域 Technical field

本发明涉及输入技术，尤其涉及一种基于空间运动的输入方法及终端。 The present invention relates to input technologies, and in particular, to a spatial motion based input method and terminal.

背景技术 Background technique

随着移动通信技术的飞速发展和人们对用户体验越来越高的要求，移动终端产品在功能上越发呈现多元化和个性化的趋势。特别是在人机交互方面，用户渴望使用更便捷、更人性化、突破传统的方法。传统的移动终端字符输入和功能操作是通过键盘来实现的，存在按键密集不便操作，汉字字符输入需要结合拼音、五笔等输入法，输入速度较慢、不直观等缺点。新出现的触摸屏人机交互方法，需要移动终端有手写笔和较大的触摸幕，只有在使用触摸屏时才能实现输入，无法随时、迅速响应用户的输入或操作指令。重力感应等技术的应用使得终端能够识别用户的简单动作，但目前仅限于屏幕解锁、简单游戏操作等单一应用，还不支持根据用户习惯灵活设定某种动作和需要执行的特定操作指令间的对应关系，也不支持通过重力感应实现字符或图形的输入。目前应用于移动终端的重力感应技术不能精确捕捉终端的空间位置变化，只能识别简单的方向性动作，应用范围受到了限制。 With the rapid development of mobile communication technology and the increasing demand for user experience, mobile terminal products are increasingly diversified and personalized. Especially in terms of human-computer interaction, users are eager to use more convenient, more humane, and break through traditional methods. The traditional mobile terminal character input and function operation are realized by the keyboard. There is inconvenient operation of the key set. The Chinese character input needs to combine the input methods such as pinyin and five strokes, and the input speed is slow and not intuitive. The emerging touch screen human-computer interaction method requires the mobile terminal to have a stylus and a large touch screen. The input can only be realized when the touch screen is used, and the user's input or operation instruction cannot be responded to at any time and quickly. The application of technologies such as gravity sensing enables the terminal to recognize the simple actions of the user, but currently it is limited to a single application such as screen unlocking and simple game operation, and does not support flexible setting of certain actions and specific operational commands that need to be performed according to user habits. Correspondence does not support the input of characters or graphics through gravity sensing. The gravity sensing technology currently applied to mobile terminals cannot accurately capture the spatial position change of the terminal, and can only recognize simple directional motion, and the application range is limited.

发明内容 Summary of the invention

本发明要解决的技术问题是提供一种基于空间运动的输入方法及***，以解决输入方法的应用受限的问题。 The technical problem to be solved by the present invention is to provide a spatial motion based input method and system to solve the problem of limited application of the input method.

为解决以上技术问题，本发明提供给了一种基于空间运动的输入方法，操作者根据待识别对象形状在空间移动输入终端，所述输入终端执行以下步骤： In order to solve the above technical problem, the present invention provides a spatial motion based input method in which an operator moves an input terminal in space according to the shape of an object to be recognized, and the input terminal performs the following steps:

釆集有效的运动轨迹数据，所述运动轨迹数据至少包括三维空间数据；将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据； Collecting effective motion trajectory data, the motion trajectory data including at least three-dimensional spatial data; Projecting the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data;

根据所述运动轨迹投影数据计算相应的运动轨迹投影占据的面积，将面积最大的运动轨迹投影所在的二维平面确定为有效平面； Calculating an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determining a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 The input object is identified based on the motion trajectory projection of the effective plane or the image of the motion trajectory projection.

优选地，所述三个二维平面分别是水平面以及与水平面正交的两个竖直面。 Preferably, the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

优选地，若根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像无法识别输入对象，该方法还包括：将有效平面分别以其与其他两平面的相交线为轴以特定角度步进旋转，每步进旋转一次，计算旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新平面上运作为修正后的有效平面，重新对该修正后的有效平面上运动轨迹投影或运动轨迹投影的镜像进行识别，若仍识别不出，则继续按该方向步进旋转，重复上述过程直到能识别出或达到预置停止条件为止。 Preferably, if the image of the motion trajectory projection or the motion trajectory projection according to the effective plane cannot identify the input object, the method further comprises: rotating the effective plane by a specific angle with the intersection line of the other two planes as an axis. , rotating once every step, calculating the area of the motion trajectory projected on the new plane after the rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the direction is reversed. Step rotation; if the new plane works as the corrected effective plane, re-identify the image of the motion trajectory projection or motion trajectory projection on the modified effective plane. If it still cannot be recognized, continue to step in the direction. Rotate, repeat the above process until the preset stop condition can be recognized or reached.

优选地，根据所述有效平面或修正后的运动轨迹投影或运动轨迹投影的镜像识别输入对象包括：根据所述运动轨迹投影识别所述输入对象，如无法识别，则将所述运动轨迹投影关于横轴或纵轴做镜像映射，再根据所述运动轨迹投影镜像识别所述输入对象。 Preferably, the image recognition input object according to the effective plane or the corrected motion trajectory projection or the motion trajectory projection comprises: identifying the input object according to the motion trajectory projection, and if not recognized, projecting the motion trajectory The horizontal axis or the vertical axis is mirrored, and the input object is identified according to the motion trajectory projection image.

优选地，所述输入对象为汉字，所述运动轨迹数据和所述运动轨迹投影数据还包括时间信息和 /或笔画索引，根据所述有效平面或修正后的有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象包括： Preferably, the input object is a Chinese character, and the motion trajectory data and the motion trajectory projection data further include time information and/or a stroke index, and the motion trajectory projection or motion trajectory according to the effective plane or the modified effective plane The projected image recognition input object includes:

根据所述时间信息其对应的二维平面位置判断所述有效平面的运动轨迹投影是否符合汉字的书写顺序，如符合则根据所述运动轨迹投影识别所述输入对象，否则将所述运动轨迹投影关于横轴或纵轴做镜像映射，根据所述运动轨迹投影镜像识别所述输入对象。优选地，确定所述有效平面前，所述输入终端判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整，根据完整的待识别对象对应的运动轨迹投影确定有效平面，否则继续釆集下一个有效的运动轨迹数据。 Determining, according to the time information of the corresponding two-dimensional plane position, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory Regarding the horizontal axis or the vertical axis as a mirror map, the input object is identified based on the motion trajectory projection image. Preferably, before determining the effective plane, the input terminal determines whether the time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, the object to be identified is considered to be complete, according to the complete The motion trajectory corresponding to the object to be identified determines the effective plane, otherwise it continues to collect the next effective motion trajectory data.

优选地，所述输入终端具有由操作者控制的输入开关，所述输入开关釆用软件或硬件实现，所述输入终端根据所述输入开关的状态控制运动数据数据釆集的起止或判断釆集的运动轨迹数据的有效性；所述输入终端釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集运动轨迹数据。 Preferably, the input terminal has an input switch controlled by an operator, and the input switch is implemented by software or hardware, and the input terminal controls the start or stop of the motion data data collection according to the state of the input switch. The validity of the motion trajectory data; the input terminal uses a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique to collect motion trajectory data.

优选地，所述待识别对象是汉字、汉字的笔画、字母、数字、符号、图形或代表特定指令的自定义形状。 Preferably, the object to be identified is a Chinese character, a Chinese character stroke, a letter, a number, a symbol, a graphic or a custom shape representing a specific instruction.

优选地，所述运动轨迹投影在各个二维平面上占据的面积为该运动轨迹投影在该二维平面的横轴方向的最大间距与该运动轨迹投影在该二维平面的纵轴方向的最大间距的积。 Preferably, the area occupied by the motion trajectory projection on each two-dimensional plane is the maximum distance of the motion trajectory projected in the horizontal axis direction of the two-dimensional plane and the maximum of the motion trajectory projected in the longitudinal axis direction of the two-dimensional plane. The product of the spacing.

为解决以上技术问题，本发明还提供给了一种基于空间运动的输入终端，该输入终端包括： To solve the above technical problem, the present invention also provides an input terminal based on spatial motion, the input terminal comprising:

数据釆集单元，其设置为：釆集所述输入终端有效的运动轨迹的数据，所述运动轨迹数据至少包括三维空间数据，所述运动轨迹是操作者根据待识别对象形状在空间移动输入终端的轨迹； a data collection unit, configured to: collect data of an effective motion trajectory of the input terminal, the motion trajectory data includes at least three-dimensional spatial data, and the motion trajectory is an operator moving the input terminal in space according to the shape of the object to be identified traces of;

平面投影单元，其设置为：将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据； a plane projection unit, configured to: project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data;

有效平面确定单元，其设置为：根据所述运动轨迹投影数据计算相应的运动轨迹投影占据的面积，将面积最大的运动轨迹投影所在的二维平面确定为有效平面； An effective plane determining unit is configured to: calculate an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

输入对象识别单元，其设置为：根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 An input object recognition unit is configured to: identify an input object according to a motion trajectory projection of the effective plane or a mirror image of the motion trajectory projection.

优选地，所述输入终端还包括：有效平面修正单元，设置为：在输入对象识别单元识别失败后，对所述有效平面进行修正，包括：将当前有效平面分别以其与其他两平面的相交线为轴以特定角度步进旋转，每步进旋转一次，计算在旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新平面上运动轨迹投影的面积大于前述有效平面的运动轨迹投影的面积，则将该新平面作为修正后的有效平面；所述有效平面修正单元重复上述过程直到能识别出或达到预置停止条件为止； Preferably, the input terminal further includes: The effective plane correction unit is configured to: after the input object recognition unit fails to identify, correct the effective plane, including: rotating the current effective plane by a certain angle with the intersection line of the other two planes as an axis, Rotate once per step, calculate the area of the motion trajectory projected on the new plane after the rotation. If the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the direction is reversed. Step rotation; if the area projected by the motion trajectory on the new plane is larger than the area projected by the motion trajectory of the effective plane, the new plane is used as the corrected effective plane; the effective plane correction unit repeats the above process until the Until the preset stop condition is reached;

所述输入单元识别单元还设置为：根据所述修正后的有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 The input unit identification unit is further configured to: identify an input object according to a motion image of the corrected effective plane or a mirror image of the motion trajectory projection.

优选地，所述数据釆集单元还设置为：所述输入对象为汉字，釆集的运动轨迹数据以及平面投影单元得到的运动轨迹投影数据还包括时间信息和 / 或笔画索引； Preferably, the data collection unit is further configured to: the input object is a Chinese character, the motion trajectory data of the set and the motion trajectory projection data obtained by the planar projection unit further include time information and/or a stroke index;

所述输入对象识别单元包括： The input object identification unit includes:

所述书写顺序识别模块，设置为：时间信息和 /或笔画索引判断所述有效平面的运动轨迹投影是否符合汉字的书写顺序； The writing sequence identification module is configured to: time information and/or a stroke index to determine whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters;

所述投影识别模块，设置为：在所述运动轨迹投影符合汉字的书写顺序时，根据所述运动轨迹投影识别所述输入对象； The projection recognition module is configured to: when the motion trajectory projection conforms to a writing order of a Chinese character, and identify the input object according to the motion trajectory projection;

所述镜像映射模块，设置为：在所述运动轨迹投影不符合汉字的书写顺序时，将所述运动轨迹投影关于横轴或纵轴做镜像映射；以及 The image mapping module is configured to: when the motion trajectory projection does not conform to the writing order of the Chinese characters, project the motion trajectory on the horizontal axis or the vertical axis; and

镜像投影识别模块，设置为：根据所述运动轨迹投影镜像识别所述输入对象。 The mirror projection recognition module is configured to: identify the input object according to the motion trajectory projection image.

优选地，所述输入终端还包括输入开关和数据釆集控制单元，其中：所述输入开关釆用软件或硬件实现，并由操作者控制； Preferably, the input terminal further includes an input switch and a data collection control unit, wherein: the input switch is implemented by software or hardware, and is controlled by an operator;

数据釆集控制单元，设置为：识别输入开关状态，并根据所述输入开关状态控制所述数据釆集单元釆集运动轨迹数据的起止或判断所釆集的运动轨迹数据的有效性。 The data collection control unit is configured to: identify an input switch state, and control the data collection unit to collect the start and end of the motion trajectory data or determine the validity of the collected motion track data according to the input switch state.

优选地，所述输入终端还包括输入完整性识别单元，设置为：判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整； Preferably, the input terminal further includes an input integrity identifying unit, configured to: determine that the validity is valid Whether the time interval between the motion track data is greater than a preset value, and if the time interval is greater than a preset value, it is considered that the object to be identified is completely input;

所述有效平面确定单元还设置为：根据完整的待识别对象对应的运动轨迹投影确定有效平面。 The effective plane determining unit is further configured to: determine an effective plane according to the motion track projection corresponding to the complete object to be identified.

优选地，所述输入对象识别单元包括投影识别模块、镜像映射模块和镜像投影识别模块，其中： Preferably, the input object recognition unit comprises a projection recognition module, a mirror image mapping module and a mirror projection recognition module, wherein:

所述投影识别模块，设置为：根据所述运动轨迹投影识别所述输入对象；所述镜像映射模块，设置为：在运动轨迹投影无法识别时，将所述运动轨迹投影关于横轴或纵轴做镜像映射； The projection recognition module is configured to: identify the input object according to the motion trajectory projection; and the mirror image mapping module is configured to: when the motion trajectory projection is not recognized, project the motion trajectory about a horizontal axis or a vertical axis Do mirror mapping;

优选地，所述数据釆集单元设置为：釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集所述运动轨迹的三维空间数据。 Preferably, the data collection unit is configured to: collect multi-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.

本发明实施例基于空间运动的输入方法和输入终端，将釆集输入终端在任意空间移动的三维空间数据投影到二维平面上，根据运动轨迹在二维平面上的投影面积的最大值确定有效平面，并根据该有效平面上的投影或投影的镜像识别输入对象，从而根据终端移动轨迹实现相应字符、图形或操作指令的输入，克服现有输入方法的局限性。附图概述 According to the input method and the input terminal of the spatial motion, the embodiment of the present invention projects the three-dimensional spatial data moved by the input terminal in any space onto the two-dimensional plane, and determines the effective value of the projected area on the two-dimensional plane according to the motion trajectory. The plane recognizes the input object according to the projection or projection image on the effective plane, thereby implementing the input of the corresponding character, graphic or operation instruction according to the terminal movement trajectory, overcoming the limitations of the existing input method. BRIEF abstract

图 1是本发明基于空间运动的输入方法实施例示意图； 1 is a schematic diagram of an embodiment of an input method based on spatial motion according to the present invention;

图 2是本发明基于空间运动的输入方法又一实施例示意图； 2 is a schematic diagram of still another embodiment of a spatial motion based input method according to the present invention;

图 3是终端移动轨迹到 5维坐标系的映射示意图；图 4是对字符投影进行镜像映射处理的示意图； 3 is a schematic diagram of mapping of a terminal moving track to a 5-dimensional coordinate system; 4 is a schematic diagram of mirror image mapping processing on a character projection;

图 5是本发明基于空间运动的输入终端的实施例示意图； 5 is a schematic diagram of an embodiment of a spatial motion based input terminal of the present invention;

图 6是本发明基于空间运动的输入终端的又一实施例示意图。本发明的较佳实施方式本发明基于空间运动的输入方法和输入终端的主要思想是釆集输入终端在任意空间移动的包括三维空间数据的运动轨迹数据，并投影到二维平面上，根据运动轨迹在二维平面上的投影面积的最大值确定有效平面，并根据该有效平面上的投影或投影的镜像识别输入对象，从而根据终端移动轨迹实现相应字符、图形或操作指令的输入，克服现有输入方法的局限性。 6 is a schematic diagram of still another embodiment of a spatial motion based input terminal of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION The main idea of the input method based on spatial motion and the input terminal of the present invention is to collect motion trajectory data including three-dimensional spatial data that the input terminal moves in an arbitrary space, and project it onto a two-dimensional plane, according to the motion. The maximum value of the projected area of the trajectory on the two-dimensional plane determines the effective plane, and recognizes the input object according to the projection or projection image on the effective plane, thereby realizing the input of the corresponding character, graphic or operation instruction according to the movement trajectory of the terminal, overcoming the present There are limitations on the input method.

下文中将结合附图对本发明的实施例进行详细说明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。 Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

本发明基于空间运动的输入方法，操作者根据待识别对象形状在空间移动输入终端，根据具体的输入法类型，如拼音输入法、笔画输入法、英文输入法、数字输入法、符号输入法、图形输入法，所述待识别对象可以是汉字、汉字的笔画、字母、数字、符号、图形或代表特定指令的自定义形状，所述输入终端执行如图 1所示的步骤： The invention is based on an input method of spatial motion, and the operator moves the input terminal in space according to the shape of the object to be recognized, according to specific input method types, such as pinyin input method, stroke input method, English input method, digital input method, symbol input method, The graphic input method, the object to be identified may be a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic or a custom shape representing a specific instruction, and the input terminal performs the steps shown in FIG. 1 :

步骤 101 : 釆集其有效的运动轨迹数据，所述运动轨迹数据至少包括三维空间数据； Step 101: Collecting effective motion trajectory data, where the motion trajectory data includes at least three-dimensional spatial data;

优选地，所述输入终端具有由操作者控制的输入开关，所述输入开关釆用软件或硬件实现，所述输入终端根据所述输入开关的状态控制运动数据数据釆集的起止或判断釆集的运动轨迹数据的有效性。 Preferably, the input terminal has an input switch controlled by an operator, and the input switch is implemented by software or hardware, and the input terminal controls the start or stop of the motion data data collection according to the state of the input switch. The validity of the trajectory data.

所述输入终端可以釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集运动轨迹数据。 The input terminal can collect motion trajectory data by using multi-directional gravity sensing technology, gyroscope or invisible light positioning technology.

步骤 102: 将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据，优选地，所述三个二维平面分别是水平面以及与水平面正交的两个竖直面； Step 102: Project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data. Preferably, the three two-dimensional planes are respectively horizontal and orthogonal to the horizontal plane. Two vertical faces;

步骤 103 : 根据所述运动轨迹投影数据计算相应的运动轨迹投影占据的面积，将面积最大的运动轨迹投影所在的二维平面确定为有效平面；优选地，确定所述有效平面前，所述输入终端判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整，根据完整的待识别对象对应的运动轨迹投影确定有效平面，否则继续釆集下一个有效的运动轨迹数据。 Step 103: Calculate a corresponding motion trajectory projection according to the motion trajectory projection data The area is determined as an effective plane by the two-dimensional plane in which the motion track of the largest area is projected. Preferably, before determining the effective plane, the input terminal determines whether the time interval between the valid motion track data is greater than a preset value. If the time interval is greater than the preset value, it is considered that the object to be recognized is completely input, and the effective plane is determined according to the motion trajectory corresponding to the complete object to be identified, otherwise the next effective motion track data is continuously collected.

所述运动轨迹投影在各个二维平面上占据的面积为该运动轨迹投影在该二维平面的横轴方向的最大间距与该运动轨迹投影在该二维平面的纵轴方向的最大间距的积。 The area occupied by the motion trajectory projection on each two-dimensional plane is the product of the maximum distance of the motion trajectory projected in the horizontal axis direction of the two-dimensional plane and the maximum distance of the motion trajectory projected in the longitudinal axis direction of the two-dimensional plane. .

步骤 104: 根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 Step 104: Identify an input object according to a motion trajectory projection of the effective plane or an image of a motion trajectory projection.

具体实现时，可通过查询本地数据库匹配与运动轨迹投影或运动轨迹投影的镜像一致或接近的是汉字、汉字的笔画、字母、数字、符号、图形或代表特定指令的自定义形状。 In the specific implementation, the local database matching or moving image projection or motion trajectory projection image can be matched or matched by Chinese characters, Chinese characters, letters, numbers, symbols, graphics or custom shapes representing specific instructions.

具体地，步骤 104可根据釆集的运动轨迹数据有以下两个优选方案：方案一：步骤 104包括： Specifically, step 104 may have the following two preferred solutions according to the collected motion trajectory data: Option 1: Step 104 includes:

根据所述运动轨迹投影识别所述输入对象，如无法识别，则将所述运动轨迹投影关于横轴或纵轴做镜像映射，再根据所述运动轨迹投影镜像识别所述输入对象。 The input object is identified according to the motion trajectory projection. If not recognized, the motion trajectory projection is mirrored on the horizontal axis or the vertical axis, and the input object is recognized according to the motion trajectory projection image.

方案二：所述输入对象为汉字，所述运动轨迹数据和所述运动轨迹投影数据还包括时间信息和 /或笔画索引，步骤 104具体包括： Scenario 2: The input object is a Chinese character, and the motion track data and the motion track projection data further include time information and/or a stroke index. Step 104 specifically includes:

根据所述时间信息其对应的二维平面位置判断所述有效平面的运动轨迹投影是否符合汉字的书写顺序，如符合则根据所述运动轨迹投影识别所述输入对象，否则将所述运动轨迹投影关于横轴或纵轴做镜像映射，根据所述运动轨迹投影镜像识别所述输入对象。执行步骤 104后，如果仍无法识别，输入终端可提示重新输入，结束流程。 Determining, according to the time information of the corresponding two-dimensional plane position, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory Regarding the horizontal axis or the vertical axis as a mirror map, the input object is identified based on the motion trajectory projection image. After performing step 104, if it still cannot be recognized, the input terminal can prompt to re-enter and end the process.

较佳的实现方式是，无法识别时，对有效平面进行修正，重新识别，即在步骤 104后，执行以下步骤：将有效平面（即根据步骤 103选定的投影面积最大的平面）分别以其与其他两平面的相交线为轴以特定角度（比如 15。）步进旋转，优选地，以有转一次，计算旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新平面上运动轨迹投影的面积大于前述有效平面的运动轨迹投影的面积，则将该新平面作为修正后的有效平面，按照以上步骤 104对该修正后的有效平面上运动轨迹投影或运动轨迹投影的镜像进行识别，若仍识别不出，则继续按该方向步进旋转，重复上述过程直到能识别出或达到预置停止条件 (比如旋转次数阔值或识别时间阔值）为止。 Preferably, when the data is unrecognizable, the effective plane is corrected and re-identified, that is, after step 104, the following steps are performed: The effective plane (ie, the plane with the largest projected area selected according to step 103) is rotated in a stepwise manner (for example, 15°) with its intersecting line with the other two planes as an axis, preferably, with one revolution, The area projected by the motion trajectory on the new plane after the rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the rotation is performed in the reverse direction; The area projected by the motion trajectory is larger than the area projected by the motion trajectory of the effective plane, and the new plane is used as the corrected effective plane. According to the above step 104, the mirror image of the motion trajectory projection or the motion trajectory projection on the corrected effective plane is performed. Identification, if still not recognized, continue to rotate in this direction, repeat the above process until the preset stop condition (such as the rotation number threshold or the recognition time threshold) can be recognized or reached.

以下结合附图给出一种釆集 5维运动轨迹数据的具体输入流程。其核心在于通过建立 5维坐标系，实时釆集每一笔画从起笔到止笔时间内移动终端的空间位置、时间和笔画索引信息，利用这些信息综合判断并选择出一个容易识别出有意义内容的投影平面并完成字符识别，将终端移动的轨迹转换为相应的字符、图形或操作指令，实现字符、图形或操作指令的输入。如图 2 所示，并结合图 3和图 4, 本专利所述方法包括以下步骤： A specific input flow for collecting 5-dimensional motion trajectory data is given below with reference to the accompanying drawings. The core of this is to establish a 5-dimensional coordinate system, collect the spatial position, time and stroke index information of the mobile terminal from the start of the stroke to the end of the stroke in real time, and use this information to comprehensively judge and select an easy-to-recognize meaningful content. The projection plane completes the character recognition, and converts the track of the terminal movement into corresponding characters, graphics or operation instructions, and realizes input of characters, graphics or operation instructions. As shown in FIG. 2, and in conjunction with FIG. 3 and FIG. 4, the method described in this patent includes the following steps:

步骤 201 : 每输入 1个字符或 1个图形的第一笔画前，移动终端内部建立 5维坐标系，初始化移动终端的起始坐标 ( x,y,z,t,n )为 ( xl,yl,zl,tl,l ) , 其中 x,y,z为空间 3维 xyz坐标系上的点，其中， xy平面即水平面， yz平面及 zx平面为与 xy平面正交的竖直面， t代表时间， n代表当前输入该字符或图形的第 n个笔画，即 n为笔画索引； Step 201: Before inputting the first stroke of 1 character or 1 graphic, a 5-dimensional coordinate system is established inside the mobile terminal, and the starting coordinates (x, y, z, t, n) of the mobile terminal are initialized to be (xl, yl). , zl, tl, l) , where x, y, z are points on the spatial 3-dimensional xyz coordinate system, wherein the xy plane is the horizontal plane, the yz plane and the zx plane are vertical planes orthogonal to the xy plane, and t represents Time, n represents the nth stroke currently inputting the character or graphic, ie n is the stroke index;

以图 3 中输入汉字"和"为例，在开始输入前，建立坐标系，初始化第一笔起笔点 301坐标为（xl,yl,zl,tl,l ) ； Taking the input Chinese character "and" in Figure 3 as an example, before starting the input, the coordinate system is established, and the coordinates of the first pen starting point 301 are initialized to (xl, yl, zl, tl, l);

步骤 202: 开始输入，操作者手持所述移动终端在任意自由空间按照需要输入字符或图形的笔画移动，使得所述移动终端在自由空间滑过的轨迹和所需要输入的字符或图形的笔画一致； Step 202: Start input, the operator holds the mobile terminal to move the stroke of the character or the graphic as needed in any free space, so that the trajectory of the mobile terminal sliding in the free space is consistent with the stroke of the character or graphic to be input. ;

以图 3中输入汉字"和"为例，终端按照图 3中粗体实线字 "和，，的笔画顺序在自由空间滑过，图中粗体虚线字为终端在空间滑过的轨迹在 yz、 zx平面的投影；步骤 203 : 所述移动终端判定是否检测到起笔的标志，如果检测到就进行步骤 204, 否则回到步骤 201 ; Taking the input Chinese character "and" in Fig. 3 as an example, the terminal slides in free space according to the stroke order of the bold solid line characters "and" in Fig. 3. The bold dotted line in the figure is the track in which the terminal slides in space. Yz, zx plane projection; Step 203: The mobile terminal determines whether the flag of the pen is detected, if it is detected, proceeds to step 204, otherwise returns to step 201;

图 3中移动终端 313上有一个黑色按钮 314, 当前有新的一笔开始输入时立即按下该按钮，一直保持按下该按钮直到该笔输入动作结束才松开，即开始按下所述按钮是起笔标志，松开所述按钮是止笔标志； In FIG. 3, the mobile terminal 313 has a black button 314. When a new one starts to input, the button is pressed immediately, and the button is kept pressed until the end of the pen input operation is released, that is, the button is pressed. Is a pen mark, and releasing the button is a stop pen mark;

所述每个笔画起止时间的判断，通过使用专用的用于指示起止笔时间的硬件开关来实现，当每一笔画开始起笔时按下所述硬件开关，在该笔画书写过程中该开关保持被按下的状态，直到该笔画书写完毕止笔时松开该开关；步骤 204: 所述移动终端实时釆集从当前笔画起笔开始连续多个样点的位置、时间信息和笔画索引，并保存为 5维坐标（x,y,z,t,n ) ； The determination of the start and end time of each stroke is achieved by using a dedicated hardware switch for indicating the start and end time of the pen. When each stroke starts to start the pen, the hardware switch is pressed, and the switch remains held during the stroke writing process. Pressing the state, until the stroke of the stroke is finished, the switch is released; Step 204: The mobile terminal collects the position, time information and stroke index of the plurality of samples starting from the current stroke in real time, and saves as 5-dimensional coordinates (x, y, z, t, n);

所述移动终端空间位置的实时釆集，可以釆用多种技术，比如多向重力感应技术、陀螺仪、不可见光定位技术等； The real-time collection of the spatial location of the mobile terminal can employ various technologies, such as multi-directional gravity sensing technology, gyroscope, invisible light positioning technology, and the like;

步骤 205: 所述移动终端判定是否检测到止笔标志，如果检测到就进行步骤 206, 否则重复进行步骤 204, 止笔标志的检测同样使用所述按钮 314, 所述按钮 314由按下变为松开的动作代表止笔标志； Step 205: The mobile terminal determines whether the stop pen flag is detected. If it is detected, step 206 is performed. Otherwise, step 204 is repeated. The detection of the pen stop flag also uses the button 314, and the button 314 is changed from pressed to The released action represents the stop pen mark;

步骤 206: 所述移动终端判断当前输入字符或图形所有笔画的输入动作是否完毕，如果完毕，就进行步骤 207 , 否则返回进行步骤 203; Step 206: The mobile terminal determines whether the input action of all strokes of the currently input character or graphic is completed, if yes, proceed to step 207, otherwise return to step 203;

所述判断前输入字符或图形所有笔画的输入动作是否完毕可以通过较长时间内没有检测到新的起笔标志、专用的软 /硬件开关等方法来实现； Whether the inputting action of all the strokes of the input character or the graphic before the judgment is completed can be realized by not detecting a new starting flag, a dedicated soft/hardware switch, etc. for a long time;

步骤 207: 所述移动终端将釆集到的该字符或图形所有笔画的所有 5维坐标点分别投影到 xyz坐标系的 xy平面、 yz平面和 zx平面，投影时 5维坐标的前 3维（ x,y,z )直接按照 xyz坐标系的几何投影进行， 5维坐标的后 2维 ( t,n ) 不做任何变换直接投影到 xy平面、 yz平面和 zx平面后的新坐标的后面，投影后的坐标分别变为（x,y,t,n ) 、 ( y,z,t,n ) 、 ( ζ,χ,ΐ,η ) ； Step 207: The mobile terminal respectively projects all the 5-dimensional coordinate points of all the strokes of the character or graphic collected by the mobile terminal to the xy plane, the yz plane, and the zx plane of the xyz coordinate system, and the first 3 dimensions of the 5-dimensional coordinates when projecting ( x, y, z) is directly performed according to the geometric projection of the xyz coordinate system. The latter 2 dimensions (t, n) of the 5D coordinates are directly projected onto the xy plane, the yz plane, and the new coordinates after the zx plane without any transformation. The coordinates after projection become (x, y, t, n), ( y, z, t, n ), ( ζ, χ, ΐ, η);

例如图 3 中输入 "和"字共有 8 个笔画，第 1 笔起笔点 301 坐标为 For example, in the figure 3, the input "and" has a total of 8 strokes, and the first stroke point is 301.

( xl,yl,zl,tl,l ) ，第 1笔止笔点 302坐标为 ( x2,y2,z2,t2,l ) ，第 1笔起笔点映射到 yz平面的点 305坐标为（yl',zr,tl,l ) 、映射到 zx平面的点 309坐标为 ( χΓ',ζΓ',ΐΙ,Ι )，第 1笔止笔点映射到 yz平面的点 306坐标为（ y2',z2',t2,l )、映射到 zx平面的点 310坐标为（x2",z2",t2,l ) ；第 8笔起笔点 303 坐标为 ( x3,y3,z3,t3,8 ) ，第 8笔止笔点 304坐标（ x4,y4,z4,t4,8 ) ，第 8笔起笔点映射到 yz平面的点 307坐标为（ y3',z3',t3,8 ) 、映射到 zx平面的点 311坐标为 ( x3",z3",t3,8 )，第 8笔止笔点映射到 yz平面的点 308坐标为（ y4',z4',t4,8 ) 、映射到 zx平面的点 312坐标为（ x4",z4",t4,8 ) ,上述各点坐标中 t4>t3>t2>tl。 . (xl, yl, zl, tl, l), the coordinates of the first pen stop point 302 are (x2, y2, z2, t2, l), and the point 305 of the first pen point mapped to the yz plane is (yl' , zr, tl, l), the coordinates of point 309 mapped to the zx plane are ( χΓ ', ζΓ ', ΐΙ, Ι ), and the coordinates of point 306 of the first pen ending point mapped to the yz plane are ( y2 ', z2 ' ,t2,l ), The coordinates of the point 310 mapped to the zx plane are (x2", z2", t2, l); the coordinates of the eighth pen point 303 are (x3, y3, z3, t3, 8), and the coordinates of the eighth pen stop point 304 ( X4, y4, z4, t4, 8), the point 307 of the eighth pen point mapped to the yz plane is (y3', z3', t3, 8), and the point 311 mapped to the zx plane is (x3", Z3", t3, 8), the point 308 of the eighth pen point mapped to the yz plane is (y4', z4', t4, 8), and the point 312 mapped to the zx plane is (x4", z4" , t4, 8), in the coordinates of the above points, t4>t3>t2>tl. .

也就是说投影后的坐标中的时间坐标和笔画索引坐标保持不变，仍然是投影前釆集到的该坐标的时间和笔画索引。 That is to say, the time coordinate and the stroke index coordinate in the projected coordinates remain unchanged, and it is still the time and stroke index of the coordinates collected before the projection.

步骤 208: 分别计算所述字符或图形的投影在 xy平面、 yz平面、 zx平面占据的最大面积（也称为运动轨迹投影的面积） S_xy 、 S_yz、 S_zx, 找出 S_xy 、 s_yz、 s_zx中数值最大的一个，并选定该最大值所在平面为有效平面，初步选定该最大值所在平面上的投影为字符识别时使用的投影； Step 208: Calculate the maximum area occupied by the projection of the character or graphic in the xy plane, the yz plane, and the zx plane, respectively (also referred to as the area of the motion trajectory projection) S _xy , S _yz , S _zx , and find S _xy , s _The largest value of _yz and s _zx , and the plane where the maximum value is selected is the effective plane, and the projection on the plane where the maximum value is initially selected is the projection used for character recognition;

在 xy平面投影占据面积的最大值计算公式为： The maximum value of the area occupied by the projection in the xy plane is:

Sxy— I ( Xmax-Xmin ) I * I ( ymax_ymin ) | Sxy— I ( Xmax-Xmin ) I * I ( ymax_ymin ) |

上式中， S_xy代表所述字符或图形的投影在 xy平面占据的最大面积， x_max、 y_max分别代表所述字符或图形在 xy平面投影的所有样点坐标中 X和 y的最大值， x_mm和 y_mm分别代表所述字符或图形在 xy平面投影的所有样点坐标中 X 和 y的最小值； In the above formula, S _xy represents the maximum area occupied by the projection of the character or graphic in the xy plane, and x _max and y _max respectively represent the maximum values of X and y in all the sample coordinates of the character or graphic projected on the xy plane. , x _mm and y _mm represent the minimum values of X and y in all the sample coordinates of the character or graphic projected on the xy plane, respectively;

类似的，在 yz平面投影占据面积的最大值计算公式为： Similarly, the maximum value of the area occupied by the projection in the yz plane is:

Syz— I ( ymax-Ymin ) I * I ( Z_max-Z_mi_n ) | Syz— I ( ymax-Ymin ) I * I ( Z _max -Z _m i _n ) |

上式中， S_y^ 表所述字符或图形的投影在 yz平面占据的最大面积， y_max、 z_max分别代表所述字符或图形在 yz平面投影的所有样点坐标中 y和 z的最大值， y_mm和 z_mm分别代表所述字符或图形在 yz平面投影的所有样点坐标中 y 和 z的最小值； In the above formula, S _y ^ represents the maximum area occupied by the projection of the character or graphic in the yz plane, and y _max and z _max respectively represent the maximum of y and z in all the sample coordinates of the character or graphic projected on the yz plane. The values, y _mm and z _mm represent the minimum values of y and z, respectively, of all the sample coordinates projected by the character or graphic on the yz plane;

在 zx平面投影占据面积的最大值计算公式为： The formula for calculating the maximum area occupied by the zx plane projection is:

S_zx— I ( Z_max_Z_mi_n ) I * I ( Xmax_Xmin ) | S _zx — I ( Z _max _Z _m i _n ) I * I ( Xmax_Xmin ) |

上式中， S_zx代表所述字符或图形的投影在 zx平面占据的最大面积， z_max、 x_max分别代表所述字符或图形在 zx平面投影的所有样点坐标中 z和 X的最大值， z_mm和 x_mm分别代表所述字符或图形在 ZX平面投影的所有样点坐标中 Z 和 X的最小值； In the above formula, S _zx represents the maximum area occupied by the projection of the character or graphic in the zx plane, and z _max and x _max respectively represent the maximum values of z and X in all the sample coordinates of the character or graphic projected on the zx plane. , z _mm and x _mm represent the coordinates of all the sample points of the character or graphic projected on the ZX plane, respectively. And the minimum value of X;

图 3中，从"和，，字投影的大小可以看出 S_zx >S_yz> S_xy, 其中 S_xy为 0, 所以初步选定"和"字在 zx平面的投影作为字符识别时使用的投影； In Fig. 3, from the sum of the "and," word projections, it can be seen that S _zx >S _yz > S _xy , where S _xy is 0, so the projection of the word "and" in the zx plane is initially selected as the character recognition. projection;

步骤 209: 根据由步骤 208初步选定的投影中样点坐标的笔画索引 n和每个笔画上样点的横、纵坐标，可以得到笔画之间的相对位置，根据笔画索引和笔画间的相对位置判断该投影是否符合一般字符从上到下、从左到右的笔画书写顺序，若符合，直接使用该选定的投影做为最终字符识别时使用的投影，若不符合，则在该投影所在平面内将该投影的坐标关于横轴或纵轴做镜像映射，使得映射后投影符合般字符从上到下、从左到右的笔画书写顺序，并使用该镜像映射后的投影做为最终字符识别时使用的投影； Step 209: According to the stroke index n of the coordinates of the projected sample points initially selected in step 208 and the horizontal and vertical coordinates of each stroke of the sample, the relative position between the strokes can be obtained, according to the relative index between the stroke index and the stroke. The position determines whether the projection conforms to the stroke order of the general characters from top to bottom and from left to right. If yes, directly uses the selected projection as the projection used for the final character recognition. If not, the projection is used. The coordinates of the projection are mirrored on the horizontal axis or the vertical axis in the plane, so that the projected projection conforms to the stroke order of the normal characters from top to bottom and from left to right, and the projection after the mirror mapping is used as the final The projection used for character recognition;

判断该初步选定的投影是否符合一般字符从上到下、从左到右的笔画书写顺序时，除了使用笔画索引和每个笔画的横、纵坐标进行判断外，还可以借助投影的时间坐标 t, 做更准确的判断。 Judging whether the initially selected projection conforms to the stroke order of the general characters from top to bottom and from left to right, in addition to using the stroke index and the horizontal and vertical coordinates of each stroke, the time coordinate of the projection can also be utilized. t, make a more accurate judgment.

例如图 3中，根据步骤 208初步选择了"和"字在 zx平面的投影作为字符识别的投影，通过比较该投影所有样点的笔画索引和横坐标看以得出该投影的第 1笔的所有横坐标都比第 8笔的横坐标要小，说明该投影的第 8笔在第 1 笔的左侧，不符合一般汉字字符从上到下、从左到右的书写顺序，为了便于后续字符识别，需要按照图 4的方法关于 z轴对投影做镜像处理，镜像处理投后该投影第 1笔起笔点变为 309， ( -xl",zl",tl,l ) ，第 1笔止笔点变为 310， ( -x2",z2",t2,l ) , 第 8笔起笔点变为 311 ' ( -x3",z3",t3,8 ) , 第 8笔止笔点变为 312' ( -x4",z4",t4,8 ) , 其它所有笔画的所有样点的坐标也完成同样的镜像处理，将完成镜像处理后的投影作为最终字符识别用的投影并进行字符识别。 For example, in FIG. 3, the projection of the word "and" in the zx plane is initially selected as a projection of the character recognition according to step 208, and the first stroke of the projection is obtained by comparing the stroke index and the abscissa of all the projections of the projection. All the abscissas are smaller than the abscissa of the 8th pen, indicating that the 8th pen of the projection is on the left side of the 1st pen, which does not conform to the writing order of the general Chinese characters from top to bottom and left to right, in order to facilitate subsequent Character recognition, you need to mirror the projection on the z-axis according to the method of Figure 4. After the mirroring process, the first pen-start point of the projection becomes 309, ( -xl", zl", tl, l), the first stroke The pen point becomes 310, ( -x2", z2", t2, l ), the eighth pen point becomes 311 ' ( -x3", z3", t3, 8 ), and the eighth pen point becomes 312. ' ( -x4", z4", t4, 8 ) , the coordinates of all the samples of all the other strokes are also mirrored, and the projection after the mirroring is completed as the projection for the final character recognition and character recognition.

步骤 210: 所述移动终端判断当前是需要输入字符、图形还是要输入操作指令，如果是输入操作指令就进入步骤 211 , 如果是需要输入字符、图形就进入步骤 212; Step 210: The mobile terminal determines whether it is necessary to input a character, a graphic or an operation instruction, if it is an input operation instruction, the process proceeds to step 211, and if it is necessary to input characters and graphics, the process proceeds to step 212;

实际中可在开始进行输入动作前通过软 /硬件开关指示是需要输入字符、图形还是需要输入操作命令； In practice, it is possible to indicate whether a character, a graphic, or an operation command needs to be input through a soft/hardware switch before starting the input action;

步骤 211 : 所述移动终端在预先设定好并保存在自己内存中的操作指令与字符、图形对应表中查找步骤 209中识别出的字符或图形，如果找到其有对应的指令，就执行该指令然后返回步骤 201 , 如果未找到有对应的指令，就直接返回步骤 201 ; Step 211: The operation instruction that the mobile terminal presets and saves in its own memory Searching for the character or graphic identified in step 209 with the character or graphic correspondence table. If it finds that there is a corresponding instruction, the instruction is executed and then returns to step 201. If no corresponding instruction is found, the process returns directly to step 201;

步骤 212: 所述移动终端输入步骤 209 中识别出的字符或图形，按照类似于二维平面手写识别的算法进行字符识别并完成字符或指令的输入，输入后返回步骤 201。 Step 212: The mobile terminal inputs the character or graphic recognized in step 209, performs character recognition according to an algorithm similar to the two-dimensional plane handwriting recognition, and completes input of a character or an instruction, and returns to step 201 after input.

如果预先将所述移动终端内的某些指令编码为特定的字符或图形，釆用所述方法，就可以灵活的实现用户各种动作指令的识别和执行。 If some of the instructions in the mobile terminal are encoded into a specific character or graphic in advance, the method can be used to flexibly realize the identification and execution of various action instructions of the user.

由以上描述可知，有效平面选择的基本原则是使字符在该平面的投影占据面积尽可能的大，以此达成快速准确的识别。如执行步骤 212最终选定的投影无法被识别为有意义的字符，则优选地，可执行有效平面修正流程，以图 3、 4为例，优选地，将 xz面绕 z轴以 15。为步进角度进行旋转，每步旋转一次后计算在旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转结合图 3 , 如向 y轴负半轴方向旋转，则投影面积减小，应停止旋转，向 y轴正半轴方向旋转；若新平面上运动轨迹投影的面积大于前述有效平面的运动轨迹投影的面积，则按照以上步骤 209对该新平面上运动轨迹投影或运动轨迹投影的镜像进行识别，若仍识别不出，则继续按该方向步进旋转，重复上述过程直到能识别出或达到预置停止条件（比如旋转次数阔值或识别时间阔值）为止。 As can be seen from the above description, the basic principle of effective plane selection is to make the projection area of characters in the plane as large as possible, thereby achieving fast and accurate recognition. If the final selected projection in step 212 is not recognized as a meaningful character, then preferably an effective plane correction procedure can be performed, exemplifying Figs. 3 and 4, preferably by setting the xz plane around the z-axis by 15. Rotating for the step angle, calculating the area of the motion trajectory on the new plane after the rotation after each step of rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the direction is stopped. Rotate, and rotate in the opposite direction in combination with Figure 3. If the rotation is in the negative half-axis direction of the y-axis, the projected area is reduced, and the rotation should be stopped to rotate in the positive half-axis direction of the y-axis; if the motion trajectory is projected on the new plane If the area is larger than the area of the motion trajectory projected by the effective plane, the image of the motion trajectory projection or the motion trajectory projection on the new plane is identified according to the above step 209, and if it is still not recognized, the step rotation is continued in the direction, and the image is repeated. The above process until the preset stop condition (such as the rotation number threshold or the recognition time threshold) can be recognized or reached.

所述方法中，还可以更充分的利用釆集到的字符样点 5维坐标的信息，利用样点的空间位置、时间、笔画索引通过计算加速度、建立终端移动轨迹的数学模型等方法综合实现字符的识另。 In the method, the information of the 5-dimensional coordinates of the character samples collected by the 釆 can be more fully utilized, and the spatial position, time and stroke index of the sample point are used to calculate the acceleration and establish a mathematical model of the movement trajectory of the terminal. Character recognition.

应用本发明所述的基于 5维坐标定位移动终端的输入方法，可以实现对移动终端空间位置的精确动态定位并将其运动轨迹转换为字符、图形，实现自然状态下无需特殊介质的字符、图形输入。该方法提出的基于笔画起止位置的空间位置和时间信号釆集、记录笔画索引、 xyz坐标空间投影等联合识别方案，能大大提高将移动终端运动轨迹识别为字符、图形的识别率。 By applying the input method based on the 5-dimensional coordinate positioning mobile terminal according to the present invention, accurate dynamic positioning of the spatial position of the mobile terminal can be realized and the motion track can be converted into characters and graphics, and characters and graphics without special media can be realized in a natural state. Input. Joint recognition based on spatial position and time signal set, record stroke index, xyz coordinate space projection, etc. The solution can greatly improve the recognition rate of the mobile terminal motion track as characters and graphics.

另外，通过预先将移动终端内的某些指令编码设定为特定的字符或图形，应用本专利所述方法，可以灵活的实现用户各种动作指令的识别和执行，使得输入方法更便捷、更人性化，对视力障碍人士也有很大帮助。还可以在移动终端键盘或触摸屏突然失灵的情况下作为一种备选的输入方案，这是其它输入方法所不及的。 In addition, by presetting certain instruction codes in the mobile terminal to specific characters or graphics, the method described in this patent can be used to flexibly realize the recognition and execution of various action instructions of the user, thereby making the input method more convenient and more convenient. Humanization is also very helpful for people with visual impairments. It can also be used as an alternative input solution if the mobile terminal keyboard or touch screen suddenly fails, which is beyond the reach of other input methods.

对应于以上方法，本发明还提供了一种基于空间运动的输入终端实施例，如图 5所示，该输入终端包括： Corresponding to the above method, the present invention further provides an embodiment of an input terminal based on spatial motion. As shown in FIG. 5, the input terminal includes:

数据釆集单元，用于釆集所述输入终端有效的运动轨迹的数据，所述运动轨迹数据至少包括三维空间数据，所述运动轨迹是操作者根据待识别对象形状在空间移动输入终端的轨迹；所述待识别对象是汉字、汉字的笔画、字母、数字、符号、图形或代表特定指令的自定义形状。 a data collection unit, configured to collect data of an effective motion trajectory of the input terminal, where the motion trajectory data includes at least three-dimensional spatial data, and the motion trajectory is a trajectory of the operator moving the input terminal in space according to the shape of the object to be identified The object to be identified is a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic, or a custom shape representing a specific instruction.

平面投影单元，用于将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据，优选地，所述三个二维平面分别是水平面以及与水平面正交的两个竖直面； a plane projection unit, configured to respectively project the motion trajectory data onto three orthogonal two-dimensional two-dimensional planes to obtain three sets of motion trajectory projection data, preferably, the three two-dimensional planes are respectively a horizontal plane and Two vertical faces orthogonal to the water level;

有效平面确定单元，用于根据所述运动轨迹投影数据计算相应的运动轨迹投影占据的面积，将面积最大的运动轨迹投影所在的二维平面确定为有效平面； An effective plane determining unit, configured to calculate an area occupied by the corresponding motion track projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

输入对象识别单元，用于根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 An input object identifying unit is configured to identify an input object according to a motion trajectory projection of the effective plane or a mirror image of the motion trajectory projection.

所述投影识别模块，用于根据所述运动轨迹投影识别所述输入对象；所述镜像映射模块，用于在运动轨迹投影无法识别时，将所述运动轨迹投影关于横轴或纵轴做镜像映射；镜像投影识别模块，用于根据所述运动轨迹投影镜像识别所述输入对象。所述数据釆集单元釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集所述运动轨迹的三维空间数据。 The projection recognition module is configured to identify the input object according to the motion trajectory projection; and the mirror image mapping module is configured to mirror the motion trajectory about a horizontal axis or a vertical axis when the motion trajectory projection is unrecognizable Mapping A mirror projection recognition module is configured to identify the input object according to the motion trajectory projection image. The data collection unit collects three-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.

可替换地，所述输入对象为汉字，所述数据釆集单元釆集的运动轨迹数据以及平面投影单元得到的运动轨迹投影数据还包括时间信息和 /或笔画索引；在输入装置的又一实施例中，如图 6所示，其与图 5所示输入装置的区别之处在于，所述输入对象识别单元包括： Alternatively, the input object is a Chinese character, the motion trajectory data collected by the data collection unit and the motion trajectory projection data obtained by the planar projection unit further include time information and/or stroke index; another implementation of the input device For example, as shown in FIG. 6, it is different from the input device shown in FIG. 5 in that the input object recognition unit includes:

所述书写顺序识别模块，用于时间信息和 /或笔画索引判断所述有效平面的运动轨迹投影是否符合汉字的书写顺序； The writing sequence identification module is configured to determine whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters according to the time information and/or the stroke index;

所述投影识别模块，用于在所述运动轨迹投影符合汉字的书写顺序时，根据所述运动轨迹投影识别所述输入对象； The projection recognition module is configured to: when the motion trajectory projection conforms to a writing order of a Chinese character, identify the input object according to the motion trajectory projection;

所述镜像映射模块，用于在所述运动轨迹投影不符合汉字的书写顺序时，将所述运动轨迹投影关于横轴或纵轴做镜像映射； The image mapping module is configured to perform mirror image mapping on the horizontal axis or the vertical axis when the motion trajectory projection does not conform to the writing order of the Chinese characters;

镜像投影识别模块，用于根据所述运动轨迹投影镜像识别所述输入对象。进一步地，所述输入终端还包括输入开关和数据釆集控制单元，其中：所述输入开关釆用软件或硬件实现，并由操作者控制； A mirror projection recognition module is configured to identify the input object according to the motion trajectory projection image. Further, the input terminal further includes an input switch and a data collection control unit, wherein: the input switch is implemented by software or hardware, and is controlled by an operator;

数据釆集控制单元，用于识别输入开关状态，并根据所述输入开关状态控制所述数据釆集单元釆集运动轨迹数据的起止或判断其釆集的运动轨迹数据的有效性。 And a data collection control unit, configured to identify an input switch state, and control, according to the input switch state, the data collection unit to collect the start and end of the motion trajectory data or determine the validity of the collected motion trajectory data.

优选地，所述输入终端还包括输入完整性识别单元，用于判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整；所述有效平面确定单元，用于根据完整的待识别对象对应的运动轨迹投影确定有效平面。 Preferably, the input terminal further includes an input integrity identifying unit, configured to determine whether a time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, determining that the object to be identified is completely input; The effective plane determining unit is configured to determine an effective plane according to a motion trajectory corresponding to the complete object to be identified.

本发明还提供了一种基于空间运动的输入终端实施例，其与图 5、图 6 所示的实施例的不同之处在于，所述输入终端还包括： The present invention further provides an embodiment of the input terminal based on the spatial motion, which is different from the embodiment shown in FIG. 5 and FIG. 6 in that the input terminal further includes:

有效平面修正单元，用于在输入对象识别单元识别失败后，对所述有效平面进行修正，包括：将当前有效平面分别以其与其他两平面的相交线为轴以特定角度（比如 15。）步进旋转，每步进旋转一次，计算在旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新

, 则将该新平面作为修正后的有效平面；所述有效平面修正单元重复上述过程直 ^ 能识别出或达到预置停止条件（比如旋转次数阔值或识别时间阔值）为止。 The effective plane correction unit is configured to correct the effective plane after the input object recognition unit fails to identify, and includes: dividing the current effective plane by a certain angle with the intersection line of the other two planes (for example, 15). Step rotation, rotate once per step, calculate the new plane after rotation The area projected on the motion trajectory, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation is stopped in the direction, and the rotation is reversed in the opposite direction;

Then, the new plane is used as the corrected effective plane; the effective plane correcting unit repeats the above process to directly recognize or reach a preset stop condition (such as a rotation number threshold or a recognition time threshold).

优选地，

Preferably,

平面的相交线为轴进行旋转爹正； The intersecting line of the plane is rotated for the axis;

所述输入单元识别单元，还用于根据所述修正后的有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象。 The input unit identification unit is further configured to identify an input object according to a mirror image of the motion trajectory projection or the motion trajectory projection of the modified effective plane.

以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。 The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

工业实用性本发明实施例基于空间运动的输入方法和输入终端，将釆集输入终端在任意空间移动的三维空间数据投影到二维平面上，根据运动轨迹在二维平面上的投影面积的最大值确定有效平面，并根据该有效平面上的投影或投影的镜像识别输入对象，从而根据终端移动轨迹实现相应字符、图形或操作指令的输入，克服现有输入方法的局限性。 INDUSTRIAL APPLICABILITY The embodiment of the present invention is based on a spatial motion input method and an input terminal, and projects a three-dimensional spatial data moving in an arbitrary input space onto a two-dimensional plane, and the maximum projected area on the two-dimensional plane according to the motion trajectory. The value determines the effective plane and identifies the input object based on the projected or projected image on the effective plane, thereby enabling input of corresponding characters, graphics, or operational commands based on the terminal movement trajectory, overcoming the limitations of existing input methods.

Claims

权利要求书 Claim

1、一种基于空间运动的输入方法，操作者根据待识别对象形状在空间移动输入终端，所述输入终端执行以下步骤： 1. An input method based on spatial motion, the operator moves the input terminal in space according to the shape of the object to be identified, and the input terminal performs the following steps:

釆集有效的运动轨迹数据，所述运动轨迹数据至少包括三维空间数据；将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据； Collecting effective motion trajectory data, the motion trajectory data includes at least three-dimensional spatial data; and the motion trajectory data is respectively projected onto two orthogonal two-dimensional two-dimensional planes to obtain three sets of motion trajectory projection data;

2、如权利要求 1所述的方法，其中，所述三个二维平面分别是水平面以及与水平面正交的两个竖直面。 2. The method of claim 1 wherein the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

3、如权利要求 1所述的方法，其中，若根据所述有效平面的运动轨迹投影或运动轨迹投影的镜像无法识别输入对象，该方法还包括：每步进旋转一次，计算旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新平面上运动轨迹投影的面积大于所述有效平面的运动轨迹投影的面积，则将该新平面作为修正后的有效平面，重新对该修正后的有效平面上运动轨迹投影或运动轨迹投影的镜像进行识别，若仍识别不出，则继续按该方向步进旋转，重复上述过程直到能识别出或达到预置停止条件为止。 3. The method according to claim 1, wherein if the image of the motion trajectory projection or the motion trajectory projection according to the effective plane does not recognize the input object, the method further comprises: rotating each step by step, and calculating a new plane after the rotation The area projected by the motion trajectory, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation is stopped in the direction and rotated in the opposite direction; if the motion trajectory is projected on the new plane If the area is larger than the area projected by the motion trajectory of the effective plane, the new plane is used as the corrected effective plane, and the image of the motion trajectory projection or the motion trajectory projection on the corrected effective plane is re-identified, if still not recognized If it is out, continue to rotate in this direction and repeat the above process until the preset stop condition can be recognized or reached.

4、如权利要求 1至 3中任一项所述的方法，其中，根据所述有效平面或修正后的运动轨迹投影或运动轨迹投影的镜像识别输入对象包括： The method according to any one of claims 1 to 3, wherein the image recognition input object according to the effective plane or the corrected motion trajectory projection or motion trajectory projection comprises:

根据所述运动轨迹投影识别所述输入对象，如无法识别，则将所述运动轨迹投影关于横轴或纵轴做镜像映射，再根据所述运动轨迹投影镜像识别所述输入对象。 Identifying the input object according to the motion trajectory projection, if not recognized, mapping the motion trajectory to a horizontal axis or a vertical axis, and then identifying the input object according to the motion trajectory projection image.

5、如权利要求 1至 3中任一项所述的方法，其中，所述输入对象为汉字，所述运动轨迹数据和所述运动轨迹投影数据还包括时间信息和 /或笔画索引，根据所述有效平面或修正后的有效平面的运动轨迹投影或运动轨迹投影的镜像识别输入对象包括： The method according to any one of claims 1 to 3, wherein the input object is a Chinese character, the motion trajectory data and the motion trajectory projection data further include time information and/or stroke index, according to The image recognition input object of the motion trajectory projection or the motion trajectory projection of the effective plane or the modified effective plane includes:

根据所述时间信息对应的二维平面位置判断所述有效平面的运动轨迹投影是否符合汉字的书写顺序，如符合则根据所述运动轨迹投影识别所述输入对象，否则将所述运动轨迹投影关于横轴或纵轴做镜像映射，根据所述运动轨迹投影镜像识别所述输入对象。 Determining, according to the two-dimensional plane position corresponding to the time information, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory The horizontal axis or the vertical axis is mirrored, and the input object is identified according to the motion trajectory projection image.

6、如权利要求 1所述的方法，其中，确定所述有效平面前，所述输入终端判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整，根据完整的待识别对象对应的运动轨迹投影确定有效平面，否则继续釆集下一个有效的运动轨迹数据。 The method according to claim 1, wherein, before determining the effective plane, the input terminal determines whether a time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, It is considered that the input of the object to be identified is complete, and the effective plane is determined according to the motion trajectory corresponding to the complete object to be identified, otherwise the next effective motion trajectory data is continuously collected.

7、如权利要求 1所述的方法，其中，所述输入终端具有由操作者控制的输入开关，所述输入开关釆用软件或硬件实现，所述输入终端根据所述输入开关的状态控制运动数据数据釆集的起止或判断釆集的运动轨迹数据的有效性；所述输入终端釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集运动轨迹数据。 7. The method according to claim 1, wherein the input terminal has an input switch controlled by an operator, the input switch is implemented by software or hardware, and the input terminal controls motion according to a state of the input switch. The start and end of the data data collection or the validity of the motion trajectory data of the set; the input terminal uses the multi-directional gravity sensing technique, the gyroscope or the invisible light localization technique to collect the motion trajectory data.

8、如权利要求 1所述的方法，其中，所述待识别对象是汉字、汉字的笔画、字母、数字、符号、图形或代表特定指令的自定义形状。 8. The method according to claim 1, wherein the object to be identified is a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic, or a custom shape representing a specific instruction.

9、如权利要求 1所述的方法，其中，所述运动轨迹投影在各个二维平面上占据的面积为该运动轨迹投影在该二维平面的横轴方向的最大间距与该运动轨迹投影在该二维平面的纵轴方向的最大间距的积。 9. The method according to claim 1, wherein an area occupied by the motion trajectory projection on each two-dimensional plane is a maximum pitch of the motion trajectory projected in a horizontal axis direction of the two-dimensional plane and the motion trajectory is projected The product of the maximum spacing of the two-dimensional plane in the direction of the longitudinal axis.

10、一种基于空间运动的输入终端，该输入终端包括： 10. An input terminal based on spatial motion, the input terminal comprising:

平面投影单元，其设置为：将所述运动轨迹数据分别投影到两两正交的三个二维平面上，得到三组运动轨迹投影数据；有效平面确定单元，其设置为：根据所述运动轨迹投影数据计算相应的运动轨迹投影占据的面积，将面积最大的运动轨迹投影所在的二维平面确定为有效平面； a plane projection unit, configured to: project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data; An effective plane determining unit is configured to: calculate an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

11、如权利要求 10所述的输入终端，其中，所述三个二维平面分别是水平面以及与水平面正交的两个竖直面。 The input terminal according to claim 10, wherein the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

12、如权利要求 10所述的输入终端，其中，所述输入终端还包括：有效平面修正单元，设置为：在输入对象识别单元识别失败后，对所述有效平面进行修正，包括：将当前有效平面分别以其与其他两平面的相交线为轴以特定角度步进旋转，每步进旋转一次，计算在旋转后新平面上的运动轨迹投影的面积，若新平面上运动轨迹投影的面积小于前述有效平面的运动轨迹投影的面积则停止向该方向旋转，并向反方向步进旋转；若新平面上运动轨迹投影的面积大于前述有效平面的运动轨迹投影的面积，则将该新平面作为修正后的有效平面；所述有效平面修正单元重复上述过程直到能识别出或达到预置停止条件为止； The input terminal according to claim 10, wherein the input terminal further comprises: an effective plane correction unit, configured to: after the input object identification unit fails to identify, correct the effective plane, including: The effective plane is rotated step by step at a specific angle with its intersection line with the other two planes. Each step is rotated once, and the area of the motion trajectory projected on the new plane after the rotation is calculated, if the area of the motion trajectory projected on the new plane The area projected by the motion trajectory smaller than the effective plane stops rotating in the direction and rotates in the opposite direction; if the area projected by the motion trajectory on the new plane is larger than the area projected by the motion trajectory of the effective plane, the new plane is As the corrected effective plane; the effective plane correction unit repeats the above process until the preset stop condition can be recognized or reached;

13、如权利要求 10至 12中任一项所述的输入终端，其中，所述数据釆集单元还设置为：所述输入对象为汉字，釆集的运动轨迹数据以及平面投影单元得到的运动轨迹投影数据还包括时间信息和 /或笔画索引； The input terminal according to any one of claims 10 to 12, wherein the data collection unit is further configured to: the input object is a Chinese character, the collected motion trajectory data, and the motion obtained by the planar projection unit The trajectory projection data also includes time information and/or stroke index;

所述镜像映射模块，设置为：在所述运动轨迹投影不符合汉字的书写顺序时，将所述运动轨迹投影关于横轴或纵轴做镜像映射；以及镜像投影识别模块，设置为：根据所述运动轨迹投影镜像识别所述输入对象。 The image mapping module is configured to: when the motion trajectory projection does not conform to the writing order of the Chinese characters, project the motion trajectory on the horizontal axis or the vertical axis; and The mirror projection recognition module is configured to: identify the input object according to the motion trajectory projection image.

14、如权利要求 13所述输入终端，其中，所述输入终端还包括输入开关和数据釆集控制单元，其中： 14. The input terminal of claim 13, wherein the input terminal further comprises an input switch and a data collection control unit, wherein:

所述输入开关釆用软件或硬件实现，并由操作者控制； The input switch is implemented by software or hardware and controlled by an operator;

15、如权利要求 14所述输入终端，其中，所述输入终端还包括输入完整性识别单元，设置为：判断有效的运动轨迹数据之间的时间间隔是否大于预设值，若时间间隔大于预设值，则认为待识别对象输入完整； The input terminal according to claim 14, wherein the input terminal further comprises an input integrity identifying unit, configured to: determine whether a time interval between valid motion track data is greater than a preset value, if the time interval is greater than a pre- If the value is set, the object to be identified is considered to be complete;

16、如权利要求 10至 12中任一项所述输入终端，其中，所述运动轨迹投影在各个二维平面上占据的面积为该运动轨迹投影在该二维平面的横轴方向的最大间距与该运动轨迹投影在该二维平面的纵轴方向的最大间距的积。 The input terminal according to any one of claims 10 to 12, wherein an area occupied by the motion trajectory projection on each two-dimensional plane is a maximum pitch of the motion trajectory projected in a horizontal axis direction of the two-dimensional plane The product of the maximum trajectory of the motion trajectory projected in the direction of the longitudinal axis of the two-dimensional plane.

17、如权利要求 10所述输入终端，其中，所述输入对象识别单元包括投影识别模块、镜像映射模块和镜像投影识别模块，其中： The input terminal according to claim 10, wherein the input object recognition unit comprises a projection recognition module, a mirror map module, and a mirror projection recognition module, wherein:

18、如权利要求 17所述输入终端，其中，所述数据釆集单元设置为：釆用多向重力感应技术、陀螺仪或不可见光定位技术釆集所述运动轨迹的三维空间数据。 18. The input terminal according to claim 17, wherein the data collection unit is configured to: 釆 collect three-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.