WO2020001193A1 - Gesture recognition method and apparatus, readable storage medium and mobile terminal - Google Patents

Gesture recognition method and apparatus, readable storage medium and mobile terminal Download PDF

Info

Publication number
WO2020001193A1
WO2020001193A1 PCT/CN2019/087490 CN2019087490W WO2020001193A1 WO 2020001193 A1 WO2020001193 A1 WO 2020001193A1 CN 2019087490 W CN2019087490 W CN 2019087490W WO 2020001193 A1 WO2020001193 A1 WO 2020001193A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
gesture
preset window
gesture operation
stored
Prior art date
Application number
PCT/CN2019/087490
Other languages
French (fr)
Chinese (zh)
Inventor
韩帅
Original Assignee
奇酷互联网络科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 奇酷互联网络科技（深圳）有限公司 filed Critical 奇酷互联网络科技（深圳）有限公司
Publication of WO2020001193A1 publication Critical patent/WO2020001193A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to the technical field of mobile terminals, and in particular, to a gesture recognition method, device, readable storage medium, and mobile terminal.
  • mobile terminals such as mobile phones, tablets, and smart cameras
  • applications on mobile phones or tablets have also become more and more abundant, bringing people's lives Great fun and convenience.
  • gesture operations can achieve multiple functions without the need for key assistance.
  • the user can implement functions such as returning to the previous level or returning to the homepage or opening the option menu by sliding the mobile phone screen from bottom to top.
  • the gesture operation also encounters some problems. For example, when using gestures, swipe up from the bottom. If the currently displayed application is a list, it will cause the list to trigger scrolling by mistake and cannot perform gesture operation Or if the current foreground application is ANR (Application Not Responding, the application is not responding), the gesture operation will be completely invalid, and these conditions will affect the user experience.
  • ANR Application Not Responding, the application is not responding
  • an embodiment of the present invention proposes a gesture recognition method to solve the problem that when a gesture operation is performed, other applications are incorrectly operated or the gesture operation is invalid.
  • a gesture recognition method is applied to a mobile terminal, and the method includes:
  • a gesture operation generated in response to the sliding touch operation is performed to perform a function corresponding to the gesture operation.
  • a preset window is set in the mobile terminal, and the preset window is located at the front of all the applications that have been opened in the mobile terminal.
  • the system will respond to the gesture operation generated by the sliding touch operation to perform the function corresponding to the gesture operation. Since the preset window is the most foreground application Therefore, the system will not pass the gesture operation to other applications, but will only consume the gesture operation through the preset window to avoid misoperation of other applications, and even if there is an ANR in one of the applications, the corresponding function of the gesture operation It will not be affected, and it can take effect, thereby effectively improving the user experience.
  • gesture recognition method may further have the following additional technical features:
  • the method further includes:
  • the step of responding to a gesture operation generated by the sliding touch operation includes:
  • the method further includes:
  • the method further includes:
  • a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
  • the preset window is located at an edge position on the touch screen.
  • the preset window is a transparent window.
  • a window height of the preset window is 20-30 pixels.
  • Another embodiment of the present invention proposes a gesture recognition device to solve the problem of misoperation of other applications or invalid gesture operations during gesture operations.
  • the device is applied to a mobile terminal.
  • the device includes:
  • An obtaining module configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal
  • a judging module configured to judge whether the starting point is located within a region of a preset window
  • a response module configured to: when the judgment module determines that the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to execute a gesture operation corresponding to the gesture operation Features.
  • gesture recognition device may also have the following additional technical features:
  • the apparatus further includes:
  • An intercepting module configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
  • a transfer module configured to transfer the intercepted input event to a system of the mobile terminal.
  • the response module includes:
  • a judging unit configured to judge whether a response result corresponding to the gesture operation is stored in the mobile terminal
  • a call execution unit is configured to call a response result corresponding to the gesture operation, and execute a response if the response result corresponding to the gesture operation is stored in the mobile terminal.
  • the response module further includes:
  • a transmitting unit configured to transmit an input event of the sliding touch operation to a currently opened mobile terminal other than the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal; Foreground application
  • a control unit configured to control the foreground application according to the sliding touch operation.
  • the response module further includes:
  • a pop-up unit is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
  • the preset window is located at an edge position on the touch screen.
  • the preset window is a transparent window.
  • a window height of the preset window is 20-30 pixels.
  • Another embodiment of the present invention also provides a readable storage medium having stored thereon a computer program that implements the steps of the foregoing method when the program is executed by a processor.
  • Another embodiment of the present invention further provides a mobile terminal including a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the foregoing method when the program is executed.
  • FIG. 1 is a flowchart of a gesture recognition method according to a first embodiment of the present invention
  • FIG. 2 is a schematic diagram of a mobile phone in a gesture recognition method according to a first embodiment of the present invention
  • FIG. 3 is a flowchart of a gesture recognition method according to a second embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a gesture recognition device according to a third embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a gesture recognition device according to a fourth embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a mobile terminal according to a sixth embodiment of the present invention.
  • a gesture recognition method is applied to a mobile terminal, and the method includes:
  • the mobile terminal may be a terminal device such as a mobile phone or a tablet computer.
  • the mobile terminal is described by using a mobile phone with a touch screen as an example.
  • the mobile phone can be a smart phone with an IOS or Android system.
  • the starting point of the sliding touch operation means that when the user makes a sliding touch on the touch screen of the mobile phone, the first touch point on the touch screen is touched.
  • the user starts from the non-touch area at the bottom of the mobile phone and faces The touch area (that is, the touch screen) is swiped from bottom to top, and the first touch point on the touch screen of the mobile phone is the starting point.
  • S102 Determine whether the starting location is within a region of a preset window, and the preset window is located at the foreground of all applications that have been opened in the mobile terminal;
  • the preset window needs to be set in the mobile phone by programming in advance.
  • the preset window can be an application.
  • This application is presented in the form of a window on the mobile phone.
  • the foreground of all applications, that is, compared with the preset window, other open applications in the phone are in the background of the preset window. In this way, once a touch operation occurs, the preset window will be used first. Processes touch operations.
  • the preset window may be a transparent window, which is invisible to the user, and the window height of the preset window is preferably 20-30 pixels to avoid the window being too large and affecting Other touch operations by the user.
  • the shape of the preset window may be a square or a circle, which is not limited herein. Please refer to FIG. 2. In this embodiment, the shape of the preset window is, for example, a square.
  • the preset window is preferably located at an edge position on the touch screen, for example, at the bottom edge of the touch screen.
  • step S101 it is determined whether the starting point is within the area of a preset window, that is, whether the starting point is within the square area.
  • the mobile phone system will respond to the gesture operation generated by the sliding touch operation to perform a function corresponding to the gesture operation.
  • the mobile phone has pre-stored response operations corresponding to gesture operations.
  • the gesture operation is swiping from bottom to top, and the corresponding response operation is to return to the homepage. Then the mobile phone executes the response operation and returns to the homepage.
  • Gesture operation It should be noted that the specific gesture types of gesture operations, such as gestures from top to bottom, left to right, and the corresponding response functions, such as returning to the previous level, opening an application, etc., can be changed. There are no restrictions.
  • this step can be specifically implemented in the following ways:
  • a window consumption event is added, and the input event (Input) of the sliding touch operation is intercepted through the preset window.
  • the intercepted input event will not be passed to other applications, but the intercepted input event will be passed to The mobile phone system, and then the mobile phone system responds to the gesture operation generated by the sliding touch operation to perform a function corresponding to the gesture operation.
  • a preset window is set in the mobile terminal, and the preset window is located at the foreground of all applications that have been opened in the mobile terminal.
  • the system will respond to the gesture operation generated by the sliding touch operation to perform the function corresponding to the gesture operation.
  • the system will not pass the gesture operation to other applications, but will only consume the gesture operation through the preset window to avoid misoperation of other applications, and even if there is an ANR in one of the applications, the corresponding function of the gesture operation It will not be affected, and it can take effect, thereby effectively improving the user experience.
  • a gesture recognition method is applied to a mobile terminal.
  • the method includes:
  • the mobile terminal may be a terminal device such as a mobile phone or a tablet computer.
  • the mobile terminal is also described by using a mobile phone with a touch screen as an example.
  • the mobile phone can be a smart phone with an IOS or Android system.
  • S202 Determine whether the starting location is within a region of a preset window, and the preset window is located at the front of all applications that have been opened in the mobile terminal;
  • the preset window needs to be set in the mobile phone by programming in advance.
  • the preset window can be an application.
  • This application is presented in the form of a window on the mobile phone.
  • the preset window is located on the mobile phone.
  • the foreground of all applications, that is, compared with the preset window, other open applications in the phone are in the background of the preset window. In this way, once a touch operation occurs, the preset window will be used first. Processes touch operations.
  • the mobile phone first determines whether a response result corresponding to the gesture operation generated by the sliding touch operation is stored in the mobile phone, thereby improving the recognition and control of the gesture operation. Precision.
  • step S203 if it is determined that the response result corresponding to the gesture operation is not stored in the mobile terminal, there are two ways to interact with the user:
  • an input event of the sliding touch operation is transferred to a currently opened mobile terminal other than the preset window.
  • a foreground application and then controlling the foreground application according to the sliding touch operation.
  • the foreground application is an application that is displaying a list, and a corresponding list scroll effect is triggered according to a gesture operation.
  • a response result corresponding to the gesture operation is not stored in the mobile terminal, a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
  • the prompt information can be displayed in the form of a pop-up dialog box, and the dialog box can automatically disappear within a preset time (for example, within 2s).
  • the method provided by this embodiment optimizes the process of interacting with the user, improves the recognition and control accuracy of gesture operations, and can further improve the use of the user. Experience.
  • a third embodiment of the present invention proposes a gesture recognition device applied to a mobile terminal.
  • the device includes:
  • An obtaining module 10 configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal
  • a judging module 20 configured to judge whether the starting point is located within a region of a preset window
  • the response module 30 is configured to respond to a gesture operation generated by the sliding touch operation when the determination module determines that the starting position is within the area of the preset window, so as to perform a corresponding operation to the gesture operation Functions.
  • the device further includes:
  • An intercepting module 40 configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
  • a transmitting module 50 configured to transmit the intercepted input event to a system of the mobile terminal
  • the preset window is located at an edge position on the touch screen.
  • the preset window is a transparent window.
  • the window height of the preset window is 20-30 pixels.
  • a gesture recognition device applied to a mobile terminal.
  • the device includes:
  • An obtaining module 10 configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal
  • a judging module 20 configured to judge whether the starting point is located within a region of a preset window
  • the response module 30 is configured to respond to a gesture operation generated by the sliding touch operation when the judgment module determines that the starting point is located within the area of the preset window, so as to execute a gesture operation corresponding to the gesture operation. Functions.
  • the response module 30 includes:
  • a determining unit 301 configured to determine whether a response result corresponding to the gesture operation is stored in the mobile terminal;
  • the fetch execution unit 302 is configured to fetch the response result corresponding to the gesture operation, and execute the response if the response result corresponding to the gesture operation is stored in the mobile terminal.
  • the response module 30 further includes:
  • a transmitting unit 303 configured to transmit an input event of the sliding touch operation to a current opening of the mobile terminal except the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal Foreground application;
  • the control unit 304 is configured to control the foreground application according to the sliding touch operation.
  • the response module 30 may further include:
  • a pop-up unit 305 is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
  • a fifth embodiment of the present invention provides a readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the foregoing method embodiments are implemented.
  • a sixth embodiment of the present invention provides a mobile terminal.
  • the mobile terminal includes a memory and a processor.
  • the memory is configured to store a program that supports the processor to execute the application program speed-up method provided by the foregoing embodiment.
  • the processor is configured to: Execute the program stored in the memory.
  • the mobile terminal may further include a communication interface for communicating with other devices or a communication network.
  • the mobile terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), and a vehicle-mounted computer.
  • FIG. 6 is a schematic structural diagram of a mobile terminal according to a sixth embodiment of the present invention.
  • the mobile terminal includes a camera, a radio frequency (RF) circuit 1210, a memory 1220, an input unit 1230, a display unit 1240, a sensor 1250, an audio circuit 1260, and a wireless fidelity (WiFi) module 1270. , Processor 1280, and power supply 1290.
  • RF radio frequency
  • Memory 1220 the structure of the mobile terminal shown in FIG. 6 does not constitute a limitation on the mobile terminal, and may include more or fewer components than shown in the figure, or some components may be combined, or different components may be arranged.
  • WiFi wireless fidelity
  • the RF circuit 1210 can be used for receiving and sending signals during the process of transmitting and receiving information.
  • the downlink information of the base station is received and processed by the processor 1280; in addition, the uplink data of the design is transmitted to the base station.
  • the RF circuit 1210 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
  • the RF circuit 1210 can also communicate with a network and other devices through wireless communication.
  • the above wireless communication can use any communication standard or protocol, including, but not limited to, Global System of Mobile (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc.
  • GSM Global System of Mobile
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • E-mail Short Messaging Service
  • the memory 1220 can be used to store software programs and modules.
  • the processor 1280 executes various functional applications and data processing of the mobile terminal by running the software programs and modules stored in the memory 1220.
  • the memory 1220 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.), etc .; the storage data area may store data according to Data (such as audio data, phone book, etc.) created by the use of mobile phones.
  • the memory 1220 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the input unit 1230 may be used to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the mobile terminal.
  • the input unit 1230 may include a touch panel 1231 and other input devices 1232.
  • the touch panel 1231 also known as a touch screen, can collect user's touch operations on or near it (such as the user using a finger, stylus, etc. any suitable object or accessory on the touch panel 1231 or near the touch panel 1231 Operation), and drive the corresponding connection device according to a preset program.
  • the touch panel 1231 may include a touch detection device and a touch controller.
  • the touch detection device detects the user's touch position, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into contact coordinates, and sends it To the processor 1280, and can receive the command sent by the processor 1280 and execute it.
  • various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 1231.
  • the input unit 1230 may also include other input devices 1232.
  • the other input devices 1232 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, an operation lever, and the like.
  • the display unit 1240 may be used to display information input by the user or information provided to the user and various menus of the mobile terminal.
  • the display unit 1240 may include a display panel 1241.
  • the display panel 1241 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch panel 1231 may cover the display panel 1241. After the touch panel 1231 detects a touch operation on or near the touch panel 1231, the touch panel 1231 transmits the touch operation to the processor 1280 to determine the type of the touch event. The type provides corresponding visual output on the display panel 1241.
  • the touch panel 1231 and the display panel 1241 are implemented as two independent components to implement the input and input functions of the mobile phone, in some embodiments, the touch panel 1231 and the display panel 1241 can be integrated and Realize the input and output functions of mobile phones.
  • the mobile terminal may further include at least one sensor 1250, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1241 according to the brightness of the ambient light.
  • the audio circuit 1260, the speaker 1261, and the microphone 1262 can provide an audio interface between the user and the mobile terminal.
  • the audio circuit 1260 may transmit the received electrical data converted electrical signals to the speaker 1261, which is converted into a sound signal output by the speaker 1261; on the other hand, the microphone 1262 converts the collected sound signal into an electrical signal, and the audio circuit 1260 After receiving, it is converted into audio data, and then the audio data output processor 1280 is processed and then sent to, for example, another mobile terminal via the RF circuit 1210, or the audio data is output to the memory 1220 for further processing.
  • WiFi is a short-range wireless transmission technology.
  • the mobile terminal can provide users with wireless broadband Internet access through the WiFi module 1270.
  • FIG. 6 shows the WiFi module 1270, it can be understood that it does not belong to the necessary configuration of the mobile terminal, and can be omitted as needed without changing the essence of the invention.
  • the processor 1280 is a control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 1220, and calling data stored in the memory 1220, Perform various functions of the mobile terminal and process data to perform overall monitoring of the mobile terminal.
  • the processor 1280 may include one or more processing units; preferably, the processor 1280 may integrate an application processor, and the application processor mainly processes an operating system, a user interface, and an application program.
  • the processor 1280 may be integrated with a modem processor, or the modem processor may not be integrated into the processor 1280.
  • the mobile terminal also includes a power source 1290 (such as a battery) for supplying power to various components.
  • a power source 1290 such as a battery
  • the power source can be logically connected to the processor 1280 through the power management system, so as to implement functions such as managing charging, discharging, and power consumption management through the power management system.
  • the mobile terminal may further include a first camera, a Bluetooth module, and the like, and details are not described herein again.
  • the method, device, readable storage medium, and mobile terminal provided by the embodiment of the present invention include a computer-readable storage medium storing program code, and the program code includes instructions that can be used to execute the method described in the foregoing method embodiment.
  • program code includes instructions that can be used to execute the method described in the foregoing method embodiment.
  • the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium.
  • the technical solution of the present invention is essentially a part that contributes to the existing technology or a part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in various embodiments of the present invention.
  • the foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes .
  • a gesture recognition method applied to a mobile terminal includes:
  • a gesture operation generated in response to the sliding touch operation is performed to perform a function corresponding to the gesture operation.
  • the method further includes:
  • A3 The gesture recognition method according to A1, wherein the step of responding to the gesture operation generated by the sliding touch operation includes:
  • the method further includes:
  • the method further includes:
  • a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
  • A6 The gesture recognition method according to A1, wherein the preset window is located at an edge position on the touch screen.
  • the preset window is a transparent window.
  • a window height of the preset window is 20-30 pixels.
  • a gesture recognition device applied to a mobile terminal includes:
  • An obtaining module configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal
  • a judging module configured to judge whether the starting point is located within a region of a preset window
  • a response module configured to: when the judgment module determines that the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to execute a gesture operation corresponding to the gesture operation Features.
  • the gesture recognition device after the step of determining whether the starting position is within a preset window, the device further includes:
  • An intercepting module configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
  • a transfer module configured to transfer the intercepted input event to a system of the mobile terminal.
  • the response module includes:
  • a judging unit configured to judge whether a response result corresponding to the gesture operation is stored in the mobile terminal
  • a call execution unit is configured to call a response result corresponding to the gesture operation, and execute a response if the response result corresponding to the gesture operation is stored in the mobile terminal.
  • the response module further includes:
  • a transmitting unit configured to transmit an input event of the sliding touch operation to a currently opened mobile terminal other than the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal; Foreground application
  • a control unit configured to control the foreground application according to the sliding touch operation.
  • the gesture recognition device according to B11, the response module further includes:
  • a pop-up unit is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
  • a readable storage medium having stored thereon a computer program, which when executed by a processor implements the method according to any one of A1-A8.
  • a mobile terminal including a camera, a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • the processor executes the program, the processor implements any one of A1 to A8. method.

Abstract

Disclosed are a gesture recognition method and apparatus, a readable storage medium and a mobile terminal, and the method is applied to the mobile terminal. The method comprises: acquiring a starting point of a sliding touch operation of a user on a touch screen of a mobile terminal; determining whether the starting point is within an area range of a preset window, wherein the preset window is located at the foremost foreground of all the opened application programs in the mobile terminal; and if the starting point is within the area range of the preset window, in response to a gesture operation generated by the sliding touch operation, performing a function corresponding to the gesture operation. The present invention can ensure that when a gesture is made, erroneous operation of other applications is prevented, and even if an ANR occurs in a certain application, the function corresponding to the gesture operation will not be affected, and the gesture can be effective, thereby effectively improving the usage experience of a user.

Description

手势识别方法、装置、可读存储介质及移动终端Gesture recognition method, device, readable storage medium and mobile terminal 【技术领域】[Technical Field]
本发明涉及移动终端技术领域，特别是涉及一种手势识别方法、装置、可读存储介质及移动终端。The present invention relates to the technical field of mobile terminals, and in particular, to a gesture recognition method, device, readable storage medium, and mobile terminal.
【背景技术】【Background technique】
随着移动通信技术的发展，移动终端，如手机、平板电脑、智能相机等，越来越得到发展和普及，手机或平板电脑上的应用程序也越来越丰富，给人们的生活带来了极大的乐趣和便利。With the development of mobile communication technology, mobile terminals, such as mobile phones, tablets, and smart cameras, have been increasingly developed and popularized, and applications on mobile phones or tablets have also become more and more abundant, bringing people's lives Great fun and convenience.
以手机为例，随着全面屏手机的流行和普及，手机上的按键越来越少，因此很多手机都增加了手势操作功能，手势操作能够在无需按键辅助的情况下，实现多种功能，例如用户通过从下到上滑动手机屏幕，能够实现返回上一级或回到主页或打开选项菜单等功能。Take mobile phones as an example. With the popularity and popularity of full-screen mobile phones, there are fewer and fewer keys on mobile phones. Therefore, many mobile phones have added gesture operation functions. Gesture operations can achieve multiple functions without the need for key assistance. For example, the user can implement functions such as returning to the previous level or returning to the homepage or opening the option menu by sliding the mobile phone screen from bottom to top.
但在实际使用过程中，手势操作也会遇到一些问题，例如当使用手势的时候，从底部向上滑起，如果当前显示的应用是个列表，会导致列表误触发滚动，而不能执行手势操作对应的功能，或者，如果当前前台应用ANR(Application Not Responding，应用程序无响应)，则手势操作会完全无效，这些情况都会影响用户的使用体验。However, in actual use, the gesture operation also encounters some problems. For example, when using gestures, swipe up from the bottom. If the currently displayed application is a list, it will cause the list to trigger scrolling by mistake and cannot perform gesture operation Or if the current foreground application is ANR (Application Not Responding, the application is not responding), the gesture operation will be completely invalid, and these conditions will affect the user experience.
【发明内容】[Summary of the Invention]
为此，本发明的一个实施例提出一种手势识别方法，以解决手势操作时，会误操作其它应用或者手势操作无效的问题。For this reason, an embodiment of the present invention proposes a gesture recognition method to solve the problem that when a gesture operation is performed, other applications are incorrectly operated or the gesture operation is invalid.
根据本发明一实施例的手势识别方法，应用于移动终端，所述方法包括：A gesture recognition method according to an embodiment of the present invention is applied to a mobile terminal, and the method includes:
获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；Obtaining a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断所述起始位点是否位于预设窗口的区域范围内，所述预设窗口位于所述移动终端中已开启的所有应用程序中的最前台；Judging whether the starting position is within a region of a preset window, and the preset window is located in the foreground of all applications opened in the mobile terminal;
若所述起始位点位于所述预设窗口的区域范围内，则响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。If the starting position is within the area of the preset window, a gesture operation generated in response to the sliding touch operation is performed to perform a function corresponding to the gesture operation.
根据本发明实施例的手势识别方法，在移动终端中设置一个预设窗口，且该预设窗口位于移动终端中已开启的所有应用程序中的最前台，这样，当用户在触摸屏上产生的滑动触摸操作的起始位点位于该预设窗 口的区域范围内时，***会响应滑动触摸操作产生的手势操作，去执行与所述手势操作对应的功能，由于预设窗口是处于最前台的应用，因此，***不会再将手势操作传递给其它应用，而只会通过该预设窗口去消耗此次手势操作，避免误操作其它应用，且即使有某一个应用出现ANR，手势操作对应的功能也不会受影响，一样能够生效，从而有效提升用户的使用体验。According to the gesture recognition method according to the embodiment of the present invention, a preset window is set in the mobile terminal, and the preset window is located at the front of all the applications that have been opened in the mobile terminal. When the starting point of the touch operation is within the area of the preset window, the system will respond to the gesture operation generated by the sliding touch operation to perform the function corresponding to the gesture operation. Since the preset window is the most foreground application Therefore, the system will not pass the gesture operation to other applications, but will only consume the gesture operation through the preset window to avoid misoperation of other applications, and even if there is an ANR in one of the applications, the corresponding function of the gesture operation It will not be affected, and it can take effect, thereby effectively improving the user experience.
另外，根据本发明上述实施例的手势识别方法，还可以具有如下附加的技术特征：In addition, the gesture recognition method according to the foregoing embodiment of the present invention may further have the following additional technical features:
进一步地，在本发明的一个实施例中，所述判断所述起始位点是否位于预设窗口内的步骤之后，所述方法还包括：Further, in an embodiment of the present invention, after the step of determining whether the starting site is located within a preset window, the method further includes:
若所述起始位点位于所述预设窗口的区域范围内，则控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；If the starting point is within the area of the preset window, controlling the preset window to intercept the input event of the sliding touch operation;
将拦截后的所述输入事件传递给所述移动终端的***；A system for transmitting the intercepted input event to the mobile terminal;
响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A gesture operation generated in response to the sliding touch operation to perform a function corresponding to the gesture operation.
进一步地，在本发明的一个实施例中，所述响应所述滑动触摸操作产生的手势操作的步骤包括：Further, in an embodiment of the present invention, the step of responding to a gesture operation generated by the sliding touch operation includes:
判断所述移动终端中是否存储有与所述手势操作对应的响应结果；Determining whether a response result corresponding to the gesture operation is stored in the mobile terminal;
若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。If a response result corresponding to the gesture operation is stored in the mobile terminal, the response result is retrieved and the response is executed.
进一步地，在本发明的一个实施例中，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：Further, in an embodiment of the present invention, after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further includes:
若所述移动终端中未存储与所述手势操作对应的响应结果，则将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；If a response result corresponding to the gesture operation is not stored in the mobile terminal, transmitting an input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
进一步地，在本发明的一个实施例中，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：Further, in an embodiment of the present invention, after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further includes:
若所述移动终端中未存储与所述手势操作对应的响应结果，则弹出提示信息，所述提示信息用于提示当前的手势操作未被识别；If no response result corresponding to the gesture operation is stored in the mobile terminal, a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；Passing the input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
进一步地，在本发明的一个实施例中，所述预设窗口位于所述触摸屏上的边缘位置。Further, in an embodiment of the present invention, the preset window is located at an edge position on the touch screen.
进一步地，在本发明的一个实施例中，所述预设窗口为透明窗口。Further, in an embodiment of the present invention, the preset window is a transparent window.
进一步地，在本发明的一个实施例中，所述预设窗口的窗口高度为20-30像素。Further, in an embodiment of the present invention, a window height of the preset window is 20-30 pixels.
本发明的另一个实施例提出一种手势识别装置，以解决手势操作时，会误操作其它应用或者手势操作无效的问题，该装置应用于移动终端，所述装置包括：Another embodiment of the present invention proposes a gesture recognition device to solve the problem of misoperation of other applications or invalid gesture operations during gesture operations. The device is applied to a mobile terminal. The device includes:
获取模块，用于获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；An obtaining module, configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断模块，用于判断所述起始位点是否位于预设窗口的区域范围内；A judging module, configured to judge whether the starting point is located within a region of a preset window;
响应模块，用于当所述判断模块判断到所述起始位点位于所述预设窗口的区域范围内时，响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A response module, configured to: when the judgment module determines that the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to execute a gesture operation corresponding to the gesture operation Features.
另外，根据本发明上述实施例的手势识别装置，还可以具有如下附加的技术特征：In addition, the gesture recognition device according to the foregoing embodiment of the present invention may also have the following additional technical features:
进一步地，在本发明的一个实施例中，所述装置还包括：Further, in an embodiment of the present invention, the apparatus further includes:
拦截模块，用于若所述起始位点位于所述预设窗口的区域范围内，控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；An intercepting module, configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
传递模块，用于将拦截后的所述输入事件传递给所述移动终端的***。A transfer module, configured to transfer the intercepted input event to a system of the mobile terminal.
进一步地，在本发明的一个实施例中，所述响应模块包括：Further, in an embodiment of the present invention, the response module includes:
判断单元，用于判断所述移动终端中是否存储有与所述手势操作对应的响应结果；A judging unit, configured to judge whether a response result corresponding to the gesture operation is stored in the mobile terminal;
调取执行单元，用于若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。A call execution unit is configured to call a response result corresponding to the gesture operation, and execute a response if the response result corresponding to the gesture operation is stored in the mobile terminal.
进一步地，在本发明的一个实施例中，所述响应模块还包括：Further, in an embodiment of the present invention, the response module further includes:
传递单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；A transmitting unit, configured to transmit an input event of the sliding touch operation to a currently opened mobile terminal other than the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal; Foreground application
控制单元，用于根据所述滑动触摸操作控制所述前台应用程序。A control unit, configured to control the foreground application according to the sliding touch operation.
进一步地，在本发明的一个实施例中，所述响应模块还包括：Further, in an embodiment of the present invention, the response module further includes:
弹出单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，弹出提示信息，所述提示信息用于提示当前的手势操作未被识 别。A pop-up unit is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
进一步地，在本发明的一个实施例中，所述预设窗口位于所述触摸屏上的边缘位置。Further, in an embodiment of the present invention, the preset window is located at an edge position on the touch screen.
进一步地，在本发明的一个实施例中，所述预设窗口为透明窗口。Further, in an embodiment of the present invention, the preset window is a transparent window.
进一步地，在本发明的一个实施例中，所述预设窗口的窗口高度为20-30像素。Further, in an embodiment of the present invention, a window height of the preset window is 20-30 pixels.
本发明的另一个实施例还提出一种可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述方法的步骤。Another embodiment of the present invention also provides a readable storage medium having stored thereon a computer program that implements the steps of the foregoing method when the program is executed by a processor.
本发明的另一个实施例还提出一种移动终端，包括摄像头、存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现上述方法。Another embodiment of the present invention further provides a mobile terminal including a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the foregoing method when the program is executed.
本发明的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实施例了解到。Additional aspects and advantages of the present invention will be given in part in the following description, part of which will become apparent from the following description, or be learned through the embodiments of the present invention.
【附图说明】[Brief Description of the Drawings]
本发明实施例的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解，其中：The above and / or additional aspects and advantages of the embodiments of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, wherein:
图1是根据本发明第一实施例的手势识别方法的流程图；1 is a flowchart of a gesture recognition method according to a first embodiment of the present invention;
图2是根据本发明第一实施例的手势识别方法中的手机的示意图；2 is a schematic diagram of a mobile phone in a gesture recognition method according to a first embodiment of the present invention;
图3是根据本发明第二实施例的手势识别方法的流程图；3 is a flowchart of a gesture recognition method according to a second embodiment of the present invention;
图4是根据本发明第三实施例的手势识别装置的结构示意图；4 is a schematic structural diagram of a gesture recognition device according to a third embodiment of the present invention;
图5是根据本发明第四实施例的手势识别装置的结构示意图；5 is a schematic structural diagram of a gesture recognition device according to a fourth embodiment of the present invention;
图6是根据本发明第六实施例的移动终端的结构示意图。FIG. 6 is a schematic structural diagram of a mobile terminal according to a sixth embodiment of the present invention.
【具体实施方式】【detailed description】
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part, but not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
请参阅图1，本发明第一实施例提出的手势识别方法，应用于移动终端，所述方法包括：Referring to FIG. 1, a gesture recognition method according to a first embodiment of the present invention is applied to a mobile terminal, and the method includes:
S101，获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；S101. Acquire a starting position of a user's sliding touch operation on a touch screen of the mobile terminal.
其中，所述移动终端可以是手机或平板电脑等终端设备，本实施例中，所述移动终端以具有触摸屏的手机为例进行说明。手机可以为具有IOS或者Android***的智能手机。The mobile terminal may be a terminal device such as a mobile phone or a tablet computer. In this embodiment, the mobile terminal is described by using a mobile phone with a touch screen as an example. The mobile phone can be a smart phone with an IOS or Android system.
这里，滑动触摸操作的起始位点是指当用户在手机的触摸屏上产生滑动触摸时，首先接触到触摸屏上的触摸点，例如，用户从手机的最底部的非触摸区域开始，朝手机的触摸区域(即触摸屏)，进行从下到上的滑动，则手机触摸屏上最先产生触摸点即为起始位点。Here, the starting point of the sliding touch operation means that when the user makes a sliding touch on the touch screen of the mobile phone, the first touch point on the touch screen is touched. For example, the user starts from the non-touch area at the bottom of the mobile phone and faces The touch area (that is, the touch screen) is swiped from bottom to top, and the first touch point on the touch screen of the mobile phone is the starting point.
S102，判断所述起始位点是否位于预设窗口的区域范围内，所述预设窗口位于所述移动终端中已开启的所有应用程序中的最前台；S102. Determine whether the starting location is within a region of a preset window, and the preset window is located at the foreground of all applications that have been opened in the mobile terminal;
其中，预设窗口需要预先通过编程的方式设置于手机中，这里预设窗口可以是一个应用程序，这个应用程序在手机上是以一个窗口的形式呈现，该预设窗口位于手机中已开启的所有应用程序中的最前台，也即，相比与预设窗口，该手机中其它已开启的应用程序都处于该预设窗口的后台，这样，一旦产生触摸操作，将首先由该预设窗口对触摸操作进行处理。The preset window needs to be set in the mobile phone by programming in advance. Here, the preset window can be an application. This application is presented in the form of a window on the mobile phone. The foreground of all applications, that is, compared with the preset window, other open applications in the phone are in the background of the preset window. In this way, once a touch operation occurs, the preset window will be used first. Processes touch operations.
具体实施时，为了不影响手机屏幕的显示，该预设窗口可以是一个为透明窗口，对用户不可见，且该预设窗口的窗口高度为20-30像素为佳，避免窗口过大，影响用户的其它触摸操作。该预设窗口的形状可以是方形、圆形，在此不做限制。请参阅图2，本实施例中，该预设窗口的形状例如是方形。In specific implementation, in order not to affect the display of the mobile phone screen, the preset window may be a transparent window, which is invisible to the user, and the window height of the preset window is preferably 20-30 pixels to avoid the window being too large and affecting Other touch operations by the user. The shape of the preset window may be a square or a circle, which is not limited herein. Please refer to FIG. 2. In this embodiment, the shape of the preset window is, for example, a square.
由于通常用户在进行手势操作时，都是从触摸屏的边缘开始滑动，因此，该预设窗口最好位于触摸屏上的边缘位置，例如位于触摸屏的底边上。Since the user usually slides from the edge of the touch screen when performing a gesture operation, the preset window is preferably located at an edge position on the touch screen, for example, at the bottom edge of the touch screen.
当在步骤S101中获取到滑动触摸操作的起始位点时，会判断该起始位点是否位于预设窗口的区域范围内，即会判断该起始位点是否位于该方形区域内。When the starting point of the sliding touch operation is obtained in step S101, it is determined whether the starting point is within the area of a preset window, that is, whether the starting point is within the square area.
S103，若所述起始位点位于所述预设窗口的区域范围内，则响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。S103. If the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to perform a function corresponding to the gesture operation.
其中，若该起始位点位于该方形区域内，则手机***会响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。具体实施时，手机中预先存储有与手势操作对应的响应操作，例如手势操作是从下往上滑动，对应的响应操作是返回主页，则手机会之间执行该响应操作，返回主页，从而实现手势操作。需要指出的是，手势操作的具体手势类型，例如从上到下，从左到右等手势，以及对应的响应功能，例如返回上一级、打开某个应用程序等，都可以进行更改，在此不做限 制。Wherein, if the starting point is located in the square area, the mobile phone system will respond to the gesture operation generated by the sliding touch operation to perform a function corresponding to the gesture operation. During the specific implementation, the mobile phone has pre-stored response operations corresponding to gesture operations. For example, the gesture operation is swiping from bottom to top, and the corresponding response operation is to return to the homepage. Then the mobile phone executes the response operation and returns to the homepage. Gesture operation. It should be noted that the specific gesture types of gesture operations, such as gestures from top to bottom, left to right, and the corresponding response functions, such as returning to the previous level, opening an application, etc., can be changed. There are no restrictions.
此外，作为一个具体示例，本步骤具体可以通过以下方式实现：In addition, as a specific example, this step can be specifically implemented in the following ways:
若所述起始位点位于所述预设窗口的区域范围内，则控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；If the starting point is within the area of the preset window, controlling the preset window to intercept the input event of the sliding touch operation;
将拦截后的所述输入事件传递给所述移动终端的***；A system for transmitting the intercepted input event to the mobile terminal;
即增加了一个窗口消费事件，通过该预设窗口对滑动触摸操作的输入事件(Input)进行拦截，拦截到的输入事件不会传递给其它应用程序，而是会将拦截后的输入事件传递给手机***，然后手机***响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。That is, a window consumption event is added, and the input event (Input) of the sliding touch operation is intercepted through the preset window. The intercepted input event will not be passed to other applications, but the intercepted input event will be passed to The mobile phone system, and then the mobile phone system responds to the gesture operation generated by the sliding touch operation to perform a function corresponding to the gesture operation.
根据本发明实施例的手势识别方法，在移动终端中设置一个预设窗口，且该预设窗口位于移动终端中已开启的所有应用程序中的最前台，这样，当用户在触摸屏上产生的滑动触摸操作的起始位点位于该预设窗口的区域范围内时，***会响应滑动触摸操作产生的手势操作，去执行与所述手势操作对应的功能，由于预设窗口是处于最前台的应用，因此，***不会再将手势操作传递给其它应用，而只会通过该预设窗口去消耗此次手势操作，避免误操作其它应用，且即使有某一个应用出现ANR，手势操作对应的功能也不会受影响，一样能够生效，从而有效提升用户的使用体验。According to the gesture recognition method according to the embodiment of the present invention, a preset window is set in the mobile terminal, and the preset window is located at the foreground of all applications that have been opened in the mobile terminal. In this way, when a user generates a slide on the touch screen, When the starting point of the touch operation is within the area of the preset window, the system will respond to the gesture operation generated by the sliding touch operation to perform the function corresponding to the gesture operation. Since the preset window is the most foreground application Therefore, the system will not pass the gesture operation to other applications, but will only consume the gesture operation through the preset window to avoid misoperation of other applications, and even if there is an ANR in one of the applications, the corresponding function of the gesture operation It will not be affected, and it can take effect, thereby effectively improving the user experience.
请参阅图3，本发明第二实施例提出的手势识别方法，应用于移动终端，所述方法包括：Referring to FIG. 3, a gesture recognition method according to a second embodiment of the present invention is applied to a mobile terminal. The method includes:
S201，获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；S201. Acquire a starting position of a user's sliding touch operation on a touch screen of the mobile terminal.
其中，所述移动终端可以是手机或平板电脑等终端设备，本实施例中，所述移动终端同样以具有触摸屏的手机为例进行说明。手机可以为具有IOS或者Android***的智能手机。The mobile terminal may be a terminal device such as a mobile phone or a tablet computer. In this embodiment, the mobile terminal is also described by using a mobile phone with a touch screen as an example. The mobile phone can be a smart phone with an IOS or Android system.
S202，判断所述起始位点是否位于预设窗口的区域范围内，所述预设窗口位于所述移动终端中已开启的所有应用程序中的最前台；S202. Determine whether the starting location is within a region of a preset window, and the preset window is located at the front of all applications that have been opened in the mobile terminal;
其中，预设窗口需要预先通过编程的方式设置于手机中，这里预设窗口可以是一个应用程序，这个应用程序在手机上是以一个窗口的形式呈现，该预设窗口位于手机中已开启的所有应用程序中的最前台，也即，相比与预设窗口，该手机中其它已开启的应用程序都处于该预设窗口的后台，这样，一旦产生触摸操作，将首先由该预设窗口对触摸操作进行处理。The preset window needs to be set in the mobile phone by programming in advance. Here, the preset window can be an application. This application is presented in the form of a window on the mobile phone. The preset window is located on the mobile phone. The foreground of all applications, that is, compared with the preset window, other open applications in the phone are in the background of the preset window. In this way, once a touch operation occurs, the preset window will be used first. Processes touch operations.
S203，若所述起始位点位于所述预设窗口的区域范围内，则判断所述移动终端中是否存储有与所述滑动触摸操作产生的手势操作对应的 响应结果；S203. If the starting point is within the area of the preset window, determine whether a response result corresponding to a gesture operation generated by the sliding touch operation is stored in the mobile terminal;
其中，若该起始位点位于该预设窗口的区域范围内，则手机会先判断手机中是否存储有与滑动触摸操作产生的手势操作所对应的响应结果，从而提升手势操作的识别和控制精度。Wherein, if the starting point is within the area of the preset window, the mobile phone first determines whether a response result corresponding to the gesture operation generated by the sliding touch operation is stored in the mobile phone, thereby improving the recognition and control of the gesture operation. Precision.
S204，若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。S204. If a response result corresponding to the gesture operation is stored in the mobile terminal, retrieve the response result and execute a response.
作为一个具体示例，在步骤S203之后，若判断到所述移动终端中未存储与所述手势操作对应的响应结果，则可以有两者方式与用户进行交互：As a specific example, after step S203, if it is determined that the response result corresponding to the gesture operation is not stored in the mobile terminal, there are two ways to interact with the user:
第一种，若所述移动终端中未存储与所述手势操作对应的响应结果，则将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序，然后根据所述滑动触摸操作控制所述前台应用程序。First, if a response result corresponding to the gesture operation is not stored in the mobile terminal, an input event of the sliding touch operation is transferred to a currently opened mobile terminal other than the preset window. A foreground application, and then controlling the foreground application according to the sliding touch operation.
其中，例如前台应用程序例如是一个正在显示列表的应用程序，则会根据手势操作触发相应的列表滚动效果。For example, the foreground application is an application that is displaying a list, and a corresponding list scroll effect is triggered according to a gesture operation.
第二种，若所述移动终端中未存储与所述手势操作对应的响应结果，则弹出提示信息，所述提示信息用于提示当前的手势操作未被识别；Second, if a response result corresponding to the gesture operation is not stored in the mobile terminal, a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
具体实施时，可以通过弹出对话框的形式将提示信息展示出来，对话框可以在预设时间内(例如2s内)自动消失。In specific implementation, the prompt information can be displayed in the form of a pop-up dialog box, and the dialog box can automatically disappear within a preset time (for example, within 2s).
然后将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；Then passing the input event of the sliding touch operation to the currently opened foreground application in the mobile terminal except the preset window;
最后根据所述滑动触摸操作控制所述前台应用程序。Finally, the foreground application is controlled according to the sliding touch operation.
本实施例提供的方法在第一实施例的基础上，除了具备第一实施例的效果外，优化了与用户进行交互的过程，提高了手势操作的识别和控制精度，能够进一步提升用户的使用体验。In addition to the effects of the first embodiment, the method provided by this embodiment optimizes the process of interacting with the user, improves the recognition and control accuracy of gesture operations, and can further improve the use of the user. Experience.
需要说明是，本实施例重点说明的是与上一实施例的不同之处，各个实施例之间相同相似的部分未重复描述，可以相互参见。It should be noted that this embodiment focuses on the differences from the previous embodiment. The same or similar parts between the embodiments are not described repeatedly and can be referred to each other.
此外，需要指出的是，本发明上述各实施例提供的方法可以根据需要对相关步骤进行选择性的组合，在此不作限制。In addition, it should be pointed out that the methods provided by the foregoing embodiments of the present invention can selectively combine related steps according to requirements, which is not limited herein.
请参阅图4，基于同一发明构思，本发明第三实施例提出一种手势识别装置，应用于移动终端，所述装置包括：Referring to FIG. 4, based on the same inventive concept, a third embodiment of the present invention proposes a gesture recognition device applied to a mobile terminal. The device includes:
获取模块10，用于获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；An obtaining module 10, configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断模块20，用于判断所述起始位点是否位于预设窗口的区域范围内；A judging module 20, configured to judge whether the starting point is located within a region of a preset window;
响应模块30，用于当所述判断模块判断到所述起始位点位于所述预设窗口的区域范围内时，响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。The response module 30 is configured to respond to a gesture operation generated by the sliding touch operation when the determination module determines that the starting position is within the area of the preset window, so as to perform a corresponding operation to the gesture operation Functions.
本实施例中，所述装置还包括：In this embodiment, the device further includes:
拦截模块40，用于若所述起始位点位于所述预设窗口的区域范围内，控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；An intercepting module 40, configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
传递模块50，用于将拦截后的所述输入事件传递给所述移动终端的***；A transmitting module 50, configured to transmit the intercepted input event to a system of the mobile terminal;
本实施例中，所述预设窗口位于所述触摸屏上的边缘位置。所述预设窗口为透明窗口。所述预设窗口的窗口高度为20-30像素。In this embodiment, the preset window is located at an edge position on the touch screen. The preset window is a transparent window. The window height of the preset window is 20-30 pixels.
本发明实施例提出的手势识别装置的技术特征和技术效果与本发明第一实施例提出的方法相同，在此不予赘述。The technical features and technical effects of the gesture recognition device provided by the embodiment of the present invention are the same as the method provided by the first embodiment of the present invention, and details are not described herein.
请参阅图5，基于同一发明构思，本发明第四实施例提出一种手势识别装置，应用于移动终端，所述装置包括：Referring to FIG. 5, based on the same inventive concept, a fourth embodiment of the present invention proposes a gesture recognition device applied to a mobile terminal. The device includes:
获取模块10，用于获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；An obtaining module 10, configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断模块20，用于判断所述起始位点是否位于预设窗口的区域范围内；A judging module 20, configured to judge whether the starting point is located within a region of a preset window;
响应模块30，用于当所述判断模块判断到所述起始位点位于所述预设窗口的区域范围内时，响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。The response module 30 is configured to respond to a gesture operation generated by the sliding touch operation when the judgment module determines that the starting point is located within the area of the preset window, so as to execute a gesture operation corresponding to the gesture operation. Functions.
本实施例中，所述响应模块30包括：In this embodiment, the response module 30 includes:
判断单元301，用于判断所述移动终端中是否存储有与所述手势操作对应的响应结果；A determining unit 301, configured to determine whether a response result corresponding to the gesture operation is stored in the mobile terminal;
调取执行单元302，用于若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。The fetch execution unit 302 is configured to fetch the response result corresponding to the gesture operation, and execute the response if the response result corresponding to the gesture operation is stored in the mobile terminal.
本实施例中，所述响应模块30还包括：In this embodiment, the response module 30 further includes:
传递单元303，用于若所述移动终端中未存储与所述手势操作对应的响应结果，将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；A transmitting unit 303, configured to transmit an input event of the sliding touch operation to a current opening of the mobile terminal except the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal Foreground application;
控制单元304，用于根据所述滑动触摸操作控制所述前台应用程序。The control unit 304 is configured to control the foreground application according to the sliding touch operation.
本实施例中，所述响应模块30还可以包括：In this embodiment, the response module 30 may further include:
弹出单元305，用于若所述移动终端中未存储与所述手势操作对应的响应结果，弹出提示信息，所述提示信息用于提示当前的手势操作未被识别。A pop-up unit 305 is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
本发明实施例提出的手势识别装置的技术特征和技术效果与本发明第二实施例提出的方法相同，在此不予赘述。The technical features and technical effects of the gesture recognition device provided by the embodiment of the present invention are the same as the method provided by the second embodiment of the present invention, and details are not described herein.
此外，需要指出的是，本发明上述各实施例提供的装置可以根据需要对相关模块进行选择性的组合，在此不作限制。In addition, it should be pointed out that the devices provided by the foregoing embodiments of the present invention can selectively combine related modules according to requirements, which is not limited herein.
本发明第五实施例提供了一种可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述各方法实施例的步骤。A fifth embodiment of the present invention provides a readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the foregoing method embodiments are implemented.
本发明第六实施例提供了一种移动终端，该移动终端包括存储器以及处理器，存储器用于存储支持处理器执行前述实施例所提供的应用程序提速方法的程序，处理器被配置为用于执行存储器中存储的程序。该移动终端还可以包括通信接口，用于与其他设备或通信网络通信。该移动终端可以为包括手机、平板电脑、PDA(Personal Digital Assistant，个人数字助理)、车载电脑等任意终端设备。A sixth embodiment of the present invention provides a mobile terminal. The mobile terminal includes a memory and a processor. The memory is configured to store a program that supports the processor to execute the application program speed-up method provided by the foregoing embodiment. The processor is configured to: Execute the program stored in the memory. The mobile terminal may further include a communication interface for communicating with other devices or a communication network. The mobile terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), and a vehicle-mounted computer.
如图6所示的本发明第六实施例提供的移动终端的结构示意图。参考图6，该移动终端包括：摄像头、射频(Radio Frequency，RF)电路1210、存储器1220、输入单元1230、显示单元1240、传感器1250、音频电路1260、无线保真(Wireless Fidelity，WiFi)模块1270、处理器1280、以及电源1290等部件。本领域技术人员可以理解，图6中示出的移动终端结构并不构成对移动终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。下面结合图6对本实施例的移动终端的各个构成部件进行具体的介绍：FIG. 6 is a schematic structural diagram of a mobile terminal according to a sixth embodiment of the present invention. Referring to FIG. 6, the mobile terminal includes a camera, a radio frequency (RF) circuit 1210, a memory 1220, an input unit 1230, a display unit 1240, a sensor 1250, an audio circuit 1260, and a wireless fidelity (WiFi) module 1270. , Processor 1280, and power supply 1290. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 6 does not constitute a limitation on the mobile terminal, and may include more or fewer components than shown in the figure, or some components may be combined, or different components may be arranged. Each component of the mobile terminal in this embodiment is specifically described below with reference to FIG. 6:
RF电路1210可用于收发信息过程中，信号的接收和发送，特别地，将基站的下行信息接收后，给处理器1280处理；另外，将设计上行的数据发送给基站。通常，RF电路1210包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier，LNA)、双工器等。此外，RF电路1210还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯***(Global System of Mobile communication，GSM)、通用分组无线服务(General Packet Radio Service，GPRS)、码分多址(Code Division Multiple Access，CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution，LTE)、电子邮件、短消息服务(Short Messaging Service，SMS)等。The RF circuit 1210 can be used for receiving and sending signals during the process of transmitting and receiving information. In particular, the downlink information of the base station is received and processed by the processor 1280; in addition, the uplink data of the design is transmitted to the base station. Generally, the RF circuit 1210 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1210 can also communicate with a network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including, but not limited to, Global System of Mobile (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc.
存储器1220可用于存储软件程序以及模块，处理器1280通过运行存储在存储器1220的软件程序以及模块，从而执行移动终端的各种功能应用以及数据处理。存储器1220可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作***、至少一个功能所需的应用程序 (比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器1220可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 1220 can be used to store software programs and modules. The processor 1280 executes various functional applications and data processing of the mobile terminal by running the software programs and modules stored in the memory 1220. The memory 1220 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.), etc .; the storage data area may store data according to Data (such as audio data, phone book, etc.) created by the use of mobile phones. In addition, the memory 1220 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
输入单元1230可用于接收输入的数字或字符信息，以及产生与移动终端的用户设置以及功能控制有关的键信号输入。具体地，输入单元1230可包括触控面板1231以及其他输入设备1232。触控面板1231，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1231上或在触控面板1231附近的操作)，并根据预先设定的程式驱动相应的连接装置。可选的，触控面板1231可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器1280，并能接收处理器1280发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1231。除了触控面板1231，输入单元1230还可以包括其他输入设备1232。具体地，其他输入设备1232可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。The input unit 1230 may be used to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the input unit 1230 may include a touch panel 1231 and other input devices 1232. The touch panel 1231, also known as a touch screen, can collect user's touch operations on or near it (such as the user using a finger, stylus, etc. any suitable object or accessory on the touch panel 1231 or near the touch panel 1231 Operation), and drive the corresponding connection device according to a preset program. Optionally, the touch panel 1231 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into contact coordinates, and sends it To the processor 1280, and can receive the command sent by the processor 1280 and execute it. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 1231. In addition to the touch panel 1231, the input unit 1230 may also include other input devices 1232. Specifically, the other input devices 1232 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, an operation lever, and the like.
显示单元1240可用于显示由用户输入的信息或提供给用户的信息以及移动终端的各种菜单。显示单元1240可包括显示面板1241，可选的，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1241。进一步的，触控面板1231可覆盖显示面板1241，当触控面板1231检测到在其上或附近的触摸操作后，传送给处理器1280以确定触摸事件的类型，随后处理器1280根据触摸事件的类型在显示面板1241上提供相应的视觉输出。虽然在图6中，触控面板1231与显示面板1241是作为两个独立的部件来实现手机的输入和输入功能，但是在某些实施例中，可以将触控面板1231与显示面板1241集成而实现手机的输入和输出功能。The display unit 1240 may be used to display information input by the user or information provided to the user and various menus of the mobile terminal. The display unit 1240 may include a display panel 1241. Optionally, the display panel 1241 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 1231 may cover the display panel 1241. After the touch panel 1231 detects a touch operation on or near the touch panel 1231, the touch panel 1231 transmits the touch operation to the processor 1280 to determine the type of the touch event. The type provides corresponding visual output on the display panel 1241. Although in FIG. 6, the touch panel 1231 and the display panel 1241 are implemented as two independent components to implement the input and input functions of the mobile phone, in some embodiments, the touch panel 1231 and the display panel 1241 can be integrated and Realize the input and output functions of mobile phones.
移动终端还可包括至少一种传感器1250，比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板1241的亮度。音频电路1260、扬声器1261，传声器1262可提供用户与移动终端之间的音频接口。音频电路1260可将接收到的音频数据转换后的 电信号，传输到扬声器1261，由扬声器1261转换为声音信号输出；另一方面，传声器1262将收集的声音信号转换为电信号，由音频电路1260接收后转换为音频数据，再将音频数据输出处理器1280处理后，经RF电路1210以发送给比如另一移动终端，或者将音频数据输出至存储器1220以便进一步处理。The mobile terminal may further include at least one sensor 1250, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1241 according to the brightness of the ambient light. The audio circuit 1260, the speaker 1261, and the microphone 1262 can provide an audio interface between the user and the mobile terminal. The audio circuit 1260 may transmit the received electrical data converted electrical signals to the speaker 1261, which is converted into a sound signal output by the speaker 1261; on the other hand, the microphone 1262 converts the collected sound signal into an electrical signal, and the audio circuit 1260 After receiving, it is converted into audio data, and then the audio data output processor 1280 is processed and then sent to, for example, another mobile terminal via the RF circuit 1210, or the audio data is output to the memory 1220 for further processing.
WiFi属于短距离无线传输技术，移动终端通过WiFi模块1270可以为用户提供了无线的宽带互联网访问。虽然图6示出了WiFi模块1270，但是可以理解的是，其并不属于移动终端的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。WiFi is a short-range wireless transmission technology. The mobile terminal can provide users with wireless broadband Internet access through the WiFi module 1270. Although FIG. 6 shows the WiFi module 1270, it can be understood that it does not belong to the necessary configuration of the mobile terminal, and can be omitted as needed without changing the essence of the invention.
处理器1280是移动终端的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器1220内的软件程序和/或模块，以及调用存储在存储器1220内的数据，执行移动终端的各种功能和处理数据，从而对移动终端进行整体监控。可选的，处理器1280可包括一个或多个处理单元；优选的，处理器1280可集成应用处理器，应用处理器主要处理操作***、用户界面和应用程序等。处理器1280可以集成调制解调处理器，调制解调处理器也可以不集成到处理器1280中。The processor 1280 is a control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 1220, and calling data stored in the memory 1220, Perform various functions of the mobile terminal and process data to perform overall monitoring of the mobile terminal. Optionally, the processor 1280 may include one or more processing units; preferably, the processor 1280 may integrate an application processor, and the application processor mainly processes an operating system, a user interface, and an application program. The processor 1280 may be integrated with a modem processor, or the modem processor may not be integrated into the processor 1280.
移动终端还包括给各个部件供电的电源1290(比如电池)，优选的，电源可以通过电源管理***与处理器1280逻辑相连，从而通过电源管理***实现管理充电、放电、以及功耗管理等功能。尽管未示出，移动终端还可以包括第一摄像头、蓝牙模块等，在此不再赘述。The mobile terminal also includes a power source 1290 (such as a battery) for supplying power to various components. Preferably, the power source can be logically connected to the processor 1280 through the power management system, so as to implement functions such as managing charging, discharging, and power consumption management through the power management system. Although not shown, the mobile terminal may further include a first camera, a Bluetooth module, and the like, and details are not described herein again.
本发明实施例所提供的图片拍摄方法、装置、可读存储介质及移动终端，包括存储了程序代码的计算机可读存储介质，所述程序代码包括的指令可用于执行前面方法实施例中所述的方法，具体实现可参见方法实施例，在此不再赘述。The method, device, readable storage medium, and mobile terminal provided by the embodiment of the present invention include a computer-readable storage medium storing program code, and the program code includes instructions that can be used to execute the method described in the foregoing method embodiment. For the specific implementation of the method, refer to the method embodiment, and details are not described herein again.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially a part that contributes to the existing technology or a part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in various embodiments of the present invention. The foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes .
最后应说明的是：以上所述实施例，仅为本发明的具体实施方式， 用以说明本发明的技术方案，而非对其限制，本发明的保护范围并不局限于此，尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化，或者对其中部分技术特征进行等同替换；而这些修改、变化或者替换，并不使相应技术方案的本质脱离本发明实施例技术方案的精神和范围，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以所述权利要求的保护范围为准。Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present invention, and are used to illustrate the technical solutions of the present invention, but not to limit them. The scope of protection of the present invention is not limited to this, although referring to the foregoing The present invention has been described in detail in the embodiments. Those of ordinary skill in the art should understand that anyone skilled in the art can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention. Or you can easily think of changes or equivalent replacements of some of the technical features; and these modifications, changes, or replacements do not deviate the essence of the corresponding technical solution from the spirit and scope of the technical solutions of the embodiments of the present invention, which should be covered in the present invention Within the scope of protection. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
本发明实施例还公开了：The embodiment of the invention also discloses:
A1、一种手势识别方法，应用于移动终端，所述方法包括：A1. A gesture recognition method applied to a mobile terminal, the method includes:
获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；Obtaining a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断所述起始位点是否位于预设窗口的区域范围内，所述预设窗口位于所述移动终端中已开启的所有应用程序中的最前台；Judging whether the starting position is within a region of a preset window, and the preset window is located in the foreground of all applications opened in the mobile terminal;
若所述起始位点位于所述预设窗口的区域范围内，则响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。If the starting position is within the area of the preset window, a gesture operation generated in response to the sliding touch operation is performed to perform a function corresponding to the gesture operation.
A2、根据A1所述的手势识别方法，所述判断所述起始位点是否位于预设窗口内的步骤之后，所述方法还包括：A2. According to the gesture recognition method according to A1, after the step of determining whether the starting position is within a preset window, the method further includes:
若所述起始位点位于所述预设窗口的区域范围内，则控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；If the starting point is within the area of the preset window, controlling the preset window to intercept the input event of the sliding touch operation;
将拦截后的所述输入事件传递给所述移动终端的***；A system for transmitting the intercepted input event to the mobile terminal;
响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A gesture operation generated in response to the sliding touch operation to perform a function corresponding to the gesture operation.
A3、根据A1所述的手势识别方法，所述响应所述滑动触摸操作产生的手势操作的步骤包括：A3. The gesture recognition method according to A1, wherein the step of responding to the gesture operation generated by the sliding touch operation includes:
判断所述移动终端中是否存储有与所述手势操作对应的响应结果；Determining whether a response result corresponding to the gesture operation is stored in the mobile terminal;
若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。If a response result corresponding to the gesture operation is stored in the mobile terminal, the response result is retrieved and the response is executed.
A4、根据A3所述的手势识别方法，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：A4. According to the gesture recognition method according to A3, after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further includes:
若所述移动终端中未存储与所述手势操作对应的响应结果，则将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；If a response result corresponding to the gesture operation is not stored in the mobile terminal, transmitting an input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
A5、根据A3所述的手势识别方法，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：A5. According to the gesture recognition method according to A3, after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further includes:
若所述移动终端中未存储与所述手势操作对应的响应结果，则弹出提示信息，所述提示信息用于提示当前的手势操作未被识别；If no response result corresponding to the gesture operation is stored in the mobile terminal, a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；Passing the input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
A6、根据A1所述的手势识别方法，所述预设窗口位于所述触摸屏上的边缘位置。A6. The gesture recognition method according to A1, wherein the preset window is located at an edge position on the touch screen.
A7、根据A1所述的手势识别方法，所述预设窗口为透明窗口。A7. According to the gesture recognition method of A1, the preset window is a transparent window.
A8、根据A1所述的手势识别方法，所述预设窗口的窗口高度为20-30像素。A8. According to the gesture recognition method of A1, a window height of the preset window is 20-30 pixels.
B9、一种手势识别装置，应用于移动终端，所述装置包括：B9. A gesture recognition device applied to a mobile terminal. The device includes:
获取模块，用于获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；An obtaining module, configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
判断模块，用于判断所述起始位点是否位于预设窗口的区域范围内；A judging module, configured to judge whether the starting point is located within a region of a preset window;
响应模块，用于当所述判断模块判断到所述起始位点位于所述预设窗口的区域范围内时，响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A response module, configured to: when the judgment module determines that the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to execute a gesture operation corresponding to the gesture operation Features.
B10、根据B9所述的手势识别装置，所述判断所述起始位点是否位于预设窗口内的步骤之后，所述装置还包括：B10. The gesture recognition device according to B9, after the step of determining whether the starting position is within a preset window, the device further includes:
拦截模块，用于若所述起始位点位于所述预设窗口的区域范围内，控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；An intercepting module, configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
传递模块，用于将拦截后的所述输入事件传递给所述移动终端的***。A transfer module, configured to transfer the intercepted input event to a system of the mobile terminal.
B11、根据B9所述的手势识别装置，所述响应模块包括：B11. The gesture recognition device according to B9, the response module includes:
判断单元，用于判断所述移动终端中是否存储有与所述手势操作对应的响应结果；A judging unit, configured to judge whether a response result corresponding to the gesture operation is stored in the mobile terminal;
调取执行单元，用于若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。A call execution unit is configured to call a response result corresponding to the gesture operation, and execute a response if the response result corresponding to the gesture operation is stored in the mobile terminal.
B12、根据B11所述的手势识别装置，所述响应模块还包括：B12. The gesture recognition device according to B11, the response module further includes:
传递单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；A transmitting unit, configured to transmit an input event of the sliding touch operation to a currently opened mobile terminal other than the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal; Foreground application
控制单元，用于根据所述滑动触摸操作控制所述前台应用程序。A control unit, configured to control the foreground application according to the sliding touch operation.
B13、根据B11所述的手势识别装置，所述响应模块还包括：B13. The gesture recognition device according to B11, the response module further includes:
弹出单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，弹出提示信息，所述提示信息用于提示当前的手势操作未被识别。A pop-up unit is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
B14、根据B9所述的手势识别装置，所述预设窗口位于所述触摸屏上的边缘位置。B14. The gesture recognition device according to B9, wherein the preset window is located at an edge position on the touch screen.
B15、根据B9所述的手势识别装置，所述预设窗口为透明窗口。B15. The gesture recognition device according to B9, wherein the preset window is a transparent window.
B16、根据B9所述的手势识别装置，所述预设窗口的窗口高度为20-30像素。B16. The gesture recognition device according to B9, wherein a window height of the preset window is 20-30 pixels.
C17、一种可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如A1-A8任意一项所述的方法。C17. A readable storage medium having stored thereon a computer program, which when executed by a processor implements the method according to any one of A1-A8.
D18、一种移动终端，包括摄像头、存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如A1至A8任意一项所述的方法。D18. A mobile terminal, including a camera, a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the processor implements any one of A1 to A8. method.

Claims (18)

  1. 一种手势识别方法，应用于移动终端，其中，所述方法包括：A gesture recognition method applied to a mobile terminal, wherein the method includes:
    获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；Obtaining a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
    判断所述起始位点是否位于预设窗口的区域范围内，所述预设窗口位于所述移动终端中已开启的所有应用程序中的最前台；Judging whether the starting position is within a region of a preset window, and the preset window is located in the foreground of all applications opened in the mobile terminal;
    若所述起始位点位于所述预设窗口的区域范围内，则响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。If the starting position is within the area of the preset window, a gesture operation generated in response to the sliding touch operation is performed to perform a function corresponding to the gesture operation.
  2. 根据权利要求1所述的手势识别方法，其中，所述判断所述起始位点是否位于预设窗口内的步骤之后，所述方法还包括：The gesture recognition method according to claim 1, wherein after the step of determining whether the starting point is within a preset window, the method further comprises:
    若所述起始位点位于所述预设窗口的区域范围内，则控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；If the starting point is within the area of the preset window, controlling the preset window to intercept the input event of the sliding touch operation;
    将拦截后的所述输入事件传递给所述移动终端的***；A system for transmitting the intercepted input event to the mobile terminal;
    响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A gesture operation generated in response to the sliding touch operation to perform a function corresponding to the gesture operation.
  3. 根据权利要求1所述的手势识别方法，其中，所述响应所述滑动触摸操作产生的手势操作的步骤包括：The gesture recognition method according to claim 1, wherein the step of responding to a gesture operation generated by the sliding touch operation comprises:
    判断所述移动终端中是否存储有与所述手势操作对应的响应结果；Determining whether a response result corresponding to the gesture operation is stored in the mobile terminal;
    若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。If a response result corresponding to the gesture operation is stored in the mobile terminal, the response result is retrieved and the response is executed.
  4. 根据权利要求3所述的手势识别方法，其中，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：The gesture recognition method according to claim 3, wherein after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further comprises:
    若所述移动终端中未存储与所述手势操作对应的响应结果，则将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；If a response result corresponding to the gesture operation is not stored in the mobile terminal, transmitting an input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
    根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
  5. 根据权利要求3所述的手势识别方法，其中，所述判断所述移动终端中是否存储有与所述手势操作对应的响应结果的步骤之后，所述方法还包括：The gesture recognition method according to claim 3, wherein after the step of determining whether a response result corresponding to the gesture operation is stored in the mobile terminal, the method further comprises:
    若所述移动终端中未存储与所述手势操作对应的响应结果，则弹出提示信息，所述提示信息用于提示当前的手势操作未被识别；If no response result corresponding to the gesture operation is stored in the mobile terminal, a prompt message is displayed, and the prompt information is used to indicate that the current gesture operation is not recognized;
    将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；Passing the input event of the sliding touch operation to a currently opened foreground application in the mobile terminal except the preset window;
    根据所述滑动触摸操作控制所述前台应用程序。Controlling the foreground application according to the sliding touch operation.
  6. 根据权利要求1所述的手势识别方法，其中，所述预设窗口位于所述触摸屏上的边缘位置。The gesture recognition method according to claim 1, wherein the preset window is located at an edge position on the touch screen.
  7. 根据权利要求1所述的手势识别方法，其中，所述预设窗口为透明窗口。The gesture recognition method according to claim 1, wherein the preset window is a transparent window.
  8. 根据权利要求1所述的手势识别方法，其中，所述预设窗口的窗口高度为20-30像素。The gesture recognition method according to claim 1, wherein a window height of the preset window is 20-30 pixels.
  9. 一种手势识别装置，应用于移动终端，其中，所述装置包括：A gesture recognition device applied to a mobile terminal, wherein the device includes:
    获取模块，用于获取用户在所述移动终端的触摸屏上的滑动触摸操作的起始位点；An obtaining module, configured to obtain a starting position of a user's sliding touch operation on a touch screen of the mobile terminal;
    判断模块，用于判断所述起始位点是否位于预设窗口的区域范围内；A judging module, configured to judge whether the starting point is located within a region of a preset window;
    响应模块，用于当所述判断模块判断到所述起始位点位于所述预设窗口的区域范围内时，响应所述滑动触摸操作产生的手势操作，以执行与所述手势操作对应的功能。A response module, configured to: when the judgment module determines that the starting point is within the area of the preset window, respond to a gesture operation generated by the sliding touch operation to execute a gesture operation corresponding to the gesture operation Features.
  10. 根据权利要求9所述的手势识别装置，其中，所述装置还包括：The gesture recognition device according to claim 9, wherein the device further comprises:
    拦截模块，用于若所述起始位点位于所述预设窗口的区域范围内，控制所述预设窗口对所述滑动触摸操作的输入事件进行拦截；An intercepting module, configured to control the preset window to intercept the input event of the sliding touch operation if the starting point is located within the area of the preset window;
    传递模块，用于将拦截后的所述输入事件传递给所述移动终端的***。A transfer module, configured to transfer the intercepted input event to a system of the mobile terminal.
  11. 根据权利要求9所述的手势识别装置，其中，所述响应模块包括：The gesture recognition device according to claim 9, wherein the response module comprises:
    判断单元，用于判断所述移动终端中是否存储有与所述手势操作对应的响应结果；A judging unit, configured to judge whether a response result corresponding to the gesture operation is stored in the mobile terminal;
    调取执行单元，用于若所述移动终端中存储有与所述手势操作对应的响应结果，则调取与所述响应结果，并执行响应。A call execution unit is configured to call a response result corresponding to the gesture operation, and execute a response if the response result corresponding to the gesture operation is stored in the mobile terminal.
  12. 根据权利要求11所述的手势识别装置，其中，所述响应模块还包括：The gesture recognition device according to claim 11, wherein the response module further comprises:
    传递单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，将所述滑动触摸操作的输入事件传递给所述移动终端中除所述预设窗口外的当前开启的前台应用程序；A transmitting unit, configured to transmit an input event of the sliding touch operation to a currently opened mobile terminal other than the preset window if a response result corresponding to the gesture operation is not stored in the mobile terminal; Foreground application
    控制单元，用于根据所述滑动触摸操作控制所述前台应用程序。A control unit, configured to control the foreground application according to the sliding touch operation.
  13. 根据权利要求11所述的手势识别装置，其中，所述响应模块还包括：The gesture recognition device according to claim 11, wherein the response module further comprises:
    弹出单元，用于若所述移动终端中未存储与所述手势操作对应的响应结果，弹出提示信息，所述提示信息用于提示当前的手势操作未被识别。A pop-up unit is configured to pop up a prompt message if a response result corresponding to the gesture operation is not stored in the mobile terminal, and the prompt information is used to indicate that a current gesture operation is not recognized.
  14. 根据权利要求9所述的手势识别装置，其中，所述预设窗口位于所述触摸屏上的边缘位置。The gesture recognition device according to claim 9, wherein the preset window is located at an edge position on the touch screen.
  15. 根据权利要求9所述的手势识别装置，其中，所述预设窗口为透明窗口。The gesture recognition device according to claim 9, wherein the preset window is a transparent window.
  16. 根据权利要求9所述的手势识别装置，其中，所述预设窗口的窗口高度为20-30像素。The gesture recognition device according to claim 9, wherein a window height of the preset window is 20-30 pixels.
  17. 一种可读存储介质，其上存储有计算机程序，其中，该程序被处理器执行时实现如权利要求1-8任意一项所述的方法。A readable storage medium having stored thereon a computer program, wherein when the program is executed by a processor, the method according to any one of claims 1-8 is implemented.
  18. 一种移动终端，包括摄像头、存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述程序时实现如权 利要求1-8任意一项所述的方法。A mobile terminal includes a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the program according to any one of claims 1-8 when executing the program. The method described.
PCT/CN2019/087490 2018-06-29 2019-05-17 Gesture recognition method and apparatus, readable storage medium and mobile terminal WO2020001193A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810715277.0A CN108958626A (en) 2018-06-29 2018-06-29 Gesture identification method, device, readable storage medium storing program for executing and mobile terminal
CN201810715277.0 2018-06-29

Publications (1)

Publication Number Publication Date
WO2020001193A1 true WO2020001193A1 (en) 2020-01-02

Family

ID=64485320

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/087490 WO2020001193A1 (en) 2018-06-29 2019-05-17 Gesture recognition method and apparatus, readable storage medium and mobile terminal

Country Status (2)

Country Link
CN (1) CN108958626A (en)
WO (1) WO2020001193A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115048019A (en) * 2021-02-26 2022-09-13 深圳市万普拉斯科技有限公司 Terminal operation method and device, computer equipment and storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108958626A (en) * 2018-06-29 2018-12-07 奇酷互联网络科技（深圳）有限公司 Gesture identification method, device, readable storage medium storing program for executing and mobile terminal
CN110245586A (en) * 2019-05-28 2019-09-17 贵州卓霖科技有限公司 A kind of data statistical approach based on gesture identification, system, medium and equipment
CN112181264A (en) * 2019-07-03 2021-01-05 中兴通讯股份有限公司 Gesture recognition method and device
CN111338506B (en) * 2020-02-19 2022-01-07 Oppo广东移动通信有限公司 Touch response method and device, electronic equipment and storage medium
CN113971092A (en) * 2020-07-21 2022-01-25 Oppo广东移动通信有限公司 Application response method and device, electronic equipment and readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019444A (en) * 2012-12-09 2013-04-03 广州市动景计算机科技有限公司 Touch operation method of touch screen and touch screen device
CN105739902A (en) * 2016-02-04 2016-07-06 广州橙行智动汽车科技有限公司 Gesture identification system and method
CN107179849A (en) * 2017-05-19 2017-09-19 努比亚技术有限公司 Terminal and its input control method, computer-readable recording medium
CN107357458A (en) * 2017-07-04 2017-11-17 广东欧珀移动通信有限公司 Response method, device, storage medium and the mobile terminal of touch key-press
CN107368250A (en) * 2017-06-22 2017-11-21 深圳市爱培科技术股份有限公司 A kind of screen edge slip detecting method, storage medium and device
CN107728900A (en) * 2017-09-29 2018-02-23 努比亚技术有限公司 Gesture operation method, mobile terminal and the storage medium of virtual key
CN108958626A (en) * 2018-06-29 2018-12-07 奇酷互联网络科技（深圳）有限公司 Gesture identification method, device, readable storage medium storing program for executing and mobile terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101550450B1 (en) * 2013-09-27 2015-09-18 우석 계 The method and apparatus for zoom control of portable devices
CN106991014A (en) * 2017-02-28 2017-07-28 努比亚技术有限公司 A kind of method, device and mobile terminal for handling user's incoming event
CN107105088A (en) * 2017-03-30 2017-08-29 努比亚技术有限公司 One kind operation response method and terminal
CN107315517B (en) * 2017-06-26 2021-04-06 北京小米移动软件有限公司 Method and device for preventing false touch, mobile terminal and intelligent terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019444A (en) * 2012-12-09 2013-04-03 广州市动景计算机科技有限公司 Touch operation method of touch screen and touch screen device
CN105739902A (en) * 2016-02-04 2016-07-06 广州橙行智动汽车科技有限公司 Gesture identification system and method
CN107179849A (en) * 2017-05-19 2017-09-19 努比亚技术有限公司 Terminal and its input control method, computer-readable recording medium
CN107368250A (en) * 2017-06-22 2017-11-21 深圳市爱培科技术股份有限公司 A kind of screen edge slip detecting method, storage medium and device
CN107357458A (en) * 2017-07-04 2017-11-17 广东欧珀移动通信有限公司 Response method, device, storage medium and the mobile terminal of touch key-press
CN107728900A (en) * 2017-09-29 2018-02-23 努比亚技术有限公司 Gesture operation method, mobile terminal and the storage medium of virtual key
CN108958626A (en) * 2018-06-29 2018-12-07 奇酷互联网络科技（深圳）有限公司 Gesture identification method, device, readable storage medium storing program for executing and mobile terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115048019A (en) * 2021-02-26 2022-09-13 深圳市万普拉斯科技有限公司 Terminal operation method and device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN108958626A (en) 2018-12-07

Similar Documents

Publication Publication Date Title
WO2020001193A1 (en) Gesture recognition method and apparatus, readable storage medium and mobile terminal
US11237724B2 (en) Mobile terminal and method for split screen control thereof, and computer readable storage medium
US10642483B2 (en) Quick screen splitting method, apparatus, and electronic device, display UI, and storage medium
CN107678631B (en) Side menu display method and device and terminal
US10057201B2 (en) Method and apparatus for managing the display of messages of a group chat
WO2019174611A1 (en) Application configuration method and mobile terminal
US11258893B2 (en) Method for prompting notification message and mobile terminal
EP3015978A1 (en) Gesture-based conversation processing method, apparatus, and terminal device
US20170315777A1 (en) Method, terminal, and storage medium for starting voice input function of terminal
CN106201491B (en) Mobile terminal and method and device for controlling remote assistance process of mobile terminal
US10423264B2 (en) Screen enabling method and apparatus, and electronic device
CN108549519B (en) Split screen processing method and device, storage medium and electronic equipment
US20220012003A1 (en) Object management method and mobile terminal
US10171640B2 (en) Method, apparatus, and system for displaying message in mobile terminal
CN109407949B (en) Display control method and terminal
WO2017035818A1 (en) Method of controlling electronic apparatus, and device and electronic apparatus utilizing same
CN109101152A (en) A kind of data inputting method and terminal
CN107479799B (en) Method and device for displaying window
WO2020001190A1 (en) Application program interface display method and device, readable storage medium, and mobile terminal
CN107608725A (en) A kind of information processing method and terminal
CN108536368B (en) Key using method, terminal and computer readable storage medium
CN111580911A (en) Operation prompting method and device for terminal, storage medium and terminal
WO2019140611A1 (en) Navigation button-based mistaken touch prevention method for terminal during handwriting
EP3674867B1 (en) Human-computer interaction method and electronic device
WO2017035740A9 (en) Method for selecting text

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19825010

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19825010

Country of ref document: EP

Kind code of ref document: A1