WO2018068207A1 - 识别操作的方法、装置及移动终端 - Google Patents

识别操作的方法、装置及移动终端 Download PDF

Info

Publication number
WO2018068207A1
WO2018068207A1 PCT/CN2016/101811 CN2016101811W WO2018068207A1 WO 2018068207 A1 WO2018068207 A1 WO 2018068207A1 CN 2016101811 W CN2016101811 W CN 2016101811W WO 2018068207 A1 WO2018068207 A1 WO 2018068207A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
user
hand
determining
gesture
Prior art date
Application number
PCT/CN2016/101811
Other languages
English (en)
French (fr)
Inventor
尹帮实
高久亮
薛康乐
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US16/340,945 priority Critical patent/US10739927B2/en
Priority to PCT/CN2016/101811 priority patent/WO2018068207A1/zh
Priority to CN201680090039.4A priority patent/CN109804339B/zh
Publication of WO2018068207A1 publication Critical patent/WO2018068207A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0443—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a single layer of sensing electrodes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/169—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/169—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes
    • G06F1/1692—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0447—Position sensing using the local deformation of sensor cells
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033—Indexing scheme relating to G06F3/033
    • G06F2203/0339—Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means

Definitions

  • the present invention relates to the field of electronic technologies, and in particular, to a method, an apparatus, and a mobile terminal for identifying operations.
  • touch input mode mainly focuses on the touch screen on the front of the mobile phone.
  • Common touch screens include a resistive touch display and a capacitive touch display.
  • the capacitive touch display has gradually replaced the resistive touch display due to its high sensitivity and has become the mainstream.
  • the existing capacitive touch screen solution is a capacitive sensor formed by ITO (Indium Tin Oxide) transparent conductive film arranged on a capacitive touch screen. The position and motion of the finger on the touch screen are sensed by the capacitive sensor to determine the user's touch command.
  • ITO Indium Tin Oxide
  • the user In actual use, the user often touches the side of the mobile phone while holding the mobile phone.
  • the side of the mobile phone due to the low sensitivity of the mobile phone to the side touch and the limitation of operation, the operation of the user's hand on the side cannot be accurately recognized.
  • the side of the mobile phone usually has physical buttons (such as volume keys, lock screen keys, etc.), and the operation of the user on the side of the mobile phone is limited to the pressing operation of the physical keys, the operation is single, and the user experience is not good.
  • the method and device provided by the present invention are used to eliminate the problem in the prior art that the user's hand can not accurately recognize the operation of the side of the mobile terminal.
  • an operation identification method for a mobile terminal includes: first, detecting a first capacitive touch display screen and a second capacitive touch display screen a capacitive signal, wherein the first capacitive touch display screen is located on a front surface of the mobile terminal, and the second capacitive touch display screen is located on a back side of the mobile terminal; and then determining the first capacitive touch The capacitance signal on the display screen satisfies at least one first region of the capacitance change threshold range, And determining, by the second capacitive touch display, that the capacitance signal meets at least one second region of the capacitance change threshold range; and then, in response to detecting the proximity of the same side, and in the first direction a third area and the fourth area, determining a side area between the third set of the third area and the fourth area of the opposite is a contact area of the user hand and the side, wherein each The third area is all or part of the first area, and
  • the operation identification method determines the contact area of the user's hand on the side of the mobile terminal according to the electrical characteristics of the dual-capacitive touch display screen of the mobile terminal through the electrical characteristics of the dual-capacitive touch display screen of the mobile terminal.
  • the dynamic change determines the gesture operation of the hand on the side, which improves the sensitivity of the side gesture recognition, thereby achieving accurate recognition of the gesture operation of the user hand on the side.
  • the dynamic change of the contact area of the user's hand on the side can be determined, and the gesture operation of the user's hand on the side is further determined, including longitudinal sliding (in The sliding movement from top to bottom on the side, vertical sliding (sliding from the front to the back on the side, or sliding from the back to the front), click and other gestures increase the diversity of identifiable operations.
  • the physical buttons provided on the side of the mobile terminal in the technology have better operational flexibility and improve the user experience.
  • the operation recognition method can replace the physical button to recognize the user's side-to-side gesture operation, weakening the constraint imposed on the operation due to the unchangeable physical position of the physical button, and increasing the ease of use and improvement.
  • the operation is fun, and physical buttons are no longer provided on the side of the mobile terminal, thereby helping to improve the fluency and aesthetics of the appearance of the mobile terminal.
  • the determining the contact area of the user hand with the side surface comprises: responsive to detecting the relative orientation of the third area and the fourth area in the first direction When the area satisfies a preset area threshold, or the area ratio satisfies a preset area ratio threshold, it is determined A side area between the third area and the fourth area is a contact area of the user's hand and the side.
  • the determining the contact area of the user hand with the side surface further comprises: determining a relative position of the third area and the fourth area relative to each other in the first direction Determining a center of the contact position of the user's hand on the side along a first position in the second direction on the side; according to the third area and the opposite in the first direction Determining an area relationship of the fourth region, determining a second position of the center of the contact position of the user's hand on the side along the first direction; the determining that the user's hand is in the
  • the step of the side gesture operation further includes determining a gesture operation of the user hand on the side in response to detecting a change in position of the first position and the second position on the side over time.
  • the step of determining the gesture operation of the user hand on the side may specifically determine at least one or more of the following operations:
  • a sliding operation in the first direction on the side surface in response to detecting that the area of the area of the third area that is opposite in the first direction is increased from small to large while the area of the fourth area The area is changed from large to small, or the area of the third area is changed from large to small with time while the area of the fourth area is increased from small to large, and the edge of the contact area of the user's hand on the side is determined. Movement of the first direction; determining a sliding operation of the user hand in the first direction on the side according to movement of the contact area of the user's hand on the side in the first direction .
  • a sliding operation in the first direction of the side surface in response to detecting that a region capacitance signal of the third region opposing in the first direction is increased from small to small while the fourth region is The area capacitance signal is changed from large to small, or the relative area capacitance signal of the third area is changed from large to small with time, and the area capacitance signal of the fourth area is changed from small to large, and the user's hand is determined to be on the side. Movement of the upper contact area in the first direction; determining, along the movement of the contact area of the user's hand on the side in the first direction, along the side of the user's hand The sliding operation in the first direction.
  • a sliding operation in the second direction of the side surface responsive to detecting relative movement of the third region and the fourth region in the first direction relative to each other in the second direction Determining movement of the contact area of the user's hand on the side in the second direction, wherein Determining that the second direction is parallel to the front surface of the mobile terminal and parallel to the side surface; determining that the user hand is in accordance with the movement of the contact area of the user hand on the side in the second direction A sliding operation of the side along the second direction.
  • a click operation on the side determining that the user's hand is the same as the detecting that the third region and the fourth region that are opposite in the first direction appear to disappear simultaneously after appearing within the first time threshold
  • the contact area of the side exits after contact within the first time threshold; and the click operation of the user hand on the side is determined according to the user's hand and the contact area of the side exit after contact within the first time threshold.
  • the determining the contact area of the user hand with the side surface comprises: determining a plurality of side areas as a plurality of contact areas of the user hand and the side; the determining The step of the gesture operation of the user hand on the side includes determining a multi-point gesture operation of the user hand on the side in response to detecting a dynamic change of the plurality of contact areas of the user hand on the side.
  • the method further includes: detecting an application currently running; and operating the gesture in response to the detected gesture operation of the user's hand on the side Associated with the application, determining an operation instruction; executing the operation instruction.
  • the operation recognition method further determines an operation command by associating a gesture operation of the user's hand on the side with an application, increasing the versatility that the user can operate.
  • the determining the operation instruction comprises: detecting a first gesture initiation operation, the first gesture initiation operation including a preset activation gesture operation of the user hand on the side; in response to detecting The first gesture initiates an operation, initiates association recognition associated with the gesture operation with the application, and operates the gesture operation in response to the detected gesture operation of the user hand on the side
  • the application is associated with the operational instructions.
  • the determining the operation instruction comprises: after the association identification is initiated, the gesture operation of the user hand on the side is not detected within a preset time, and the association identification is turned off.
  • the method detects the current system or different applications by giving different operational meanings to different motions of the gesture operation (eg, volume increase and decrease, song switching, e-book page turning) for the system or different applications.
  • the operation identifying method further comprises: performing gesture graphic recognition on the first region and the second region combination to determine a grip gesture of the user hand.
  • the holding posture of the user hand includes a contact position of the left or right hand, the palm and the finger on the mobile terminal.
  • the holding posture of the user hand is determined, and the holding posture of the user hand includes a holding position of a left or right hand, a palm and a finger on the mobile terminal, and can be held according to the holding position.
  • the gesture determines an effective gesture operation, avoids unintentional contact interference with the operation recognition, and further improves the accuracy of the operation recognition.
  • the multi-point gesture operation of the finger on the side of the mobile terminal can be recognized, and the gesture diversity and flexibility are improved.
  • the operation recognition method further includes: determining, according to a grip gesture of the user hand, a display screen currently being viewed by the user, the display screen The first capacitive touch display screen or the second capacitive display screen; on the display screen that the user is viewing, displaying information to save energy consumption of the mobile terminal.
  • the mobile terminal adopting the identification operation method described in the foregoing embodiment may cancel the physical key that is set on the side of the mobile terminal and set a volume key, a lock screen key, etc. in the prior art, thereby avoiding side opening, thereby improving The overall waterproof ability of the phone.
  • first capacitive touch display screen and the second capacitive touch display screen comprise capacitive sensors composed of mutual capacitance sensors.
  • the contact area of the user hand with the side surface comprises: a contact touch area of the user hand and the side surface; and/or a suspension touch area of the user hand and the side surface.
  • a mobile terminal includes: a touch display unit; one or more processors; a memory; a plurality of applications; and the memory,
  • the processor is configured to execute the computer program, and execute the following process: detecting a capacitance signal of the first capacitive touch display screen and the second capacitive touch display screen, wherein the first capacitor The touch display screen is located on the front side of the mobile terminal, and the second capacitive touch The display screen is located at the back of the mobile terminal; determining that the capacitance signal on the first capacitive touch display screen meets at least one first region of the capacitance change threshold range, and determining that the capacitance signal on the second capacitive touch display screen is satisfied The at least one second region of the capacitance variation threshold range; determining each of the relative regions in response to detecting the third region and the fourth region adjacent to the same side and opposite in the first direction a side area between the third area and the fourth area is a contact area of the user hand and
  • a device for operating identification includes: a signal detecting module, configured to detect a first capacitive touch display screen and a second capacitive touch display screen a capacitive signal, wherein the first capacitive touch display screen is located on a front side of the mobile terminal, the second capacitive touch display screen is located on a back side of the mobile terminal, and a first area detecting module is configured to determine the The capacitance signal on the first capacitive touch display screen meets at least one first region of the capacitance change threshold range, and determines that the capacitance signal on the second capacitive touch display screen satisfies at least one second region of the capacitance change threshold range; a second area detecting module, configured to determine, in response to detecting the third area and the fourth area adjacent to the same side and in the first direction, determining the third group of the opposite a side area between the area and the fourth area is a contact area of the user hand and the side surface, wherein
  • FIG. 1 shows an exemplary structural block diagram of a mobile phone provided in accordance with some embodiments
  • FIG. 2 shows an exemplary appearance of a mobile phone provided in accordance with some embodiments
  • FIG. 3 shows an exemplary cross-sectional view of a handset provided in accordance with some embodiments
  • 4(a) to 4(c) are diagrams showing a user-held mobile terminal provided in accordance with some embodiments.
  • FIG. 5 illustrates a flow diagram of an operation identification method provided in accordance with some embodiments
  • FIG. 6(a) is a schematic diagram showing a capacitance signal when a user's hand touches a first capacitive display screen according to some embodiments
  • 6(b) is a schematic diagram showing a capacitive signal when a user's hand touches the side of the mobile phone according to some embodiments;
  • FIG. 7(a) and 7(b) illustrate schematic diagrams of the determined first and second regions provided in accordance with some embodiments
  • 8(a) and 8(b) are schematic diagrams showing the determined third and fourth regions provided in accordance with some embodiments.
  • Figure 8 (c) shows a schematic diagram of the determined location of the user's hand touching the side of the handset, in accordance with some embodiments
  • FIG. 9 illustrates a schematic diagram of a determined location of a user's hand touching a side of a handset, in accordance with some embodiments.
  • Figure 10 illustrates a schematic illustration of a user hand moving in a first direction on the side of the handset, in accordance with some embodiments
  • FIG. 11 is a schematic diagram showing changes in a capacitance signal when a user's hand moves in a first direction on a side of a mobile phone according to some embodiments;
  • Figure 12 illustrates a schematic illustration of a user hand moving in a second direction on the side of the handset, in accordance with some embodiments, in accordance with some embodiments;
  • FIG. 13 illustrates a variation of a capacitance signal of a user's hand as the handset moves in a second direction along a second direction side, in accordance with some embodiments
  • 14(a) to 14(c) are diagrams showing changes of a third region and a fourth region when a user's hand moves on the side of the mobile phone according to some embodiments;
  • FIG. 15 shows a flow diagram of an operation identification method provided in accordance with some embodiments.
  • FIG. 16 is a schematic flowchart of a scenario of an operation identification method provided according to some embodiments.
  • Figure 17 shows a schematic block diagram of an apparatus for operation identification provided in accordance with some embodiments.
  • Figure 18 shows a schematic block diagram of an apparatus for operational identification provided in accordance with some embodiments.
  • the mobile terminal may be a mobile phone (also known as a smart phone), a tablet personal computer (PDA), a personal digital assistant (PDA), an e-book reader (English: e-book reader) or Virtual Reality Interactive Device, etc.
  • the mobile terminal can pass 2G (second generation mobile phone communication technical specification), 3G (third generation mobile communication technical specification), 4G (fourth generation mobile communication technical specification) 5G (fifth generation mobile phone communication technology specification) or W-LAN (wireless local area network) or communication methods that may occur in the future establish communication with the network.
  • 2G second generation mobile phone communication technical specification
  • 3G third generation mobile communication technical specification
  • 4G fourth generation mobile communication technical specification
  • 5G fifth generation mobile phone communication technology specification
  • W-LAN wireless local area network
  • the mobile terminal is capable of supporting a variety of applications, such as a phone application, an instant messaging application, Digital photo and/or camera applications, web browsing applications, music and/or video playback applications, video communication applications, social networking applications, financial and financial applications, weather applications, shopping applications, office applications, and the like.
  • applications such as a phone application, an instant messaging application, Digital photo and/or camera applications, web browsing applications, music and/or video playback applications, video communication applications, social networking applications, financial and financial applications, weather applications, shopping applications, office applications, and the like.
  • the mobile terminal is preferably a mobile phone
  • FIG. 1 shows an exemplary structural block diagram of a mobile phone 100 provided in accordance with some embodiments.
  • the mobile phone 100 includes an RF (Radio Frequency) circuit 110 , a memory 120 , a touch display unit 130 , a sensor 150 , an audio circuit 160 , a WiFi (Wireless Fidelity ) module 170 , a processor 180 , and Power supply 190 and other components.
  • RF Radio Frequency
  • FIG. 1 the structure of the mobile phone shown in FIG. 1 is only an example of implementation, and does not constitute a limitation of the mobile terminal, and may include more or less components than those illustrated, or combine some components. Or different parts arrangement.
  • the components of the mobile phone 100 will be specifically described below with reference to FIG. 1 :
  • the processor 180 can be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processor integrated circuits, application specific integrated circuits, and the like.
  • the RF circuit 110 can be used for transmitting and receiving information or during a call, and receiving and transmitting the signal. Specifically, after receiving the downlink information of the base station, the processor 180 processes the data. In addition, the uplink data is designed to be sent to the base station.
  • RF circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like.
  • RF circuitry 110 can also communicate with the network and other devices via wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
  • the memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing of the mobile phone 100 by running software programs and modules stored in the memory 120.
  • the memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone 100 (such as the number of audio) According to, phone book, etc.).
  • memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the touch display unit 130 can be configured to receive input digital or character information, and generate key signals or motion signal inputs related to user settings and function control of the mobile phone 100.
  • the touch display unit 130 can include a touch panel 131 and a display panel 132.
  • the touch display unit 130 includes a touch display screen.
  • the touch display screen is a device that integrates the display panel 132 and the touch panel 131.
  • the touch display screen is a capacitive touch display screen.
  • the capacitive touch screen is used.
  • the touch panel 131 of the display screen has a capacitive susceptor formed of an ITO (Indium Tin Oxide) transparent conductive film.
  • ITO Indium Tin Oxide
  • the processor 180 performs data processing on the scan detection signal by acquiring a scan detection signal on the touch display screen, and determines each of the parasitic capacitances according to a change in current or voltage of the touch display screen. Then, according to the capacitance value of each of the parasitic capacitances, the positioning calculation is performed to determine the touch position of the user's hand.
  • the mobile phone 100 includes a first capacitive touch display 201 and a second capacitive touch display 202, which are respectively located on the front side 101A and the back side 101B of the mobile phone 100.
  • the mobile phone 100 can provide a more diverse display mode to the user, or facilitate sharing of the mobile phone 100 by multiple users. For example, when the user uses the camera function, the camera user and the photographed user are used. A photographing screen or the like can be seen from the mobile phone 100 at the same time.
  • the display panel 132 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone 100.
  • the display panel 132 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • the touch panel 131 detects a touch operation on or near it, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 provides a corresponding vision on the display panel 132 according to the type of the touch event. Output, volume increase and decrease, vibration and other actions.
  • the mobile phone 100 can also include at least one type of sensor 150, such as a light sensor, a motion sensor, and an electric Capacitors and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 132 according to the brightness of the ambient light, and the proximity sensor may close the display panel 132 when the mobile phone 100 moves to the ear. / or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone 100 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here No longer.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the handset 100.
  • the audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, sent to the other mobile phone via the RF circuit 110, or outputted to the memory 120 for further processing.
  • WiFi is a short-range wireless transmission technology
  • the mobile phone 100 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 170, which provides wireless broadband Internet access for users.
  • FIG. 1 shows the WiFi module 170, it can be understood that it does not belong to the essential configuration of the mobile phone 100, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 180 is the control center of the handset 100, connecting various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120, The various functions and processing data of the mobile phone 100 are executed to perform overall monitoring of the mobile phone.
  • the processor 180 may include one or more processing units; preferably, the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.
  • the mobile phone 100 also includes a power source 190 (such as a battery) that supplies power to various components.
  • a power source 190 such as a battery
  • the power source can be logically coupled to the processor 180 through a power management system for management by the power management system.
  • a power management system for management by the power management system.
  • Features such as charging, discharging, and power management.
  • the mobile phone 100 may further include a camera, a Bluetooth module, and the like, and details are not described herein.
  • the handset 100 also has software components that can be stored in the memory 120 and can be used for software running in the handset, can include an operating system and applications, and the like.
  • operating systems such as Android (Android), Apple Systems (IOS), UNIX systems, Window systems, etc.
  • the application may include, but is not limited to, at least one of the following: a phone book module, an instant messaging module, a web browsing module, a camera module, a video playing module, a social network module, a music playing module, and the like.
  • the mobile terminal After receiving the input signal of the user to the touch display unit 130, the mobile terminal performs corresponding operations and processing, generates a corresponding output signal, and transmits the corresponding output signal to the display panel 132. Thereby the mobile terminal can interact with the user in a visually operable manner.
  • the touch panel 131 and the display panel 132 are implemented by a touch display screen.
  • the mobile terminal may further include one or more keys, which may be physical keys or soft keys displayed by the display unit.
  • the physical button may be an input obtained by actual pressure pressing
  • the physical button may include a button for turning on/off the device power and the locking device, and a button for adjusting the volume
  • the soft key may obtain an input by the aforementioned contact.
  • the mobile terminal can detect the touch operation on the side of the mobile terminal by using the first capacitive touch display 201 and the second capacitive display 202, which can replace the physical buttons on the side of the mobile terminal in the prior art, for example, Volume adjustment buttons, lock screen buttons, etc.
  • the mobile terminal 100 may also accept voice input for activating some functions via the microphone 162, or accept an action input for activating some functions via the sensor 150, such as obtaining a panning action by a gravity sensor or the like.
  • the first direction O1 is perpendicular to the front side 101A of the mobile terminal 100, and the front side 101A of the mobile terminal may be one side viewed by the user when using the mobile terminal.
  • the back surface 101B is the opposite side of the front surface, and the front side 101A of the mobile terminal And the back side 101B may be interchanged, the side of the mobile terminal being the faces 101C and 101D of the two sides of the viewing surface when the user holds the mobile terminal in the normal viewing direction, the second direction O2 being parallel to the mobile terminal
  • the front side 101A is parallel to the side surface 101C.
  • the side faces 101C and 101D of the mobile terminal may be planar, or may be a face having a certain curvature from the front surface 101A toward the back surface 101B.
  • the first capacitive touch display 201 includes a first cover layer 211, a first touch display structure layer 212, and a plurality of first connection circuit structures 213.
  • the first cover layer 211 may be a tempered glass layer
  • the first touch display structure layer 212 is disposed on the front surface of the mobile phone in the mobile phone cavity corresponding to the central area A1, and is used for the first touch.
  • the circuit of the display structure layer 212 for providing communication or power supply may be disposed in the mobile phone cavity corresponding to the frame area A2.
  • the touch display structure layer 212 has a plurality of first capacitive sensors 501, and the plurality of first capacitive sensors 501 are arranged in an array.
  • the second capacitive touch display screen 202 includes a second cover layer 221, a second touch display structure layer 222, and a plurality of second connection circuit structures 223.
  • the second cover layer 211 may be a tempered glass layer.
  • the second touch display structure layer 222 is distributed in the corresponding mobile phone cavity in the central area B1 on the back of the mobile phone, and the line for communication or power supply can be set in the frame area B2.
  • Machine lumen, the second touch display structure layer 222 having a plurality of second capacitor susceptor 502, susceptor 502 to a plurality of second capacitor arranged in an array.
  • the side walls 101D and 101C of the mobile phone 100 form a support housing.
  • the first capacitive susceptor 501 adjacent to the (non-contact) side 101D in the touch display structure layer 212 of the first capacitive touch display 201 generates a change in the capacitance signal. And transmitting the capacitance signal to the processor 180 through the first connection circuit structure 213.
  • the second capacitance sensor 502 generates a change of the capacitance signal, and sends the signal to the processor 180 through the second connection circuit structure 223 for the processor. 180 for detection and identification.
  • FIG. 4(a) shows an exemplary schematic diagram of a front side of a user holding a mobile terminal right handed in accordance with some embodiments.
  • 4(b) shows a schematic diagram of a user's right hand holding the back of a mobile terminal, provided in accordance with some embodiments.
  • the front side 101A of the mobile terminal 100 has a first capacitive touch display screen 201
  • the mobile terminal 100 has a back side 101B of the mobile phone.
  • the second capacitive touch display screen 202 allows the user to input control commands for various touch operations of the first capacitive touch display screen 201 and the second capacitive touch display screen 202, including by one or more fingers or a stylus Touch the corresponding area to control the object pointed to.
  • the contact may include one or more consecutive clicks, stay on the touch display screen and slide (from left to right, right to left, up/or down, circle, etc.). For example, when a user stops on a touch display screen and slides, the touch display will show the current page panning in the direction of the slide.
  • the two touch display screens are used to display a user interface that interacts with the user, can display the user interface in an intuitive manner, and display the interaction with the user in an easy-to-operate manner.
  • FIG. 4(a) and 4(b) are schematic diagrams showing when the user's right hand 300B holds the mobile terminal 100.
  • the user's left hand 300A may also hold the mobile terminal 100 without being restricted. .
  • FIG. 5 illustrates a flow chart of a mobile terminal implementing an operation identification method provided in accordance with some embodiments.
  • the operation recognition method provides a method for detecting a gesture operation on a side of the mobile terminal by a user's hand.
  • the method includes a step S11 to a step S14, in which the mobile terminal detects a capacitance signal of the first capacitive touch display screen and the second capacitive touch display screen, wherein the first capacitive touch The display screen is located on the front side of the mobile terminal, and the second capacitive touch display screen is located on the back of the mobile terminal. Then, in step S12, it is determined that the capacitance signal on the first capacitive touch display screen satisfies the capacitance change.
  • At least one first region of a threshold range (specific value of the threshold range is determined according to process requirements and product accuracy), and determining that the capacitance signal on the second capacitive touch display screen satisfies at least one second of the capacitance change threshold range a region; then, in the step S13, determining the third region and the opposite region according to the third region and the fourth region adjacent to the same side and opposite in the first direction a side area between the fourth areas is a contact area of the user hand and the side surface, wherein each of the third areas is all or part of the first area Each of the fourth regions is all or a portion of the fourth region, the first direction being perpendicular to a front side of the mobile terminal; thereafter, in the step S14, according to the first party Determining any one of an area change, a change in a capacitance signal strength, and a change in position of the third region and the fourth region that face each other, determining a dynamic change of a contact area of the user's hand on the side, and Description A dynamic change
  • the contact area of the user hand with the side surface includes: a contact touch area of the user hand and the side surface; and/or a suspension touch area of the user hand and the side surface.
  • the mobile terminal has the first capacitive touch display screen and the second capacitive touch display screen on the front side and the back side respectively.
  • the first capacitive touch display screen The second capacitive touch display screen comprises a capacitive sensor composed of a mutual capacitance sensor, and the capacitive sensor composed of the mutual capacitance sensor supports a multi-touch function.
  • the first capacitive touch display screen and the second capacitive touch display screen may further include a capacitive sensor combined by a mutual capacitance sensor and a self capacitance sensor, the first capacitive touch display.
  • the screen and the second capacitive touch display screen can detect a contact touch or a floating touch of the user's hand on the side.
  • the mobile terminal has a first capacitive touch display screen and a second capacitive touch display screen on the front and back sides thereof respectively.
  • the user hand for example, a finger
  • the finger touches the first capacitive contact.
  • a capacitive effect is generated between the capacitive sensors of the control display and between the capacitive receptors of the second capacitive touch display, thereby simultaneously changing the proximity of the finger portion of the first capacitive touch display adjacent to the side
  • the parasitic capacitance and the second capacitive touch display screen are adjacent to the parasitic capacitance of the side near the finger portion, and the magnitude of the parasitic capacitance at the relative position on the two display screens is related to the position of the user on the side of the mobile terminal, so Collecting scan signals of the first capacitive touch display screen and the second capacitive touch display screen, determining a capacitance signal about the parasitic capacitance, and determining a contact position of the user's hand on the side of the mobile terminal, further The scan signal is acquired to determine the change of the capacitance signal with time, and the touch operation of the user's hand on the side of the mobile terminal is determined.
  • the mobile terminal respectively detects a capacitance signal of the first capacitive touch display screen and a capacitance signal of the second capacitive touch display screen.
  • the first capacitive touch display screen includes a driving line arranged in a first direction and a sensing line arranged perpendicular to the first direction, and the sensing line is The position of the intersection of the driving lines forms a sensing point.
  • the processor controls the signal generator in the capacitive touch display screen to send a driving signal to the driving line column by column, and the sensing line receives the sensing signal row by row until After scanning the last line, storing the scan data; continuously collecting the scan data of the multi-frame and performing comprehensive calculation (for example, averaging), thereby obtaining the collected data of the capacitance signal of the first capacitive touch display screen, the first
  • the capacitive touch display has a plurality of sensing points distributed in an array, and the collected data includes a capacitance signal of each sensing point.
  • the method for detecting the capacitance signal of the second capacitive touch display screen refers to the method for detecting the capacitance signal of the first capacitive touch display screen. For the sake of brevity, no further details are provided.
  • the capacitive signal is as shown in FIG. 6(a); in conjunction with FIG. 6(b), when the user's hand 300 touches the side 101D of the mobile phone, the capacitive signal received on the first capacitive touch display 201 of the front side 101A is on the back side.
  • the received capacitive signal on the second capacitive touch display 202 of 101B is as shown in Figure 6(b).
  • step S12 determining that the capacitance signal on the first capacitive touch display screen meets at least one first region of the capacitance change threshold range, and determining that the capacitance signal on the second capacitive touch display screen is satisfied
  • the contact capacitance changes at least one second region of the threshold range.
  • the dual-screen is respectively determined according to the capacitance signal of the first capacitive touch display screen 201 and the collected data of the second capacitive touch display screen 202.
  • the capacitance signal C p of each of the sensing points is respectively determined according to the capacitance signal of the first capacitive touch display screen 201 and the collected data of the second capacitive touch display screen 202.
  • the capacitance signal C p of each of the sensing points is respectively determined according to the capacitance signal of the first capacitive touch display screen 201 and the collected data of the second capacitive touch display screen 202.
  • the mobile phone 100 determines motion gesture operation began. In a plurality of sampling periods (for example, 20) exceeding the capacitance change threshold, the mobile terminal 100 obtains the motion center of the hand by solving the geometric center of the sensing point capable of acquiring the effective capacitance signal C P .
  • the capacitive sensor and the surrounding capacitive signals C p on a plurality of capacitors are separately extracted for geometric operations (for example, solving the arithmetic mean) to determine the effective capacitance signal C p and The position of the corresponding sensing point, and the data is stored in order according to time, used for gesture analysis.
  • the capacitance variation range of the threshold value may be set larger than a first capacitor C t1 on the touch screen 201, is greater than the second capacitor C t2 on the display screen 202, wherein, C t1 and C t2 may be the same or Differently, C t1 and C t2 are specifically determined according to the performance of the two capacitive touch display screens.
  • the capacitance signal C p satisfies the capacitance change threshold range, it is determined that there is touch sensing on the corresponding sensing point, and then the adjacent sensing points that are touch-sensing are combined to form a first area, where the first area It can be one area or multiple non-adjacent areas.
  • the method for determining the at least one second area on the second capacitive touch display screen refers to the method of at least one first area on the first capacitive touch display screen, which will not be described again for brevity.
  • FIGS. 4(a) and 4(b) when the user's hand holds the mobile terminal as shown in FIGS. 4(a) and 4(b), a plurality of forms formed on the front side 101A of the mobile terminal 100 are shown.
  • a side area between the four areas is a contact area of the user hand and the side surface, wherein each of the third areas is all or part of the first area, and each of the fourth areas is All or part of the area of the fourth area, the first direction being perpendicular to the front side of the mobile terminal.
  • the region 700 adjacent to the side is in a region within a set width of the side of the front side of the mobile terminal 100 toward the center, and the region includes a plurality of columns of capacitive susceptors.
  • the set width can be determined based on the sensitivity of the capacitive sensor.
  • the third area (603a-603f) is all or part of the first area 601 in the area 700 adjacent to the side of the first capacitive touch display screen 201, and the fourth area (604a-604f) All of the second region 602 in the region 700 adjacent to the side on the second capacitive touch display 202 Or a partial area, determining a side area between the grouped third area and the fourth area according to the group of the third area and the fourth area corresponding in the first direction O1, The contact area of the user's hand with the side.
  • the contact area of the user's hand with the side may be one, or may be multiple discontinuities.
  • the mobile phone has two sides, and the user hand can have a contact area on each of the sides, which may be one or more.
  • a plurality of contact positions (801a to 801f) of the user's hand on the side which are determined according to the plurality of sets of the opposite third and fourth regions of FIGS.
  • one of the third region and one of the fourth regions are relatively formed in a first direction, and the groups of the third region and the fourth region are not necessarily identical in area.
  • the area of the third region in the group may be larger than the area of the fourth region (for example, the third region 603e and the fourth region 604e of FIGS. 8(a) and 8(b)), and conversely, the third The area of the area may be smaller than the area of the fourth area (for example, the third area 603a and the fourth area 604a of FIGS. 8(a) and 8(b)).
  • the area of the third area 603 and the fourth area 604 meets a preset area threshold, or the area ratio satisfies a preset area ratio threshold, it may be determined that the user's hand touches the third.
  • the tilting direction of the user's hand relative to the second direction when the side is in contact is determined according to the distribution of the corresponding third region 603 and the fourth region 604.
  • the direction in which the thumb extends from the base of the finger to the fingertip may be parallel to the front of the mobile terminal or may be inclined to the front of the mobile terminal, if detected
  • the third region 603 and the fourth region determined by the thumb when the side surface is in contact If the field 604 is not completely facing, the tilt angle of the thumb to the front of the mobile terminal can be determined according to the positional relationship of the areas of the two.
  • the third area 603 and the fourth area 604 have the same size, but the projections do not completely coincide.
  • the position of the third area 603 in the second direction is closer to the top surface of the mobile phone. Tilt to the front, and the thumb extends upward from the base of the finger and extends in the front direction.
  • the user's hand is determined on the side according to the relative positions of the third region 603 and the fourth region 604 that are opposite in the first direction.
  • a gesture operation of the user hand on the side may be determined according to a temporal change in position of the first position and the second position on the side.
  • step S14 according to the change of the area of the third area and the fourth area in the first direction (area area change, area capacitance signal intensity change, and area position change) a change) determining a dynamic change of a contact area of the user's hand on the side, and determining a gesture operation of the user's hand on the side according to a dynamic change of a contact area of the user's hand on the side .
  • step S14 in response to detecting that the area of the area of the third area that is opposite in the first direction is increased from small to small while the area of the area of the fourth area is Large or small, or the area of the third area is reduced from large to large while the area of the fourth area is changed from small to large, and the area of the contact area of the user's hand on the side is determined along the Movement in a first direction; determining a sliding operation of the user's hand in the first direction on the side according to movement of the contact area of the user's hand on the side in the first direction.
  • step S14 in response to detecting that the regional capacitance signal of the third region opposite in the first direction is increased from small to large while the regional capacitance of the fourth region
  • the signal is changed from large to small, or the relative area capacitance signal of the third area is changed from large to small, and the area capacitance signal of the fourth area is changed from small to large, and the user's hand is determined on the side.
  • Contact Movement of the region in the first direction determining, along the first direction, the user's hand on the side according to the movement of the contact area of the user's hand on the side in the first direction Sliding operation.
  • Figure 11 determines movement of the contact area of the user's hand on the side in the first direction based on a certain change in the intensity of the capacitive signal of the third and fourth regions opposite in the first direction over time Schematic diagram of the method.
  • the regional capacitive signal strength of each of the third regions may be an average capacitive signal strength in each third region, or may be a maximum capacitive signal strength in the region.
  • the capacitance signal strength of the third region 603 is detected on the first capacitive touch display screen 201 as C PT0 , C PT1 , C PT2 , C PT0 .
  • the signal intensity of the corresponding fourth region 603 detected on the second capacitive touch display screen 201 is C' PT0 , C' PT1 , C' PT2 , C' PT0 ⁇ C' PT1 ⁇ C' PT2 , from time T 0 , T 1 to time T 2 , the intensity of the capacitive signal in the third region 603 is weakened from strong to strong, and the intensity of the capacitive signal in the fourth region 604 is weakened and strong, and the user's hand can be determined on the side.
  • the contact area slides in the direction from the front side 101A to the back side 101B in the first direction O1, and the gesture operation is as shown in FIG.
  • C P2 and C' P2 are the capacitance signals of the palm contacting the side frame, and there is no change from T 0 , T 1 to time T 2 , indicating that it has not moved.
  • the value of the average capacitance signal first becomes larger and then becomes smaller.
  • the maximum value of the capacitive signal obtained by sampling on the first capacitive touch display is earlier than the second capacitive touch.
  • the maximum time point on the display When the thumb is swiped from the first capacitive touch display screen to the second capacitive touch display screen, the mobile phone 100 can also determine the order of the strokes through the appearance time of the maximum value points, thereby determining the gesture operation direction of the thumb. .
  • the thumb when the thumb is not from the first capacitive touch display screen to the second capacitive touch display screen, but from the side (C side or D side) of the middle frame to both sides (A side or B side)
  • the capacitive signal collected by the first capacitive touch display still has a maximum value
  • the data collected by the second capacitive touch display has no maximum value, so that it can be determined that the finger is directed from the middle frame.
  • the contact of the user's hand on the side is determined based on the relative movement of the third region 603 and the fourth region 604 in the first direction relative to each other in the first direction. Movement of the region in the second direction, and then determining, along the movement of the contact area of the user's hand on the side in the second direction, along the side of the user's hand Two-way sliding operation.
  • Figure 13 illustrates, in some embodiments, determining a user's hand on the side as a function of time based on changes in capacitance signals of the third region 603 and the fourth region 604 that are opposite in the first direction.
  • a schematic diagram of a method of movement of a contact area in a second direction From time T 0 , T 1 to time T 2 , the third region 603 on the A side moves in the X direction, and the fourth region 604 opposite the B surface also moves in the X direction, and the contact area of the user's hand on the side can be determined.
  • the gesture operation is as shown in FIG.
  • 14(a) to 14(c) are diagrams showing a method of changing the area and changing the position of the third region 603 and the fourth region 604 provided in some embodiments.
  • a pair of opposing third regions 603 and fourth regions 604 are changed from a position indicated by 901a to a position indicated by 901b, said third
  • the area of the area 603 is decreased and the area of the fourth area is increased, it can be determined that the corresponding contact area of the side of the user hand between the third area 603 and the fourth area 604 is from the front side 101A in the first direction O1.
  • the gesture operation can be determined as shown in FIG.
  • the third region 603 and the fourth region 604 are changed from the position indicated by 901a to the position indicated by 901c, the third region 603 and the
  • the gesture operation is as shown in FIG.
  • the third region and the fourth region are opposite in the first direction, appearing within the first time threshold, disappear simultaneously (or disappear simultaneously within a certain error time range) Determining that the contact area of the user hand and the side surface is contacted after being contacted within a first time threshold, and then, according to the contact area of the user hand and the side surface, after contacting within a first time threshold, determining The click operation of the user's hand on the side.
  • dynamically monitoring the movement of the center position over time according to the center point position (X O1 , X O2 ) as determined in FIG. 8 may determine a dynamic change in the contact area of the user's hand on the side, further determining the The gesture of the user's hand on the side.
  • the above-described embodiments for determining the dynamic change of the contact area of the user's hand on the side may be used in combination.
  • the determined contact area of the user hand and the side may be one, or may be a plurality of discontinuous areas, in some embodiments, when there are multiple, according to the user's hand, the side is more
  • the dynamic change of the contact areas determines the multi-point gesture operation of the user hand on the side, and realizes the operation recognition of the multi-point gesture.
  • the electrical characteristics of the dual-capacitive touch display screen of the mobile terminal determine the contact area of the user's hand on the side of the mobile terminal and its dynamic change according to the capacitance signal of the detected dual-capacitive touch display screen, without Adding a sensor to the side of the mobile terminal to sense a gesture, thereby determining a gesture operation of the hand on the side, improving sensitivity to side gesture recognition, thereby accurately recognizing a gesture of the user's hand to the side operating.
  • the dynamic change of the contact area of the user's hand on the side can be determined, and the gesture operation of the user's hand on the side is further determined, including longitudinal sliding (in The sliding movement from top to bottom on the side, vertical sliding (sliding from the front to the back on the side, or sliding from the back to the front), click and other gestures increase the diversity of identifiable operations.
  • the physical buttons provided on the side of the mobile terminal in the technology have better operational flexibility and improve the user experience.
  • the operation recognition method may recognize the user's side-to-side gesture operation instead of the physical button, and the physical button may no longer be disposed on the side of the mobile terminal, thereby helping to improve the fluency and aesthetics of the appearance of the mobile terminal.
  • the operating method further includes step S15, step S16 and step S17; wherein, in the step S15, the mobile terminal detects the currently running application; in the step S16, in response to the detecting And the gesture operation of the user hand on the side, associating the gesture operation with the application, determining an operation instruction; and in the step S17, executing the operation instruction.
  • the mobile terminal detects an application currently running, in some In an embodiment, detecting whether the interface currently displayed on the first capacitive touch display screen or the second capacitive touch display screen of the mobile terminal is a system interface or an application interface, and when the system interface is, detecting the current system interface.
  • the application when it is an application interface, detects the application of the corresponding application.
  • system interface may be a system desktop interface, a call interface, a text message viewing interface, and the like.
  • application interface may be a music play interface, an e-book viewing interface, a recording interface, or the like.
  • the gesture operation of the user hand detected in the step is performed on the side, and the gesture operation is associated with the application, and the operation instruction is determined.
  • the operation instructions include the operated object and the execution content.
  • the sliding may be performed.
  • the operation is identified as an instruction to scroll the system desktop interface or page through the e-book viewing interface.
  • the sliding operation may be recognized as an adjustment. Volume command.
  • the sliding operation may be identified as Move the display of the SMS list or move the instructions to display the e-book.
  • the click operation may be recognized as pause/continue to play music or recording. instruction.
  • a preset start gesture operation (wake-up gesture) of a side gesture operation may be preset in order to distinguish between the user's normal grip and the gesture operation under the background of no operation intention.
  • the first gesture start operation includes a preset start gesture operation of the user hand on the side; in response to detecting the first gesture start An operation to initiate an association that associates the gesture operation with the application
  • the gesture operation is associated with the application to determine an operation instruction. For example, setting the stroke from the front to the back and back to the front is a wake-up gesture. After this awake gesture, association recognition is initiated, and the detected gesture operation of the user hand on the side is associated with the application.
  • the step S16 further includes: after the association identification is initiated, the gesture operation of the user hand on the side is not detected within a preset time, and the association recognition is turned off.
  • the association identification is started, the detected gesture operation of the user hand on the side is associated with the application within a certain time, and after the gesture operation is stopped for a preset time (for example, 5 seconds), It is considered that the gesture operation flow ends and the association recognition is turned off. To continue the association of the side gestures with the application, a new wakeup is required.
  • the method detects the current system or different applications by giving different operational meanings to different motions of the gesture operation (eg, volume increase and decrease, song switching, e-book page turning) for the system or different applications.
  • the application associates the gesture operation with the application. When the association is implemented, the correct gesture operation acts to generate a corresponding operation instruction, and the mobile terminal executes the gesture operation instruction.
  • the operation identification method is further configured to determine, according to the capacitance signal on the first capacitive touch display screen and the capacitance signal on the second capacitive touch display screen, a contact position of the palm and the finger when the user hand holds the mobile terminal To determine the grip and hold gesture.
  • the method includes a step S18, in which the gesture recognition is performed on the first region and the second region combination, and the holding posture of the user hand is determined.
  • the gripping posture of the user's hand includes a left or right hand held by the hand, a palm and a finger touching the position on the mobile terminal.
  • the process of recognizing the gesture pattern may be based on the first region and the second region, and performing a graphical comparison with some preset gesture graphics, when compared with the graphics of any preset gesture graphics.
  • the holding posture of the user hand is determined according to the preset gesture pattern, and the contact position of the left or right hand, the palm and the finger held by the mobile terminal is held.
  • the contact position of the finger at the mobile terminal when determining the contact position of the finger at the mobile terminal, Do not determine the contact position of the thumb on the side and the contact position of one or more of the other four fingers on the other side.
  • determining a gesture operation of the thumb as an effective gesture operation dynamically detecting a contact position near the thumb, the third region and the fourth region Any change in area change, capacitance signal strength change, and position change determines the dynamic change of the thumb's contact area on the side, and determines an effective gesture operation to avoid unintentional contact interference with the operation recognition.
  • the gesture operation of the thumb and one of the other four fingers are determined when the contact position of the thumb on one side and the contact position of one or more of the other four fingers on the other side are determined.
  • a plurality of gesture operations determined to be effective at the other of the sides, dynamically detecting the third region and the fourth region of the contact position adjacent to one or more of the thumb and the other four fingers Any change in area change, capacitance signal strength change, and position change, determine the dynamic change of the contact area of the side, determine an effective multi-point gesture operation, and avoid unintentional contact interference to the operation recognition while being identifiable Multi-point gestures to increase gesture diversity and flexibility.
  • the method further includes a step S19 (not shown) and a step S20 (not shown) when determining that the palm is close to one side (front or back) of the mobile terminal,
  • the opposite side can be determined as the display screen currently being viewed by the user, and the information can be displayed on the determined display screen that the user is viewing.
  • the display screen of the palm close to one side of the mobile terminal can automatically turn off the display, which can save power consumption.
  • FIG. 15 and FIG. 16 a schematic flowchart of an operation identification method implemented in a mobile phone; when the user holds the mobile phone, the processor controls the capacitive sensing on the first capacitive touch display screen and the second capacitive touch display screen.
  • the area performs sensing to determine the first area and the second area that satisfy the capacitance change threshold range, and the processor performs gesture pattern recognition on the first area and the second area, determines a contact position of the skin of the user's hand on the side, and determines a holding gesture.
  • the sensing area of each capacitor changes, it is determined that the user's hand contact position is moved up and down along the side, thereby determining that the user's hand slides up and down on the side (ie, the frame), when the electricity is The size of the sensing area changes, determining the relative position of the skin on the side, that is, the back and forth movement of the contact position, thereby determining that the user's hand slides back and forth in the direction of the vertical screen (the first capacitive touch display screen); when determining that the user's hand is
  • the side frame gesture operation detects the current application, for example, detecting that the current music playback application is, the user's hand slides up and down on the side frame, then associates the two, determines
  • FIG. 17 illustrates an apparatus for operational identification provided in accordance with some embodiments, wherein the apparatus includes a signal detection module 11, a first area detection module 12, a second area detection module 13, and a dynamic detection module 14.
  • the signal detecting module 11 detects the capacitance signals of the first capacitive touch display screen and the second capacitive touch display screen, wherein the first capacitive touch display screen is located on the front side of the mobile terminal, The second capacitive touch display screen is located at the back of the mobile terminal; the first area detecting module 12 determines that the capacitive signal on the first capacitive touch display screen meets at least one first region of the capacitance change threshold range, and determines The second capacitive sensing signal on the second capacitive touch display screen satisfies at least one second region of the capacitance change threshold range; the second region detecting module 13 is responsive to detecting the proximity of the same side and at the first Determining the third region and the fourth region in the opposite direction, determining that the side region between the third group and the fourth region of the opposite group is the contact area between the user hand and the side surface, Each of the third regions is all or a portion of the first region, and each of the fourth regions is all or a portion of the fourth region, and the first direction
  • the second area detecting module 13 includes: a first contact area detecting subunit, wherein the first contact area detecting subunit is responsive to detecting the third in the first direction The relative area of the area and the fourth area meets a preset area threshold, or the area ratio satisfies When the area ratio threshold is set, it is determined that the side area between the third area and the fourth area is a contact area of the user hand and the side surface.
  • the second area detecting module 13 further includes: a first position detecting subunit, configured to compare relative positions of the third area and the fourth area in the first direction Determining a center of the contact position of the user's hand on the side along a first position in the second direction on the side; a second position detecting subunit for using in the first direction Opposing an area relationship of the third region and the fourth region, determining a center of the contact position of the user's hand on the side surface in a second position along the first direction on the side; correspondingly
  • the dynamic detection module further includes: a first dynamic detection subunit, configured to determine the user hand in response to detecting a change in position of the first position and the second position on the side over time Gesture operation on the side.
  • the dynamic detection module 14 includes: a first movement determination subunit and a first operation determination subunit, wherein the first movement determination subunit is responsive to detecting the opposite in the first direction
  • the area of the area of the third area increases from small to large with time, while the area of the area of the fourth area decreases from large to large, or the area of the area of the third area changes from large to small while the area of the fourth area
  • the area is changed from small to large, determining movement of the contact area of the user's hand on the side in the first direction; the first operation determining sub-unit according to the contact area of the user's hand on the side
  • a movement in the first direction determines a sliding operation of the user hand in the first direction on the side.
  • the dynamic detection module 14 includes: a second movement determination subunit and a second operation determination subunit, wherein the second movement determination subunit is responsive to detecting the opposite in the first direction
  • the regional capacitance signal of the third region is changed from small to large with time, while the regional capacitance signal of the fourth region is changed from large to small, or the relative regional capacitance signal of the third region is changed from large to small over time.
  • the area capacitance signal of the fourth area is changed from small to large, and the movement of the contact area of the user's hand on the side is determined in the first direction; the second operation determining subunit is according to the user's hand The movement of the contact area on the side in the first direction determines a sliding operation of the user hand in the first direction on the side.
  • the dynamic detection module 14 includes: a third movement determination subunit and a third operation determination subunit, the third movement determination subunit responsive to detecting the relative in the first direction a relative movement of the position of the third region and the fourth region in the second direction relative to time, determining movement of the contact area of the user hand on the side in the second direction, wherein the The second direction is parallel to the front surface of the mobile terminal and parallel to the side surface; the third operation determining subunit determines the position according to the movement of the contact area of the user hand on the side in the second direction A sliding operation of the user's hand in the second direction on the side.
  • the dynamic detection module 14 includes: a fourth movement determination subunit and a fourth operation determination subunit, the fourth movement determination subunit responsive to detecting the relative in the first direction The third area and the fourth area disappear simultaneously after appearing within the first time threshold, and the contact area of the user hand and the side is determined to be in contact after being contacted within the first time threshold; the fourth operation determining subunit And determining to perform a click operation of the user hand on the side according to the user's hand contacting the contact area of the side after contacting within a first time threshold.
  • the second area detecting module 13 includes: a second contact area detecting subunit and a second dynamic detecting subunit, wherein the second contact area detecting subunit determines a plurality of side areas as the user hand a plurality of contact areas with the side; the dynamic detection module includes: the second dynamic detection subunit determines the user hand in response to detecting a dynamic change of a plurality of contact areas of the user hand on the side Multi-point gesture operation on the side.
  • the content of the function implemented by the signal detecting module 11 and the sub-units it includes is referred to the content described in the step S11 of the method in the foregoing embodiments, the first area detecting module 12 and the sub-units included therein.
  • the content of the function refer to the content described in the step S12 of the method in the foregoing embodiments, the content of the second area detecting module 13 and the functions implemented by the sub-units thereof, and the steps of the method in the foregoing embodiments.
  • the contents of the content and dynamic detection module 14 and the functions of the sub-units included in the S13 are referred to the content described in the step S14 of the method in the foregoing embodiments, and are not described herein again. .
  • FIG. 17 shows an exemplary structural block diagram of an apparatus provided on the basis of FIG. 16 , further comprising: a data detection module 15, an instruction detection module 16, and an execution module 17, in accordance with some embodiments.
  • the data detection module 15 detects an application currently running; the instruction detection module 16 associates the gesture operation with the application in response to the detected gesture operation of the user hand on the side, determining an operation An instruction; the execution module 17 executes the operation instruction.
  • the instruction detection module 16 includes a gesture detection subunit and an instruction detection subunit.
  • the gesture detection subunit detects a first gesture initiation operation, the first gesture initiation operation including a preset activation gesture operation of the user hand on the side; the instruction detection subunit is responsive to detecting the first a gesture initiation operation, initiating association recognition associated with the gesture operation with the application, and associating the gesture operation with the application in response to the detected gesture operation of the user hand on the side , determine the operation instructions.
  • the instruction detecting module 16 further includes: a closing subunit, the closing subunit not detecting the gesture operation of the user hand on the side within a preset time after starting the association identification, Turn off association recognition.
  • the content of the function implemented by the data detection module 15 and the sub-units it includes is referred to the content described in the step S15 of the method in the foregoing embodiments, and the function of the instruction detection module 16 and the sub-units thereof are implemented.
  • the content of the function implemented by the execution module 17 and the sub-units thereof is referred to the content described in the step S17 of the method in some embodiments. , will not repeat them, and are included here by reference.
  • Figure 18 shows a schematic block diagram of an apparatus for operation identification provided in accordance with some embodiments, the apparatus further comprising: a gesture detection module 18, the gesture detection module 18 The first area and the second area are combined for gesture pattern recognition to determine a grip gesture of the user's hand.
  • the holding posture of the user hand includes a contact position of the left or right hand, the palm and the finger on the mobile terminal.
  • the device further includes: a display screen detecting module (not shown) and a display module (not shown), the display screen detecting module according to the holding posture of the user hand, Determining a display screen currently viewed by the user, the display screen being the first capacitive touch display screen or the second capacitive display screen; the display module is displayed on a display screen that the user is viewing information.
  • the content of the functions implemented by the gesture detection module 18 and the sub-units included therein are referred to the foregoing one.
  • the content of the step S18 and the display module are referred to the contents of the step S19 and the step S20, respectively, and are not described here, and are included herein by reference.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Telephone Function (AREA)
  • Position Input By Displaying (AREA)

Abstract

根据本申请一些实施例提供的识别操作的方法、装置及移动终端，其中，所述方法通过移动终端的双电容触控显示屏的电学特性，根据检测的双电容触控显示屏的电容信号确定用户手在所述移动终端侧面的接触区域及其动态变化，确定所述手在所述侧面的手势操作，提高了对侧面手势识别的灵敏度，从而实现准确地识别用户手对所述侧面的手势操作，并且，根据移动终端的双电容触控显示屏的电容信号的变化，可以确定用户手在所述侧面的接触区域的动态变化，进一步确定用户手在所述侧面的手势操作，包括纵向滑动、垂向滑动、点击等手势操作，增加了可识别操作的多样性，比现有技术中设置在移动终端侧面的物理按键具有更佳的操作灵活性，提高用户体验。

Description

识别操作的方法、装置及移动终端 技术领域
本发明涉及电子技术领域，尤其涉及一种识别操作的方法、装置及移动终端。
背景技术
目前移动终端中被广泛使用的手机，其触控输入方式主要集中在手机正面的触摸屏，常见的触摸屏包括电阻触控显示屏和电容触控显示屏。
电容触控显示屏因其较高的灵敏度逐渐取代电阻触控显示屏，成为主流。
现有的电容屏触控技术方案是在电容式触摸屏上排布着ITO(铟锡氧化物)透明导电膜形成的电容感受器。利用电容感受器感受手指在触摸屏上的位置和运动，确定用户的触控指令。
在实际使用中，用户在握持手机时，常常接触到手机侧面。现有技术中，因手机对侧面的触控的灵敏性低、操作局限性较大的问题，导致无法准确识别用户手对所述侧面的操作。目前手机侧面通常具有指物理按键(例如音量键、锁屏键等)，用户在手机侧面的操作仅限于对物理按键的按压操作，操作单一，用户体验不佳。
发明内容
有鉴于此，本发明所提供的方法和设备用以消除现有技术中，无法准确识别用户手对移动终端侧面的操作识别的问题。
一方面，根据本申请一些实施例的提供的一种用于移动终端的操作识别方法，其中，所述操作识别方法包括：首先，检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；接着，确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域， 并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；然后，响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；随后，进可实时地，响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
通过上述一些实施例，所述操作识别方法通过移动终端的双电容触控显示屏的电学特性，根据检测的双电容触控显示屏的电容信号确定用户手在所述移动终端侧面的接触区域及其动态变化，确定所述手在所述侧面的手势操作，提高了对侧面手势识别的灵敏度，从而实现准确地识别用户手对所述侧面的手势操作。并且，根据移动终端的双电容触控显示屏的电容信号的变化，可以确定用户手在所述侧面的接触区域的动态变化，进一步确定用户手在所述侧面的手势操作，包括纵向滑动(在侧面上从上到下的滑动)、垂向滑动(在侧面上的从正面向背面的滑动，或从背面向正面的滑动)、点击等手势操作，增加了可识别操作的多样性，比现有技术中设置在移动终端侧面的物理按键具有更佳的操作灵活性，提高用户体验。在一些实施例中，所述操作识别方法可替代所述物理按键识别用户对侧面的手势操作，削弱了由于实体按键物理位置不可改变而给操作带来的约束，而且增加了易用性，提升操作趣味性，此外在移动终端的侧面可不再设置物理按键，从而帮助提高移动终端的外观的流畅性和美观性。
在一些实施例中，所述的确定所述用户手与所述侧面的接触区域的步骤包括：响应于检测到所述第一方向上相对的所述第三区域和所述第四区域的相对面积满足预设的面积阈值，或面积比例满足预设的面积比例阈值时，确定所述 第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域。
在一些实施例中，所述的确定所述用户手与所述侧面的接触区域的步骤还包括：根据在所述第一方向上相对的所述第三区域和所述第四区域的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置；根据在所述第一方向上相对的所述第三区域和所述第四区域的面积关系，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第一方向的第二位置；所述的确定所述用户手在所述侧面的手势操作的步骤还包括：响应于检测到所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
在一些实施例中，所述的确定所述用户手在所述侧面的手势操作的步骤可以具体确定至少以下一种或任几种操作：
在所述侧面的沿所述第一方向的滑动操作：响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
在所述侧面的沿所述第一方向的滑动操作：响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
在所述侧面的沿所述第二方向的滑动操作：响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第二方向上的位置的随时间相对移动，确定所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，其中，所 述第二方向平行于所述移动终端的正面且平行于所述侧面；根据所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
在所述侧面的点击操作：响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第一时间阈值内出现后同时消失，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开；根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
在一些实施例中，所述的确定所述用户手与所述侧面的接触区域的步骤包括：确定多个侧面区域为所述用户手与所述侧面的多个接触区域；所述的确定所述用户手在所述侧面的手势操作的步骤包括：响应于检测所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作。
在一些实施例中，结合前述一些实施例，所述方法还包括：检测当前正在运行的应用程序；响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；执行所述操作指令。
通过上述一些实施例，所述操作识别方法进一步地将用户手在所述侧面的手势操作与应用程序相关联确定操作指令，增加了用户可操作的多样性。
在一些实施例中，所述的确定操作指令的步骤包括：检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令。
在一些实施例中，所述的确定操作指令的步骤包括：在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。
在一些实施例中，所述方法通过为***或不同应用，对手势操作的不同运动赋予不同的操作含义(例如音量增减、歌曲切换、电子书翻页)时，检测当前所在***或不同应用的应用程序，将手势操作与应用程序进行关联，当实现 关联后，正确的手势操作发生作用，产生对应的操作指令，移动终端会执行手势操作指令。
在一些实施例中，基于前述一些实施例，所述操作识别方法还包括：对所述第一区域和所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。其中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
通过上述一些实施例，确定所述所述用户手的握持姿势，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置，能够根据握持姿势确定有效的手势操作，避免无意图的接触对操作识别的干扰，进一步提高操作识别的准确度。同时，根据握持姿势可识别手指在移动终端侧面的多点手势操作，提高手势多样性和灵活性。
在一些实施例中，结合确定所述用户手的握持姿势，所述操作识别方法还包括：根据所述用户手的握持姿势，确定当前所述用户正在查看的显示屏，所述显示屏为所述第一电容触控显示屏或所述第二电容显示屏；在所述用户正在查看的显示屏上，显示信息，以节约移动终端的能源消耗。
在一些实施例中，采用前述实施例所述的识别操作方法的移动终端可以取消现有技术中设置在移动终端侧面设置音量键、锁屏键等实体键，从而避免侧面开孔，进而可以提高手机的整体防水能力。
进一步地，所述第一电容触控显示屏和所述第二电容触控显示屏包括互电容传感器组成的电容感受器。
值得一提的是，所述用户手与所述侧面的接触区域包括：所述用户手与所述侧面的接触触碰区域；和/或所述用户手与所述侧面的悬浮触碰区域。
一方面，根据本申请一些实施例提供的一种移动终端，其中，所述移动终端包括：一个触控显示单元；一个或多个处理器；存储器；多个应用程序；及所述存储器，用于存储计算机程序；所述处理器，用于运行所述计算机程序，执行下述流程：检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控 显示屏位于所述移动终端的背面；确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
一方面，根据本申请一些实施例提供的一种用于操作识别的装置，其中，所述装置包括：信号检测模块，用于检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；第一区域检测模块，用于确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；第二区域检测模块，用于响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；动态检测模块，用于响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、 区域电容信号强度变化及区域位置变化中任一项变化。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要地介绍。在附图中，相同的标号表示相应的部分。显而易见地，下面描述中的附图仅仅是本发明的一些实施例，而非全部。对于本领域普通技术人员来讲，在没有付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。
图1示出根据一些实施例提供的手机的示例性的结构框图；
图2示出根据一些实施例提供的手机示例性的外观示意图；
图3示出根据一些实施例提供的手机示例性的剖面示意图；
图4(a)～图4(c)示出根据一些实施例提供的用户手持移动终端的示意图；
图5示出根据根据一些实施例提供的操作识别方法的流程示意图；
图6(a)示出根据一些实施例提供的用户手触摸第一电容显示屏时电容信号示意图；
图6(b)示出根据一些实施例提供的用户手触摸手机侧面时电容信号示意图；
图7(a)和图7(b)示出根据一些实施例提供的所确定的第一区域和第二区域的示意图；
图8(a)和图8(b)示出根据一些实施例提供的所确定的第三区域和第四区域的示意图；
图8(c)示出根据一些实施例提供的所确定的用户手接触手机侧面的位置的示意图；
图9示出根据一些实施例提供的所确定的用户手接触手机侧面的位置的示意图；
图10示出根据一些实施例提供的用户手在手机侧面沿第一方向移动示意图；
图11示出根据一些实施例提供的的用户手在手机侧面时沿第一方向移动时电容信号的变化示意图；
图12示出根据一些实施例根据一些实施例提供的用户手在手机侧面沿第二方向移动示意图；
图13示出根据一些实施例根据一些实施例提供的用户手在手机沿第二方向侧面沿第二方向移动时电容信号的变化示意图；
图14(a)～图14(c)示出根据一些实施例提供的用户手在手机侧面时移动时第三区域和第四区域的变化示意图；
图15示出根据一些实施例提供的操作识别方法的流程示意图；
图16示出根据一些实施例提供的操作识别方法的场景流程示意图；
图17示出根据一些实施例提供的操作识别的装置的示意性结构框图；
图18示出根据一些实施例提供的操作识别的装置的示意性结构框图。
具体实施方式
下面将结合一些实施例中的附图，对实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是一部分实施例，而不是全部的实施例，一些众所周知的方法、过程、结构和网络，不再过多赘述。
以下描述的移动终端和所述移动终端的实现方法的实施例。其中，所述移动终端可以是移动电话(又称智能手机)、平板电脑(Tablet Personal Computer)、个人数字助理(personal digital assistant，简称PDA)、电子书阅读器(英文：e-book reader)或虚拟现实交互设备(Virtual Reality Interactive Device)等，所述移动终端可以通过2G(第二代手机通信技术规格)、3G(第三代手机通信技术规格)、4G(***手机通信技术规格)、5G(第五代手机通信技术规格)或W-LAN(无线局域网)或今后可能出现的通信方式与网络建立通信。
为简明起见，对此本发明实施例不做进一步限定。为了方便说明，在以下的实施例中，以移动终端为例进行说明。
所述移动终端能够支持多种应用，譬如，电话应用、即时消息收发应用、 数码拍照和/或摄像应用、网络浏览应用、音乐和/或视频播放应用、视频通信应用、社交网络应用、金融财经应用、天气应用、购物应用、办公应用等。
所述移动终端优选地为手机，图1示出的是根据一些实施例提供的手机100的示例性的结构框图。参考图1，手机100包括RF(Radio Frequency，射频)电路110、存储器120、触控显示单元130、传感器150、音频电路160、WiFi(wireless fidelity，无线保真)模块170、处理器180、以及电源190等部件。
本领域技术人员可以理解，图1中示出的手机结构只做实现方式的举例，并不构成对移动终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图1对手机100的各个构成部件进行具体的介绍：
所述处理器180可基于一个或多个微处理器、微控制器、数字信号处理器、基带处理器集成电路、专用集成电路等等。
RF电路110可用于收发信息或通话过程中，信号的接收和发送，特别地，将基站的下行信息接收后，给处理器180处理；另外，将设计上行的数据发送给基站。通常，RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、LNA(Low Noise Amplifier，低噪声放大器)、双工器等。此外，RF电路110还可以通过无线通信与网络和其他设备通信。所述无线通信可以使用任一通信标准或协议，包括但不限于GSM(Global System of Mobile communication，全球移动通讯***)、GPRS(General Packet Radio Service，通用分组无线服务)、CDMA(Code Division Multiple Access，码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service，短消息服务)等。
存储器120可用于存储软件程序以及模块，处理器180通过运行存储在存储器120的软件程序以及模块，从而执行手机100的各种功能应用以及数据处理。存储器120可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作***、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机100的使用所创建的数据(比如音频数 据、电话本等)等。此外，存储器120可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
触控显示单元130可用于接收输入的数字或字符信息，以及产生与手机100的用户设置以及功能控制有关的键信号或动作信号输入。具体地，触控显示单元130可包括触控面板131、显示面板132。
触控显示单元130包括触控显示屏。其中，触控显示屏是集成显示面板132与触控面板131的设备，在优选的实施例中，所述触控显示屏为电容触控显示屏，在一些实施例中，所述电容触控显示屏的触控面板131具有由ITO(铟锡氧化物)透明导电膜形成的电容感受器，当用户手接触触碰或悬浮触碰时，电容感受器的寄生电容由CP改变为CP与Cfinger并联。故根据所述寄生电容值的变化，可以确定用户触碰的位置。具体地，处理器180通过获取对所述触控显示屏的扫描检测信号，对所述扫描检测信号进行数据处理，根据所述触控显示屏的电流或电压的变化确定各个所述寄生电容，再根据各个所述寄生电容的电容值进行定位计算，确定用户手的触碰位置。
如图2所示，在优选的实施例中，所述手机100包括第一电容触控显示屏201和第二电容触控显示屏202，分别位于所述手机100的正面101A和背面101B。通过正面11A和背面11B双屏的显示方式，所述手机100能够向用户提供更为多样的显示方式，或便于多用户共享使用手机100，例如，用户使用拍照功能时，拍照用户和被拍照用户可以同时从所述手机100上看到拍照画面等。
显示面板132可用于显示由用户输入的信息或提供给用户的信息以及手机100的各种菜单。显示面板132可以采用LCD(Liquid Crystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置显示面板132。进一步的，当触控面板131检测到在其上或附近的触摸操作后，传送给处理器180以确定触摸事件的类型，随后处理器180根据触摸事件的类型在显示面板132上提供相应的视觉输出、音量增减、振动等动作。
手机100还可包括至少一种传感器150，比如光传感器、运动传感器、电 容感受器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板132的亮度，接近传感器可在手机100移动到耳边时，关闭显示面板132和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机的姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于手机100还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路160、扬声器161，麦克风162可提供用户与手机100之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号，传输到扬声器161，由扬声器161转换为声音信号输出；另一方面，麦克风162将收集的声音信号转换为电信号，由音频电路160接收后转换为音频数据，再将音频数据输出处理器180处理后，经RF电路110以发送给比如另一手机，或者将音频数据输出至存储器120以便进一步处理。
WiFi属于短距离无线传输技术，手机100通过WiFi模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图1示出了WiFi模块170，但是可以理解的是，其并不属于手机100的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器180是手机100的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器120内的软件程序和/或模块，以及调用存储在存储器120内的数据，执行手机100的各种功能和处理数据，从而对手机进行整体监控。可选的，处理器180可包括一个或多个处理单元；优选的，处理器180可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作***、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器180中。
手机100还包括给各个部件供电的电源190(比如电池)，优选的，电源可以通过电源管理***与处理器180逻辑相连，从而通过电源管理***实现管理 充电、放电、以及功耗管理等功能。
尽管未示出，手机100还可以包括摄像头、蓝牙模块等，在此不再赘述。
此外，所述手机100还具有软件部件，所述软件部件可以存储于存储器120中，并可被用于运行在手机中的软件，可以包括操作***和应用程序等等。其中，操作***，比如安卓***(Android)、苹果***(IOS)、UNIX***、Window***等等，用于控制管理一般的***任务(比如电力管理等)的各种软件部件和/或驱动器，并便于各种硬件与软件部件之间的通讯。应用程序可以包括但不限于以下至少任一种：电话簿模块、即时消息传送模块、网页浏览模块、摄像模块、视频播放模块、社交网络模块、音乐播放模块等等。
结合处理器180、触控显示单元130及相关应用程序，移动终端在接收用户对触控显示单元130的输入信号后，进行相应的运算和处理，生成对应的输出信号并传送给显示面板132，从而移动终端可以通过可视可操作的方式与用户进行交互。在优选的一些实施例中，触控面板131和显示面板132由触控显示屏实现。
此外，移动终端还可以包括一个或多个按键，按键可以是实体按键也可以是通过显示单元显示的软键。在一些实施例中，实体按键可以是通过实际压力按压获得输入，实体按键可以包括用于打开/关闭设备电源和锁定设备的按钮、及调节音量的按钮，软键可以通过前述接触的方式获得输入。
在一些实施中，移动终端利用第一电容触控显示屏201和第二电容显示屏202可以检测位于所述移动终端侧面的触摸操作，可以替代现有技术中位于移动终端侧面的实体按键，例如音量调节按键、锁屏按键等。
在可替代的实施例中，移动终端100还可以通过麦克风162接受用于激活一些功能的语音输入，或通过传感器150接受用于激活一些功能的动作输入，例如通过重力传感器获得摇动动作等。
在以下实施例中，如图2所示，所述第一方向O1垂直于所述移动终端100的正面101A，所述的移动终端的正面101A可以是用户使用所述移动终端时观看的其中一面，所述背面101B为所述正面的相对面，所述移动终端的正面101A 和背面101B可以互换，所述移动终端的侧面是用户按照正常观看方向持有所述移动终端时观看面的两侧的面101C和101D，所述第二方向O2平行于所述移动终端的正面101A且平行于所述侧面101C。所述移动终端的侧面101C和101D可以是平面的，也可以是从正面101A向背面101B方向上具有一定弧度的面。
图3示出根据一些实施例提供的手机示例性的剖面示意图，第一电容触控显示屏201包括第一覆盖层211、第一触控显示结构层212及若干第一连接电路结构213，在一些实施例中，所述第一覆盖层211可以为钢化玻璃层，所述第一触控显示结构层212在手机正面分布在中心区域A1对应的手机内腔中，用于为第一触控显示结构层212提供通信或供电的线路可以设置在边框区域A2对应的手机内腔中，在触控显示结构层212中具有若干第一电容感受器501，若干第一电容感受器501以阵列排布，第二电容触控显示屏202包括第二覆盖层221、第二触控显示结构层222及若干第二连接电路结构223，在一些实施例中，所述第二覆盖层211可以为钢化玻璃层，所述的第二触控显示结构层222在手机背面分布在中心区域B1中对应的手机内腔中，用于通信或供电的线路可以设置在边框区域B2中对应的手机内腔中，在第二触控显示结构层222中具有若干第二电容感受器502，若干第二电容感受器502以阵列排布。
手机100的在侧面101D和101C形成支撑外壳。当用户手300，例如拇指触碰侧面101D时，则在第一电容触控显示屏201的触控显示结构层212中邻近(不接触)侧面101D的第一电容感受器501会产生电容信号的变化，并将电容信号通过第一连接电路结构213发送给处理器180，同样，第二电容感受器502会产生电容信号的变化，并通过第二连接电路结构223发送给处理器180，以供处理器180进行检测和识别。
图4(a)示出根据一些实施例提供的用户右手持有移动终端的正面的示例性示意图。图4(b)示出根据一些实施例提供的用户右手持有移动终端的背面的示意图。结合图4(a)和图4(b)，在一些实施例中，所述移动终端100的手机正面101A上具有第一电容触控显示屏201，移动终端100的手机背面101B上具有 第二电容触控显示屏202，用户可以对第一电容触控显示屏201和第二电容触控显示屏202的各种触摸操作输入控制指令，包括通过一个或多个手指、或触控笔接触对应的区域来控制所指向的对象。所述的接触可以包括一次、或多次连续点击、停留在触控显示屏并进行滑动(从左向右、从右向左、向上/或向下、画圈等)。比如，用户一个手指停留在触控显示屏上并进行滑动时，触控显示屏将展示当前页面沿滑动的方向进行平移的过程。所述的两个触控显示屏用于显示与用户进行交互的用户界面，能够以直观地方式展示用户界面，并以易操作地方式展示与用户进行交互。
图4(a)和图4(b)示出用户右手300B持有所述移动终端100时的示意图，结合图4(c)，用户左手300A也可以持有所述移动终端100，不被限制。
图5示出了根据一些实施例提供的移动终端实现操作识别方法的流程图。所述操作识别方法提供了一种用于检测对用户手在所述移动终端侧面的手势操作的方法。
所述方法包括步骤S11～步骤S14，在所述步骤S11中，所述移动终端检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；接着，在步骤S12中，确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围(阈值范围的具体数值根据工艺要求和产品精度具体确定)的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；然后，在所述步骤S13中，根据临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；其后，在所述步骤S14中，根据在所述第一方向上相对的所述第三区域和所述第四区域的面积变化、电容信号强度变化及位置变化中任一项变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用 户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作。
在此，所述用户手与所述侧面的接触区域包括：所述用户手与所述侧面的接触触碰区域；和/或所述用户手与所述侧面的悬浮触碰区域。
所述移动终端在所述正面和所述背面分别具有所述第一电容触控显示屏和所述第二电容触控显示屏，在优选的实施例中，所述第一电容触控显示屏和所述第二电容触控显示屏包括互电容传感器组成的电容感受器，互电容传感器组成的电容感受器支持多点触控功能。在一些实施例中，所述第一电容触控显示屏和所述第二电容触控显示屏还可以是包括由互电容传感器和自电容传感器结合的电容感受器，所述第一电容触控显示屏和所述第二电容触控显示屏可以检测用户手在所述侧面的接触触碰或悬浮触碰。
所述移动终端在其正面和背面分别具有第一电容触控显示屏和第二电容触控显示屏，当用户手(例如手指)从侧面靠近和接触手机时，手指与所述第一电容触控显示屏的电容感受器之间以及与所述第二电容触控显示屏的电容感受器之间都会产生电容效应，从而同时改变所述第一电容触控显示屏上临近所述侧面的靠近手指部位的寄生电容和所述第二电容触控显示屏临近所述侧面的靠近手指部位的寄生电容，且在两个显示屏上相对位置的寄生电容的大小与用户在移动终端侧面的位置有关，故采集所述第一电容触控显示屏和所述第二电容触控显示屏的扫描信号，从中确定关于寄生电容的电容信号，能够确定用户手在所述移动终端侧面的接触位置，进一步通过动态采集扫描信号确定电容信号随时间的变化，确定用户手在所述移动终端的侧面的触控操作。
在一些具体的实施例中，在所述步骤S11中，所述移动终端分别检测所述第一电容触控显示屏的电容信号和所述第二电容触控显示屏的电容信号。
在一些实施例中，以所述第一电容触控显示屏为例，第一电容触控显示屏包括第一方向排布的驱动线和垂直于第一方向排布的感应线，感应线与驱动线交点的位置形成感应点，在每一帧扫描中，处理器控制所述电容触控显示屏中的信号发生器向驱动线逐列发出驱动信号，所述感应线逐行接收感应信号直至 扫描到最后一行后，存储扫描数据；连续采集多帧的扫描数据后进行综合计算(例如取平均值)，从而获得所述第一电容触控显示屏的电容信号的采集数据，所述第一电容触控显示屏上具有阵列分布的多个感应点，所述采集数据包括每个感应点的电容信号。
检测所述第二电容触控显示屏的电容信号的方法参考检测所述第一电容触控显示屏的电容信号的方法，为简明起见，不再赘述。
结合图6(a)和图6(b)，在一些实施例中，当用户手300(例如手指)触摸手机正面101A时，在正面101A的第一电容触控显示屏201上接收到的示例性电容信号如图6(a)所示；结合图6(b)，当用户手300触摸手机侧面101D时，在正面101A的第一电容触控显示屏201上接收到的电容信号和在背面101B的第二电容触控显示屏202上的接收到的电容信号如图6(b)所示。
接着，在所述步骤S12中，确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上的电容信号满足所述接触电容变化阈值范围的至少一个第二区域。
接前述实施例，继续参考图6(a)和图6(b)，根据所述第一电容触控显示屏201的电容信号和第二电容触控显示屏202的采集数据，分别确定双屏上每一所述感应点的电容信号Cp。
在一些具体实施例中，当电容感受器采集到的电容信号Cp达到电容变化阈值范围(例如超过设定的电容变化阈值时)，手机100确定手势操作动作开始发生。在超过电容变化阈值的数个采样周期内(例如为20个)，移动终端100通过求解能够采集到有效的电容信号CP的感应点的几何中心的方法，获得手的运动中心。这个电容感受器连同周围的数个(暂定为左右各一个)电容感受器上的电容信号Cp会被单独提取出来，进行几何运算(例如求解算术平均值)，确定有效的电容信号Cp及其对应的感应点的位置，并按照时间依次存储数据，用作手势分析。
在一些实施例中，电容变化阈值范围可以设定为在第一电容触控显示屏201上大于Ct1，在第二电容显示屏202上大于Ct2，其中，Ct1和Ct2可以相同或 不同，根据两个电容触控显示屏的自身性能具体确定Ct1和Ct2。
当所述电容信号Cp满足电容变化阈值范围时，则确定对应感应点存在触控感应，接着将存在触控感应的相邻的多个感应点组合，形成第一区域，所述第一区域可以是一个区域或多个不相邻的区域。
确定所述第二电容触控显示屏上的至少一个第二区域的方法参考所述所述第一电容触控显示屏上的至少一个第一区域的方法，为简明起见，不再赘述。
结合图7(a)和图7(b)所示，当用户手如图4(a)和图4(b)所示持有所述移动终端时，在移动终端100的正面101A形成的若干第一区域601及在移动终端100的背面101B的若干第二区域602。
接着，在所述步骤S13中，根据临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面。
结合图8(a)和图8(b)，所述临近侧面的区域700在所述移动终端100的正面的侧面向中心的设定宽度内的区域，该区域中包括若干列电容感受器，所设定的宽度可以根据电容感受器的灵敏度确定。
从所述第一区域601和第二区域602中，确定位于所述临近侧面的区域700中，且在所述第一方面O1上投影部分重叠或全部重叠的多组第三区域和第四区域，例如：第三区域603a和第四区域604a，第三区域603b和第四区域604b，第三区域603c和第四区域604c，第三区域603d和第四区域604d，第三区域603e和第四区域604e，第三区域603f和第四区域604f，每个所述第三区域(603a～603f)位于所述第一区域601中，每个所述第四区域(604a～604f)位于所述第二区域602中。
所述第三区域(603a～603f)为所述第一电容触控显示屏201上临近所述侧面的区域700中第一区域601的全部或部分区域，所述第四区域(604a～604f)为所述第二电容触控显示屏202上临近所述侧面的区域700中第二区域602的全部 或部分区域，根据在第一方向O1上对应的成组的所述第三区域和所述第四区域，确定成组的第三区域和所述第四区域之间的侧面区域，为所述用户手与所述侧面的接触区域。
所述用户在握持手机时，几个手指及部分手掌都可能与所述移动终端的侧面相接触，因此，所述用户手与所述侧面的接触区域可以是一个，也可以是多个不连续的区域，并且，所述手机具有两个侧面，所述用户手在每个所述侧面都可以具有接触区域，可以是一个，也可以是多个。如图8(c)所示，根据图8(a)和图8(b)多组相对的第三区域和第四区域所确定的用户手在侧面的多个接触位置(801a～801f)，包括：第三区域603a和第四区域604a确定的801a，第三区域603b和第四区域604b确定的801b，第三区域603c和第四区域604c确定的801c，第三区域603d和第四区域604d确定的801d，第三区域603e和第四区域604e确定的801e，第三区域603f和第四区域604f确定的801f。
在一些实施例中，一个所述第三区域和一个所述第四区域在第一方向上相对形成一组，成组的所述第三区域和所述第四区域的面积并不一定完全相同或正对，例如，当所述用户手在所述侧面101C或101D的接触位置到所述第一电容触控显示屏101A的距离小于到所述第二电容触控显示屏101B的距离时，成组所述第三区域的面积可能大于所述第四区域的面积(例如，图8(a)和图8(b)的第三区域603e和第四区域604e)，反之，所述第三区域的面积可能小于所述第四区域的面积(例如，图8(a)和图8(b)的第三区域603a和第四区域604a)。
在一些实施例中，当所述第三区域603和所述第四区域604相对的面积满足预设的面积阈值，或面积比例满足预设的面积比例阈值时，可确定用户手接触了第三区域603和第四区域604之间的所述侧面的区域。
在一些实施例中，根据相对应的所述所述第三区域603和所述第四区域604的分布，确定用户手在所述侧面接触时相对于所述第二方向的倾斜方向。当用户的拇指与所述侧面接触时，拇指接触在侧面上时，拇指从指根向指尖的延伸方向可能平行于所述移动终端正面也可能倾斜于所述移动终端的正面，如果检测到所述拇指在所述所述侧面接触时所确定的所述第三区域603和所述第四区 域604不完全正对，则可根据二者的面积的位置关系确定拇指倾斜于所述移动终端正面的倾斜角度。例如，所述第三区域603和所述第四区域604的面积大小相同，但是投影不完全重合，所述第三区域603在第二方向上的位置更接近手机的顶面，则可推测拇指倾斜于正面，且拇指由指根向上，向正面方向延伸。
在一些实施例中，如图9所示，根据在所述第一方向上相对的所述第三区域603和所述第四区域604的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置XO2；根据在所述第一方向上相对的所述第三区域603和所述第四区域604的面积关系，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第一方向的第二位置XO1。
然后，在后续步骤S14中，可以根据所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
接着，在所述步骤S14中，根据在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化(区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化)，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作。
在一些实施例中，在所述步骤S14中，响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
在一些实施例中，在所述步骤S14中，响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触 区域的沿所述第一方向的移动；根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
图11根据在所述第一方向上相对的所述第三区域和所述第四区域的电容信号强度随时间的一定变化，确定用户手在所述侧面上的接触区域沿第一方向的移动的方法示意图。其中，各个第三区域的区域电容信号强度可以是每个第三区域内的平均电容信号强度，也可以是区域内最大电容信号强度。
如图11所示，从时间T0、T1到时间T2，在第一电容触控显示屏201上检测到第三区域603的电容信号强度为CPT0、CPT1、CPT2，CPT0>CPT1>CPT2，在第二电容触控显示屏201上检测到的对应的第四区域603的信号强度为C’PT0、C’PT1、C’PT2，C’PT0<C’PT1<C’PT2，从时间T0、T1到时间T2，在第三区域603的电容信号强度由强变弱，第四区域604的电容信号强度由弱变强，可确定用户手在此侧面的接触区沿第一方向O1从正面101A向背面101B的方向滑动，手势操作如图10所示。此外，CP2和C’P2为手掌接触到侧边框的电容信号，在T0、T1到时间T2没有变化，说明并未移动。
在一些实施例中，对应正面101A和背面101B而言，随着拇指的接近和远离，平均电容信号的值均会先变大后变小。但是由于拇指从第一电容触控显示屏滑向第二电容触控显示屏，所以第一电容触控显示屏上采样获得的电容信号极大值对应的时间点会早于第二电容触控显示屏上的极大值时间点。当拇指从第一电容触控显示屏划向第二电容触控显示屏时，手机100也可以通过极大值点的出现时间先后来判断划过屏幕的先后顺序，从而确定拇指的手势操作方向。
在一些实施例中，当拇指不是从第一电容触控显示屏划向第二电容触控显示屏，而是从侧面(C面或D面)的中框向两边(A面或B面)划动时，那么第一电容触控显示屏采集到的电容信号依然会有极大值，而第二电容触控显示屏采集到的数据没有极大值，从而可以确定手指是从中框划向A面。
在一些实施例中，根据在所述第一方向上相对的、所述第三区域603和所述第四区域604在第二方向上相对移动，确定所述用户手在所述侧面上的接触 区域的沿所述第二方向的移动，接着，根据所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
图13示出在一些实施例中提供的根据在所述第一方向上相对的所述第三区域603和所述第四区域604的电容信号随时间的变化确定用户手在所述侧面上的接触区域沿第二方向的移动的方法示意图。从时间T0、T1到时间T2，在A面的第三区域603沿X方向移动，在B面相对的第四区域604同样沿X方向移动，可确定用户手在此侧面的接触区沿第二方向O2移动，并且具体确定沿第二方向O2从上向下滑动，手势操作如图12所示。
图14(a)～图14(c)示出在一些实施例中提供的所述第三区域603和所述第四区域604相对的面积的变化及位置变化的方法示意图。
根据图14(a)和图14(b)所示，一组相对的所述第三区域603和所述第四区域604从901a所示的位置变化为901b所示的位置，所述第三区域603的面积减小、第四区域的面积增大，则可确定用户手在所述第三区域603和所述第四区域604之间的侧面的对应接触区沿第一方向O1从正面101A滑向背面102B，可确定手势操作如图10所示。
根据图14(a)和图14(c)所示，所述第三区域603和所述第四区域604从901a所示的位置变化为901c所示的位置，所述第三区域603和第四区域同时沿第二方向移动，则可确定用户手在此侧面的接触区沿第二方向O2从上向下滑动，手势操作如图12所示。
在一些实施例中，根据在所述第一方向上相对的、所述第三区域和所述第四区域在第一时间阈值内出现后，同时消失(或在一定的误差时间范围内同时消失)，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，接着，根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
在一些实施例中，根据如图8所确定的中心点位置(XO1，XO2)，动态监测中心位置随时间的移动，可以确定用户手在侧面的接触区域的动态变化，进一 步确定所述用户手在所述侧面的手势操作。
在实际场景实施例中，上述确定所述用户手在所述侧面的接触区域的动态变化的实施例可以结合使用。
由于所确定的用户手与所述侧面的接触区域可以是一个，也可以是多个不连续的区域，在一些实施例中，当具有多个，可以根据所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作，实现多点手势的操作识别。
在一些实施例中，通过移动终端的双电容触控显示屏的电学特性，根据检测的双电容触控显示屏的电容信号确定用户手在所述移动终端侧面的接触区域及其动态变化，无需在所述移动终端的侧面增加感应器来感应手势，即可确定所述手在所述侧面的手势操作，提高了对侧面手势识别的灵敏度，从而实现准确地识别用户手对所述侧面的手势操作。
并且，根据移动终端的双电容触控显示屏的电容信号的变化，可以确定用户手在所述侧面的接触区域的动态变化，进一步确定用户手在所述侧面的手势操作，包括纵向滑动(在侧面上从上到下的滑动)、垂向滑动(在侧面上的从正面向背面的滑动，或从背面向正面的滑动)、点击等手势操作，增加了可识别操作的多样性，比现有技术中设置在移动终端侧面的物理按键具有更佳的操作灵活性，提高用户体验。
在一些实施例中，所述操作识别方法可替代所述物理按键识别用户对侧面的手势操作，在移动终端的侧面可不再设置物理按键，从而帮助提高移动终端的外观的流畅性和美观性。
在一些实施例中，所述操作方法还包括步骤S15、步骤S16和步骤S17；其中，在所述步骤S15中，移动终端检测当前正在运行的应用程序；在所述步骤S16中，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；在所述步骤S17中，执行所述操作指令。
在所述步骤S15中，所述移动终端检测当前正在运行的应用程序，在一些 实施例中，检测当前在所述移动终端的第一电容触控显示屏或第二电容触控显示屏上所显示的界面为***界面还是应用界面，当为***界面，则检测当前***界面的应用程序，当为应用界面，则检测对应应用的应用程序。
在一些实施例中，所述***界面可以是***桌面界面、通话界面、短信阅览界面等，在一些实施例中，所述应用界面可以是音乐播放界面、电子书阅览界面、录音界面等。
接着，在所述步骤S16中，将在所述步骤检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令，其中，所述操作指令包括***作对象和执行内容。
在一些实施例中，若检测到当前为***桌面界面或所述电子书阅览界面，且检测到所述所述用户手在所述侧面的沿所述第一方向的滑动操作，可将该滑动操作识别为对所述***桌面界面进行翻屏或对所述电子书阅览界面进行翻页的指令。
在一些实施例中，若检测到当前为通话界面或音乐播放界面，且检测到所述所述用户手在所述侧面的沿所述第二方向的滑动操作，可将该滑动操作识别为调整音量的指令。
在一些实施例中，若检测到当前为短信界面或电子书阅览界面，且检测到所述所述用户手在所述侧面的沿所述第二方向的滑动操作，可将该滑动操作识别为移动显示短信列表或移动显示电子书的指令。
在一些实施例中，若检测到当前为音乐播放界面或录音界面，且检测到所述所述用户手在所述侧面的点击操作，可将该点击操作识别为暂停/继续播放音乐或录音的指令。
在一些实施例中，为区分用户正常握持无操作意图背景下的随意滑动和有操作意图下的手势操作，可以预先设定一个侧边手势操作的预设启动手势操作(唤醒手势)。具体地，在所述步骤S16中，检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识 别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令。例如，设定从正面划向背面再划回正面，是一个唤醒手势。从这个唤醒手势之后，启动关联识别，将检测到的所述用户手在所述侧面的手势操作与所述应用程序相关联。
在一些实施例中，所述步骤S16还包括在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。启动关联识别后，在一定时间内将检测到的所述用户手在所述侧面的手势操作与所述应用程序相关联，当手势操作停止一段预设时间(例如5秒)后，则可以被认为是手势操作流程结束，关闭关联识别。若要继续进行对侧面的手势操作与所述应用程序的关联，需要重新唤醒。
在一些实施例中，所述方法通过为***或不同应用，对手势操作的不同运动赋予不同的操作含义(例如音量增减、歌曲切换、电子书翻页)时，检测当前所在***或不同应用的应用程序，将手势操作与应用程序进行关联，当实现关联后，正确的手势操作发生作用，产生对应的操作指令，移动终端会执行手势操作指令。
所述操作识别方法还能够根据所述第一电容触控显示屏上的电容信号和所述第二电容触控显示屏上的电容信号确定用户手握持移动终端时，手掌和手指的接触位置，从而确定握持手以及握持手势。
具体地，所述方法包括步骤S18，在所述步骤S18中，对所述第一区域、所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。在一些实施例中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
在一些实施例中，所述手势图形识别的过程可以是根据所述第一区域、所述第二区域，与一些预设手势图形进行图形比对，当与任一预设手势图形的图形比对满足比对条件时，则根据该预设手势图形确定所述用户手的握持姿势，握持的左手或右手、手掌和手指在所述移动终端的接触位置。
在一些实施例中，当确定所述手指在所述移动终端的接触位置时，可以分 别确定所述拇指在所述侧面的接触位置及其他四指的一个或多个在另一所述侧面的接触位置。
在一些实施例中，当确定所述拇指的接触位置时，将所述拇指的手势操作确定为有效的手势操作，动态检测靠近所述拇指的接触位置所述第三区域和所述第四区域的面积变化、电容信号强度变化及位置变化中任一项变化，确定拇指在所述侧面的接触区域的动态变化，确定有效的手势操作，可以避免无意图的接触对操作识别的干扰。
在一些实施例中，当确定所述拇指在一个侧面的接触位置及其他四指的一个或多个在另一所述侧面的接触位置时，将所述拇指的手势操作和其他四指的一个或多个在另一所述侧面的接触位置确定为有效的手势操作，动态检测靠近所述拇指及其他四指中一个或多个的接触位置的所述第三区域和所述第四区域的面积变化、电容信号强度变化及位置变化中任一项变化，确定所述侧面的接触区域的动态变化，确定有效的多点手势操作，避免无意图的接触对操作识别的干扰的同时，可识别多点手势操作，提高手势多样性和灵活性。
在一些实施例中，所述方法还包括步骤S19(图中未示出)和步骤S20(图中未示出)当确定所述手掌贴近所述移动终端的一面(正面或背面)时，则相对的一面可以确定为当前所述用户正在查看的显示屏，可以选择在所确定的所述用户正在查看的显示屏上显示信息。在一些实施例中，所述手掌贴近所述移动终端的一面的显示屏可以自动关闭显示，可以节省电源消耗。
结合图15和图16，在手机实现的操作识别方法的流程示意图；当用户手握持手机时，处理器控制所述第一电容触控显示屏和第二电容触控显示屏上的电容感应区域进行感应，确定满足电容变化阈值范围的第一区域和第二区域，处理器对第一区域和第二区域进行手势图形识别，确定用户手的皮肤在侧面的接触位置、并确定握持手势；接着，动态检测用户手在侧面的接触位置是否有变化，若无变化则无操作动作，若有变化，则判断各电容触控显示屏(即电容屏)上感应区域中接触位置的移动，当各电容感应区域变化，确定用户手接触位置为沿侧面上下移动，进而确定用户手在侧面(即边框)上下滑动，当个电 容感应区域大小变化，确定皮肤在侧面的相对位置发生变化，即接触位置的前后移动，进而确定用户手在垂直屏幕(第一电容触控显示屏)的方向上前后滑动；当确定用户手在侧边框的手势操作，检测当前的应用程序，例如检测到当前为音乐播放应用，用户手在侧边框上下滑动，则将二者相关联，确定调节音量的操作指令，则执行操作指令，调节当前音乐播放的音量大小，实现相应功能。
图17示出根据一些实施例提供的一种用于操作识别的装置，其中，所述装置包括：信号检测模块11、第一区域检测模块12、第二区域检测模块13和动态检测模块14。
其中，所述信号检测模块11检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；所述第一区域检测模块12确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；所述第二区域检测模块13响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；所述动态检测模块14响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
在一些实施例中，所述第二区域检测模块13包括：第一接触区域检测子单元，所述第一接触区域检测子单元响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的相对面积满足预设的面积阈值，或面积比例满足预 设的面积比例阈值时，确定所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域。
在一些实施例中，所述第二区域检测模块13还包括：第一位置检测子单元，用于根据在所述第一方向上相对的所述第三区域和所述第四区域的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置；第二位置检测子单元，用于根据在所述第一方向上相对的所述第三区域和所述第四区域的面积关系，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第一方向的第二位置；相应地，所述动态检测模块还包括：第一动态检测子单元，用于响应于检测到所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
在一些实施例中，所述动态检测模块14包括：第一移动确定子单元和第一操作确定子单元，所述第一移动确定子单元响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；所述第一操作确定子单元根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
在一些实施例中，所述动态检测模块14包括：第二移动确定子单元和第二操作确定子单元，所述第二移动确定子单元响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；所述第二操作确定子单元根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
在一些实施例中，所述动态检测模块14包括：第三移动确定子单元和第三操作确定子单元，所述第三移动确定子单元响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第二方向上的位置的随时间相对移动，确定所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，其中，所述第二方向平行于所述移动终端的正面且平行于所述侧面；所述第三操作确定子单元根据所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
在一些实施例中，所述动态检测模块14包括：第四移动确定子单元和第四操作确定子单元，所述第四移动确定子单元响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第一时间阈值内出现后同时消失，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开；所述第四操作确定子单元，用于根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
在一些实施例中，所述第二区域检测模块13包括：第二接触区域检测子单元和第二动态检测子单元，所述第二接触区域检测子单元确定多个侧面区域为所述用户手与所述侧面的多个接触区域；所述动态检测模块包括：所述第二动态检测子单元响应于检测所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作。
所述信号检测模块11及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S11所述的内容、所述第一区域检测模块12及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S12所述的内容、所述第二区域检测模块13及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S13所述的内容和动态检测模块14及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S14所述的内容，不再赘述，并以引用的方式包含于此。
图17示出根据一些实施例提供的装置的示例性结构框图，所述装置在图16基础上，还包括：数据检测模块15、指令检测模块16和执行模块17。所述 数据检测模块15检测当前正在运行的应用程序；所述指令检测模块16响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；所述执行模块17执行所述操作指令。
在一些实施例中，所述指令检测模块16包括：手势检测子单元和指令检测子单元。所述手势检测子单元检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；所述指令检测子单元响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令。
在一些实施例中，所述指令检测模块16还包括：关闭子单元，所述关闭子单元在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。
所述数据检测模块15及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S15所述的内容，所述指令检测模块16及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S16所述的内容，所述执行模块17及其包含的各子单元所实现功能的内容参考前述一些实施例中方法所述步骤S17所述的内容，不再赘述，并以引用的方式包含于此。
图18示出根据一些实施例提供的操作识别的装置的示意性结构框图，所述装置在图17的实施例的基础上，还包括：姿势检测模块18，所述姿势检测模块18对所述第一区域和所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。其中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
在一些实施例中，所述装置还包括：显示屏检测模块(图中未示出)和显示模块(图中未示出)，所述显示屏检测模块根据所述用户手的握持姿势，确定当前所述用户正在查看的显示屏，所述显示屏为所述第一电容触控显示屏或所述第二电容显示屏；所述显示模块在所述用户正在查看的显示屏上，显示信息。
所述姿势检测模块18及其包含的各子单元所实现功能的内容参考前述一 些实施例中方法所述步骤S18所述的内容，显示屏检测模块和显示模块分别参考步骤S19和步骤S20的内容，不再赘述，并以引用的方式包含于此。

Claims (45)

  1. 一种用于移动终端的操作识别方法，其中，所述操作识别方法包括：
    检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；
    确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；
    响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；
    响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
  2. 根据权利要求1所述的操作识别方法，其中，所述的确定所述用户手与所述侧面的接触区域的步骤包括：
    响应于检测到所述第一方向上相对的所述第三区域和所述第四区域的相对面积满足预设的面积阈值，或面积比例满足预设的面积比例阈值时，确定所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域。
  3. 根据权利要求1或2所述的操作识别方法，其中，
    所述的确定所述用户手与所述侧面的接触区域的步骤还包括：
    根据在所述第一方向上相对的所述第三区域和所述第四区域的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置；
    根据在所述第一方向上相对的所述第三区域和所述第四区域的面积关系，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第一方向的第二位置；
    所述的确定所述用户手在所述侧面的手势操作的步骤还包括：
    响应于检测到所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
  4. 根据权利要求1或2所述的操作识别方法，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  5. 根据权利要求1或2所述的操作识别方法，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  6. 根据权利要求1或2所述的操作识别方法，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第二方向上的位置的随时间相对移动，确定所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，其中，所述第二方向平行于所述移动终端的正面且平行于所述侧面；
    根据所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
  7. 根据权利要求1或2中所述的操作识别方法，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第一时间阈值内出现后同时消失，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开；
    根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
  8. 根据权利要求1至7中任一项所述的操作识别方法，其中，
    所述的确定所述用户手与所述侧面的接触区域的步骤包括：
    确定多个侧面区域为所述用户手与所述侧面的多个接触区域；
    所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作。
  9. 根据权利要求1至8中任一项所述的操作识别方法，其中，所述操作识别方法还包括：
    检测当前正在运行的应用程序；
    响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；
    执行所述操作指令。
  10. 根据权利要求9所述的操作识别方法，其中，所述的确定操作指令的步骤包括：
    检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；
    响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令。
  11. 根据权利要求10所述的操作识别方法，其中，所述的确定操作指令的步骤还包括：
    在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。
  12. 根据权利要求1至11中任一项所述的操作识别方法，其中，所述操作识别方法还包括：
    对所述第一区域和所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。
  13. 根据权利要求12所述的操作识别方法，其中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
  14. 根据权利要求13所述的操作识别方法，其中，所述操作识别方法还包括：
    根据所述用户手的握持姿势，确定当前所述用户正在查看的显示屏，所述显示屏为所述第一电容触控显示屏或所述第二电容显示屏；
    在所述用户正在查看的显示屏上，显示信息。
  15. 根据权利要求1至14中任一项所述的操作识别方法，其中，所述用户手与所述侧面的接触区域包括：
    所述用户手与所述侧面的接触触碰区域；和/或
    所述用户手与所述侧面的悬浮触碰区域。
  16. 一种移动终端，其中，所述移动终端包括：
    一个触控显示单元；
    一个或多个处理器；
    存储器；
    多个应用程序；及
    所述存储器，用于存储计算机程序；
    所述处理器，用于运行所述计算机程序，执行下述流程：
    检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述第二电容触控显示屏位于所述移动终端的背面；
    确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；
    响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；
    响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
  17. 根据权利要求16所述的移动终端，其中，所述的确定所述用户手与所述侧面的接触区域的步骤包括：
    响应于检测到所述第一方向上相对的所述第三区域和所述第四区域的相对面积满足预设的面积阈值，或面积比例满足预设的面积比例阈值时，确定所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域。
  18. 根据权利要求16或17所述的移动终端，其中，
    所述的确定所述用户手与所述侧面的接触区域的步骤还包括：
    根据在所述第一方向上相对的所述第三区域和所述第四区域的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置；
    根据在所述第一方向上相对的所述第三区域和所述第四区域的面积关系，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第一方向的第二位置；
    所述的确定所述用户手在所述侧面的手势操作的步骤还包括：
    响应于检测到所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
  19. 根据权利要求17或18所述的移动终端，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  20. 根据权利要求17或18所述的移动终端，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  21. 根据权利要求17或18所述的移动终端，其中，所述的确定所述用户 手在所述侧面的手势操作的步骤包括：
    响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第二方向上的位置的随时间相对移动，确定所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，其中，所述第二方向平行于所述移动终端的正面且平行于所述侧面；
    根据所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
  22. 根据权利要求17或18所述的移动终端，其中，所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第一时间阈值内出现后同时消失，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开；
    根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
  23. 根据权利要求16至22中任一项所述的移动终端，其中，
    所述的确定所述用户手与所述侧面的接触区域的步骤包括：
    确定多个侧面区域为所述用户手与所述侧面的多个接触区域；
    所述的确定所述用户手在所述侧面的手势操作的步骤包括：
    响应于检测所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作。
  24. 根据权利要求16至23中任一项所述的移动终端，其中，所述操作识别方法还包括：
    检测当前正在运行的应用程序；
    响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；
    执行所述操作指令。
  25. 根据权利要求24所述的移动终端，其中，所述的确定操作指令的步 骤包括：
    检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；
    响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令。
  26. 根据权利要求25所述的移动终端，其中，所述的确定操作指令的步骤还包括：
    在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。
  27. 根据权利要求15至26中任一项所述的移动终端，其中，所述操作识别方法还包括：
    对所述第一区域和所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。
  28. 根据权利要求27所述的移动终端，其中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
  29. 根据权利要求28所述的移动终端，其中，所述操作识别方法还包括：
    根据所述用户手的握持姿势，确定当前所述用户正在查看的显示屏，所述显示屏为所述第一电容触控显示屏或所述第二电容显示屏；
    在所述用户正在查看的显示屏上，显示信息。
  30. 根据权利要求15至29中任一项所述的移动终端，其中，所述用户手与所述侧面的接触区域包括：
    所述用户手与所述侧面的接触触碰区域；和/或
    所述用户手与所述侧面的悬浮触碰区域。
  31. 一种用于操作识别的装置，其中，所述装置包括：
    信号检测模块，用于检测第一电容触控显示屏和第二电容触控显示屏的电容信号，其中，所述第一电容触控显示屏位于所述移动终端的正面，所述 第二电容触控显示屏位于所述移动终端的背面；
    第一区域检测模块，用于确定所述第一电容触控显示屏上电容信号满足电容变化阈值范围的至少一个第一区域，并确定所述第二电容触控显示屏上电容信号满足所述电容变化阈值范围的至少一个第二区域；
    第二区域检测模块，用于响应于检测到临近同一所述侧面的、且在所述第一方向上相对的第三区域和所述第四区域，确定该相对的每一组所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域，其中，每一所述第三区域为所述第一区域的全部或部分区域，每一所述第四区域为所述第四区域的全部或部分区域，所述第一方向垂直于所述移动终端的正面；
    动态检测模块，用于响应于检测到在所述第一方向上相对的所述第三区域和所述第四区域的的区域变化，确定所述用户手在所述侧面的接触区域的动态变化，并根据所述用户手在所述侧面的接触区域的动态变化，确定所述用户手在所述侧面的手势操作，其中，所述区域变化包括区域面积变化、区域电容信号强度变化及区域位置变化中任一项变化。
  32. 根据权利要求31所述的装置，其中，所述第二区域检测模块包括：
    第一接触区域检测子单元，用于响应于检测到所述第一方向上相对的所述第三区域和所述第四区域的相对面积满足预设的面积阈值，或面积比例满足预设的面积比例阈值时，确定所述第三区域和所述第四区域之间的侧面区域为所述用户手与所述侧面的接触区域。
  33. 根据权利要求31或32所述的装置，其中，
    所述第二区域检测模块还包括：
    第一位置检测子单元，用于根据在所述第一方向上相对的所述第三区域和所述第四区域的相对位置，确定所述用户手在所述侧面上的接触位置的中心在所述侧面上沿所述第二方向上的第一位置；
    第二位置检测子单元，用于根据在所述第一方向上相对的所述第三区域和所述第四区域的面积关系，确定所述用户手在所述侧面上的接触位置的中 心在所述侧面上沿所述第一方向的第二位置；
    所述动态检测模块还包括：
    第一动态检测子单元，用于响应于检测到所述第一位置和所述第二位置在所述侧面上的随时间的位置变化，确定所述用户手在所述侧面的手势操作。
  34. 根据权利要求31或32所述的装置，其中，所述动态检测模块包括：
    第一移动确定子单元，用于响应于检测到在所述第一方向上相对的所述第三区域的区域面积随时间由小变大同时所述第四区域的区域面积由大变小，或所述第三区域的区域面积随时间由大变小同时所述第四区域的区域面积由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    第一操作确定子单元，用于根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  35. 根据权利要求31或32所述的装置，其中，所述动态检测模块包括：
    第二移动确定子单元，用于响应于检测到在所述第一方向上相对的所述第三区域的区域电容信号随时间由小变大同时所述第四区域的区域电容信号由大变小，或相对的所述第三区域的区域电容信号随时间由大变小同时所述第四区域的区域电容信号由小变大，确定所述用户手在所述侧面上的接触区域的沿所述第一方向的移动；
    第二操作确定子单元，用于根据所述用户手在所述侧面上的接触区域的沿所述第一方向的移动，确定所述用户手在所述侧面的沿所述第一方向的滑动操作。
  36. 根据权利要求31或32中所述的装置，其中，所述动态检测模块包括：
    第三移动确定子单元，用于响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第二方向上的位置的随时间相对移动，确定所述用户手在所述侧面上的接触区域的沿所述第二方向的移动，其中，所述第二方向平行于所述移动终端的正面且平行于所述侧面；
    第三操作确定子单元，用于根据所述用户手在所述侧面上的接触区域的 沿所述第二方向的移动，确定所述用户手在所述侧面的沿所述第二方向的滑动操作。
  37. 根据权利要求31或32中任一项所述的装置，其中，所述动态检测模块包括：
    第四移动确定子单元，用于响应于检测在所述第一方向上相对的所述第三区域和所述第四区域在第一时间阈值内出现后同时消失，确定所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开；
    第四操作确定子单元，用于根据所述用户手与所述侧面的接触区域在第一时间阈值内接触后离开，确定所述用户手在所述侧面的点击操作。
  38. 根据权利要求31至37中任一项所述的装置，其中，
    所述第二区域检测模块包括：
    第二接触区域检测子单元，用于确定多个侧面区域为所述用户手与所述侧面的多个接触区域；
    所述动态检测模块包括：
    第二动态检测子单元，用于响应于检测所述用户手在所述侧面的多个接触区域的动态变化，确定所述用户手在所述侧面的多点手势操作。
  39. 根据权利要求31至38中任一项所述的装置，其中，所述装置还包括：
    数据检测模块，用于检测当前正在运行的应用程序；
    指令检测模块，用于响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作指令；
    执行模块，用于执行所述操作指令。
  40. 根据权利要求39所述的装置，其中，所述指令检测模块包括：
    手势检测子单元，用于检测第一手势启动操作，所述第一手势启动操作包括所述用户手在所述侧面的预设启动手势操作；
    指令检测子单元，用于响应于检测到所述第一手势启动操作，启动将所述手势操作与所述应用程序相关联的关联识别，响应于检测到的所述用户手在所述侧面的手势操作，将所述手势操作与所述应用程序相关联，确定操作 指令。
  41. 根据权利要求40所述的装置，其中，所述指令检测模块还包括：
    关闭子单元，用于在启动关联识别后，在预设时间内未检测到所述用户手在所述侧面的手势操作，关闭关联识别。
  42. 根据权利要求31至41中任一项所述的装置，其中，所述装置还包括：
    姿势检测模块，用于对所述第一区域和所述第二区域组合进行手势图形识别，确定所述用户手的握持姿势。
  43. 根据权利要求42所述的装置，其中，所述用户手的握持姿势包括握持的左手或右手、手掌和手指在所述移动终端上接触位置。
  44. 根据权利要求43所述的装置，其中，所述装置还包括：
    显示屏检测模块，用于根据所述用户手的握持姿势，确定当前所述用户正在查看的显示屏，所述显示屏为所述第一电容触控显示屏或所述第二电容显示屏；
    显示模块，用于在所述用户正在查看的显示屏上，显示信息。
  45. 根据权利要求31至44中任一项所述的装置，其中，所述用户手与所述侧面的接触区域包括：
    所述用户手与所述侧面的接触触碰区域；和/或
    所述用户手与所述侧面的悬浮触碰区域。
PCT/CN2016/101811 2016-10-11 2016-10-11 识别操作的方法、装置及移动终端 WO2018068207A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US16/340,945 US10739927B2 (en) 2016-10-11 2016-10-11 Operation detection method and apparatus, and mobile terminal
PCT/CN2016/101811 WO2018068207A1 (zh) 2016-10-11 2016-10-11 识别操作的方法、装置及移动终端
CN201680090039.4A CN109804339B (zh) 2016-10-11 2016-10-11 识别操作的方法、装置及移动终端

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/101811 WO2018068207A1 (zh) 2016-10-11 2016-10-11 识别操作的方法、装置及移动终端

Publications (1)

Publication Number Publication Date
WO2018068207A1 true WO2018068207A1 (zh) 2018-04-19

Family

ID=61904965

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/101811 WO2018068207A1 (zh) 2016-10-11 2016-10-11 识别操作的方法、装置及移动终端

Country Status (3)

Country Link
US (1) US10739927B2 (zh)
CN (1) CN109804339B (zh)
WO (1) WO2018068207A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109669616A (zh) * 2018-12-26 2019-04-23 努比亚技术有限公司 一种侧屏交互控制方法、设备及计算机可读存储介质
CN110297583A (zh) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 电子设备及电子设备的控制方法

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11089446B2 (en) * 2018-01-11 2021-08-10 Htc Corporation Portable electronic device, operating method for the same, and non-transitory computer readable recording medium
US20210194481A1 (en) * 2018-09-07 2021-06-24 Azoteq (Pty) Ltd Dynamic capacitive sensing
CN111381907B (zh) * 2018-12-27 2024-02-20 北京小米移动软件有限公司 应用界面显示位置切换方法、装置以及存储介质
CN112486346B (zh) 2019-09-12 2023-05-30 北京小米移动软件有限公司 按键模式设置方法、装置及存储介质
US11907526B2 (en) 2019-12-09 2024-02-20 Huawei Technologies Co., Ltd. Touch region adjustment method and apparatus for determining a grasping gesture of a user on an electronic device
CN113031802A (zh) * 2019-12-09 2021-06-25 华为终端有限公司 一种触控区域调整方法及装置
CN111562811B (zh) * 2020-04-27 2022-09-02 维沃移动通信有限公司 电子设备及触控操作的控制方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102662463A (zh) * 2012-03-22 2012-09-12 上海华勤通讯技术有限公司 移动终端及识别方法
CN104375724A (zh) * 2014-10-30 2015-02-25 惠州Tcl移动通信有限公司 移动终端及其触控操作方法
CN105511675A (zh) * 2015-11-20 2016-04-20 努比亚技术有限公司 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端
CN105868607A (zh) * 2016-03-25 2016-08-17 乐视控股（北京）有限公司 一种终端的控制方法及装置
US20160259521A1 (en) * 2012-07-18 2016-09-08 Sony Mobile Communications Inc. Mobile terminal device, operation method, program, and storage medium

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7956847B2 (en) * 2007-01-05 2011-06-07 Apple Inc. Gestures for controlling, manipulating, and editing of media files using touch sensitive devices
US20090174679A1 (en) * 2008-01-04 2009-07-09 Wayne Carl Westerman Selective Rejection of Touch Contacts in an Edge Region of a Touch Surface
KR101537596B1 (ko) * 2008-10-15 2015-07-20 엘지전자 주식회사 이동 단말기 및 이것의 터치 인식 방법
US20100107067A1 (en) * 2008-10-27 2010-04-29 Nokia Corporation Input on touch based user interfaces
US9122356B2 (en) * 2008-10-30 2015-09-01 Dell Products L.P. Virtual periphery display buttons
KR101572071B1 (ko) * 2009-01-06 2015-11-26 삼성전자주식회사 휴대단말 표시부의 온/오프 제어 방법 및 장치
US8836648B2 (en) * 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US9310994B2 (en) 2010-02-19 2016-04-12 Microsoft Technology Licensing, Llc Use of bezel as an input mechanism
US20110209098A1 (en) 2010-02-19 2011-08-25 Hinckley Kenneth P On and Off-Screen Gesture Combinations
US9965165B2 (en) 2010-02-19 2018-05-08 Microsoft Technology Licensing, Llc Multi-finger gestures
US9274682B2 (en) * 2010-02-19 2016-03-01 Microsoft Technology Licensing, Llc Off-screen gestures to create on-screen input
CN103221914B (zh) * 2010-09-24 2020-01-31 黑莓有限公司 便携式电子设备及其控制方法
US9423876B2 (en) * 2011-09-30 2016-08-23 Microsoft Technology Licensing, Llc Omni-spatial gesture input
KR102060155B1 (ko) * 2013-01-11 2019-12-27 삼성전자주식회사 양면 디스플레이를 사용하는 전자장치의 멀티태스킹 제어 방법 및 장치
US20140320420A1 (en) 2013-04-25 2014-10-30 Sony Corporation Method and apparatus for controlling a mobile device based on touch operations
US9976841B2 (en) * 2013-12-30 2018-05-22 Futurewei Technologies, Inc. Mobile device and method for determining a handling condition thereof
CN104133310A (zh) 2014-08-22 2014-11-05 深圳市中兴移动通信有限公司 一种无边框显示装置
JP6222397B2 (ja) * 2015-03-04 2017-11-01 株式会社村田製作所 タッチ式入力装置
WO2016154859A1 (zh) * 2015-03-30 2016-10-06 华为技术有限公司 一种左右手的识别方法及终端
CN104915143B (zh) 2015-06-19 2019-01-22 努比亚技术有限公司 无边框移动终端的控制方法及终端
CN105278841B (zh) * 2015-11-12 2019-04-23 小米科技有限责任公司 用于终端设备的控制方法及装置
CN105956432A (zh) * 2016-04-29 2016-09-21 北京小米移动软件有限公司 移动终端的解锁方法、装置和移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102662463A (zh) * 2012-03-22 2012-09-12 上海华勤通讯技术有限公司 移动终端及识别方法
US20160259521A1 (en) * 2012-07-18 2016-09-08 Sony Mobile Communications Inc. Mobile terminal device, operation method, program, and storage medium
CN104375724A (zh) * 2014-10-30 2015-02-25 惠州Tcl移动通信有限公司 移动终端及其触控操作方法
CN105511675A (zh) * 2015-11-20 2016-04-20 努比亚技术有限公司 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端
CN105868607A (zh) * 2016-03-25 2016-08-17 乐视控股（北京）有限公司 一种终端的控制方法及装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109669616A (zh) * 2018-12-26 2019-04-23 努比亚技术有限公司 一种侧屏交互控制方法、设备及计算机可读存储介质
CN109669616B (zh) * 2018-12-26 2021-08-03 努比亚技术有限公司 一种侧屏交互控制方法、设备及计算机可读存储介质
CN110297583A (zh) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 电子设备及电子设备的控制方法

Also Published As

Publication number Publication date
US20190235703A1 (en) 2019-08-01
US10739927B2 (en) 2020-08-11
CN109804339B (zh) 2021-01-01
CN109804339A (zh) 2019-05-24

Similar Documents

Publication Publication Date Title
WO2018068207A1 (zh) 识别操作的方法、装置及移动终端
CN108762954B (zh) 一种对象分享方法及移动终端
CN108701001B (zh) 显示图形用户界面的方法及电子设备
US9383918B2 (en) Portable electronic device and method of controlling same
WO2021083132A1 (zh) 图标移动方法及电子设备
WO2018082269A1 (zh) 菜单显示方法及终端
CN113821134B (zh) 控制光标移动的方法、内容选择方法、控制页面滚动的方法及电子设备
US9377868B2 (en) Sliding control method and terminal device thereof
US10133480B2 (en) Method for adjusting input-method keyboard and mobile terminal thereof
CN109710139B (zh) 一种页面处理方法、装置、终端以及存储介质
CN110727369A (zh) 电子装置
WO2015043194A1 (zh) 虚拟键盘显示方法、装置及终端
CN109800045B (zh) 一种显示方法及终端
US11567725B2 (en) Data processing method and mobile device
WO2018133285A1 (zh) 显示方法及终端
WO2020238647A1 (zh) 手势交互方法和终端
CN108920069B (zh) 一种触控操作方法、装置、移动终端和存储介质
WO2020078234A1 (zh) 显示控制方法及终端
WO2021098696A1 (zh) 触控方法及电子设备
CN109165033B (zh) 一种应用更新方法及移动终端
CN108052258B (zh) 一种终端任务的处理方法、任务处理装置及移动终端
WO2018112803A1 (zh) 触摸屏手势识别的方法及装置
CN108845700A (zh) 显示屏触控方法、双面屏终端及计算机可读存储介质
WO2019179296A1 (zh) 应用程序的管理方法及电子设备
CN110874141A (zh) 图标移动的方法及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16918698

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16918698

Country of ref document: EP

Kind code of ref document: A1