CN111596759A - Operation gesture recognition method, device, equipment and medium - Google Patents
Operation gesture recognition method, device, equipment and medium Download PDFInfo
- Publication number
- CN111596759A CN111596759A CN202010355313.4A CN202010355313A CN111596759A CN 111596759 A CN111596759 A CN 111596759A CN 202010355313 A CN202010355313 A CN 202010355313A CN 111596759 A CN111596759 A CN 111596759A
- Authority
- CN
- China
- Prior art keywords
- operation gesture
- power generation
- user
- shape
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses an operation gesture recognition method, device, equipment and medium. The method is applied to the electronic equipment which comprises a screen and a screen power generation assembly. The method can comprise the following steps: acquiring an electric signal output by a screen power generation assembly; and identifying the operation gesture of the user according to the electric signal. The operation gesture recognition method, the operation gesture recognition device, the operation gesture recognition equipment and the operation gesture recognition medium can reduce the consumption of the battery power of the electronic equipment and prolong the service time of the electronic equipment while recognizing the operation gesture of the user.
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to an operation gesture recognition method, device, equipment and medium.
Background
With the development of communication technology, electronic devices have more and more entertainment functions, and the operating modes of the devices are more and more diversified. The air-separating operation provides a new equipment operation mode for the user, and the experience effect of the user is improved.
The air-separating operation is that when the user does not contact the equipment, a certain gesture is made by the hand to the equipment, and the equipment identifies the gesture of the user and further makes a corresponding response. For example, if a hand is flicked from the front of the screen of the mobile phone, the mobile phone performs operations such as unlocking or switching songs.
Currently, when a user gesture of an idle operation is recognized, a sensor (such as an image sensor or a radar sensor) needs to be used for capturing the user gesture, and then a corresponding analysis technology is used for recognizing the user gesture, however, the sensor consumes the power of a battery of the electronic device, and the service time of the electronic device is reduced.
Disclosure of Invention
Embodiments of the present invention provide an operation gesture recognition method, apparatus, device, and medium, which can reduce consumption of battery power of an electronic device and improve service life of the electronic device while recognizing an operation gesture of a user.
In a first aspect, an embodiment of the present invention provides an operation gesture recognition method, where the method is applied to an electronic device, where the electronic device includes a screen and a screen power generation component; the method can comprise the following steps:
acquiring an electric signal output by a screen power generation assembly;
and identifying the operation gesture of the user according to the electric signal.
In a second aspect, the embodiment of the invention provides an operation gesture recognition device, which is applied to an electronic device, wherein the electronic device comprises a screen and a screen power generation component; the apparatus may include:
the acquisition module is used for acquiring the electric signal output by the screen power generation assembly;
and the identification module is used for identifying the operation gesture of the user according to the electric signal.
In a third aspect, an embodiment of the present invention provides an electronic device, including a screen, a screen power generation component, a memory, a processor, and a computer program stored in the memory and executable on the processor;
the processor implements the operation gesture recognition method of the first aspect of the embodiments of the present invention when executing the computer program.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for operating gesture recognition according to the first aspect of the embodiment of the present invention is implemented.
The operation gesture recognition method provided by the embodiment of the invention is applied to the electronic equipment comprising the screen power generation assembly, and because the user applies the air separation gesture to the electronic equipment, shadow usually appears on the screen of the electronic equipment. The shadow can affect the light intensity irradiated on the screen power generation assembly, and further affect the electric signal output by the screen power generation assembly. Therefore, the operation gesture of the user can be recognized through the electric signal output by the screen power generation assembly without using a sensor, and the screen power generation assembly does not consume the electric quantity of the battery of the electronic equipment, so that the consumption of the electric quantity of the battery of the electronic equipment can be reduced, and the service life of the electronic equipment is prolonged.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an operation gesture recognition method according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a screen of an electronic device being manually flicked according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a screen power generation assembly provided by an embodiment of the present invention;
FIG. 4 is a first schematic diagram of the current output by the screen power generating unit according to the embodiment of the present invention;
FIG. 5 is a second schematic diagram of the current output by the screen power generating unit according to the embodiment of the present invention;
FIG. 6 is a third schematic diagram of the current output by the screen power generating unit according to the embodiment of the invention;
fig. 7 is a schematic structural diagram of an operation gesture recognition apparatus according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, when the user's gesture of the air operation is recognized, the user's gesture needs to be captured by using a sensor, and then the user's gesture needs to be recognized by using a corresponding analysis technology. For example, an image of a hand is captured using a camera (with an image sensor in the camera head) and then analyzed using image processing techniques to recognize gestures. As another example, an image of a hand is captured using a radar sensor and then analyzed using radar technology to identify gestures. However, the sensors consume the power of the battery of the electronic device, reducing the usage time of the electronic device. And when the radar sensor is used for capturing the image of the hand, new hardware needs to be added to the electronic equipment, so that the manufacturing cost of the electronic equipment is increased. Based on the above, the embodiment of the invention provides an operation gesture recognition method, device, equipment and medium. First, the operation gesture recognition method provided by the embodiment of the present invention is explained in detail below.
The operation gesture recognition method provided by the embodiment of the invention is preferably suitable for electronic equipment, and the electronic equipment comprises a screen and a screen power generation assembly. The screen power generation assembly is an assembly capable of converting light energy into electric energy.
In some possible implementations of embodiments of the present invention, the screen power generation assembly may be a wysips photoelectric conversion technology based assembly. Of course, the screen power generation component may also be a component based on other photoelectric conversion technologies. The method can be selected according to actual needs, and the embodiment of the invention is not limited herein.
Fig. 1 is a schematic flowchart of an operation gesture recognition method according to an embodiment of the present invention. The operation gesture recognition method may include:
s101: and acquiring the electric signal output by the screen power generation assembly.
S102: and identifying the operation gesture of the user according to the electric signal.
In some possible implementations of the embodiments of the present invention, the electrical signal may be a voltage signal or a current signal.
The operation gesture recognition method provided by the embodiment of the invention is applied to the electronic equipment comprising the screen power generation assembly, and because the user applies the air separation gesture to the electronic equipment, shadow usually appears on the screen of the electronic equipment. The shadow can affect the light intensity irradiated on the screen power generation assembly, and further affect the electric signal output by the screen power generation assembly. Therefore, the operation gesture recognition method provided by the embodiment of the invention can recognize the operation gesture of the user through the electric signal output by the screen power generation assembly without using a sensor. Because the screen power generation assembly does not consume the electric quantity of the battery of the electronic equipment, the consumption of the electric quantity of the battery of the electronic equipment can be reduced, and the service life of the electronic equipment is prolonged. Moreover, the device manufacturing cost can be reduced without adding special hardware (such as radar) for gesture recognition.
The following describes an operation gesture recognition method provided by an embodiment of the present invention with reference to fig. 2. FIG. 2 is a diagram illustrating a screen of an electronic device being manually flicked according to an embodiment of the present invention.
Under the condition that the external illumination intensity is not changed, when the hand does not flick the screen of the electronic equipment, the light intensity received by the screen power generation assembly is stronger, and the generated current or voltage is also larger. During the process of brushing the hand across the screen of the electronic device, the hand can block light and shadows appear on the screen. With the movement of hands, the shadow on the screen is changed from small to large and then from large to small, the light intensity received by the screen power generation assembly is changed from large to small and then from small to large, and the current value or the voltage value output by the screen power generation assembly is changed from large to small and then from small to large. When the hand completely brushes the screen of the electronic equipment, the light intensity received by the screen power generation assembly is restored to the original value, and the output current value or voltage value is restored accordingly.
It should be noted that the shadow in the embodiment of the present invention may be a shadow visible to the naked eye, and may also be a shadow invisible to the naked eye. That is, the shadows are not necessarily visible to the naked eye. The shadow appearing on the screen means that the object blocks the light transmission, so that the light intensity irradiated to the screen power generation assembly is changed.
Based on the above, in the case that the value of the electric signal output by the screen power generation assembly is changed from the first value to the second value within the preset time period, and the second value is changed from the second value to the third value, the operation gesture of the user is recognized as a flick gesture, wherein the second value is smaller than the first value, and the third value is associated with the first value. It is understood that the flick gesture is a gesture of flicking across a screen of the electronic device.
It should be noted that the first numerical value and the third numerical value may be numerical values of the electrical signal output by the screen power generation assembly when no object blocks the screen power generation assembly or the light source. The third value may be the same as or different from the first value. The first value and the third value are the same in the case where the ambient light intensity is not changed. The first data and the third value are different when the intensity of the external light is changed.
According to the operation gesture recognition method, the flick gesture can be recognized through the change of the numerical value of the electric signal output by the screen power generation assembly, compared with the flick gesture which is analyzed and recognized by utilizing an image processing technology and a radar technology, the gesture recognition speed is high, the efficiency is high, excessive processor resources are not occupied, and the processing speed of a processor is not influenced.
In some possible implementations of embodiments of the present invention, the screen power generation assembly may include at least one screen power generation assembly unit, as shown in fig. 3. Fig. 3 is a schematic diagram of a screen power generation assembly according to an embodiment of the present invention. Wherein the screen power generation assembly unit shown in fig. 3 includes: and 80 screen power generation assembly units, wherein each line of the screen power generation assembly units is 8 in the row direction, and each column of the screen power generation assembly units is 10 in the column direction. The specific number and position distribution of the screen power generation assembly units can be defined according to actual needs, and the embodiment of the invention is not limited herein.
When a hand is placed over the electronic device, the screen of the electronic device may appear shaded. The screen power generation assembly part corresponding to the shadow covering part receives weaker light than the part without the shadow, and the output current or voltage is smaller. Therefore, the shape of the shadow can be recognized based on the electric signal output from the screen power generation assembly unit.
For example, it is assumed that the current output from each of the above 80 screen power generation assembly units is as shown in fig. 4. Fig. 4 is a first schematic diagram of the current output by the screen power generation unit according to the embodiment of the present invention. In fig. 4, currents of different magnitudes are indicated by different fills.
The shape corresponding to the shadow can be identified from fig. 4. The shape corresponding to the shadow identified in fig. 4 is the shape of the "thumb standing up".
Based on the above, the first electric signal output by each screen power generation assembly unit in the case where the screen is shaded first can be acquired. That is, the electric signal output by the screen power generation element includes the above-described first electric signal output by each screen power generation element unit in the case where the screen is shaded first.
According to the first electric signal output by each screen power generation assembly unit under the condition that the screen has the first shadow, a first shape corresponding to the first shadow is identified, and according to the first shape, the operation gesture of the user is identified.
For example, it is assumed that the current output from each screen power generation assembly unit in the case where the screen is shaded first is as shown in fig. 5. Fig. 5 is a second schematic diagram of the current output by the screen power generation unit according to the embodiment of the invention. Wherein different magnitudes of current are indicated in fig. 5 with different fills. The first shape corresponding to the first shadow is recognized as the shape of "open five fingers" by fig. 5, and the gesture of the user is recognized as the gesture of "open five fingers".
In some possible implementations of the embodiments of the present invention, the electrical signals output by the screen power generation assembly may further include a second electrical signal output by each screen power generation assembly unit in a case where a second shadow occurs on the screen; before the operation gesture of the user is recognized according to the first shape, the operation gesture recognition method provided by the embodiment of the invention may further include: a second shape of the second shadow is identified based on the second electrical signal. According to the first shape, recognizing an operation gesture of the user may include: and recognizing the operation gesture of the user according to the first shape and the second shape.
Illustratively, the current output by each screen power generation assembly unit in the case of the second shading of the screen is as shown in fig. 6. Fig. 6 is a third schematic diagram of the current output by the screen power generation unit according to the embodiment of the invention. In fig. 6, currents of different magnitudes are indicated by different fills. The second shape corresponding to the second shadow is identified in fig. 6 as a "four-finger open" shape.
And recognizing the operation gesture of the user according to the shape of the five fingers and the shape of the four fingers.
In some possible implementations of the embodiments of the invention, in a case where the appearance time of the first shadow is earlier than the appearance time of the second shadow, the operation gesture of the user is recognized according to the change information from the first shape to the second shape; and when the appearance time of the first shadow is later than that of the second shadow, recognizing the operation gesture of the user according to the change information of the first shape changed from the second shape.
Exemplarily, fig. 5 and fig. 6 are taken as examples.
When the appearance time of the first shadow is earlier than the appearance time of the second shadow, the operation gesture of the user is recognized as a gesture in which the shape of the "five fingers open" is changed into the shape of the "four fingers open".
When the appearance time of the first shadow is later than the appearance time of the second shadow, the operation gesture of the user is recognized as a gesture in which the shape of the "four fingers open" is changed into the shape of the "five fingers open".
According to the operation gesture recognition method, the changed user gestures can be recognized through the electric signals output by the screen power generation assembly units included by the screen power generation assembly, and compared with the method of recognizing the changed gestures through image processing technology analysis and radar technology analysis, the method is high in recognition speed and efficiency, does not occupy excessive processor resources, and does not influence the processing speed of a processor.
In some possible implementations of the embodiment of the present invention, after the operation gesture of the user is recognized according to the electrical signal, the operation gesture recognition method provided in the embodiment of the present invention may further include the following steps: and executing the operation corresponding to the operation gesture.
Such as: the operation corresponding to the flick gesture is to switch songs, and the operation corresponding to the gesture in which the shape of the five fingers is changed to the shape of the four fingers is changed is to unlock the electronic device.
Then, after recognizing that the operation gesture of the user is a "flick gesture", the song is switched. After the operation gesture of the user is recognized as a gesture of changing the shape of the five fingers to the shape of the four fingers, the electronic equipment is unlocked.
In some possible implementations of the embodiment of the present invention, after the operation gesture of the user is recognized according to the electrical signal, before the operation corresponding to the operation gesture is performed, the operation gesture recognition method provided in the embodiment of the present invention may further include the following steps: and sending a preset trigger signal to the electronic equipment. And after the electronic equipment receives the preset trigger signal, executing operation corresponding to the identified operation gesture. It can be understood that the preset trigger signal is used for triggering the electronic device to execute an operation corresponding to the operation gesture.
According to the operation gesture recognition method provided by the embodiment of the invention, the preset trigger signal is used for triggering execution of the operation corresponding to the recognized operation gesture, so that the occurrence of misoperation conditions can be prevented, and the use of a user is prevented from being influenced.
Corresponding to the above method embodiment, the embodiment of the invention also provides an operation gesture recognition device.
Fig. 7 is a schematic structural diagram of an operation gesture recognition apparatus according to an embodiment of the present invention. Operating the gesture recognition device may include:
an obtaining module 701, configured to obtain an electrical signal output by a screen power generation assembly;
the identification module 702 is configured to identify an operation gesture of a user according to the electrical signal.
In some possible implementations of the embodiment of the present invention, the identifying module 702 may be specifically configured to:
and under the condition that the value of the electric signal is changed from a first value to a second value within a preset time period, and the second value is changed from the second value to a third value, the operation gesture of the user is identified to be a flick gesture, wherein the second value is smaller than the first value, and the third value is associated with the first value.
In some possible implementations of embodiments of the present invention, the screen power generation assembly includes at least one screen power generation assembly unit; the electric signals comprise first electric signals output by each screen power generation assembly unit under the condition that a first shadow appears on the screen; an identification module 702, comprising:
a first recognition unit for recognizing a first shape of the first shadow based on the first electric signal;
and the second recognition unit is used for recognizing the operation gesture of the user according to the first shape.
In some possible implementations of embodiments of the present invention, the electrical signals further include a second electrical signal output by each screen power generation assembly unit in the event of a second shadow appearing on the screen; the identification module 702, further comprising:
a third recognition unit for recognizing a second shape of the second shadow based on the second electric signal;
the second identification unit may specifically be configured to:
and recognizing the operation gesture of the user according to the first shape and the second shape.
In some possible implementations of the embodiment of the present invention, the second identifying unit may be specifically configured to:
under the condition that the appearance time of the first shadow is earlier than that of the second shadow, identifying the operation gesture of the user according to the change information of the first shape to the second shape;
and when the appearance time of the first shadow is later than that of the second shadow, recognizing the operation gesture of the user according to the change information of the first shape changed from the second shape.
In some possible implementations of the embodiment of the present invention, the operation gesture recognition apparatus provided in the embodiment of the present invention may further include:
and the execution module is used for executing the operation corresponding to the operation gesture.
In some possible implementations of the embodiment of the present invention, the operation gesture recognition apparatus provided in the embodiment of the present invention may further include:
the receiving module is used for receiving a preset trigger signal, and the preset trigger signal is used for triggering the electronic equipment to execute an operation corresponding to the operation gesture.
For the operation gesture recognition device embodiment of the present invention, since it is basically similar to the operation gesture recognition method embodiment of the present invention, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the operation gesture recognition method embodiment of the present invention. The embodiments of the present invention are not described herein in detail.
According to the operation gesture recognition device provided by the embodiment of the invention, the operation gesture of the user can be recognized through the electric signal output by the screen power generation assembly without using a sensor, and the screen power generation assembly does not consume the electric quantity of the battery of the electronic equipment, so that the consumption of the electric quantity of the battery of the electronic equipment can be reduced, and the service life of the electronic equipment is prolonged. Moreover, special hardware for gesture recognition is not required to be added, and the manufacturing cost of the device can be reduced.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention. The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811, a screen power generation assembly, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 8 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 810 is used for acquiring the electric signal output by the screen power generation assembly; and identifying the operation gesture of the user according to the electric signal.
According to the embodiment of the invention, the operation gesture of the user can be recognized through the electric signal output by the screen power generation assembly without using a sensor, and the screen power generation assembly does not consume the electric quantity of the battery of the electronic equipment, so that the consumption of the electric quantity of the battery of the electronic equipment can be reduced, and the service life of the electronic equipment is prolonged. Moreover, special hardware for gesture recognition is not required to be added, and the manufacturing cost of the device can be reduced.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 810; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 801 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 802, such as to assist the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output related to a specific function performed by the electronic apparatus 800 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.
The input unit 804 is used for receiving an audio or video signal. The input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics processor 8041 processes image data of a still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 806. The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage medium) or transmitted via the radio frequency unit 801 or the network module 802. The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 801 in case of a phone call mode.
The electronic device 800 also includes at least one sensor 805, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 8061 according to the brightness of ambient light and a proximity sensor that can turn off the display panel 8061 and/or the backlight when the electronic device 800 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 805 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 806 is used to display information input by the user or information provided to the user. The Display unit 806 may include a Display panel 8061, and the Display panel 8061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 807 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 8071 (e.g., operations by a user on or near the touch panel 8071 using a finger, a stylus, or any other suitable object or accessory). The touch panel 8071 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 810, receives a command from the processor 810, and executes the command. In addition, the touch panel 8071 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 8071, the user input unit 807 can include other input devices 8072. In particular, other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 8071 can be overlaid on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near the touch panel 8071, the touch operation is transmitted to the processor 810 to determine the type of the touch event, and then the processor 810 provides a corresponding visual output on the display panel 8061 according to the type of the touch event. Although in fig. 8, the touch panel 8071 and the display panel 8061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 may be integrated to implement the input and output functions of the electronic device, and the implementation is not limited herein.
The interface unit 808 is an interface for connecting an external device to the electronic apparatus 800. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 808 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 800 or may be used to transmit data between the electronic device 800 and external devices.
The memory 809 may be used to store software programs as well as various data. The memory 809 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 809 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 810 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 809 and calling data stored in the memory 809, thereby monitoring the whole electronic device. Processor 810 may include one or more processing units; alternatively, the processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The electronic device 800 may also include a power supply 811 (e.g., a battery) to provide power to the various components, and optionally, the power supply 811 may be logically coupled to the processor 810 via a power management system to provide management of charging, discharging, and power consumption via the power management system.
The screen power generation assembly is used for converting light energy into electric energy to charge the electronic equipment.
In addition, the electronic device 800 includes some functional modules that are not shown, and are not described in detail herein.
Optionally, an embodiment of the present invention further provides an electronic device, which includes a screen power generation component, a processor 810, a memory 809, and a computer program that is stored in the memory 809 and is executable on the processor 810, and when the computer program is executed by the processor 810, the computer program implements each process of the operation gesture recognition method embodiment applied to the electronic device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium has computer program instructions stored thereon; when executed by the processor, the computer program instructions implement the processes of the embodiment of the operation gesture recognition method applied to the electronic device, which are provided by the embodiment of the invention, and can achieve the same technical effect, and are not repeated here to avoid repetition. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. An operation gesture recognition method is characterized in that the method is applied to an electronic device, and the electronic device comprises a screen and a screen power generation component; the method comprises the following steps:
acquiring an electric signal output by the screen power generation assembly;
and identifying the operation gesture of the user according to the electric signal.
2. The method according to claim 1, wherein the recognizing an operation gesture of a user according to the electrical signal comprises:
under the condition that the value of the electric signal is changed from a first value to a second value and from the second value to a third value within a preset time period, recognizing that the operation gesture of the user is a flick gesture; wherein the second value is less than the first value and the third value is associated with the first value.
3. The method of claim 1, wherein the screen power generation assembly includes at least one screen power generation assembly unit; the electrical signals comprise first electrical signals output by each screen power generation assembly unit under the condition that the screen is shaded by a first shadow;
the operation gesture of the user is recognized according to the electric signal, and the operation gesture comprises the following steps:
identifying a first shape of the first shadow from the first electrical signal;
according to the first shape, the operation gesture of the user is recognized.
4. The method of claim 3, wherein the electrical signals further comprise a second electrical signal output by each screen power generation assembly unit in the event of a second shadow of the screen;
before the recognizing an operation gesture of a user according to the first shape, the method further includes:
identifying a second shape of the second shadow from the second electrical signal;
the recognizing the operation gesture of the user according to the first shape comprises the following steps:
according to the first shape and the second shape, recognizing an operation gesture of the user.
5. The method of claim 4, wherein the recognizing the user's operational gesture according to the first shape and the second shape comprises:
in the case that the appearance time of the first shadow is earlier than the appearance time of the second shadow, recognizing the operation gesture of the user according to the change information of the first shape to the second shape;
and in the case that the appearance time of the first shadow is later than that of the second shadow, recognizing the operation gesture of the user according to the change information of the first shape changed by the second shape.
6. The method according to any one of claims 1 to 5, characterized in that after said identifying, from said electric signal, an operating gesture of a user, the method further comprises:
and executing the operation corresponding to the operation gesture.
7. The method according to claim 6, wherein after the identifying an operation gesture of a user according to the electric signal and before the performing an operation corresponding to the operation gesture, the method further comprises:
receiving a preset trigger signal, wherein the preset trigger signal is used for triggering the electronic equipment to execute an operation corresponding to the operation gesture.
8. An operation gesture recognition device is characterized in that the device is applied to an electronic device, and the electronic device comprises a screen and a screen power generation component; the device comprises:
the acquisition module is used for acquiring the electric signal output by the screen power generation assembly;
and the identification module is used for identifying the operation gesture of the user according to the electric signal.
9. An electronic device comprising a screen, a screen power generation component, a memory, a processor, and a computer program stored on the memory and executable on the processor;
the processor, when executing the computer program, implements the operational gesture recognition method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, implements the operational gesture recognition method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010355313.4A CN111596759A (en) | 2020-04-29 | 2020-04-29 | Operation gesture recognition method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010355313.4A CN111596759A (en) | 2020-04-29 | 2020-04-29 | Operation gesture recognition method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111596759A true CN111596759A (en) | 2020-08-28 |
Family
ID=72182385
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010355313.4A Pending CN111596759A (en) | 2020-04-29 | 2020-04-29 | Operation gesture recognition method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111596759A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713735A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Method and device of controlling terminal equipment by non-contact gestures |
| EP2821889A1 (en) * | 2013-07-01 | 2015-01-07 | BlackBerry Limited | Performance control of ambient light sensors |
| CN104484032A (en) * | 2013-07-01 | 2015-04-01 | 黑莓有限公司 | Gesture detection using ambient light sensors |
| CN105511631A (en) * | 2016-01-19 | 2016-04-20 | 北京小米移动软件有限公司 | Gesture recognition method and device |
| CN106057170A (en) * | 2016-06-30 | 2016-10-26 | 联想(北京)有限公司 | Adjusting method and electronic equipment |
| CN106095292A (en) * | 2016-06-03 | 2016-11-09 | 上海与德通讯技术有限公司 | Terminal unit and operational approach thereof |
| CN107066976A (en) * | 2017-04-17 | 2017-08-18 | 京东方科技集团股份有限公司 | A kind of display device with fingerprint identification function |
| CN107453473A (en) * | 2017-08-30 | 2017-12-08 | 刘国勇 | A kind of photovoltaic generation method of handheld device or wearable device |
-
2020
- 2020-04-29 CN CN202010355313.4A patent/CN111596759A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713735A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Method and device of controlling terminal equipment by non-contact gestures |
| EP2821889A1 (en) * | 2013-07-01 | 2015-01-07 | BlackBerry Limited | Performance control of ambient light sensors |
| CN104484032A (en) * | 2013-07-01 | 2015-04-01 | 黑莓有限公司 | Gesture detection using ambient light sensors |
| CN105511631A (en) * | 2016-01-19 | 2016-04-20 | 北京小米移动软件有限公司 | Gesture recognition method and device |
| CN106095292A (en) * | 2016-06-03 | 2016-11-09 | 上海与德通讯技术有限公司 | Terminal unit and operational approach thereof |
| CN106057170A (en) * | 2016-06-30 | 2016-10-26 | 联想(北京)有限公司 | Adjusting method and electronic equipment |
| CN107066976A (en) * | 2017-04-17 | 2017-08-18 | 京东方科技集团股份有限公司 | A kind of display device with fingerprint identification function |
| CN107453473A (en) * | 2017-08-30 | 2017-12-08 | 刘国勇 | A kind of photovoltaic generation method of handheld device or wearable device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762954B (en) | Object sharing method and mobile terminal | |
| CN108427876B (en) | Fingerprint identification method and mobile terminal | |
| CN108459797B (en) | Control method of folding screen and mobile terminal | |
| CN109343759B (en) | Screen-turning display control method and terminal | |
| CN107613131B (en) | Application program disturbance-free method, mobile terminal and computer-readable storage medium | |
| CN108427873B (en) | Biological feature identification method and mobile terminal | |
| CN108008859B (en) | Screen control method and mobile terminal | |
| CN109739394B (en) | SAR value processing method and mobile terminal | |
| CN108319390A (en) | A kind of control method and mobile terminal of flexible screen | |
| CN107783747B (en) | Interface display processing method and mobile terminal | |
| CN108595089A (en) | A kind of virtual key control method and mobile terminal | |
| CN109634438B (en) | Input method control method and terminal equipment | |
| CN110413172A (en) | A kind of key indicating means and electronic equipment | |
| CN108509141B (en) | Control generation method and mobile terminal | |
| CN111049510A (en) | Touch key, control method and electronic equipment | |
| CN111522613B (en) | Screen capturing method and electronic equipment | |
| CN109521937B (en) | Screen display control method and mobile terminal | |
| CN108984099B (en) | Man-machine interaction method and terminal | |
| CN110780751A (en) | Information processing method and electronic equipment | |
| CN108170310B (en) | Touch screen control method and mobile terminal | |
| CN108021315B (en) | Control method and mobile terminal | |
| CN107967086B (en) | Icon arrangement method and device for mobile terminal and mobile terminal | |
| CN111475066B (en) | Background switching method of application program and electronic equipment | |
| CN110740265B (en) | Image processing method and terminal equipment | |
| CN110007821B (en) | Operation method and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200828 |
|
| RJ01 | Rejection of invention patent application after publication |