CN109542227B

CN109542227B - Method, device and computer readable storage medium for marking holding gesture

Info

Publication number: CN109542227B
Application number: CN201811400585.0A
Authority: CN
Inventors: 王璟; 王均松
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2018-11-22
Filing date: 2018-11-22
Publication date: 2024-02-13
Anticipated expiration: 2038-11-22
Also published as: CN109542227A

Abstract

The invention discloses a method, equipment and a computer readable storage medium for marking a holding gesture, wherein the method comprises the following steps: the method comprises the steps of monitoring a holding gesture and a working state of terminal equipment, and determining a hardware component called by the terminal equipment according to the working state; then, combining the position area of the hardware component and the holding gesture, and recognizing that the holding gesture covers the first area of the hardware component in the current holding state; determining a second region associated with the first region, and a second performance value of the hardware component under the second region; finally, marking the second area in the display area of the terminal equipment so that the holding gesture is adjusted to the second area from the first area. The humanized holding gesture marking scheme is realized, so that a user can timely make adjustment according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Description

Method, device and computer readable storage medium for marking holding gesture

Technical Field

The present invention relates to the field of mobile communications, and in particular, to a method and apparatus for marking a grip gesture, and a computer readable storage medium.

Background

In the prior art, with the rapid development of intelligent terminal equipment, hardware components in the terminal equipment are also more and more abundant, for example, the number of antennas, the antenna layout and the types of antennas of the terminal equipment are more and more abundant, for example, the antennas on mobile phones are more and more at present, a user does not know where the antennas are in actual use, and when holding all the antennas in hands, the performance of the antennas is poor, so that the user experience is greatly affected. In addition, with the popularity of the game mobile phone, if the user holds the mobile phone with hands, the performance of the antenna is poor, the sound of the loudspeaker is poor, and the sound of the microphone is poor, so that the use of the user is affected.

Therefore, in the prior art, for one or more hardware components of the intelligent terminal device, the operation state of the hardware may be affected due to the holding gesture of the user, so that the user experience is reduced.

Disclosure of Invention

In order to solve the above technical drawbacks in the prior art, the present invention provides a method for marking a holding gesture, which includes:

Monitoring a holding gesture and a working state of a terminal device, and determining a hardware component called by the terminal device according to the working state;

recognizing that the holding gesture covers a first area of the hardware component in the current holding state by combining the position area of the hardware component and the holding gesture;

acquiring a first performance value of the hardware component under the first area, and simultaneously determining a second area associated with the first area and a second performance value of the hardware component under the second area, wherein the second performance value is higher than the first performance value;

marking the second area in the display area of the terminal device so that the holding gesture is adjusted from the first area to the second area.

Optionally, the monitoring the holding gesture and the working state of the terminal device, and determining, according to the working state, a hardware component invoked by the terminal device includes:

monitoring the working state of the terminal equipment in real time, and simultaneously determining a hardware component which is called in the working state, wherein the hardware component comprises an antenna component, a microphone component and a loudspeaker component;

And monitoring the holding gesture of the terminal equipment in real time, wherein the holding gesture is determined according to the holding area of the terminal equipment.

Optionally, the identifying, in combination with the location area of the hardware component and the grip gesture, that the grip gesture covers the first area of the hardware component in the current grip state includes:

determining a position area of the hardware component, and marking the hardware area according to the position area in a display area of the terminal equipment;

and determining a first area covering the hardware component according to the holding area.

Optionally, the acquiring a first performance value of the hardware component under the first area, and determining a second area associated with the first area and a second performance value of the hardware component under the second area, where the second performance value is higher than the first performance value, includes:

determining a plurality of second areas according to the hardware areas and the first areas, wherein the second areas are adjacent to the first areas, and meanwhile, the coverage area of each of the second areas and the hardware areas is smaller than that of the first areas and the hardware areas;

The first performance value of the hardware component under the first area is obtained;

simulating in the plurality of second areas to obtain second performance values of the hardware components corresponding to the areas, wherein the first performance values and the second performance values comprise antenna performance values, microphone performance values and loudspeaker performance values;

each of the plurality of second regions having a second performance value greater than the first performance value is determined as a selected second region.

Optionally, the marking the second area in the display area of the terminal device so that the holding gesture is adjusted from the first area to the second area includes:

marking the selected second area in a display area of the terminal device;

and prompting an adjusted target position of the current holding gesture in the display area, wherein the target position comprises a position area where the second area is located.

The invention also provides a holding gesture marking method device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the computer program is realized when being executed by the processor:

Optionally, the computer program is implemented when executed by the processor:

determining, among the plurality of second regions, each region having a second performance value greater than the first performance value as a selected second region;

Marking the selected second area in a display area of the terminal device;

The invention also proposes a computer readable storage medium having stored thereon a grip gesture marking method program which, when executed by a processor, implements the steps of the grip gesture marking method as described in any of the above.

By monitoring the holding gesture and the working state of the terminal equipment, the method, the equipment and the computer readable storage medium for marking the holding gesture determine the called hardware component of the terminal equipment according to the working state; then, combining the position area of the hardware component and the holding gesture, and recognizing that the holding gesture covers the first area of the hardware component in the current holding state; then, acquiring a first performance value of the hardware component under the first area, and simultaneously determining a second area associated with the first area and a second performance value of the hardware component under the second area, wherein the second performance value is higher than the first performance value; finally, marking the second area in the display area of the terminal equipment so that the holding gesture is adjusted to the second area from the first area. The humanized holding gesture marking scheme is realized, so that a user can timely make adjustment according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Drawings

The invention will be further described with reference to the accompanying drawings and examples, in which:

fig. 1 is a schematic diagram of a hardware structure of a mobile terminal according to the present invention;

fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present invention;

FIG. 3 is a flowchart of a first embodiment of a grip gesture marking method of the present invention;

FIG. 4 is a flow chart of a second embodiment of a grip gesture marking method of the present invention;

FIG. 5 is a flow chart of a third embodiment of a grip gesture marking method of the present invention;

FIG. 6 is a flow chart of a fourth embodiment of a grip gesture marking method of the present invention;

FIG. 7 is a flowchart of a fifth embodiment of a grip gesture marking method of the present invention;

fig. 8 is a simulated display diagram of a display area of a terminal device of the grip gesture marking method of the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.

In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.

The terminal may be implemented in various forms. For example, the terminals described in the present invention may include mobile terminals such as cell phones, tablet computers, notebook computers, palm computers, personal digital assistants (PersonalDigital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, wearable devices, smart bracelets, pedometers, and fixed terminals such as digital TVs, desktop computers, and the like.

The following description will be given taking a mobile terminal as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for a moving purpose.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention, the mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal structure shown in fig. 1 is not limiting of the mobile terminal and that the mobile terminal may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

The following describes the components of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be used for receiving and transmitting signals during the information receiving or communication process, specifically, after receiving downlink information of the base station, processing the downlink information by the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, global System for Mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.

WiFi belongs to a short-distance wireless transmission technology, and a mobile terminal can help a user to send and receive e-mails, browse web pages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of a mobile terminal, and can be omitted entirely as required within a range that does not change the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the mobile terminal 100. The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the mobile terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the mobile phone, the detailed description thereof will be omitted.

The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the mobile terminal. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.

Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the mobile terminal, which is not limited herein.

The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power source 111 (e.g., a battery) for supplying power to the respective components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based will be described below.

Referring to fig. 2, fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present invention, where the communication network system is an LTE system of a general mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an e-UTRAN (Evolved UMTS Terrestrial Radio Access Network ) 202, an epc (Evolved Packet Core, evolved packet core) 203, and an IP service 204 of an operator that are sequentially connected in communication.

Specifically, the UE201 may be the terminal 100 described above, and will not be described herein.

The E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. The eNodeB2021 may be connected with other eNodeB2022 by a backhaul (e.g., an X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide access from the UE201 to the EPC 203.

EPC203 may include MME (Mobility Management Entity ) 2031, hss (Home Subscriber Server, home subscriber server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, pgw (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function, policy and tariff function entity) 2036, and so on. The MME2031 is a control node that handles signaling between the UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location registers (not shown) and to hold user specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034 and PGW2035 may provide IP address allocation and other functions for UE201, PCRF2036 is a policy and charging control policy decision point for traffic data flows and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem ), or other IP services, etc.

Although the LTE system is described above as an example, it should be understood by those skilled in the art that the present invention is not limited to LTE systems, but may be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and the communication network system, various embodiments of the method of the present invention are provided.

Example 1

FIG. 3 is a flowchart of a first embodiment of a grip gesture marking method of the present invention. A method of grip gesture marking, the method comprising:

s1, monitoring a holding gesture and a working state of a terminal device, and determining a hardware component called by the terminal device according to the working state;

s2, combining the position area of the hardware component and the holding gesture, and recognizing that the holding gesture covers the first area of the hardware component in the current holding state;

s3, acquiring a first performance value of the hardware component under the first area, and simultaneously determining a second area associated with the first area and a second performance value of the hardware component under the second area, wherein the second performance value is higher than the first performance value;

S4, marking the second area in the display area of the terminal equipment so that the holding gesture is adjusted to the second area from the first area.

In this embodiment, first, a holding gesture and a working state of a terminal device are monitored, and a hardware component called by the terminal device is determined according to the working state; then, combining the position area of the hardware component and the holding gesture, and recognizing that the holding gesture covers the first area of the hardware component in the current holding state; then, acquiring a first performance value of the hardware component under the first area, and simultaneously determining a second area associated with the first area and a second performance value of the hardware component under the second area, wherein the second performance value is higher than the first performance value; finally, marking the second area in the display area of the terminal equipment so that the holding gesture is adjusted to the second area from the first area.

Specifically, in this embodiment, first, a holding gesture and a working state of a terminal device are monitored, and at the same time, a hardware component called by the terminal device is determined according to the working state. The holding gesture of the terminal device refers to a gesture adopted by a user in the process of holding the terminal device, for example, holding by one hand, holding by two hands, and the like, and further, because the corresponding holding gesture of each user is different under different application scenes and different use habits, in order to enable the adjustment scheme of the holding gesture to have wider applicability, firstly, the current holding gesture is identified, and the hardware component called by the terminal device is identified. The hardware component of the terminal device comprises various components built in the terminal device, such as an antenna component, a microphone component and a speaker component, wherein the antenna component further comprises a positioning system antenna, a main antenna and an auxiliary antenna, the microphone component further comprises a main microphone and an auxiliary microphone, and the speaker component further comprises a first speaker, a second speaker and the like.

Specifically, in this embodiment, a holding gesture and a working state of a terminal device are monitored, and after determining, according to the working state, a hardware component that is invoked by the terminal device, the holding gesture is recognized to cover a first area of the hardware component in a current holding state in combination with a position area of the hardware component and the holding gesture. In the above embodiment, the current working state needs to be monitored, where the working state refers to a function currently executed by the terminal device, and if the currently executed function needs to call a hardware component, the function is within the processing scope of the present embodiment. Specifically, if the current working state of the terminal device is that the navigation function is operated, the hardware component called by the terminal device at this time includes a positioning system antenna required for navigation, a data antenna required for navigation data, and a speaker component required for navigation broadcasting. In this embodiment, if the current user holds the gesture improperly, the operation states of the positioning system antenna, the data antenna, and the speaker assembly one or more hardware assemblies may be affected, so in this embodiment, it is first necessary to determine the area covering the one or more hardware assemblies in the current state of holding the gesture as the first area of this embodiment.

Specifically, in this embodiment, after recognizing that the grip gesture covers a first area of the hardware component in the current grip state, a first performance value of the hardware component in the first area is obtained, and at the same time, a second area associated with the first area and a second performance value of the hardware component in the second area are determined, where the second performance value is higher than the first performance value. Also, as described above, in this embodiment, the first performance value of one or more of the positioning system antenna required for navigation, the data antenna required for navigation data, and the speaker component required for navigation broadcasting is determined in the current holding gesture state, and it is understood that the first performance value is a performance value directly obtained in the current holding gesture, and then, since the current holding gesture may affect the performance of the above-mentioned hardware component, in this embodiment, a second area related to the first area is determined by using an analog measurement method, unlike the first area, when the second area covers the hand or the finger of the user, the performance effect of the corresponding hardware component will be smaller than that when the first area is covered.

Specifically, in this embodiment, after determining a second area associated with the first area and a second performance value of the hardware component under the second area, the second area is marked in a display area of the terminal device, so that the holding gesture is adjusted from the first area to the second area. Also, as described above, according to the above embodiment, after determining the second area related to the first area, the user needs to be guided to adjust the holding gesture from the first area to the second area, so that the second area is displayed in the display area of the terminal device, so as to guide the user to move the hand or the finger into the range of the second area, and it can be understood that in the display area of the present embodiment, the position area of the hardware component may also be displayed in a simulation manner, so that a more visual prompting effect is provided when the user adjusts the holding gesture.

The method has the advantages that the gripping gesture and the working state of the terminal equipment are monitored, and meanwhile, the invoked hardware component of the terminal equipment is determined according to the working state; then, combining the position area of the hardware component and the holding gesture, and recognizing that the holding gesture covers the first area of the hardware component in the current holding state; then, acquiring a first performance value of the hardware component under the first area, and simultaneously determining a second area associated with the first area and a second performance value of the hardware component under the second area, wherein the second performance value is higher than the first performance value; finally, marking the second area in the display area of the terminal equipment so that the holding gesture is adjusted to the second area from the first area. The humanized holding gesture marking scheme is realized, so that a user can timely make adjustment according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Example two

Fig. 4 is a flowchart of a second embodiment of the method for marking a grip gesture according to the present invention, based on the above embodiment, the method for monitoring a grip gesture and an operating state of a terminal device, and determining, according to the operating state, a hardware component that is invoked by the terminal device, includes:

s11, monitoring the working state of the terminal equipment in real time, and simultaneously determining a hardware component which is called in the working state, wherein the hardware component comprises an antenna component, a microphone component and a loudspeaker component;

s12, monitoring the holding gesture of the terminal equipment in real time, wherein the holding gesture is determined according to the holding area of the terminal equipment.

In this embodiment, first, the working state of the terminal device is monitored in real time, and meanwhile, a hardware component called in the working state is determined, where the hardware component includes an antenna component, a microphone component, and a speaker component; and then, monitoring the holding gesture of the terminal equipment in real time, wherein the holding gesture is determined according to the holding area of the terminal equipment.

Optionally, the main hardware component is preferentially detected according to the current working state. Because some functions of the terminal equipment are executed and more hardware components are required to be called, if the user needs to avoid the holding gesture, the holding stability of the user can be affected, and the user can be difficult to hold;

optionally, the most affected hardware components are preferentially detected according to the current working state. Because some functions of the terminal equipment are executed and more hardware components are required to be called, if the user needs to avoid the holding gesture, the holding stability of the user can be affected, and the user can be difficult to hold.

Fig. 8 is a schematic diagram showing a display area of a terminal device according to the method for marking a grip gesture according to the present invention, in which positions of an auxiliary antenna, an auxiliary mic, a GPS antenna, a Wi-Fi antenna, a main antenna, a horn, and a main mic of the terminal device are displayed in a simulated manner. In this embodiment, the actual location area of the hardware component is not completely consistent with the area of the simulated display, so that the user may refer to the adjustment scheme of the holding gesture in the display area, and in this embodiment, the actual location of the hardware component is simulated, where the area that may affect the hardware component is prioritized by the way of the simulated display.

The method has the advantages that the working state of the terminal equipment is monitored in real time, and meanwhile, the called hardware component in the working state is determined, wherein the hardware component comprises an antenna component, a microphone component and a loudspeaker component; and then, monitoring the holding gesture of the terminal equipment in real time, wherein the holding gesture is determined according to the holding area of the terminal equipment. The more humanized holding gesture marking scheme is realized, so that a user can timely adjust according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Example III

FIG. 5 is a flowchart of a third embodiment of a method for marking a holding gesture according to the present invention, based on the above embodiment, the step of combining the location area of the hardware component with the holding gesture, and identifying that the holding gesture covers the first area of the hardware component in the current holding state includes:

s21, determining a position area of the hardware component, and marking the hardware area in a display area of the terminal equipment according to the position area;

s22, determining a first area covering the hardware component according to the holding area.

In this embodiment, first, determining a location area of the hardware component, and marking a hardware area in a display area of the terminal device according to the location area; then, a first area covering the hardware component is determined from the grip area.

Optionally, determining a location area possibly affected by the hardware component, and marking the hardware area according to the location area in a display area of the terminal device;

optionally, marking one or more hardware areas in the display area of the terminal device according to the position area;

optionally, one or more hardware areas are marked in the display area of the terminal device according to the location area, wherein the one or more hardware areas may represent the same hardware component.

The method has the advantages that the hardware area is marked according to the position area in the display area of the terminal equipment by determining the position area of the hardware component; then, a first area covering the hardware component is determined from the grip area. The more humanized holding gesture marking scheme is realized, so that a user can timely adjust according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Example IV

FIG. 6 is a flowchart of a fourth embodiment of a method for marking a grip gesture according to the present invention, based on the above embodiment, the obtaining a first performance value of the hardware component under the first area, and determining a second area associated with the first area and a second performance value of the hardware component under the second area, where the second performance value is higher than the first performance value includes:

S31, determining a plurality of second areas according to the hardware areas and the first areas, wherein the second areas are adjacent to the first areas, and meanwhile, the coverage areas of the hardware areas and the first areas are smaller than those of the second areas and the hardware areas;

s32, acquiring a first performance value of the hardware component under the first area;

s33, simulating to obtain second performance values of the hardware components corresponding to the areas in the second areas, wherein the first performance values and the second performance values comprise antenna performance values, microphone performance values and loudspeaker performance values;

s34, determining each area with the second performance value larger than the first performance value in the second areas as a selected second area.

In this embodiment, first, a plurality of second areas are determined according to the hardware area and the first area, where the plurality of second areas are adjacent to the first area, and at the same time, coverage areas of the hardware area and each of the plurality of second areas are smaller than those of the first area and the hardware area; then, the first performance value of the hardware component under the first area is obtained; then, second performance values of the hardware components corresponding to the areas are obtained through simulation in the second areas, wherein the first performance values and the second performance values comprise antenna performance values, microphone performance values and loudspeaker performance values; finally, each region having a second performance value greater than the first performance value among the plurality of second regions is determined as a selected second region.

Optionally, second performance values of the hardware components corresponding to the respective areas are obtained through simulation in the plurality of second areas;

optionally, the second performance value of each hardware component in each area is detected in the usage history period of the terminal device, so in this embodiment, only the second area obtained through the usage history learning needs to be called when needed.

The method has the advantages that the plurality of second areas are determined through the hardware area and the first area, wherein the plurality of second areas are adjacent to the first area, and meanwhile, the coverage area of each area of the plurality of second areas and the hardware area is smaller than that of the first area and the hardware area; then, the first performance value of the hardware component under the first area is obtained; then, second performance values of the hardware components corresponding to the areas are obtained through simulation in the second areas, wherein the first performance values and the second performance values comprise antenna performance values, microphone performance values and loudspeaker performance values; finally, each region having a second performance value greater than the first performance value among the plurality of second regions is determined as a selected second region. The more humanized holding gesture marking scheme is realized, so that a user can timely adjust according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Example five

Fig. 7 is a flowchart of a fifth embodiment of a method for marking a holding gesture according to the present invention, based on the above embodiment, the marking the second area in the display area of the terminal device, so that the holding gesture is adjusted from the first area to the second area, includes:

s41, marking the selected second area in the display area of the terminal equipment;

s42, prompting an adjusted target position of the current holding gesture in the display area, wherein the target position comprises a position area where the second area is located.

In this embodiment, first, the selected second area is marked in the display area of the terminal device; and prompting the adjusted target position of the current holding gesture in the display area, wherein the target position comprises a position area where the second area is located.

Optionally, as can be seen from the foregoing embodiments, in the present embodiment, a plurality of second areas may be provided for the user to select, and the user may perform corresponding adjustment according to the current function and the holding gesture, at this time, the adjustment scheme of the user is recorded, that is, the second area and the current function where the user is adjusted are recorded, and the second area is associated with the current function, and if the next monitoring process determines that the function is the function, it is not necessary to display a plurality of second areas, that is, only the second area associated with the function needs to be displayed, thereby further improving user experience.

The embodiment has the advantage that the selected second area is marked in the display area of the terminal device; and prompting the adjusted target position of the current holding gesture in the display area, wherein the target position comprises a position area where the second area is located. The more humanized holding gesture marking scheme is realized, so that a user can timely adjust according to the displayed holding mode, thereby avoiding influencing related functions of the equipment and enhancing user experience.

Example six

Fig. 8 is a flowchart of a sixth embodiment of the method for marking a grip gesture according to the present invention, and based on the above embodiment, the present invention also proposes a device for marking a grip gesture, the device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being implemented when executed by the processor:

Example seven

Based on the above embodiments, the computer program when executed by the processor implements:

Example eight

Example nine

marking the selected second area in a display area of the terminal device;

Examples ten

Based on the above embodiments, the present invention further proposes a computer readable storage medium, on which a grip gesture marking method program is stored, which when executed by a processor implements the steps of the grip gesture marking method as described in any one of the above.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Claims

1. A method of grip gesture marking, the method comprising:

marking the second area in the display area of the terminal device so that the holding gesture is adjusted to the second area from the first area;

The method for monitoring the holding gesture and the working state of the terminal equipment, and simultaneously determining the invoked hardware component of the terminal equipment according to the working state comprises the following steps:

monitoring the holding gesture of the terminal equipment in real time, wherein the holding gesture is determined according to the holding area of the terminal equipment;

the identifying, in combination with the location area of the hardware component and the grip gesture, that the grip gesture covers the first area of the hardware component in the current grip state includes:

determining a first area covering the hardware component according to the holding area;

the obtaining a first performance value of the hardware component under the first area, and determining a second area associated with the first area and a second performance value of the hardware component under the second area, where the second performance value is higher than the first performance value, includes:

the marking the second area in the display area of the terminal device so that the holding gesture is adjusted from the first area to the second area comprises the following steps:

marking the selected second area in a display area of the terminal device;

prompting an adjusted target position of the current holding gesture in the display area, wherein the target position comprises a position area where the second area is located;

Wherein,

providing a plurality of second areas for user selection, recording the second areas and the current functions of the second areas which are adjusted by the user, and associating the second areas with the current functions;

in the next monitoring process, if the function associated with the second area is determined, only the second area associated with the function is displayed.

2. A grip gesture marking apparatus, the apparatus comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being implemented when executed by the processor:

marking the selected second area in a display area of the terminal device;

Wherein,

3. A computer readable storage medium, characterized in that it has stored thereon a grip gesture marking method program, which, when executed by a processor, implements the steps of the grip gesture marking method according to claim 1.