CN111752388A - Application control method, device, equipment and storage medium - Google Patents

Application control method, device, equipment and storage medium Download PDF

Info

Publication number
CN111752388A
CN111752388A CN202010568585.2A CN202010568585A CN111752388A CN 111752388 A CN111752388 A CN 111752388A CN 202010568585 A CN202010568585 A CN 202010568585A CN 111752388 A CN111752388 A CN 111752388A
Authority
CN
China
Prior art keywords
knocking
target
vibration
signal
vibration signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010568585.2A
Other languages
Chinese (zh)
Inventor
陈文强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhenke Intelligent Technology Co ltd
Original Assignee
Shenzhen Zhenke Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Zhenke Intelligent Technology Co ltd filed Critical Shenzhen Zhenke Intelligent Technology Co ltd
Priority to CN202010568585.2A priority Critical patent/CN111752388A/en
Publication of CN111752388A publication Critical patent/CN111752388A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the application discloses an application control method, an application control device, application control equipment and a storage medium. The method comprises the following steps: determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area; determining a target knocking position of the effective knocking operation in the preset human body area according to a target knocking vibration signal; knocking operations at different knocking positions generate different knocking vibration signals; and controlling the target application associated with the control equipment according to the operation information associated with the target knocking position. By adopting the scheme, the target application can be quickly controlled to realize the function of the preset knocking position association only by simply knocking the preset knocking position of the set human body area, the control process of the target application is simplified, meanwhile, the target application can be quickly and accurately controlled, and the human-computer interaction experience of a user is enhanced.

Description

Application control method, device, equipment and storage medium
Technical Field
The embodiment of the application relates to the technical field of human-computer interaction, in particular to an application control method, device, equipment and storage medium.
Background
With the continuous development of the technology, the rapid control of various applications becomes very necessary, and particularly, the man-machine interaction control of common functions in various applications is required.
At present, for the control of various applications, a corresponding application is usually found on a terminal device interface, and then a touch control is performed on the application interface to realize the control of common functions in the application. Taking music applications as an example, when listening to songs using music applications, a user needs to take out a mobile phone, search for and select a music application, click to open the application, select a song, and then put back in a pocket. However, it is sometimes inconvenient for the user to control various applications by using a conventional operation, for example, when the user runs, steps on a bicycle, or carries things, the control of various applications is very inconvenient, and the use experience of various applications is affected.
Disclosure of Invention
The embodiment of the application provides an application control method, an application control device, application control equipment and a storage medium, so that simple and quick control of applications and functions is achieved.
In a first aspect, an application control method is provided in an embodiment of the present application, which is executed by a control device, and includes:
determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein, the knocking operation at different knocking positions generates different knocking vibration signals;
and controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
In a second aspect, an embodiment of the present application further provides an application control apparatus configured to a control device, where the apparatus includes:
the knocking signal determining module is used for determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
the knocking position determining module is used for determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein the tapping operation at different tapping positions produces different tapping vibration signals.
And the target application control module is used for controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
In a third aspect, an embodiment of the present application further provides an electronic device, including:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement an application control method as provided in any of the embodiments of the present application.
In a fourth aspect, a computer-readable storage medium is also provided in embodiments of the present application, on which a computer program is stored, which when executed by a processor implements the application control method as provided in any of the embodiments of the present application.
The embodiment of the application provides an application control method, when a user needs to perform function control on a target application, the user can perform effective knocking operation in a preset human body area, a control device can determine a target knocking vibration signal generated by the effective knocking operation of the user on the preset human body area and determine a target knocking position of the target knocking vibration signal, and then a control instruction of the target application associated with the control device can be generated according to operation information associated with the target knocking position, so that the function control on the target application is realized. By adopting the scheme, a user does not need to take out the terminal equipment where the target application is located and carry out control operation on the mobile terminal equipment, does not need to execute some special knocking times or knocking actions to control, only needs to carry out simple knocking operation at the preset knocking position of the set human body area, can control the target application to realize the function of the preset knocking position association, simplifies the control process of the target application, can also realize quick and accurate control on the target application, and enhances the human-computer interaction experience.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented in accordance with the content of the description so as to make the technical means of the present application more clearly understood, and the detailed description of the present application will be given below in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart of an application control method provided in an embodiment of the present invention;
FIG. 2 is a schematic illustration of different tap locations of a body region provided in an embodiment of the present invention;
FIG. 3 is a flow chart of another application control method provided in an embodiment of the present invention;
fig. 4 is a flowchart of another application control method provided in the embodiment of the present invention;
fig. 5 is a block diagram of an application control apparatus provided in the embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations (or steps) can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Fig. 1 is a flowchart of an application control method provided in an embodiment of the present invention. The method and the device for controlling the target application on the terminal equipment can be suitable for the situation of quickly and accurately controlling the target application on the terminal equipment. The method may be performed by an application control apparatus, which may be implemented in software and/or hardware, and may be configured in an electronic device having a network communication function. As shown in fig. 1, the application control method provided in the embodiment of the present application may include the following steps:
and S110, determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area.
In this embodiment, fig. 2 is a schematic diagram of different tapping positions of a human body region provided in an embodiment of the present invention. Referring to fig. 2, the human body has a complicated structure, so that different knocking vibrations are generated when knocking is performed at different parts of the human body region. For example, taking an arm area in a human body area as an example, when a finger taps different positions in the arm area, different tapping vibrations are generated. Although human ears feel similar to the vibration at different positions and cannot sense the vibration signals at different positions in a distinguishing way, the vibration sensors can capture different vibration signals.
In this embodiment, referring to fig. 2, the preset body area may be a body arm area, and at least two preset tapping positions may be preset in the preset body area. The user can select one preset knocking position from a plurality of preset knocking positions in the preset human body area according to the requirement to perform knocking operation. The effective knocking operation may be an operation of performing knocking at any preset knocking position in the preset human body area. Based on the principle that the vibration sensor can capture different knocking vibration signals generated at different knocking positions, the vibration sensor can be used for detecting the knocking vibration signals generated by effective knocking operation of a user acting on a preset human body area, and the knocking vibration signals are recorded as target knocking vibration signals for distinguishing. Alternatively, the vibration sensor may include an accelerometer sensor and a gyroscope sensor; for example, to ensure that sufficient vibration signal data can be collected, the accelerometer sensor may employ a 6-axis accelerometer to collect multiple vibration signals simultaneously.
S120, determining a target knocking position of the effective knocking operation in a preset human body area according to the target knocking vibration signal; wherein the tapping operation at different tapping positions produces different tapping vibration signals.
In the embodiment, when the knocking operation is performed at different knocking positions of the preset human body area, the generated knocking vibration signals are different. On the basis, after the target knocking vibration signal is determined, it can be identified at which preset knocking position of the preset human body area the effective knocking operation is performed, the target knocking vibration signal can be generated, and the preset knocking position capable of generating the target knocking vibration signal in the preset human body area can be recorded as the corresponding target knocking position.
In this embodiment, different preset tapping positions can be pre-marked for tapping operation, so as to generate standard tapping vibration signals, and the preset tapping positions and the corresponding standard tapping vibration signals are correlated. On the basis, after the target knocking vibration signal is determined, the standard knocking vibration signal generated by executing the knocking operation at which preset knocking position of the preset human body area is similar to the target knocking vibration signal can be identified, and then the preset knocking position associated with the similar standard knocking vibration signal is used as the target knocking position of the effective knocking operation in the preset human body area.
And S130, controlling the target application related to the control equipment according to the operation information related to the target knocking position.
In the present embodiment, referring to fig. 2, different operation information may be set for each preset tap position in the preset human body area, each operation information being related to each function of the target application. For example, taking the target application as a music-type application as an example, the preset tap position No. 1 shown in fig. 2 indicates returning to the home page, the preset tap position No. 2 indicates opening the music application, the preset tap position No. 3 indicates playing a song in the music application, the preset tap position No. 4 indicates pausing the playing of the music application, the preset tap position No. 5 indicates playing a previous song, and the preset tap position No. 6 indicates playing a next song. In this way, the control device can generate a target control instruction of a target application associated with the control device according to the operation information associated with the target tapping position, so as to perform function control on the target application.
In the embodiment, the control device can be integrated with a vibration sensor and worn near a preset human body area; for example, the control device may be a smart watch. The control device can be in communication connection with the target application on the terminal device, and can send the generated target control instruction to the target application of the terminal device through the communication connection to control various functions of the target application.
The embodiment of the application provides an application control method, when a user needs to perform function control on a target application, the user does not need to take out a terminal device where the target application is located and perform control operation on a mobile terminal device, and does not need to execute some special knocking times or knocking actions to perform control, and only needs to perform simple knocking operation at a preset knocking position of a set human body area, so that the target application can be controlled to realize the function related to the preset knocking position, the control process of the target application is simplified, meanwhile, the target application can be quickly and accurately controlled, and human-computer interaction experience is enhanced.
Fig. 3 is a flowchart of another application control method provided in the embodiment of the present invention. The technical solution of the embodiments of the present application is optimized based on the above embodiments, and the embodiments of the present application may be combined with various alternatives in one or more of the above embodiments. As shown in fig. 3, the application control method provided in the embodiment of the present application may include the following steps:
s310, determining the amplitude of a part of vibration signals in the initial vibration signals acquired by a preset vibration sensor; the preset vibration sensor is arranged at a preset distance of a preset human body area.
In this embodiment, this vibration sensor can set up in the predetermined distance department of predetermineeing the human body region, guarantees that the position of setting up of vibration sensor can not predetermine the position of strikeing too far away from predetermineeing in the human body region, avoids as far as possible because the vibration sensor is too far away from predetermineeing the position of strikeing and leads to catching and carry out the produced vibrations signal that strikes of operation predetermineeing the position of strikeing.
In the present embodiment, the vibration sensor may capture the vibration signal, but the vibration signal is not usually screened and captured, so the initial vibration signal detected by the vibration sensor may only include the tapping vibration signal generated by performing the effective tapping operation at any one of the preset tapping positions of the preset human body area; or may also include only vibration signals due to other factors; or it may also include a combination of vibration signals generated by both of the above factors. For this purpose, after obtaining the initial vibration signal captured by the vibration sensor, the amplitude of the initial vibration signal captured by the vibration sensor may be detected to determine amplitude information of at least a portion of the initial vibration signal. Optionally, after the vibration sensor captures the initial vibration signal, the captured initial vibration signal may be written into the buffer, and at this time, traversal monitoring may be directly performed on the initial vibration signal in the buffer in sequence, and the amplitude of a part of the vibration signal in the initial vibration signal is read.
In this embodiment, optionally, if the vibration sensor is always in the vibration signal detection stage, it is necessary to acquire the vibration signal data in real time, which wastes detection resources. For this reason, a detection activation mechanism needs to be provided for the vibration sensor to reduce the influence of the above real-time detection.
In this embodiment, optionally, after the vibration sensor is activated, some vibration signals generated by the non-tapping operation of the user may be captured by the vibration sensor, and once data similar to the tapping vibration signal but not the tapping vibration signal is detected by the vibration sensor, and the captured vibration signals generated by the non-tapping operation are similar to the tapping vibration signal generated by the effective tapping operation, if subsequent control is performed according to such vibration signals, it is likely to cause misoperation. For this reason, after the vibration sensor is activated, it is possible to detect whether a preset operation of the gyroscope in the vibration sensor, for example, a rotation operation of a preset angle occurs. If the gyroscope is subjected to preset operation, a vibration signal detected by the vibration sensor is used for carrying out a subsequent control processing process; otherwise, the vibration signal detected by the vibration sensor may not be processed temporarily.
S320, if the amplitude of the partial vibration signal is determined to be larger than the effective knocking threshold value, determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area, and determining a target starting position and a target ending position in the initial vibration signal.
In this embodiment, the effective tapping threshold may be used to determine whether the initial vibration signal includes a tapping vibration signal generated by an effective tapping operation. If the amplitude of the read partial vibration signal is larger than the effective knocking threshold value in the process of traversing and reading the initial vibration signal, the initial vibration signal is considered to contain a target knocking vibration signal generated by effective knocking operation acting on a preset human body area. At this time, it is necessary to continuously determine the starting position and the ending position of the target tapping vibration signal in the initial vibration signal so as to extract the portion of the vibration signal from the initial vibration signal as the target tapping vibration signal.
In an alternative manner of this embodiment, the operation of determining the target tapping vibration signal generated by the effective tapping operation on the preset human body area, the target starting position and the target ending position in the initial vibration signal, may include steps a1-a 2:
step a1 is to set, as the target start position, a signal position at which the amplitude of the signal detected for the first time is greater than the tapping vibration threshold value in the process of detecting the amplitude of the initial vibration signal.
In this embodiment, the effective tapping threshold is set to identify whether the initial vibration signal includes a target tapping vibration signal generated by an effective tapping operation, so that a relatively large effective tapping threshold is set to avoid an identification error. The tapping vibration threshold is used for identifying the beginning and the end of the target tapping vibration signal from the initial vibration signal, so that the size of the tapping vibration threshold needs to be smaller than that of the effective tapping threshold, and thus the false deletion of the beginning part and the end part of the target tapping vibration signal can be avoided. The effective knocking threshold value can be dynamically determined according to the sum of the noise mean value and the 3-time standard deviation of the target knocking vibration signal, and the knocking vibration threshold value is dynamically determined according to the sum of the noise mean value and the 1-time standard deviation of the target knocking vibration signal.
In this embodiment, the amplitude of the initial vibration signal written in the buffer may be sequentially detected, and when it is detected that the signal amplitude is larger than the tapping vibration threshold, the position where the signal amplitude is larger than the tapping vibration threshold may be recorded. In the case where it is determined that the amplitude of a part of the vibration signal in the initial vibration signal is greater than the effective tapping threshold value, the recorded position where the amplitude of the signal is greater than the tapping vibration threshold value may be directly used as the target start position.
Step a2 is to set, as the target end position, a signal position at which the detected signal amplitude is continuously smaller than the tapping vibration threshold while continuing to detect the amplitude of the initial vibration signal.
In this embodiment, when it is determined that the amplitudes of some of the initial vibration signals are greater than the effective tapping threshold, the amplitudes of the remaining initial vibration signals can be continuously detected in sequence. When a signal having a signal amplitude continuously smaller than the tapping vibration threshold value is detected to occur in the remaining initial vibration signals, the signal position at which the signal amplitude is continuously smaller than the tapping vibration threshold value may be regarded as the target end position.
In this embodiment, when the vibration sensor acquires at least two initial vibration signals, for example, the vibration sensor may include a 6-axis accelerometer, and the 6 initial vibration signals may be captured in real time by the 6-axis accelerometer, and the signals captured in real time are written into the buffer. Optionally, because each path of initial vibration signal is captured and collected synchronously, amplitude detection can be performed on any path of initial vibration signal captured by the vibration sensor to determine the target starting position and the target ending position, and detection is not required to be performed on each path of initial vibration signal to determine the starting position and the ending position, so that the waste of computing resources is avoided.
By adopting the mode, the target knocking vibration signal generated by effective knocking operation can be simply and quickly found out at the initial position and the end of the initial vibration signal, so that the target knocking vibration signal can be extracted later.
S330, determining the vibration signal from the target starting position to the target ending position in the initial vibration signal as a target knocking vibration signal.
In the present embodiment, the target tap vibration signal is extracted from the initial vibration signal in accordance with the target start position and the target end position. And judging whether the length of the target knocking vibration signal meets a preset signal length condition or not. If the length of the target knocking vibration signal meets the condition, entering the next process; otherwise, returning to re-determining the target starting position and the target ending position so that the length of the re-extracted target knocking vibration signal meets the preset signal length condition.
In this embodiment, under the condition that the vibration sensor acquires at least two paths of initial vibration signals, the target tapping vibration signals corresponding to the respective paths of initial vibration signals can be respectively extracted from the respective paths of initial vibration signals according to the target starting position and the target ending position. And then, splicing the extracted target knocking vibration signals corresponding to all paths according to a preset sequence to obtain a complete target knocking vibration signal.
In an optional manner of this embodiment, after determining the vibration signal from the target start position to the target end position in the initial vibration signal as the target tapping vibration signal, steps B1-B3 may further be included:
and step B1, under the condition that the vibration sensor acquires at least two paths of initial vibration signals, filtering the target knocking vibration signals extracted from the initial vibration signals.
In this embodiment, there may be other vibration disturbances during the user's tapping process, such as a fist making motion being mistaken for tapping, and other large-amplitude motions of the user being detected by the accelerometer and gyroscope being mistaken for tapping. Since these motions are all at high frequencies, 10hz high-pass filtering processing can be performed on the target tap vibration signal extracted from the initial vibration signal.
And step B2, determining the signal-to-noise ratio of the target knocking vibration signal according to the pre-filtering signal and the post-filtering signal of the target knocking vibration signal.
And step B3, if the signal-to-noise ratio of the target knocking vibration signal is greater than a preset signal-to-noise ratio threshold, determining that the target knocking vibration signal belongs to an effective knocking vibration signal.
In the embodiment, after filtering the target tapping vibration signal containing noise signals caused by the motion of making a fist and other motions of large amplitude, the signal-to-noise ratio of the noise signals is obviously lower than that of the tapping vibration signal. Respectively calculating the energy of the first m points and the energy of the second m points of the filtered target knocking vibration signal, judging whether the signal-to-noise ratio of the target knocking vibration signal is greater than a signal-to-noise ratio threshold value, and if so, judging that the signal is an effective knocking vibration signal; otherwise it is considered a noise signal. And then, sequentially splicing the extracted multi-path target knocking vibration signals.
The method has the advantages that the target knocking vibration signal can be effectively identified, the situation that the amplitude of the vibration signal caused by some special actions is similar to that of the knocking vibration signal generated by effective knocking operation, and the vibration signal generated by ineffective knocking operation is mistaken for the knocking vibration signal generated by effective knocking operation, so that the follow-up error control on target application is caused is avoided.
S340, determining a target knocking position of effective knocking operation in a preset human body area according to the target knocking vibration signal; wherein the tapping operation at different tapping positions produces different tapping vibration signals.
And S350, controlling the target application related to the control equipment according to the operation information related to the target knocking position.
The embodiment of the application provides an application control method, when a user needs to perform function control on a target application, a target knocking vibration signal which is useful for an identification signal can be accurately extracted according to effective knocking operation of the user, and then a target knocking position is determined according to the extracted target knocking vibration signal, so that the user does not need to take out terminal equipment where the target application is located and perform control operation on mobile terminal equipment, and does not need to execute some special knocking times or knocking actions for control, and the target application can be controlled to realize the function related to the preset knocking position only by performing simple knocking operation at the preset knocking position of a set human body area, the control process of the target application is simplified, meanwhile, rapid and accurate control over the target application can be realized, and man-machine interaction experience is enhanced.
Fig. 4 is a flowchart of another application control method provided in the embodiment of the present invention. The technical solution of the embodiments of the present application is optimized based on the above embodiments, and the embodiments of the present application may be combined with various alternatives in one or more of the above embodiments. As shown in fig. 4, the application control method provided in the embodiment of the present application may include the following steps:
and S410, determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area.
And S420, determining the target tapping vibration characteristic information of the target tapping vibration signal.
In this embodiment, time-frequency analysis may be performed on the target knocking vibration signal to obtain time-domain characteristic information and frequency-domain characteristic information of the target knocking vibration signal, and the time-domain characteristic information and the frequency-domain characteristic information may be combined to obtain target knocking vibration characteristic information of the target knocking vibration signal. Optionally, discrete short-time fourier transform may be performed on the target knocking vibration signal to obtain frequency spectrum information representing frequency domain characteristics of the target knocking vibration signal, and meanwhile, time domain characteristic information of the target knocking vibration signal may also be obtained to obtain target knocking vibration characteristic information. For example, the following formula is used to calculate the spectrum information:
Figure BDA0002548465020000121
where x [ n ] is the input signal, w [ n-m ] is the window function, and m is the displacement; and combining the frequency spectrum information and the time domain characteristic information, and sequentially splicing into complete target knocking vibration characteristic information.
In this embodiment, the target tap vibration feature information may include feature vectors of multiple dimensions, and the feature vectors of different dimensions have different importance. Therefore, the characteristic information with the highest score of 50% can be selected by adopting the Fisher score to serve as the final target knocking vibration characteristic information, and therefore the subsequent identification accuracy can be improved. For example, the fisher score is calculated as follows:
Figure BDA0002548465020000131
wherein r represents a frequency point position, niIndicates the number of samples of the i-th class, uiAnd
Figure BDA0002548465020000132
the mean and variance of the samples representing the ith class, and u represents the mean of all classes of the dimensional feature.
S430, determining standard knocking vibration characteristic information matched with the target knocking vibration characteristic information from a preset knocking vibration characteristic set; and one standard knocking vibration characteristic information in the knocking vibration signal set is associated with a unique preset knocking position.
In an alternative manner of this embodiment, determining standard tapping vibration characteristic information that matches the target tapping vibration characteristic information from a preconfigured tapping vibration characteristic set may include steps C1-C2:
and step C1, determining the feature information similarity between the target tapping vibration feature information and each standard tapping vibration feature information in the pre-configured tapping vibration signal set.
And step C2, determining at least one standard tapping vibration characteristic information with the highest characteristic information similarity as the standard tapping vibration characteristic information matched with the target tapping vibration characteristic information.
In the embodiment, the nearest neighbor algorithm is used to calculate the similarity between the target tapping vibration characteristic information and each standard tapping vibration characteristic information in the tapping vibration signal set, and the standard tapping vibration characteristic information with the highest similarity is used as the matched standard tapping vibration characteristic information. Optionally, the calculating the similarity is to calculate the feature information similarity between the target tapping vibration feature information and each standard tapping vibration feature information in a pre-configured tapping vibration signal set by combining the euclidean distance and a dynamic time programming algorithm.
In an alternative manner of the present embodiment, before determining the standard tapping vibration feature information matching the target tapping vibration feature information from the preconfigured tapping vibration feature set, steps D1-D3 are further included:
and D1, receiving a training knocking vibration signal generated by effective knocking operation of a user on a preset knocking position of the preset human body area when the training knocking vibration signal is used for the first time.
And D2, processing the training knocking vibration signal to obtain the optimized standard knocking vibration characteristic information of the training knocking vibration signal.
And D3, associating the standard tapping vibration characteristic information with a preset tapping position to obtain a preset tapping vibration characteristic set.
S440, taking the preset knocking position associated with the matched standard knocking vibration characteristic information as a target knocking position of effective knocking operation in a preset human body area; the tapping operation at different tapping positions generates different tapping vibration signals.
S450, controlling the target application related to the control equipment according to the operation information related to the target knocking position.
The embodiment of the application provides an application control method, when a user needs to perform function control on a target application, the user does not need to take out a terminal device where the target application is located and perform control operation on a mobile terminal device, and does not need to execute some special knocking times or knocking actions to perform control, and only needs to perform simple knocking operation at a preset knocking position of a set human body area, so that the target application can be controlled to realize the function related to the preset knocking position, the control process of the target application is simplified, meanwhile, the target application can be quickly and accurately controlled, and human-computer interaction experience is enhanced.
Fig. 5 is a block diagram of an application control apparatus provided in the embodiment of the present invention. The method and the device for controlling the target application on the terminal equipment can be suitable for the situation of quickly and accurately controlling the target application on the terminal equipment. The apparatus may be implemented in software and/or hardware, and may be configured in an electronic device with a network communication function. As shown in fig. 5, the application control apparatus provided in the embodiment of the present application may include: a tap signal determination module 510, a tap location determination module 520, and a target application control module 530. Wherein:
a tapping signal determination module 510, configured to determine a target tapping vibration signal generated by an effective tapping operation performed on a preset human body area;
a tapping position determining module 520, configured to determine a target tapping position of the effective tapping operation in the preset human body area according to the target tapping vibration signal; wherein the tapping operation at different tapping positions produces different tapping vibration signals.
And a target application control module 530, configured to control a target application associated with the control device according to the operation information associated with the target tapping position.
On the basis of the above embodiment, optionally, the tapping signal determining module 510 includes:
a vibration signal amplitude determination unit for determining the amplitude of a part of the vibration signal in the initial vibration signal acquired by the vibration sensor; the vibration sensor is arranged at a preset distance of the preset human body area;
the knocking signal position determining unit is used for determining a target starting position and a target ending position of the target knocking vibration signal in the initial vibration signal if the amplitude of the partial vibration signal is determined to be larger than an effective knocking threshold value;
and the target knocking signal extraction unit is used for determining the vibration signal from the target starting position to the target ending position in the initial vibration signal as the target knocking vibration signal.
On the basis of the above embodiment, optionally, the tapping signal position determination unit includes:
taking a signal position when the initially detected signal amplitude is larger than a tapping vibration threshold value in the process of detecting the amplitude of the initial vibration signal as a target initial position;
taking the signal position when the detected signal amplitude is continuously smaller than the tapping vibration threshold value in the process of continuously detecting the amplitude of the initial vibration signal as a target end position; the size of the effective tapping threshold value is larger than that of the tapping vibration threshold value.
On the basis of the above embodiment, optionally, the tapping signal determining module 510 further includes:
the target knocking signal processing unit is used for filtering the target knocking vibration signal extracted from the initial vibration signal under the condition that the vibration sensor acquires at least two paths of initial vibration signals;
the knocking signal-to-noise ratio determining unit is used for determining the signal-to-noise ratio of the target knocking vibration signal according to the pre-filtering signal and the post-filtering signal of the target knocking vibration signal;
and the knocking signal identification and confirmation unit is used for determining that the target knocking vibration signal belongs to an effective knocking vibration signal if the signal-to-noise ratio of the target knocking vibration signal is greater than a preset signal-to-noise ratio threshold value.
On the basis of the above embodiment, optionally, the tapping position determining module 520 includes:
the knocking characteristic determining unit is used for determining target knocking vibration characteristic information of the target knocking vibration signal;
the knocking feature matching unit is used for determining standard knocking vibration feature information matched with the target knocking vibration feature information from a preset knocking vibration feature set; the method comprises the steps that a standard knocking vibration characteristic information in a knocking vibration signal set is associated with a unique preset knocking position;
and the target knocking determining unit is used for taking a preset knocking position associated with the standard knocking vibration characteristic information as a target knocking position of the effective knocking operation in the preset human body area.
On the basis of the above embodiment, optionally, the tap feature matching unit includes:
determining feature information similarity between the target knocking vibration feature information and each standard knocking vibration feature information in a preset knocking vibration signal set;
and determining at least one standard knocking vibration characteristic information with the highest characteristic information similarity as the standard knocking vibration characteristic information matched with the target knocking vibration characteristic information.
On the basis of the foregoing embodiment, optionally, the apparatus further includes:
the knocking signal training module 540 is used for receiving a training knocking vibration signal generated by effective knocking operation of a user on a preset knocking position of a preset human body area when the training knocking signal training module is used for the first time;
the training knocking signal processing module 550 is configured to process the training knocking vibration signal to obtain standard knocking vibration characteristic information of the optimized training knocking vibration signal;
and the tapping characteristic pre-configuration module 560 is configured to associate the standard tapping vibration characteristic information with the preset tapping position to obtain a pre-configured tapping vibration characteristic set.
The application control apparatus provided in the embodiment of the present application may execute the application control method provided in any embodiment of the present application, and has corresponding functions and advantages for executing the application control method.
Fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. As shown in fig. 6, the electronic device provided in the embodiment of the present application includes: one or more processors 610 and storage 620; the processor 610 in the electronic device may be one or more, and one processor 610 is taken as an example in fig. 6; storage 620 is used to store one or more programs; the one or more programs are executed by the one or more processors 610, so that the one or more processors 610 implement the application control method according to any one of the embodiments of the present application.
The electronic device may further include: an input device 630 and an output device 640.
The processor 610, the storage 620, the input device 630 and the output device 640 in the electronic apparatus may be connected by a bus or other means, and fig. 6 illustrates an example of connection by a bus.
The storage device 620 in the electronic device is used as a computer-readable storage medium for storing one or more programs, which may be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the application control method provided in the embodiments of the present application. The processor 610 executes various functional applications and data processing of the electronic device by executing software programs, instructions and modules stored in the storage device 620, that is, implements the application control method in the above method embodiment.
The storage device 620 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device, and the like. Further, the storage 620 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 620 may further include memory located remotely from the processor 610, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 630 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. The output device 640 may include a display device such as a display screen.
And, when the one or more programs included in the electronic device are executed by the one or more processors 610, the programs perform the following operations:
determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein, the knocking operation at different knocking positions generates different knocking vibration signals;
and controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
Of course, it can be understood by those skilled in the art that when one or more programs included in the electronic device are executed by the one or more processors 610, the programs may also perform related operations in the application control method provided in any embodiment of the present application.
One embodiment of the present application provides a computer-readable storage medium having stored thereon a computer program for executing an application control method when executed by a processor, the method comprising:
determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein, the knocking operation at different knocking positions generates different knocking vibration signals;
and controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
Optionally, the program, when executed by the processor, may be further configured to perform an application control method provided in any embodiment of the present application.
The computer storage media of the embodiments of the present application may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a flash Memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. A computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take a variety of forms, including, but not limited to: an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims (10)

1. An application control method, performed by a control device, the method comprising:
determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein, the knocking operation at different knocking positions generates different knocking vibration signals;
and controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
2. The method according to claim 1, wherein determining a target tapping vibration signal generated by an effective tapping operation on a predetermined body area comprises:
determining the amplitude of a part of vibration signals in the initial vibration signals acquired by the vibration sensor; the vibration sensor is arranged at a preset distance of the preset human body area;
if the amplitude of the partial vibration signal is determined to be larger than the effective knocking threshold value, determining a target starting position and a target ending position of the target knocking vibration signal in the initial vibration signal;
and determining the vibration signal from the target starting position to the target ending position in the initial vibration signal as the target knocking vibration signal.
3. The method of claim 2, wherein determining a target start position and a target end position of the target tap vibration signal in the initial vibration signal comprises:
taking a signal position when the initially detected signal amplitude is larger than a tapping vibration threshold value in the process of detecting the amplitude of the initial vibration signal as a target initial position;
taking the signal position when the detected signal amplitude is continuously smaller than the tapping vibration threshold value in the process of continuously detecting the amplitude of the initial vibration signal as a target end position; the size of the effective tapping threshold value is larger than that of the tapping vibration threshold value.
4. The method according to claim 2, wherein after determining the vibration signal from the target start position to the target end position in the initial vibration signal as the target tapping vibration signal, further comprising:
under the condition that the vibration sensor acquires at least two paths of initial vibration signals, filtering the target knocking vibration signal extracted from the initial vibration signals;
determining the signal-to-noise ratio of the target knocking vibration signal according to the pre-filtering signal and the post-filtering signal of the target knocking vibration signal;
and if the signal-to-noise ratio of the target knocking vibration signal is greater than a preset signal-to-noise ratio threshold value, determining that the target knocking vibration signal belongs to an effective knocking vibration signal.
5. The method according to claim 1, wherein determining a target tapping position of the effective tapping operation in the preset human body area according to the target tapping vibration signal comprises:
determining target knocking vibration characteristic information of the target knocking vibration signal;
determining standard knocking vibration characteristic information matched with the target knocking vibration characteristic information from a preset knocking vibration characteristic set; the method comprises the steps that a standard knocking vibration characteristic information in a knocking vibration signal set is associated with a unique preset knocking position;
and taking the preset knocking position associated with the standard knocking vibration characteristic information as a target knocking position of the effective knocking operation in the preset human body area.
6. The method according to claim 5, wherein determining standard tapping vibration feature information that matches the target tapping vibration feature information from a preconfigured tapping vibration feature set comprises:
determining feature information similarity between the target knocking vibration feature information and each standard knocking vibration feature information in a preset knocking vibration signal set;
and determining at least one standard knocking vibration characteristic information with the highest characteristic information similarity as the standard knocking vibration characteristic information matched with the target knocking vibration characteristic information.
7. The method according to claim 5, before determining standard tapping vibration feature information that matches the target tapping vibration feature information from a preconfigured tapping vibration feature set, further comprising:
when the training knocking vibration signal is used for the first time, the training knocking vibration signal generated by effective knocking operation of a user acting on a preset knocking position of a preset human body area is received;
processing the training knocking vibration signal to obtain optimized standard knocking vibration characteristic information of the training knocking vibration signal;
and associating the standard knocking vibration characteristic information with the preset knocking position to obtain a preset knocking vibration characteristic set.
8. An application control apparatus, configured to a control device, the apparatus comprising:
the knocking signal determining module is used for determining a target knocking vibration signal generated by effective knocking operation acting on a preset human body area;
the knocking position determining module is used for determining a target knocking position of the effective knocking operation in the preset human body area according to the target knocking vibration signal; wherein the tapping operation at different tapping positions produces different tapping vibration signals.
And the target application control module is used for controlling the target application associated with the control equipment according to the operation information associated with the target knocking position.
9. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the application control method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the application control method of any one of claims 1 to 7.
CN202010568585.2A 2020-06-19 2020-06-19 Application control method, device, equipment and storage medium Pending CN111752388A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010568585.2A CN111752388A (en) 2020-06-19 2020-06-19 Application control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010568585.2A CN111752388A (en) 2020-06-19 2020-06-19 Application control method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111752388A true CN111752388A (en) 2020-10-09

Family

ID=72675822

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010568585.2A Pending CN111752388A (en) 2020-06-19 2020-06-19 Application control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111752388A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112327783A (en) * 2020-11-17 2021-02-05 深圳Tcl新技术有限公司 Device control method, device, terminal and computer readable storage medium
CN113467748A (en) * 2021-07-12 2021-10-01 交互未来(北京)科技有限公司 Mobile equipment interaction method, system, storage medium and mobile equipment
CN114822521A (en) * 2022-04-15 2022-07-29 广州易而达科技股份有限公司 Sound box awakening method, device, equipment and storage medium
CN115665319A (en) * 2022-09-27 2023-01-31 深圳振科智能科技有限公司 Application control method, device, equipment and storage medium based on wireless earphone

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009129248A (en) * 2007-11-26 2009-06-11 Seiko Epson Corp Hit command processing system, operation system for electronic instrument, and electronic instrument
CN102770830A (en) * 2010-03-15 2012-11-07 日本电气株式会社 Input device, input method and program
CN106484088A (en) * 2015-09-02 2017-03-08 腾讯科技(深圳)有限公司 The control method of intelligent mobile terminal, device and intelligent mobile terminal
CN106919815A (en) * 2015-12-25 2017-07-04 中兴通讯股份有限公司 The operating method of a kind of electronic equipment, device and electronic equipment
CN107300971A (en) * 2017-06-09 2017-10-27 深圳大学 The intelligent input method and system propagated based on osteoacusis vibration signal
CN109032384A (en) * 2018-08-30 2018-12-18 Oppo广东移动通信有限公司 Music control method, device and storage medium and wearable device
CN109840480A (en) * 2019-01-04 2019-06-04 深圳大学 A kind of exchange method and interactive system of smartwatch
CN110297592A (en) * 2019-06-28 2019-10-01 联想(北京)有限公司 A kind of processing method and electronic equipment
CN110554768A (en) * 2018-05-31 2019-12-10 努比亚技术有限公司 intelligent wearable device control method and device and computer readable storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009129248A (en) * 2007-11-26 2009-06-11 Seiko Epson Corp Hit command processing system, operation system for electronic instrument, and electronic instrument
CN102770830A (en) * 2010-03-15 2012-11-07 日本电气株式会社 Input device, input method and program
CN106484088A (en) * 2015-09-02 2017-03-08 腾讯科技(深圳)有限公司 The control method of intelligent mobile terminal, device and intelligent mobile terminal
CN106919815A (en) * 2015-12-25 2017-07-04 中兴通讯股份有限公司 The operating method of a kind of electronic equipment, device and electronic equipment
CN107300971A (en) * 2017-06-09 2017-10-27 深圳大学 The intelligent input method and system propagated based on osteoacusis vibration signal
CN110554768A (en) * 2018-05-31 2019-12-10 努比亚技术有限公司 intelligent wearable device control method and device and computer readable storage medium
CN109032384A (en) * 2018-08-30 2018-12-18 Oppo广东移动通信有限公司 Music control method, device and storage medium and wearable device
CN109840480A (en) * 2019-01-04 2019-06-04 深圳大学 A kind of exchange method and interactive system of smartwatch
CN110297592A (en) * 2019-06-28 2019-10-01 联想(北京)有限公司 A kind of processing method and electronic equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
胡茑庆,胡雷,程哲编著: "《机械振动》", vol. 2017, 30 April 2017, 长沙:国防科技大学出版社, pages: 257 - 260 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112327783A (en) * 2020-11-17 2021-02-05 深圳Tcl新技术有限公司 Device control method, device, terminal and computer readable storage medium
CN113467748A (en) * 2021-07-12 2021-10-01 交互未来(北京)科技有限公司 Mobile equipment interaction method, system, storage medium and mobile equipment
CN114822521A (en) * 2022-04-15 2022-07-29 广州易而达科技股份有限公司 Sound box awakening method, device, equipment and storage medium
CN114822521B (en) * 2022-04-15 2023-07-11 广州易而达科技股份有限公司 Sound box awakening method, device, equipment and storage medium
CN115665319A (en) * 2022-09-27 2023-01-31 深圳振科智能科技有限公司 Application control method, device, equipment and storage medium based on wireless earphone
CN115665319B (en) * 2022-09-27 2024-04-30 苏州歪饼智能科技有限公司 Application control method, device, equipment and storage medium based on wireless earphone

Similar Documents

Publication Publication Date Title
CN111752388A (en) Application control method, device, equipment and storage medium
CN102568478B (en) Video play control method and system based on voice recognition
CN106708254B (en) Detector
JP5789270B2 (en) User interface providing apparatus and method using surface acoustic signal, and device having user interface
JP6012877B2 (en) Voice control system and method for multimedia device and computer storage medium
JP6844608B2 (en) Voice processing device and voice processing method
US20160247520A1 (en) Electronic apparatus, method, and program
CN110211589B (en) Awakening method and device of vehicle-mounted system, vehicle and machine readable medium
CN106971723A (en) Method of speech processing and device, the device for speech processes
CN103745723A (en) Method and device for identifying audio signal
WO2019105376A1 (en) Gesture recognition method, terminal and storage medium
CN104751852A (en) Sound processing method and device
US10770077B2 (en) Electronic device and method
CN107193914A (en) A kind of pronunciation inputting method and mobile terminal
CN110972112B (en) Subway running direction determining method, device, terminal and storage medium
CN105224448B (en) The method and apparatus for recording test scene
CN106228047A (en) A kind of application icon processing method and terminal unit
CN109714233B (en) Home control method and corresponding routing equipment
CN110085264B (en) Voice signal detection method, device, equipment and storage medium
CN115665319B (en) Application control method, device, equipment and storage medium based on wireless earphone
CN110070891B (en) Song identification method and device and storage medium
CN105373220B (en) It is interacted using position sensor and loudspeaker signal with the user of device
WO2016197430A1 (en) Information output method, terminal, and computer storage medium
CN112363622A (en) Character input method, character input device, electronic equipment and storage medium
Turchet Hard real-time onset detection of percussive sounds.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination