WO2021052187A1 - 基于超声波的丢帧处理方法、装置、移动终端及存储介质 - Google Patents

基于超声波的丢帧处理方法、装置、移动终端及存储介质 Download PDF

Info

Publication number
WO2021052187A1
WO2021052187A1 PCT/CN2020/113281 CN2020113281W WO2021052187A1 WO 2021052187 A1 WO2021052187 A1 WO 2021052187A1 CN 2020113281 W CN2020113281 W CN 2020113281W WO 2021052187 A1 WO2021052187 A1 WO 2021052187A1
Authority
WO
WIPO (PCT)
Prior art keywords
ultrasonic
mobile terminal
frame loss
loss rate
module
Prior art date
Application number
PCT/CN2020/113281
Other languages
English (en)
French (fr)
Inventor
彭冬炜
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to EP20865716.3A priority Critical patent/EP4021058A4/en
Publication of WO2021052187A1 publication Critical patent/WO2021052187A1/zh
Priority to US17/691,719 priority patent/US20220196815A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/20Arrangements for detecting or preventing errors in the information received using signal quality detector
    • H04L1/203Details of error rate determination, e.g. BER, FER or WER
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/523Details of pulse systems
    • G01S7/526Receivers
    • G01S7/527Extracting wanted echo signals
    • G01S7/5273Extracting wanted echo signals using digital techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/02Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
    • G01S15/04Systems determining presence of a target
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B11/00Transmission systems employing sonic, ultrasonic or infrasonic waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/20Monitoring; Testing of receivers
    • H04B17/21Monitoring; Testing of receivers for calibration; for correcting measurements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0036Systems modifying transmission characteristics according to link quality, e.g. power backoff arrangements specific to the receiver

Definitions

  • This application relates to the technical field of mobile terminals, and more specifically, to an ultrasonic-based frame loss processing method, device, mobile terminal, and storage medium.
  • this application proposes an ultrasonic-based frame loss processing method, device, mobile terminal, and storage medium to solve the above-mentioned problems.
  • an embodiment of the present application provides an ultrasonic-based frame loss processing method, which is applied to a mobile terminal, the mobile terminal includes an ultrasonic receiving module and an ultrasonic proximity calculation module, and the method includes: using the ultrasonic receiving module Receive ultrasonic data, and transmit the ultrasonic data to the ultrasonic proximity calculation module; obtain the load factor of the mobile terminal, and obtain the transmission process of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module
  • the frame loss rate in the frame loss rate; the parameter adjustment method is determined based on the load rate and the frame loss rate, and the system performance of the mobile terminal is adjusted based on the parameter adjustment method so that the frame loss rate is less than the target loss rate Frame rate.
  • an embodiment of the present application provides an ultrasonic-based frame loss processing device, which is applied to a mobile terminal.
  • the mobile terminal includes an ultrasonic receiving module and an ultrasonic proximity calculation module.
  • the device includes an ultrasonic data transmission module. It receives ultrasonic data through the ultrasonic receiving module and transmits the ultrasonic data to the ultrasonic proximity calculation module; a data acquisition module is used to acquire the load factor of the mobile terminal, and acquire the ultrasonic data from the The frame loss rate in the transmission process from the ultrasonic receiving module to the ultrasonic proximity calculation module; a parameter adjustment method determining module for determining a parameter adjustment method based on the load rate and the frame loss rate, and based on the parameter adjustment method The system performance of the mobile terminal is adjusted so that the frame loss rate is less than the target frame loss rate.
  • an embodiment of the present application provides a mobile terminal, including an ultrasonic transmitting module, an ultrasonic proximity computing module, a memory, and a processor.
  • the ultrasonic transmitting module, the ultrasonic proximity computing module, and the memory and the memory are coupled to the The processor, the memory stores instructions, and the processor executes the foregoing method when the instructions are executed by the processor.
  • an embodiment of the present application provides a computer-readable storage medium, and the computer-readable storage medium stores program code, and the program code can be invoked by a processor to execute the foregoing method.
  • FIG. 1 shows a schematic diagram of the Doppler effect provided by an embodiment of the present application
  • FIG. 2 shows a schematic diagram of a propagation path of ultrasonic waves provided by an embodiment of the present application
  • FIG. 3 shows a schematic flowchart of an ultrasonic-based frame loss processing method provided by an embodiment of the present application
  • FIG. 4 shows a schematic flowchart of an ultrasonic-based frame loss processing method provided by another embodiment of the present application
  • Fig. 5 shows a block diagram of a module of an ultrasonic-based frame loss processing apparatus provided by an embodiment of the present application
  • FIG. 6 shows a block diagram of a mobile terminal for executing the ultrasonic-based frame loss processing method according to an embodiment of the present application
  • Fig. 7 shows a storage unit for storing or carrying program codes for implementing the ultrasonic-based frame loss processing method according to the embodiment of the present application.
  • the solutions adopted by the mobile terminal in the proximity recognition scene include the micro-slit infrared solution, the TP+ infrared solution, the ultrasonic proximity technology solution, and the traditional infrared solution.
  • the traditional infrared scheme has been basically abandoned because it takes up the space of the front screen of the mobile terminal; the micro-slit infrared scheme has high structural requirements, and generally does not meet the requirements, so it is rarely used; the recognition rate of the TP+ infrared scheme needs to be Improved, and poor anti-interference ability; and the use of ultrasonic proximity technology because of its strong anti-interference ability, high recognition rate and other advantages are more and more valued and adopted.
  • the ultrasonic proximity detection is to pick up ultrasonic waves from a microphone, and then send the ultrasonic waves to the recognition module for processing, and the recognition module uses continuous ultrasonic signals as the basis for proximity judgment.
  • the mobile terminal includes an ultrasonic transmitting module and an ultrasonic receiving module at the same time.
  • the ultrasonic transmitting module moves relative to the object, the essence is that the mobile terminal moves relative to the object, so the ultrasonic receiving module also moves relative to the object.
  • Figure 1 shows a schematic diagram of the Doppler effect provided by an embodiment of the present application. According to the Doppler effect, the wavelength of the object radiation is caused by the relative motion of the wave source (mobile terminal) and the observer (object). Produce changes, the Doppler effect formula is as follows:
  • f' is the observed frequency
  • f is the original emission frequency of the emission source in the medium
  • v is the propagation speed of the wave in the medium
  • v 0 is the movement speed of the observer. If the observer is close to the emission source, it will be forward + number of operation symbol, otherwise it is - number
  • v s is the moving speed of the transmission source, if the object approaches the front of the viewer is an operation symbol - number, and vice versa for the + sign.
  • the frequency of the signal received by the observer when the emission source is relatively close to the observer, the frequency of the signal received by the observer will increase; when the emission source is relatively far away from the observer, the frequency of the signal received by the observer will decrease; When the transmitting source and the observer are relatively stationary, the frequency of the signal received by the observer is consistent with the transmitting source.
  • FIG. 2 shows a schematic diagram of the propagation path of ultrasonic waves provided by an embodiment of the present application.
  • the mobile terminal may transmit ultrasonic waves through an ultrasonic wave transmitting module (such as a receiver, a speaker, a special ultrasonic transmitter, etc.).
  • an ultrasonic wave transmitting module such as a receiver, a speaker, a special ultrasonic transmitter, etc.
  • Part of the ultrasonic wave travels through the air directly to the ultrasonic receiver module (pickup) (path 1 in Figure 2), and a part of the ultrasonic wave travels through the air and reflects on the object before reaching the ultrasonic receiver module (path 2 in Figure 2).
  • the ultrasonic receiving module picks up is the superimposed signal of direct sound and reflected sound, which is converted into audio signal by A/D converter, and the audio data is processed by algorithm to obtain the operating state of the object relative to the mobile terminal, and then guide the screen of the mobile terminal to be lit State or off state.
  • the mobile terminal will lose the ultrasonic frame due to the excessive load of the system, which will affect the accuracy of the mobile terminal's recognition of the relative motion state of the object.
  • the inventor found that it is possible to set a relatively high The system frequency and throughput ensure that frame loss does not occur in most cases, but in some extreme scenarios, the system still has frame loss, and only empirical values are used to set fixed parameters. There may be frame loss if the setting is too large, and resource waste and increased power consumption may occur. Therefore, in response to the above problems, the inventor has discovered through long-term research and proposed the ultrasonic-based frame loss processing method, device, mobile terminal, and storage medium provided by the embodiments of this application. Adjust system performance to reduce frame loss and improve user experience. Among them, the specific ultrasonic-based frame loss processing method will be described in detail in the subsequent embodiments.
  • FIG. 3 shows a schematic flowchart of an ultrasonic-based frame loss processing method provided by an embodiment of the present application.
  • the ultrasonic-based frame loss processing method is used to intelligently adjust the system performance through the load rate and the frame loss rate of the mobile terminal to reduce the frame loss rate and improve the user experience.
  • the ultrasonic-based frame dropping processing method is applied to the ultrasonic-based frame dropping processing device 200 as shown in FIG. 5 and a mobile terminal configured with the ultrasonic-based frame dropping processing device 200 (Fig. 6).
  • the following will take a mobile terminal as an example to describe the specific process of this embodiment.
  • the mobile terminal applied in this embodiment may be a smart phone, a tablet computer, a wearable electronic device, etc., which is not limited here.
  • the mobile terminal may include an ultrasonic receiving module and an ultrasonic proximity calculation module.
  • the process shown in FIG. 3 will be described in detail below.
  • the ultrasonic-based frame loss processing method may specifically include the following steps :
  • Step S101 Receive ultrasonic data through the ultrasonic receiving module, and transmit the ultrasonic data to the ultrasonic proximity calculation module.
  • the mobile terminal may include at least an ultrasonic receiving module and an ultrasonic proximity calculation module, where the ultrasonic receiving module may be used to receive ultrasonic data and transmit the ultrasonic data to the ultrasonic proximity calculation module, and the ultrasonic proximity calculation module is used for Calculate based on the received ultrasonic data.
  • the ultrasound receiving module can receive ultrasound data in real time, can receive ultrasound data at regular intervals, can receive ultrasound data at preset time intervals, or can receive ultrasound data based on user operations, etc., which are not limited here.
  • the mobile terminal may be provided with a switch.
  • the switch can be used for the user's operation to control turning on or off the ultrasonic data receiving function of the ultrasonic receiving module. It is a virtual button or virtual control.
  • the mobile terminal can turn on or off the ultrasonic data receiving function of the ultrasonic receiving module in response to the user's touch operation on the virtual button or virtual control corresponding to the switch.
  • the ultrasonic data received by the ultrasonic receiving module of the mobile terminal may include the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal and the ultrasonic data returned after being reflected by the object, and the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal propagated through the air.
  • the ultrasonic data that is directly received afterwards and the ultrasonic data of the environment in which the mobile terminal is located may include the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal and the ultrasonic data returned after being reflected by the object, and the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal propagated through the air.
  • the ultrasonic data received by the ultrasonic receiving module may include: the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal is reflected and returned after the ultrasonic data is transmitted through the air, and the ultrasonic data sent by the ultrasonic transmitting module of the mobile terminal
  • the ultrasonic data returned after the data is reflected, the direct ultrasonic data after the ultrasonic data is transmitted through the control, and the ultrasonic data of the environment in which the mobile terminal is located are not limited here.
  • Step S102 Obtain the load factor of the mobile terminal, and obtain the frame loss rate during the transmission of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module.
  • the mobile terminal may include a system load detection module, which is mainly responsible for detecting the overall situation of the system.
  • the system load detection module may be used to detect the load rate of the mobile terminal.
  • the load rate may include the usage rate of the central processing unit of the mobile terminal and/or the usage rate of the memory of the mobile terminal, which is not limited here.
  • the load factor of the mobile terminal can be acquired and updated in real time, and the load factor of the mobile terminal can also be acquired when the ultrasonic data is transmitted to the ultrasonic proximity calculation module, which is not limited here.
  • the ultrasonic receiving module and the ultrasonic proximity calculation module are respectively in two different threads of the mobile terminal, and there is data exchange between the two. Therefore, the ultrasonic data is transmitted from the ultrasonic receiving module to the ultrasonic proximity calculation module. During the process, there may be frame loss, which further affects the calculation result of the proximity detection by the ultrasonic proximity calculation module. Therefore, in some embodiments, the mobile terminal can obtain the frame loss rate during the transmission of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module. Among them, the mobile terminal can obtain the frame loss rate during the transmission of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module within a preset time period.
  • the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module within 100ms.
  • the frame loss rate in the transmission process; the frame loss rate in the transmission process of the preset number of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module can be obtained, for example, 100 frames of ultrasonic data can be obtained from the ultrasonic receiving module to the ultrasonic
  • the frame loss rate during the transmission process of the proximity calculation module; the frame loss rate during the transmission process of all the ultrasonic data received by the ultrasonic receiver module from the ultrasonic receiver module to the ultrasonic proximity calculation module can be obtained, for example, when the ultrasonic receiver module receives 1000 Frame ultrasonic data, it is possible to obtain the frame loss rate in the transmission process of 100 frames of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module, which is not limited here.
  • the load factor of the mobile terminal can be obtained first, and then the frame loss rate during the transmission of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module; the ultrasonic data can be obtained first from the ultrasonic receiving module to the ultrasonic proximity calculation
  • the frame loss rate in the transmission process of the module, and then the load rate of the mobile terminal; the load rate of the mobile terminal and the frame loss rate in the transmission process of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module can also be obtained at the same time. This is not limited.
  • Step S103 Determine a parameter adjustment method based on the load rate and the frame loss rate, and adjust the system performance of the mobile terminal based on the parameter adjustment method, so that the frame loss rate is less than the target frame loss rate.
  • the parameter adjustment method may be determined based on the load rate and the frame loss rate, and based on This parameter adjustment method adjusts the system energy efficiency of the mobile terminal so that the frame loss rate is less than the target frame loss rate, thereby improving the accuracy of the proximity detection and the user experience.
  • system effectiveness refers to the ability of a system to meet given quantitative characteristics and service requirements under specified conditions. It is a comprehensive reflection of system availability, credibility and inherent capabilities.
  • the target frame loss rate can be set when the mobile terminal leaves the factory, or it can be initially set when the mobile terminal leaves the factory and updated during use. For example, during the use of the mobile terminal, it can be set according to the mobile terminal Different environments determine different target frame loss rates. Among them, the target frame loss rate can be set to 5%, 6%, etc., which is not limited here.
  • the parameters adjusted by the mobile terminal may include clock frequency and/or bandwidth.
  • the mobile terminal may adjust the clock frequency and/or bandwidth through an API interface provided by the system.
  • the clock frequency and bandwidth can affect the data transmission rate of the mobile terminal. The larger the clock frequency and bandwidth, the higher the data transmission rate.
  • the higher the system efficiency of the mobile terminal the lower the frame loss rate of the system; and the clock The smaller the frequency and bandwidth, the lower the data transmission rate.
  • the lower the system performance of the mobile terminal the greater the frame loss rate of the system.
  • the parameter adjustment methods may include: increasing the clock frequency and/or bandwidth of the mobile terminal, reducing the clock frequency and/or bandwidth of the mobile terminal, and maintaining the clock frequency and/or bandwidth of the mobile terminal. Therefore, in this embodiment, the parameter adjustment method can be determined based on the load rate and the frame loss rate to increase the clock frequency and/or bandwidth of the mobile terminal, and to increase the mobile terminal's clock frequency and/or bandwidth by increasing the clock frequency and/or bandwidth of the mobile terminal.
  • the parameter adjustment method can be determined based on the load rate and the frame loss rate to reduce the clock frequency and/or bandwidth of the mobile terminal, and by reducing the clock frequency and/or bandwidth of the mobile terminal The method reduces the system performance of the mobile terminal, and reduces the function of the mobile terminal when the frame loss rate is less than the target frame loss rate; the parameter adjustment method can be determined based on the load rate and the frame loss rate to maintain the clock frequency of the mobile terminal and/or The bandwidth remains unchanged, and the system performance of the mobile terminal is kept unchanged by keeping the clock frequency and/or bandwidth of the mobile terminal unchanged, so that the frame loss rate is less than the target frame loss rate.
  • the ultrasonic-based frame loss processing method receives ultrasonic data through an ultrasonic receiving module, and transmits the ultrasonic data to the ultrasonic proximity calculation module, obtains the load factor of the mobile terminal, and obtains the ultrasonic data from the ultrasonic receiving module to the ultrasonic receiving module.
  • the ultrasonic approach calculates the frame loss rate in the transmission process of the module, determines the parameter adjustment method based on the load rate and the frame loss rate, and adjusts the system performance of the mobile terminal based on the parameter adjustment method, so that the frame loss rate is less than the target frame loss rate , So as to reduce the frame loss rate and improve the user experience by intelligently adjusting the system performance through the load rate and frame loss rate of the mobile terminal.
  • FIG. 4 shows a schematic flowchart of an ultrasonic-based frame loss processing method according to another embodiment of the present application. This method is applied to the above-mentioned mobile terminal.
  • the mobile terminal includes an ultrasonic receiving module, an ultrasonic proximity calculation module, and an ultrasonic transmitting module.
  • the process shown in FIG. 4 will be described in detail below.
  • the ultrasonic-based frame loss processing method may be specifically It includes the following steps:
  • Step S201 Continuously receive multiple frames of ultrasonic data through the ultrasonic receiving module, and add multiple tags to the multiple frames of ultrasonic data, and the multiple frames of ultrasonic data correspond to the multiple tags in a one-to-one correspondence.
  • the mobile terminal may continuously receive multiple frames of ultrasonic data through the ultrasonic receiving module, and add multiple tags to the received multiple frames of ultrasonic data, where the multiple frames of ultrasonic data correspond to the multiple tags one to one, that is, A label is added to each frame of ultrasonic data in the multiple frames of ultrasonic data, and each label is used to identify its corresponding ultrasonic data.
  • the ultrasonic receiving module continuously receives 1000 frames of ultrasonic data
  • 1000 tags can be added to the 1000 frames of ultrasonic data, and each frame of ultrasonic data in the 1000 frames of ultrasonic data corresponds to one of the 1000 tags.
  • the plurality of tags may include one or a combination of number tags, character tags, letter tags, and image tags.
  • multiple tags may be different, partly the same, or all the same.
  • the multiple tags may be "1, 2, 3...n", where n is the number of frames of ultrasound data ;
  • multiple tags can include "a, a, b, b...m, m", etc.; when multiple tags are all the same, multiple tags can include "1, 1, 1, 1" etc., it is not limited here.
  • Step S202 Transmit the multiple frames of ultrasonic data carrying the multiple tags to the ultrasonic proximity calculation module.
  • the mobile terminal may transmit multi-frame ultrasound data carrying multiple tags to the ultrasound proximity calculation module.
  • Step S203 Obtain the number of tags received by the ultrasonic proximity calculation module.
  • each frame of ultrasonic data received by the ultrasonic proximity calculation module carries a tag. Therefore, the number of tags received by the ultrasonic proximity calculation module can represent the number of frames of ultrasonic data received by the ultrasonic proximity calculation module. For example, if the ultrasonic proximity calculation module receives 960 tags, it can indicate that the number of frames of ultrasonic data received by the ultrasonic proximity calculation module is 960 frames. Therefore, in some embodiments, after the ultrasonic receiving module completes the transmission of the multi-frame ultrasonic data carrying multiple tags, the number of tags received by the ultrasonic proximity calculation module can be obtained.
  • Step S204 Based on the number of tags received by the ultrasonic proximity calculation module and the corresponding numbers of the multiple tags, calculate the loss during the transmission of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module. Frame rate.
  • the mobile terminal can calculate the number of ultrasonic data from the ultrasonic receiving module to the number of tags received by the ultrasonic proximity calculation module and the corresponding number of multiple tags.
  • the ultrasonic approach calculates the frame loss rate during the transmission of the module.
  • Step S205 Obtain the usage rate of the central processing unit of the mobile terminal and the usage rate of the memory of the mobile terminal.
  • the mobile terminal can detect the usage of the central processing unit to obtain the remaining resources of the central processing unit.
  • the operating system of the mobile terminal is the Android system
  • the use of the system and the process time can be obtained through the ProcessStats class in the Android system.
  • the specific implementation principle is to read the files in the /proc directory.
  • the kernel will update the files in the /proc directory, write the operation status of the PID into the corresponding file, and get it to the center based on the above operation status.
  • the remaining resources of the processor, where the remaining resources of the central processing unit may include the remaining usage rate of the central processing unit, so as to obtain the usage rate of the central processing unit based on the remaining usage rate of the central processing unit.
  • the mobile terminal can detect the usage of the memory to obtain the remaining resources of the memory of the mobile terminal.
  • the total amount of memory of the mobile terminal can be obtained by reading the information in the file "/proc/meminfo”, and the mobile terminal’s information can be obtained through the ActivityManager.getMemoryInfo(ActivityManager.MemoryInfo) method.
  • the "/proc/meminfo" file records some memory information of the android mobile terminal. Enter “adb shell” in the command line window to enter the shell environment, and enter "cat/proc/meminfo” to display it on the command line
  • the contents of the meminfo file to obtain memory information. It is understandable that after obtaining the total amount of memory of the mobile terminal and the amount of currently available memory based on the foregoing method, the usage rate of the memory of the mobile terminal can be calculated.
  • Step S206 Obtain the load rate of the mobile terminal based on the utilization rate of the central processing unit and the utilization rate of the memory.
  • the mobile terminal after the mobile terminal obtains the usage rate of the central processing unit and the usage rate of the memory, it can obtain the load rate of the mobile terminal based on the usage rate of the central processing unit and the usage rate of the memory.
  • the load rate of the mobile terminal is positively correlated with the utilization rate of the central processing unit and positively correlated with the utilization rate of the memory.
  • step S203-step S204 can be set before step S205-step S206, step S203-step S204 can be set after step S205-step S206, and step S203-step S204 can also be set in synchronization with step S205-step S206. This is not limited.
  • Step S207 When the load rate is less than the load rate threshold and the frame loss rate is greater than the first frame loss rate threshold, determine that the parameter adjustment method is to increase the clock frequency and/or bandwidth of the mobile terminal.
  • the mobile terminal may be preset with a load rate threshold, and the load rate threshold may be used as a basis for determining the obtained load rate of the mobile terminal. Therefore, in this embodiment, when obtaining the load rate of the mobile terminal, Later, the load factor of the mobile terminal can be compared with the load factor threshold to determine the relationship between the load factor and the load factor threshold.
  • the mobile terminal may preset and store a first frame loss rate threshold, which is used as a loss in the transmission process of the acquired ultrasound data from the ultrasound receiving module to the ultrasound proximity calculation module. The basis for determining the frame rate.
  • the frame loss rate in obtaining the frame loss rate during the transmission of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module, the frame loss rate can be compared with the first frame loss rate threshold.
  • the load rate threshold may be 80%
  • the first frame loss rate threshold may be 5%.
  • the parameter adjustment method can be determined to increase the clock frequency and/or bandwidth of the mobile terminal, so as to improve the system performance of the mobile terminal, reduce the frame loss rate of the mobile terminal, and improve the accuracy of the proximity detection.
  • the judgment result indicates that the load rate is not less than the load rate threshold and the frame loss rate is greater than the first frame loss rate threshold, it indicates that the load rate of the mobile terminal is higher and the frame loss rate is higher.
  • the mobile terminal can send out prompt information, which is used to prompt the user to make adjustments to the operation of the mobile terminal, so as to reduce the load rate of the mobile terminal.
  • Step S208 When the load rate is less than the load rate threshold and the frame loss rate is less than the second frame loss rate threshold, determine that the parameter adjustment method is to reduce the clock frequency and/or bandwidth of the mobile terminal, where , The second frame loss rate threshold is less than the first frame loss rate threshold.
  • the mobile terminal may be preset with a load rate threshold, and the load rate threshold may be used as a basis for determining the obtained load rate of the mobile terminal. Therefore, in this embodiment, when obtaining the load rate of the mobile terminal, Later, the load factor of the mobile terminal can be compared with the load factor threshold to determine the relationship between the load factor and the load factor threshold.
  • the mobile terminal may preset and store a second frame loss rate threshold, and the second frame loss rate threshold is used as a loss during the transmission of the acquired ultrasound data from the ultrasound receiving module to the ultrasound proximity calculation module. The basis for determining the frame rate.
  • the frame loss rate when obtaining the frame loss rate during the transmission of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module, the frame loss rate can be compared with the second frame loss rate threshold. , To determine the relationship between the frame loss rate and the second frame loss rate threshold.
  • the second frame loss rate is less than the first frame loss rate.
  • the load rate threshold may be 90%
  • the second frame loss rate threshold may be 1%.
  • the parameter adjustment method can be determined to reduce the clock frequency and/or bandwidth of the mobile terminal to reduce the system performance of the mobile terminal , Reduce the power consumption of mobile terminals.
  • Step S209 When the load rate is less than the load rate threshold and the frame loss rate is greater than the second frame loss rate threshold and less than the first frame loss rate threshold, determine that the parameter adjustment method is to maintain all The clock frequency/or bandwidth of the mobile terminal is unchanged.
  • the mobile terminal may be preset with a load rate threshold, and the load rate threshold may be used as a basis for determining the obtained load rate of the mobile terminal. Therefore, in this embodiment, when obtaining the load rate of the mobile terminal, Later, the load factor of the mobile terminal can be compared with the load factor threshold to determine the relationship between the load factor and the load factor threshold.
  • the mobile terminal may preset and store a first frame loss rate threshold and a second frame loss rate threshold. The first frame loss rate threshold and the second frame loss rate threshold are used as the acquired ultrasound data from The basis for determining the frame loss rate during the transmission from the ultrasonic receiving module to the ultrasonic proximity calculation module.
  • the frame loss rate during the transmission of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module is obtained.
  • the frame loss rate can be compared with the first frame loss rate threshold and the second frame loss rate threshold to determine the relationship between the frame loss rate and the first frame loss rate threshold and the second frame loss rate threshold.
  • the second frame loss rate is less than the first frame loss rate.
  • the load rate threshold may be 90%
  • the first frame loss rate threshold may be 5%
  • the second frame loss rate threshold may be 1%.
  • the judgment result indicates that the load rate is less than the load rate threshold, and the frame loss rate is greater than the second frame loss rate threshold and less than the first frame loss rate threshold, it indicates that the load rate of the mobile terminal is low and the frame loss rate is lower than the first frame loss rate threshold.
  • the accuracy of proximity detection has a small impact, that is, the system performance of the mobile terminal can be kept unchanged. Therefore, the parameter adjustment method can be determined to keep the clock frequency and/or bandwidth of the mobile terminal unchanged to ensure the frame loss of the mobile terminal. Both the rate and power consumption are within the preset range.
  • the judgment result indicates that the load rate is not less than the load rate threshold, and the frame loss rate is greater than the second frame loss rate threshold and less than the first frame loss rate threshold, it indicates that the mobile terminal has a higher load rate and a lower frame loss rate. Decreasing system performance will cause the load of the mobile terminal to increase rapidly, which may lead to a higher load of the mobile terminal and cause the mobile terminal to freeze. Therefore, the judgment result indicates that the load rate is not less than the load rate threshold and the frame loss rate is greater than the first 2. When the frame loss rate threshold is less than the first frame loss rate threshold, processing may not be performed.
  • Step S210 Send an ultrasonic signal through the ultrasonic transmitter module, and receive an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiver module.
  • the mobile terminal can be used for proximity detection.
  • the mobile terminal includes an ultrasonic transmitting module and an ultrasonic receiving module.
  • the mobile terminal may transmit an ultrasonic signal through the ultrasonic transmitting module, and receive an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiving module.
  • Step S211 Obtain the attribute value of the ultrasonic signal in the transmission process from the ultrasonic sending module to the ultrasonic receiving module, and calculate the Doppler effect area difference of the ultrasonic signal in the transmission process based on the attribute value And Doppler effect area sum.
  • the mobile terminal after the mobile terminal receives the ultrasonic signal through the ultrasonic receiving device, it can obtain the attribute value of the ultrasonic signal during the transmission process, and calculate the Doppler effect of the ultrasonic signal during the transmission process based on the attribute value Area difference and Doppler effect area sum.
  • the transmission process can include the process of ultrasonic signal transmission and the process of ultrasonic signal reception, and the attribute value can include the transmission frequency, transmission amplitude, and transmission time of the ultrasonic signal sent by the ultrasonic transmitter.
  • the ultrasonic wave received by the ultrasonic receiver The frequency variation range, receiving amplitude, receiving time, etc. of the signal are not limited here.
  • Step S212 Determine the relative motion state of the mobile terminal and the object according to the Doppler effect area difference and the Doppler effect area sum.
  • the mobile terminal after the mobile terminal obtains the Doppler effect area difference and the Doppler effect area sum, it can obtain the relative motion between the mobile terminal and the object based on the Doppler effect area difference and the Doppler effect area sum.
  • the display screen of the mobile terminal is controlled to be in the on-screen state or the off-screen state, thereby improving the accuracy and stability of the state control of the display screen, effectively reducing the power consumption of the mobile terminal and reducing The radiation caused by the bright screen when the display is close to the human face.
  • the ultrasonic-based frame loss processing method continuously receives multiple frames of ultrasonic data through an ultrasonic receiving module, and adds multiple tags to the multiple frames of ultrasonic data, and the multiple frames of ultrasonic data correspond to the multiple tags in a one-to-one manner. Transmit the multi-frame ultrasonic data with multiple tags to the ultrasonic proximity calculation module to obtain the number of tags received by the ultrasonic proximity calculation module, and calculate based on the number of tags received by the ultrasonic proximity calculation module and the corresponding number of multiple tags The frame loss rate during the transmission of ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module.
  • the utilization rate of the central processing unit of the mobile terminal and the utilization rate of the memory of the mobile terminal obtain the load rate of the mobile terminal based on the utilization rate of the central processing unit and the utilization rate of the memory.
  • the load rate is less than the load rate threshold and the frame loss rate is greater than the first frame loss rate threshold, determine the parameter adjustment method to increase the clock frequency and/or bandwidth of the mobile terminal; when the load rate is less than the load rate threshold and the frame loss rate is less than the second
  • the parameter adjustment method is determined to reduce the clock frequency and/or bandwidth of the mobile terminal.
  • the second frame loss rate threshold is less than the first frame loss rate threshold; when the load rate is less than the load rate threshold and the frame loss rate is greater than When the second frame loss rate threshold is less than the first frame loss rate threshold, it is determined that the parameter adjustment method is to keep the clock frequency/or bandwidth of the mobile terminal unchanged.
  • this embodiment also obtains the frame loss rate by adding tags to each frame of ultrasonic data to improve the accuracy of the obtained frame loss rate, and the central processing unit The utilization rate of the content and the utilization rate of the content are used to obtain the debt ratio of the mobile terminal, which improves the accuracy of the debt ratio obtained.
  • the parameter adjustment method is determined by judging the debt ratio and the debt ratio threshold and judging the frame loss rate and the frame loss rate threshold to improve the accuracy of the parameter adjustment method.
  • FIG. 5 shows a block diagram of a device 200 for processing an ultrasound-based frame loss according to an embodiment of the present application.
  • the ultrasonic-based frame loss processing device 200 is applied to the above-mentioned mobile terminal, and the mobile terminal includes an ultrasonic receiving module and an ultrasonic proximity calculation module.
  • the ultrasonic-based frame loss processing device 200 Including: an ultrasonic data transmission module 210, a data acquisition module 220, and a parameter adjustment mode determination module 230, where:
  • the ultrasonic data transmission module 210 is configured to receive ultrasonic data through the ultrasonic receiving module and transmit the ultrasonic data to the ultrasonic proximity calculation module. Further, the ultrasonic data transmission module 210 includes: an ultrasonic data receiving sub-module and an ultrasonic data transmission sub-module, wherein:
  • the ultrasonic data receiving sub-module is configured to continuously receive multiple frames of ultrasonic data through the ultrasonic receiving module, and add multiple tags to the multiple frames of ultrasonic data, and the multiple frames of ultrasonic data correspond to the multiple tags in a one-to-one correspondence.
  • the ultrasonic data transmission sub-module is used to transmit the multi-frame ultrasonic data carrying the multiple tags to the ultrasonic proximity calculation module.
  • the data acquisition module 220 is configured to acquire the load factor of the mobile terminal and acquire the frame loss rate during the transmission of the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculation module. Further, the data acquisition module 220 includes: a tag data acquisition sub-module and a frame loss rate acquisition sub-module, wherein:
  • the label quantity acquisition sub-module is used to acquire the number of labels received by the ultrasonic proximity calculation module.
  • the frame loss rate acquisition sub-module is used to calculate the ultrasonic data from the ultrasonic receiving module to the ultrasonic proximity calculating module based on the number of tags received by the ultrasonic proximity calculation module and the corresponding number of the multiple tags The frame loss rate during transmission.
  • the data acquisition module 220 includes: a utilization rate acquisition sub-module and a debt ratio acquisition sub-module, wherein:
  • the utilization rate obtaining submodule is used to obtain the utilization rate of the central processing unit of the mobile terminal and the utilization rate of the memory of the mobile terminal.
  • the debt ratio obtaining sub-module is configured to obtain the load ratio of the mobile terminal based on the utilization rate of the central processing unit and the utilization rate of the memory.
  • the parameter adjustment mode determination module 230 is configured to determine a parameter adjustment mode based on the load rate and the frame loss rate, and adjust the system performance of the mobile terminal based on the parameter adjustment mode, so that the frame loss rate Less than the target frame loss rate. Further, the parameter adjustment method determining module 230 includes: a parameter increasing sub-module, a parameter decreasing sub-module, and a parameter maintaining sub-module, wherein:
  • the parameter improvement submodule is configured to determine that the parameter adjustment method is to increase the clock frequency and/or bandwidth of the mobile terminal when the load rate is less than the load rate threshold and the frame loss rate is greater than the first frame loss rate threshold .
  • the parameter reduction submodule is configured to determine that the parameter adjustment method is to reduce the clock frequency of the mobile terminal and/or when the load rate is less than the load rate threshold and the frame loss rate is less than the second frame loss rate threshold. Or bandwidth, wherein the second frame loss rate threshold is less than the first frame loss rate threshold.
  • the parameter retention sub-module is configured to determine the parameter adjustment when the load rate is less than the load rate threshold and the frame loss rate is greater than the second frame loss rate threshold and less than the first frame loss rate threshold The way is to keep the clock frequency/or bandwidth of the mobile terminal unchanged.
  • the mobile terminal includes an ultrasonic sending module
  • the ultrasonic-based frame loss processing device 200 further includes: an ultrasonic signal receiving module, an attribute value acquiring module, and a relative motion state determining module, wherein:
  • the ultrasonic signal receiving module is used for sending ultrasonic signals through the ultrasonic transmitting module, and receiving ultrasonic signals returned by the ultrasonic signal after encountering an object through the ultrasonic receiving module.
  • the attribute value acquiring module is used to acquire the attribute value of the ultrasonic signal in the transmission process from the ultrasonic sending module to the ultrasonic receiving module, and calculate the Doppler value of the ultrasonic signal in the transmission process based on the attribute value.
  • the relative motion state determination module is configured to determine the relative motion state of the mobile terminal and the object according to the Doppler effect area difference and the Doppler effect area sum.
  • the coupling between the modules may be electrical, mechanical or other forms of coupling.
  • each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software function modules.
  • FIG. 6 shows a structural block diagram of a mobile terminal 100 provided by an embodiment of the present application.
  • the mobile terminal 100 may be an electronic device capable of running application programs, such as a smart phone, a tablet computer, or an e-book.
  • the mobile terminal 100 in this application may include one or more of the following components: a processor 110, a memory 120, a display screen 130, an ultrasonic proximity computing module 140, an ultrasonic receiving module 150, and one or more application programs, of which one or more
  • the application program may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the foregoing method embodiment.
  • the processor 110 may include one or more processing cores.
  • the processor 110 uses various interfaces and lines to connect various parts of the entire mobile terminal 100, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120.
  • Various functions and processing data of the mobile terminal 100 may use at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA).
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA Programmable Logic Array
  • the processor 110 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like.
  • the CPU mainly processes the operating system, user interface, and application programs; the GPU is used for rendering and drawing of display content; the modem is used for processing wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented by a communication chip alone.
  • the memory 120 may include random access memory (RAM) or read-only memory (Read-Only Memory).
  • the memory 120 may be used to store instructions, programs, codes, code sets or instruction sets.
  • the memory 120 may include a program storage area and a data storage area, where the program storage area may store instructions for implementing the operating system and instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.) , Instructions used to implement the following various method embodiments, etc.
  • the data storage area can also store data (such as phone book, audio and video data, chat record data) created by the terminal 100 during use.
  • the display screen 130 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the mobile terminal 100. These graphical user interfaces can be composed of graphics, text, icons, numbers, videos, and any combination thereof.
  • the display screen 130 may be a liquid crystal display (LCD) or an organic light-emitting diode (OLED), which is not limited here.
  • FIG. 7 shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • the computer-readable medium 300 stores program code, and the program code can be invoked by a processor to execute the method described in the foregoing method embodiment.
  • the computer-readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium.
  • the computer-readable storage medium 300 has storage space for the program code 310 for executing any method steps in the above-mentioned methods. These program codes can be read from or written into one or more computer program products.
  • the program code 310 may be compressed in a suitable form, for example.
  • the ultrasonic-based frame loss processing method, device, mobile terminal, and storage medium receive ultrasonic data through the ultrasonic receiving module, and transmit the ultrasonic data to the ultrasonic proximity calculation module to obtain the mobile terminal

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Acoustics & Sound (AREA)
  • Electromagnetism (AREA)
  • Telephone Function (AREA)

Abstract

本申请公开了一种基于超声波的丢帧处理方法、装置、移动终端及存储介质,涉及移动终端技术领域。该方法应用于移动终端,该移动终端包括超声波接收模块和超声波接近计算模块,所述方法包括:通过超声波接收模块接收超声波数据,并将超声波数据传输给超声波接近计算模块,获取移动终端的负载率,并获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,基于负载率和丢帧率确定参数调整方式,并基于该参数调整方式对移动终端的***效能进行调整,以使丢帧率小于目标丢帧率。本申请实施例通过移动终端的负载率和丢帧率智能调节***效能以降低丢帧率,提高用户体验。

Description

基于超声波的丢帧处理方法、装置、移动终端及存储介质
相关申请的交叉引用
本申请要求于2019年09月18日提交的申请号为CN201910882078.3的中国申请的优先权,其在此出于所有目的通过引用将其全部内容并入本文。
技术领域
本申请涉及移动终端技术领域,更具体地,涉及一种基于超声波的丢帧处理方法、装置、移动终端及存储介质。
背景技术
随着移动终端的全面屏设计的流行,为了节省移动终端的顶部空间已经有更多厂家在移动终端上采用超声波接近检测方案来代替传统的红外接近检测方案。
发明内容
鉴于上述问题,本申请提出了一种基于超声波的丢帧处理方法、装置、移动终端及存储介质,以解决上述问题。
第一方面,本申请实施例提供了一种基于超声波的丢帧处理方法,应用于移动终端,所述移动终端包括超声波接收模块和超声波接近计算模块,所述方法包括:通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块;获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率;基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。
第二方面,本申请实施例提供了一种基于超声波的丢帧处理装置,应用于移动终端,所述移动终端包括超声波接收模块和超声波接近计算模块,所述装置包括:超声波数据传输模块,用于通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块;数据获取模块,用于获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率;参数调整方式确定模块,用于基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。
第三方面,本申请实施例提供了一种移动终端,包括超声波发送模块、超声波接近计算模块、存储器以及处理器,所述超声波发送模块、超声波接近计算模块以及所述存储器和存储器耦接到所述处理器,所述存储器存储指令,当所述指令由所述处理器执行时所述处理器执行上述方法。
第四方面,本申请实施例提供了一种计算机可读取存储介质,所述计算机可读取存储介质中存储有程序代码,所述程序代码可被处理器调用执行上述方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。
图1示出了本申请实施例提供的多普勒效应的示意图;
图2示出了本申请实施例提供的超声波的传播路径的示意图;
图3示出了本申请一个实施例提供的基于超声波的丢帧处理方法的流程示意图;
图4示出了本申请又一个实施例提供的基于超声波的丢帧处理方法的流程示意图;
图5示出了本申请实施例提供的基于超声波的丢帧处理装置的模块框图;
图6示出了本申请实施例用于执行根据本申请实施例的基于超声波的丢帧处理方法的移动终端的框图;
图7示出了本申请实施例的用于保存或者携带实现根据本申请实施例的基于超声波的丢帧处理方法的程序代码的存储单元。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
目前,移动终端在接近识别场景所采用的方案包括微缝红外方案、TP+红外方案、超声波接近技术方案以及传统红外方案等。其中,传统红外方案因为要占用移动终端的正面屏幕的空间基本已经被抛弃;微缝红外方案对结构要求很高,一般情况下达不到要求,所以也很少采用;TP+红外方案的识别率有待提高,且抗干扰能力差;而使用超声波接近技术因为其抗干扰能力强、识别率高等优势被越来越重视并被采用。
其中,超声波接近检测是通过从麦克风拾取超声波,再将超声波发送给识别模块处理,识别模块根据连续的超声信号作为接近判断的依据。具体地,移动终端同时包括超声波发送模块和超声波接收模块,在超声波发送模块相对物体运动的过程中,其实质是移动终端相对物体运动,从而超声波接收模块也相对物体运动。如图1所示,图1示出了本申请实施例提供的多普勒效应的示意图,根据多普勒效应,物体辐射的波长因为波源(移动终端)和观测者(物体)的相对运动而产生变化,多普勒效应公式如下:
Figure PCTCN2020113281-appb-000001
其中,f'为观察到的频率、f为发射源于该介质中的原始发射频率、v为波在该介质中的传播速度、v 0为观察者移动速度,若观察者接近发射源则前方运算符号为+号,反之则为-号;v s为发射源移动速度,若物体接近观察者则前方运算符号为-号,反之则为+号。由多普勒效应公式可知,当发射源与观察者相对接近时,观察者接收到的信号频率会变大;当发射源与观察者相对远离时,观察者接收到的信号频率会变小;当发射源与观察者相对静止时,观察者接收到信号频率与发射源一致。
具体地,请参阅图2,图2示出了本申请实施例提供的超声波的传播路径的示意图,移动终端可以通过超射波发送模块(如听筒、喇叭、专用超声波发射器等)发射超声波,一部分超声波通过空气传播直达超声波接收模块(拾音器)(如图2的路径1),一部分超声波通过空气传播与物体形成反射后再到达超声波接收模块(如图2的路径2)。超声波接收模块拾取到的是直达声和反射声的叠加信号,经过A/D转换器转化为音频信号,通过算法处理音频数据得到物体相对移动终端的运行状态,进而指导移动终端的屏幕处于点亮状态或熄灭状态。
然而,在某些特殊的场景下,移动终端会因为***负载过大导致超声波丢帧,进而影响移动终端对于物体相对运动状态识别的准确率,针对上述问题,发明人发现可以尽量设置比较高的***频率和吞吐量,确保在大多数情况下不会发生丢帧的情况,但是在某些极端的场景下,***仍然存在丢帧的情况,并且仅仅通过经验值来设置固定参数,设置的太小可能存在丢帧,设置的太大又存在资源浪费、功耗增加的问题。因此,针对上述问题,发明人经过长期的研究发现,并提出了本申请实施例提供的基于超声波的丢帧处理方法、装置、移动终端及存储介质,通过移动终端的负载率和丢帧率智能调节***效能以降低丢帧率,提高用户体验。其中,具体的基于超声波的丢帧处理方法在后续的实施例中进行详细的说明。
请参阅图3,图3示出了本申请一个实施例提供的基于超声波的丢帧处理方法的流程示意图。所述基于超声波的丢帧处理方法用于通过移动终端的负载率和丢帧率智能调节***效能以降低丢帧率,提高用户体验。在具体的实施例中,所述基于超声波的丢帧处理方法应用于如图5所示的基于超声波的丢帧处理装置200以及配置有所述基于超声波的丢帧处理装置200的移动终端(图6)。下面将以移动终端为例,说明本实施例的具体流程,当然,可以理解的,本实施例所应用的移动终端可以为智能手机、平板电脑、穿戴式电子设备等,在此不做限定。其中,在本实施例中,该移动终端可以包括超声波接收模块和超声波接近计算模块,下面将针对图3所示的流程进行详细的阐述,所述基于超声波的丢帧处理方法具体可以包括以下步骤:
步骤S101:通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块。
在一些实施方式中,移动终端至少可以包括超声波接收模块和超声波接近计算模块,其中,该超声波接收模块可以用于接收超声波数据,并将超声波数据传输给超声波接近计算模块,超声波接近计算模块用于基于接收到的超声波数据进行计算。在本实施例中,超声波接收模块可以实时接收超声波数据、可以定时接收超声波数据、可以按预设的时间间隔接收超声波数据、也可以基于用户操作接收超声波数据等,在此不做限定。作为一种方式,当超声波接收模块基于用户操作接收超声波数据时,移动终端可以设置有开关,该开关可以用于供用户操作控制开启或关闭超声波接收模块的超声波数据接收功能,其中,该开关可以是虚拟按钮或虚拟控件,移动终端可以响应用户作用于开关对应的虚拟按钮或虚拟控件上的触控操作,开启或关闭超声波接收模块的超声波数据接收功能。
在一些实施方式中,移动终端的超声波接收模块接收的超声波数据可以包括移动终端的超声波发送模块发送的超声波数据经物体反射后返回的超声波数据、移动终端的超声波发送模块发送的超声波数据经空气传播后直达的超声波数据以及移动终端所处环境的超声波数据中的一种或几种的组合。例如,超声波接收模块接收的超声波数据可以包括:移动终端的超声波发送模块发送的超声波数据经反射后返回的超声波数据和超声波数据经空气传播后直达的超声波数据、移动终端的超声波发送模块发送的超声波数据经反射后返回的超声波数据、超声波数据经控件传播后直达的超声波数据以及移动终端所处环境的超声波数据等,在此不做限定。
步骤S102:获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。
在一些实施方式中,移动终端可以包括***负载检测模块,该***负载检测模块主要负责检测***的整体情况,例如,该***负载检测模块可以用于检测移动终端的负载率,其中,移动终端的负载率可以包括移动终端的中央处理器的使用率和/或移动终端的内存的使用率,在此不做限定。在本实施例中,可以实时获取并更新移动终端的负载率,也可以在超声波数据传输给超声波接近计算模块时获取移动终端的负载率,在此不做限定。
其中,在本实施例中,超声波接收模块和超声波接近计算模块分别在移动终端的两个不同的线程中,两者存在数据交换,因此,在超声波数据的从超声波接收模块传输到超声波接近计算模块的过程中,可能存在丢帧的情况,进而影响超声波接近计算模块对于接近检测的计算的结果。因此,在一些实施方式中,移动终端可以获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率。其中,移动终端可以获取超声波数据在预设时间段内从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,例如,可以获取超声波数据在100ms内从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率;可以获取预设帧数的超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,例如,可以获取100帧超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率;可以获取超声波接收模块接收到的所有超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,例如,当超声波接收模块接收到1000帧超声波数据,则可以获取100帧超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率等,在此不做限定。
在一些实施方式中,可以先获取移动终端的负载率,再获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率;可以先获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,再获取移动终端的负载率;也可以同时获取移动终端的负载率和超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率等,在此不做限定。
步骤S103:基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。
在一些实施方式中,在获取移动终端的负载率以及超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率后,可以基于负载率和丢帧率确定参数调整方式,并基于该参数调整方式对移动终端的***能效进行调整,以使丢帧率小于目标丢帧率,从而提升接近检测的准确性和用户体验。其中,***效能是指***在规定的条件下满足给定定量特征和服务要求的能力,它是***可用性、可信性及固有能力的综合反映。在本实施例中,该目标丢帧率可以在移动终端出厂时设置,也可以在移动终端出厂时初步设置并在使用过程中更新设置,例如,在移动终端使用过程中,可以根据移动终端所处的环境不同确定不同的目标丢帧率。其中,该目标丢帧率可以设置为5%、6%等,在此不做限定。
在一些实施方式中,移动终端调整的参数可以包括时钟频率和/或带宽,作为一种方式,移动终端可以通过***提供的API接口,对时钟频率和/或带宽进行调整。其中,时钟频率和带宽可以影响移动终端的数据传输率,时钟频率和带宽越大,则数据传输率越高,相应地,移动终端的***效能越高,***的丢帧率越小;而时钟频率和带宽越小,则数据传输率越低,相应地,移动终端的***效能越低,***的丢帧率越大。
参数调整方式可以包括:提高移动终端的时钟频率和/或带宽、降低移动终端的时钟频率和/或带宽以及保持移动终端的时钟频率和/或带宽等。因此,在本实施例中,可以基于负载率和丢帧率确定参数调整方式为提高移动终端的时钟频率和/或带宽,并通过提高移动终端的时钟频率和/或带宽的方式提高移动终端的***效能,以使丢帧率小于目标丢帧率;可以基于负载率和丢帧率确定参数调整方式为降低移动终端的时钟频率和/或带宽,并通过降低移动终端的时钟频率和/或带宽的方式降低移动终端的***效能,在使丢帧率小于目标丢帧率的情况下降低移动终端的功能;可以基于负载率和丢帧率确定参数调整方式为保持移动终端的时钟频率和/或带宽不变,并通过保持移动终端的时钟频率和/或带宽不变的方式保持移动终端的***效能不变,使丢帧率小于目标丢帧率。
本申请一个实施例提供的基于超声波的丢帧处理方法,通过超声波接收模块接收超声波数据,并将超声波数据传输给超声波接近计算模块,获取移动终端的负载率,并获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,基于负载率和丢帧率确定参数调整方式,并基于该参数调整方式对移动终端的***效能进行调整,以使丢帧率小于目标丢帧率,从而通过移动终端的负载率和丢帧率智能调节***效能以降低丢帧率,提高用户体验。
请参阅图4,图4示出了本申请又一个实施例提供的基于超声波的丢帧处理方法的流程示意图。该方法应用于上述移动终端,该移动终端包括超声波接收模块、超声波接近计算模块以及超声波发送模块,下面将针对图4所示的流程进行详细的阐述,所述基于超声波的丢帧处理方法具体可以包括以下步骤:
步骤S201:通过所述超声波接收模块连续接收多帧超声波数据,并对所述多帧超声波数据添加多个标签,所述多帧超声波数据与所述多个标签一一对应。
在一些实施方式中,移动终端可以通过超声波接收模块连续接收多帧超声波数据,并对 接收到的多帧超声波数据添加多个标签,其中,多帧超声波数据与多个标签一一对应,即可以分别对多帧超声波数据中的每帧超声波数据对应添加一个标签,每个标签用于标识其对应的超声波数据。例如,若超声波接收模块连续接收到1000帧超声波数据,则可以对1000帧超声波数据添加1000个标签,且1000帧超声波数据中的每帧超声波数据与1000个标签中的一个标签对应。
在本实施例中,该多个标签可以包括数字标签、字符标签、字母标签、图像标签中的一种或几种的组合。其中,多个标签可以均不相同、部分相同或者均相同,当多个标签均不相同时,多个标签可以为“1、2、3……n”,其中,n为超声波数据的帧数;当多个标签部分相同时,多个标签可以包括“a、a、b、b……m、m”等;当多个标签均相同时,多个标签可以包括“1、1、1、1……”等,在此不做限定。
步骤S202:将携带有所述多个标签的所述多帧超声波数据传输给所述超声波接近计算模块。
在一些实施方式中,移动终端在完成对超声波接收模块接收到的多帧超声波数据的标签添加后,可以将携带有多个标签的多帧超声波数据传输给超声波接近计算模块。
步骤S203:获取所述超声波接近计算模块接收到的标签的数量。
在本实施例中,超声波接近计算模块接收到的每帧超声波数据均携带有一个标签,因此,超声波接近计算模块接收到的标签的数量可以表征超声波接近计算模块接收到的超声波数据的帧数,例如,若超声波接近计算模块接收到960个标签,则可以表征超声波接近计算模块接收到的超声波数据的帧数为960帧。因此,在一些实施方式中,在超声波接收模块完成携带有多个标签的多帧超声波数据的传输后,可以获取超声波接近计算模块接收到的标签的数量。
步骤S204:基于所述超声波接近计算模块接收到的标签的数量和所述多个标签对应的数量,计算所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。
在一些实施方式中,移动终端在获得超声波接近计算模块接收到的标签的数量后,可以基于超声波接近计算模块接收到的标签的数量和多个标签对应的数量,计算超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率。例如,若超声波接收模块连续接收到的超声波数据的帧数为1000帧,那么,移动终端针对1000帧超声波数据添加的标签的数量为1000个,若超声波接近计算模块接收到的标签的数量为960个时,那么,可以确定超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率=(1000-960)/1000=4%。
步骤S205:获取所述移动终端的中央处理器的使用率以及所述移动终端的内存的使用率。
在一些实施方式中,移动终端可以检测中央处理器的使用情况,以获得中央处理器的剩余资源。例如,移动终端的操作***为Android***时,可以通过Android***中的ProcessStats类,获取***的使用情况及进程时间。其具体实现原理是读取/proc目录下的文件,***运行 时,内核会去更新/proc目录下的文件,将PID的运行情况写入相应的文件中,根据上述运行情况即可获取到中央处理器的剩余资源,其中,中央处理器的剩余资源可以包括中央处理器的剩余使用率,从而基于中央处理器的剩余使用率获取中央处理器的使用率。
在一些实施方式中,移动终端可以检测内存的使用情况,以获得移动终端的内存的剩余资源。例如,移动终端的操作***为Android***时,可以通过读取文件"/proc/meminfo"的信息获取移动终端的内存的总量,而通过ActivityManager.getMemoryInfo(ActivityManager.MemoryInfo)方法可以获取移动终端的内存当前的可用内存量。具体地,"/proc/meminfo"文件记录了android移动终端的一些内存信息,在命令行窗口里输入"adb shell",进入shell环境,输入"cat/proc/meminfo"即可在命令行里显示meminfo文件的内容,从而获得内存信息。可以理解的,基于上述方式获得移动终端的内存的总量和当前可用的内存量后,可以计算获得移动终端的内存的使用率。
步骤S206:基于所述中央处理器的使用率和所述内存的使用率,获得所述移动终端的负载率。
在本实施例中,移动终端在获取中央处理器的使用率和内存的使用率之后,可以基于中央处理器的使用率和内存的使用率,获得移动终端的负载率。其中,移动终端的负载率与中央处理器的使用率成正相关且与内存的使用率成正相关。
其中,步骤S203-步骤S204可以设置于步骤S205-步骤S206之前、步骤S203-步骤S204可以设置于步骤S205-步骤S206之后、步骤S203-步骤S204也可以设置于与步骤S205-步骤S206同步,在此不做限定。
步骤S207:当所述负载率小于负载率阈值且所述丢帧率大于第一丢帧率阈值时,确定所述参数调整方式为提高所述移动终端的时钟频率和/或带宽。
在一些实施方式中,移动终端可以预先设置有负载率阈值,该负载率阈值可以用于作为获取的移动终端的负载率的判断依据,因此,在本实施例中,在获得移动终端的负载率后,可以将移动终端的负载率和负载率阈值进行比较,以判断负载率和负载率阈值之间的关系。在一些实施方式中,移动终端可以预先设置并存储有第一丢帧率阈值,该第一丢帧率阈值用于作为获取的超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率的判断依据,因此,在本实施例中,在获得超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,可以将丢帧率与第一丢帧率阈值进行比较,以判断丢帧率和第一丢帧率阈值之间的关系。例如,该负载率阈值可以为80%,该第一丢帧率阈值可以为5%。
在本实施例中,当判断结果表征负载率小于负载率阈值且丢帧率大于第一丢帧率阈值时,表征移动终端的负载率较低而丢帧率较高,即移动终端还可以承担更多的负载,因此,可以将参数调整方式确定为提高移动终端的时钟频率和/或带宽,以提高移动终端的***效能、降低移动终端的丢帧率,提升接近检测的准确率。当判断结果表征负载率不小于负载率阈值且丢帧率大于第一丢帧率阈值时,表征移动终端的负载率较高且丢帧率较高,而如果要通过提高移动终端的时钟频率和/或带宽来降低移动终端的丢帧率,则会增加移动终端的负载率,在移动终端本身的负载率较高的情况下,可能会造成移动终端卡死的问题,因此,作为一种方 式,移动终端可以发出提示信息,该提示信息用于提示用户对移动终端的运行做出调整,以降低移动终端的负载率。
步骤S208:当所述负载率小于所述负载率阈值且所述丢帧率小于第二丢帧率阈值时,确定所述参数调整方式为降低所述移动终端的时钟频率和/或带宽,其中,所述第二丢帧率阈值小于所述第一丢帧率阈值。
在一些实施方式中,移动终端可以预先设置有负载率阈值,该负载率阈值可以用于作为获取的移动终端的负载率的判断依据,因此,在本实施例中,在获得移动终端的负载率后,可以将移动终端的负载率和负载率阈值进行比较,以判断负载率和负载率阈值之间的关系。在一些实施方式中,移动终端可以预先设置并存储有第二丢帧率阈值,该第二丢帧率阈值用于作为获取的超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率的判断依据,因此,在本实施例中,在获得超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,可以将丢帧率与第二丢帧率阈值进行比较,以判断丢帧率和第二丢帧率阈值之间的关系。其中,该第二丢帧率小于第一丢帧率,例如,该负载率阈值可以为90%,该第二丢帧率阈值可以为1%。
在本实施例中,当判断结果表征负载率小于负载率阈值且丢帧率小于第二丢帧率阈值时,表征移动终端的负载率较低且丢帧率较低,甚至没有丢帧,即可以适当降低移动终端的***效能、节省移动终端的***资源、降低移动终端的功耗,因此,可以将参数调整方式确定为降低移动终端的时钟频率和/或带宽,以降低移动终端的***效能、降低移动终端的功耗。当判断结果表征负载率不小于负载率阈值且丢帧率小于第二丢帧率阈值时,表征移动终端的负载率较高且丢帧率较低,而如果要降低***效能,则会造成移动终端的负载快速增加,可能导致移动终端的负载较高,造成移动终端卡死的问题,因此,在判断结果表征负载率不小于负载率阈值且丢帧率小于第二丢帧率阈值时,可以不进行处理。
步骤S209:当所述负载率小于所述负载率阈值以及所述丢帧率大于所述第二丢帧率阈值且小于所述第一丢帧率阈值时,确定所述参数调整方式为保持所述移动终端的时钟频率/或带宽不变。
在一些实施方式中,移动终端可以预先设置有负载率阈值,该负载率阈值可以用于作为获取的移动终端的负载率的判断依据,因此,在本实施例中,在获得移动终端的负载率后,可以将移动终端的负载率和负载率阈值进行比较,以判断负载率和负载率阈值之间的关系。在一些实施方式中,移动终端可以预先设置并存储有第一丢帧率阈值和第二丢帧率阈值,该第一丢帧率阈值和第二丢帧率阈值用于作为获取的超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率的判断依据,因此,在本实施例中,在获得超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,可以将丢帧率与第一丢帧率阈值和第二丢帧率阈值进行比较,以判断丢帧率和第一丢帧率阈值和第二丢帧率阈值之间的关系。其中,该第二丢帧率小于第一丢帧率,例如,该负载率阈值可以为90%,该第一丢帧率阈值可以为5%,第二丢帧率阈值可以为1%。
在本实施例中,当判断结果表征负载率小于负载率阈值、丢帧率大于第二丢帧率阈值且 小于第一丢帧率阈值时,表征移动终端的负载率较低且丢帧率对于接近检测的准确率的影响较小,即可以保持移动终端的***效能不变,因此,可以将参数调整方式确定为保持移动终端的时钟频率和/或带宽不变,以保证移动终端的丢帧率和功耗均在预设范围内。当判断结果表征负载率不小于负载率阈值、丢帧率大于第二丢帧率阈值且小于第一丢帧率阈值时,表征移动终端的负载率较高且丢帧率较低,而如果要降低***效能,则会造成移动终端的负载快速增加,可能导致移动终端的负载较高,造成移动终端卡死的问题,因此,在判断结果表征负载率不小于负载率阈值且丢帧率大于第二丢帧率阈值且小于第一丢帧率阈值时,可以不进行处理。
步骤S210:通过所述超声波发送模块发送超声波信号,并通过所述超声波接收模块接收所述超声波信号在遇到物体后返回的超声波信号。
在一些实施方式中,移动终端可以用于接近检测。具体地,移动终端包括超声波发送模块和超声波接收模块,移动终端可以通过超声波发送模块发送超声波信号,并通过超声波接收模块接收超声波信号在遇到物体后返回的超声波信号。
步骤S211:获取所述超声波信号从所述超声波发送模块到所述超声波接收模块的传输过程中的属性值,并基于所述属性值计算所述超声波信号在传输过程中的多普勒效应面积差和多普勒效应面积和。
在一些实施方式中,当移动终端通过超声波接收装置接收到超声波信号后,可以获取该超声波信号在传输过程中的属性值,并基于该属性值计算该超声波信号在传输过程中的多普勒效应面积差和多普勒效应面积和。其中,传输过程中可以包括超声波信号发送的过程以及超声波信号接收的过程,该属性值可以包括超声波发送装置发送的超声波信号的发送频率、发送幅值、发送时间等,超声波接收装置所接收的超声波信号的频率变化范围、接收幅值、接收时间等,在此不做限定。
步骤S212:根据所述多普勒效应面积差和所述多普勒效应面积和,确定所述移动终端与所述物体的相对运动状态。
在一些实施方式中,移动终端在获取多普勒效应面积差和多普勒效应面积和后,可以基于该多普勒效应面积差和多普勒效应面积和,获取移动终端与物体的相对运动状态,并根据移动终端与物体的相对运动状态控制移动终端的显示屏处于亮屏状态或息屏状态,从而提升显示屏的状态控制的准确率和稳定性,有效降低移动终端的功耗以及降低显示屏在靠近人脸时处于亮屏状态对人脸造成的辐射。
本申请又一个实施例提供的基于超声波的丢帧处理方法,通过超声波接收模块连续接收多帧超声波数据,并对多帧超声波数据添加多个标签,多帧超声波数据与多个标签一一对应,将携带有多个标签的多帧超声波数据传输给超声波接近计算模块,获取超声波接近计算模块接收到的标签的数量,基于超声波接近计算模块接收到的标签的数量和多个标签对应的数量,计算超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率。获取移动终端的中央处理器的使用率以及移动终端的内存的使用率,基于中央处理器的使用率和内存的使用率,获得移动终端的负载率。当负载率小于负载率阈值且丢帧率大于第一丢帧 率阈值时,确定参数调整方式为提高移动终端的时钟频率和/或带宽;当负载率小于负载率阈值且丢帧率小于第二丢帧率阈值时,确定参数调整方式为降低移动终端的时钟频率和/或带宽,其中,第二丢帧率阈值小于第一丢帧率阈值;当负载率小于负载率阈值以及丢帧率大于第二丢帧率阈值且小于第一丢帧率阈值时,确定参数调整方式为保持移动终端的时钟频率/或带宽不变。通过超声波发送模块发送超声波信号,并通过超声波接收模块接收超声波信号在遇到物体后返回的超声波信号,获取超声波信号从超声波发送模块到超声波接收模块的传输过程中的属性值,并基于属性值计算超声波信号在传输过程中的多普勒效应面积差和多普勒效应面积和,根据多普勒效应面积差和多普勒效应面积和,确定移动终端与物体的相对运动状态。相较于图2所示的基于超声波的丢帧处理方法,本实施例还通过在每帧超声波数据添加标签的方式获取丢帧率,提升获取的丢帧率的准确性,并通过中央处理器的使用率和内容的使用率获取移动终端的负债率,提升获取的负债率的准确性。另外,本实施例通过判断负债率和负债率阈值以及判断丢帧率和丢帧率阈值确定参数调整方式,提升参数调整方式的准确性。
请参阅图5,图5示出了本申请实施例提供的基于超声波的丢帧处理装置200的模块框图。该基于超声波的丢帧处理装置200应用于上述移动终端,该移动终端包括超声波接收模块和超声波接近计算模块,下面将针对图5所示的框图进行阐述,所述基于超声波的丢帧处理装置200包括:超声波数据传输模块210、数据获取模块220以及参数调整方式确定模块230,其中:
超声波数据传输模块210,用于通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块。进一步地,所述超声波数据传输模块210包括:超声波数据接收子模块和超声波数据传输子模块,其中:
超声波数据接收子模块,用于通过所述超声波接收模块连续接收多帧超声波数据,并对所述多帧超声波数据添加多个标签,所述多帧超声波数据与所述多个标签一一对应。
超声波数据传输子模块,用于将携带有所述多个标签的所述多帧超声波数据传输给所述超声波接近计算模块。
数据获取模块220,用于获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。进一步地,所述数据获取模块220包括:标签数据获取子模块和丢帧率获取子模块,其中:
标签数量获取子模块,用于获取所述超声波接近计算模块接收到的标签的数量。
丢帧率获取子模块,用于基于所述超声波接近计算模块接收到的标签的数量和所述多个标签对应的数量,计算所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。
进一步地,所述数据获取模块220包括:使用率获取子模块和负债率获取子模块,其中:
使用率获取子模块,用于获取所述移动终端的中央处理器的使用率以及所述移动终端的内存的使用率。
负债率获取子模块,用于基于所述中央处理器的使用率和所述内存的使用率,获得所述 移动终端的负载率。
参数调整方式确定模块230,用于基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。进一步地,所述参数调整方法确定模块230包括:参数提高子模块、参数降低子模块以及参数保持子模块,其中:
参数提高子模块,用于当所述负载率小于负载率阈值且所述丢帧率大于第一丢帧率阈值时,确定所述参数调整方式为提高所述移动终端的时钟频率和/或带宽。
参数降低子模块,用于当所述负载率小于所述负载率阈值且所述丢帧率小于第二丢帧率阈值时,确定所述参数调整方式为降低所述移动终端的时钟频率和/或带宽,其中,所述第二丢帧率阈值小于所述第一丢帧率阈值。
参数保持子模块,用于当所述负载率小于所述负载率阈值以及所述丢帧率大于所述第二丢帧率阈值且小于所述第一丢帧率阈值时,确定所述参数调整方式为保持所述移动终端的时钟频率/或带宽不变。
进一步地,所述移动终端包括超声波发送模块,所述基于超声波的丢帧处理装置200还包括:超声波信号接收模块、属性值获取模块以及相对运动状态确定模块,其中:
超声波信号接收模块,用于通过所述超声波发送模块发送超声波信号,并通过所述超声波接收模块接收所述超声波信号在遇到物体后返回的超声波信号。
属性值获取模块,用于获取所述超声波信号从所述超声波发送模块到所述超声波接收模块的传输过程中的属性值,并基于所述属性值计算所述超声波信号在传输过程中的多普勒效应面积差和多普勒效应面积和。
相对运动状态确定模块,用于根据所述多普勒效应面积差和所述多普勒效应面积和,确定所述移动终端与所述物体的相对运动状态。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述装置和模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,模块相互之间的耦合可以是电性,机械或其它形式的耦合。
另外,在本申请各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
请参阅图6,其示出了本申请实施例提供的一种移动终端100的结构框图。该移动终端100可以是智能手机、平板电脑、电子书等能够运行应用程序的电子设备。本申请中的移动终端100可以包括一个或多个如下部件:处理器110、存储器120、显示屏130、超声波接近计算模块140、超声波接收模块150以及一个或多个应用程序,其中一个或多个应用程序可以被存储在存储器120中并被配置为由一个或多个处理器110执行,一个或多个程序配置用于执行如前述方法实施例所描述的方法。
其中,处理器110可以包括一个或者多个处理核。处理器110利用各种接口和线路 连接整个移动终端100内的各个部分,通过运行或执行存储在存储器120内的指令、程序、代码集或指令集,以及调用存储在存储器120内的数据,执行移动终端100的各种功能和处理数据。可选地,处理器110可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器110可集成中央处理器(Central Processing Unit,CPU)、图形处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作***、用户界面和应用程序等;GPU用于负责显示内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器110中,单独通过一块通信芯片进行实现。
存储器120可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。存储器120可用于存储指令、程序、代码、代码集或指令集。存储器120可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作***的指令、用于实现至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等。存储数据区还可以存储终端100在使用中所创建的数据(比如电话本、音视频数据、聊天记录数据)等。
显示屏130用于显示由用户输入的信息、提供给用户的信息以及所述移动终端100的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、数字、视频和其任意组合来构成,在一个实例中,该显示屏130可以为液晶显示器(Liquid Crystal Display,LCD),也可以为有机发光二极管(Organic Light-Emitting Diode,OLED),在此不做限定。
请参阅图7,其示出了本申请实施例提供的一种计算机可读存储介质的结构框图。该计算机可读介质300中存储有程序代码,所述程序代码可被处理器调用执行上述方法实施例中所描述的方法。
计算机可读存储介质300可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。可选地,计算机可读存储介质300包括非易失性计算机可读介质(non-transitory computer-readable storage medium)。计算机可读存储介质300具有执行上述方法中的任何方法步骤的程序代码310的存储空间。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。程序代码310可以例如以适当形式进行压缩。
综上所述,本申请实施例提供的的基于超声波的丢帧处理方法、装置、移动终端及存储介质,通过超声波接收模块接收超声波数据,并将超声波数据传输给超声波接近计算模块,获取移动终端的负载率,并获取超声波数据从超声波接收模块到超声波接近计算模块的传输过程中的丢帧率,基于负载率和丢帧率确定参数调整方式,并基于该参数调整方式对移动终端的***效能进行调整,以使丢帧率小于目标丢帧率,从而通过移动终端的负载率和丢帧率智能调节***效能以降低丢帧率,提高用户体验。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (20)

  1. 一种基于超声波的丢帧处理方法,其特征在于,应用于移动终端,所述移动终端包括超声波接收模块和超声波接近计算模块,所述方法包括:
    通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块;
    获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率;
    基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。
  2. 根据权利要求1所述的方法,其特征在于,所述基于所述负载率和所述丢帧率确定参数调整方式,包括:
    当所述负载率小于负载率阈值且所述丢帧率大于第一丢帧率阈值时,确定所述参数调整方式为提高所述移动终端的时钟频率和/或带宽。
  3. 根据权利要求2所述的方法,其特征在于,所述基于所述负载率和所述丢帧率确定参数调整方式,包括:
    当所述负载率不小于所述负载率阈值以及所述丢帧率大于所述第一丢帧率阈值时,输出提示信息,其中,所述提示信息用于提示对所述移动终端的运行进行调整,以降低所述移动终端的负载率。
  4. 根据权利要求2所述的方法,其特征在于,所述基于所述负载率和所述丢帧率确定参数调整方式,包括:
    当所述负载率小于所述负载率阈值且所述丢帧率小于第二丢帧率阈值时,确定所述参数调整方式为降低所述移动终端的时钟频率和/或带宽,其中,所述第二丢帧率阈值小于所述第一丢帧率阈值。
  5. 根据权利要求4所述的方法,其特征在于,所述基于所述负载率和所述丢帧率确定参数调整方式,包括:
    当所述负载率小于所述负载率阈值以及所述丢帧率大于所述第二丢帧率阈值且小于所述第一丢帧率阈值时,确定所述参数调整方式为保持所述移动终端的时钟频率/或带宽不变。
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块,包括:
    通过所述超声波接收模块连续接收多帧超声波数据,并对所述多帧超声波数据添加多个标签,所述多帧超声波数据与所述多个标签一一对应;
    将携带有所述多个标签的所述多帧超声波数据传输给所述超声波接近计算模块;
    所述获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率,包括:
    获取所述超声波接近计算模块接收到的标签的数量;
    基于所述超声波接近计算模块接收到的标签的数量和所述多个标签对应的数量,计算所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。
  7. 根据权利要求6所述的方法,其特征在于,所述多个标签包括数字标签、字符标签、字母标签、图像标签中的一种或几种的组合。
  8. 根据权利要求1-7任一项所述的方法,其特征在于,所述获取所述移动终端的负载率,包括:
    获取所述移动终端的中央处理器的使用率以及所述移动终端的内存的使用率;
    基于所述中央处理器的使用率和所述内存的使用率,获得所述移动终端的负载率。
  9. 根据权利要求1-8任一项所述的方法,其特征在于,所述移动终端还包括超声波发送模块,所述基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整之后,还包括:
    通过所述超声波发送模块发送超声波信号,并通过所述超声波接收模块接收所述超声波信号在遇到物体后返回的超声波信号;
    获取所述超声波信号从所述超声波发送模块到所述超声波接收模块的传输过程中的属性值,并基于所述属性值计算所述超声波信号在传输过程中的多普勒效应面积差和多普勒效应面积和;
    根据所述多普勒效应面积差和所述多普勒效应面积和,确定所述移动终端与所述物体的相对运动状态。
  10. 根据权利要求9所述的方法,其特征在于,所述属性值包括所述超声波发送装置发送的超声波信号的发送频率和超声波接收装置接收的超声波信号的频率变化范围。
  11. 根据权利要求9或10所述的方法,其特征在于,所述属性值还包括所述超声波发送装置发送的超声波信号的发送幅值和超声波接收装置接收的超声波信号的接收幅值。
  12. 根据权利要求9-11任一项所述的方法,其特征在于,所述属性值还包括所述超声波发送装置发送的超声波信号的发送时间和超声波接收装置接收的超声波信号的接收时间。
  13. 根据权利要求9-12任一项所述的方法,其特征在于,所述根据所述多普勒效应面积差和所述多普勒效应面积和,确定所述移动终端与所述物体的相对运动状态之后,还包括:
    根据所述移动终端与所述物体的相对运动状态,控制所述移动终端的显示屏处于亮屏状态或息屏状态。
  14. 根据权利要求1-13任一项所述的方法,其特征在于,所述移动终端设置有开关,所述通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块,包括:
    响应于作用于所述开关的触控操作,开启所述超声波接收模块的超声波数据接收功能;
    通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接 近计算模块。
  15. 根据权利要求14所述的方法,其特征在于,所述开关为虚拟按钮或虚拟控件。
  16. 根据权利要求1-15任一项所述的方法,其特征在于,所述获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率,包括:
    获取所述超声波数据在预设时间段内从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率。
  17. 根据权利要求1-16任一项所述的方法,其特征在于,所述目标丢帧率在所述移动终端出厂时设置,或,所述目标丢帧率基于所述移动终端的使用环境设置。
  18. 一种基于超声波的丢帧处理装置,其特征在于,应用于移动终端,所述移动终端包括超声波接收模块和超声波接近计算模块,所述装置包括:
    超声波数据传输模块,用于通过所述超声波接收模块接收超声波数据,并将所述超声波数据传输给所述超声波接近计算模块;
    数据获取模块,用于获取所述移动终端的负载率,并获取所述超声波数据从所述超声波接收模块到所述超声波接近计算模块的传输过程中的丢帧率;
    参数调整方式确定模块,用于基于所述负载率和所述丢帧率确定参数调整方式,并基于所述参数调整方式对所述移动终端的***效能进行调整,以使所述丢帧率小于目标丢帧率。
  19. 一种移动终端,其特征在于,包括超声波发送模块、超声波接近计算模块、存储器以及处理器,所述超声波发送模块、超声波接近计算模块以及所述存储器和存储器耦接到所述处理器,所述存储器存储指令,当所述指令由所述处理器执行时所述处理器执行如权利要求1-17任一项所述的方法。
  20. 一种计算机可读取存储介质,其特征在于,所述计算机可读取存储介质中存储有程序代码,所述程序代码可被处理器调用执行如权利要求1-17任一项所述的方法。
PCT/CN2020/113281 2019-09-18 2020-09-03 基于超声波的丢帧处理方法、装置、移动终端及存储介质 WO2021052187A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20865716.3A EP4021058A4 (en) 2019-09-18 2020-09-03 METHOD AND DEVICE FOR PROCESSING FRAME LOSSES BASED ON ULTRASOUND WAVES, MOBILE TERMINALS AND STORAGE MEDIUM
US17/691,719 US20220196815A1 (en) 2019-09-18 2022-03-10 Method for processing frame loss of ultrasonic wave, mobile terminal and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910882078.3 2019-09-18
CN201910882078.3A CN110601771B (zh) 2019-09-18 2019-09-18 基于超声波的丢帧处理方法、装置、移动终端及存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/691,719 Continuation-In-Part US20220196815A1 (en) 2019-09-18 2022-03-10 Method for processing frame loss of ultrasonic wave, mobile terminal and storage medium

Publications (1)

Publication Number Publication Date
WO2021052187A1 true WO2021052187A1 (zh) 2021-03-25

Family

ID=68860730

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/113281 WO2021052187A1 (zh) 2019-09-18 2020-09-03 基于超声波的丢帧处理方法、装置、移动终端及存储介质

Country Status (4)

Country Link
US (1) US20220196815A1 (zh)
EP (1) EP4021058A4 (zh)
CN (1) CN110601771B (zh)
WO (1) WO2021052187A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110601771B (zh) * 2019-09-18 2021-04-13 Oppo广东移动通信有限公司 基于超声波的丢帧处理方法、装置、移动终端及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1331552A (zh) * 2000-06-30 2002-01-16 诺基亚移动电话有限公司 用于移动终端和其他设备的声音接近检测
US20090197615A1 (en) * 2008-02-01 2009-08-06 Kim Joo Min User interface for mobile devices
CN102436400A (zh) * 2011-12-06 2012-05-02 曙光信息产业股份有限公司 零拷贝驱动的实现方法和装置
CN105094662A (zh) * 2014-05-23 2015-11-25 Lg电子株式会社 移动终端及其控制方法
CN109117271A (zh) * 2018-08-10 2019-01-01 普联技术有限公司 自动调节cpu负载的方法、存储介质及终端设备
CN109254684A (zh) * 2018-08-22 2019-01-22 Oppo广东移动通信有限公司 触摸屏事件上报方法及其装置、终端设备、存储介质
CN110601771A (zh) * 2019-09-18 2019-12-20 Oppo(重庆)智能科技有限公司 基于超声波的丢帧处理方法、装置、移动终端及存储介质

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7302102B2 (en) * 2001-09-26 2007-11-27 Reynolds Jodie L System and method for dynamically switching quality settings of a codec to maintain a target data rate
US7164915B2 (en) * 2003-12-19 2007-01-16 Interdigital Technology Corporation Handover in a wireless local area network (WLAN)
US8254654B2 (en) * 2007-10-31 2012-08-28 University Of Southern California Sidelobe suppression in ultrasound imaging using dual apodization with cross-correlation
CN101471073B (zh) * 2007-12-27 2011-09-14 华为技术有限公司 一种基于频域的丢包补偿方法、装置和***
JP5307895B2 (ja) * 2008-09-03 2013-10-02 トムソン ライセンシング 無線ネットワークにおいて伝送電力制御を行う方法および装置
CN101770009B (zh) * 2009-01-06 2014-05-21 成都西谷曙光数字技术有限公司 一种精确射频定位***
JP2010245939A (ja) * 2009-04-08 2010-10-28 Sony Corp 信号処理装置、信号処理方法、プログラム
US9575544B2 (en) * 2011-11-07 2017-02-21 Qualcomm Incorporated Ultrasound based mobile receivers in idle mode
CN103368865B (zh) * 2012-04-09 2016-06-29 深圳大学 基于多网络访问接口的自适应通信方法及***
US9746916B2 (en) * 2012-05-11 2017-08-29 Qualcomm Incorporated Audio user interaction recognition and application interface
KR101471303B1 (ko) * 2013-10-02 2014-12-10 포항공과대학교 산학협력단 그래픽 처리 장치를 위한 전력 관리 장치 및 방법
US9307368B1 (en) * 2013-05-14 2016-04-05 Google Inc. Automatically generating and maintaining a floor plan
CN103716137B (zh) * 2013-12-30 2017-02-01 上海交通大学 一种识别ZigBee传感器网络丢包原因的方法及其***
CN103763216A (zh) * 2014-01-24 2014-04-30 深圳市华宝电子科技有限公司 一种数据传输的调整***及方法
CN105375990A (zh) * 2014-08-27 2016-03-02 国民技术股份有限公司 一种移动终端声波自检方法及装置
CN106330757B (zh) * 2015-06-30 2020-04-21 腾讯科技(深圳)有限公司 流量控制方法及装置
CN108029038B (zh) * 2015-09-11 2022-01-28 索尼公司 无线通信设备、无线通信方法以及无线通信***
US10083372B2 (en) * 2015-11-03 2018-09-25 Toshiba Medical Systems Corporation Ultrasound diagnosis apparatus, image processing apparatus and image processing method
US10021031B1 (en) * 2015-12-29 2018-07-10 Amazon Technologies, Inc. Pipelined packet policer
JP6142124B1 (ja) * 2016-11-30 2017-06-07 サイレックス・テクノロジー株式会社 無線通信装置、無線通信方法およびプログラム
US10966188B2 (en) * 2018-06-07 2021-03-30 Apple Inc. Full bandwidth uplink transmission for unlicensed narrowband internet of things
CN108964760A (zh) * 2018-10-12 2018-12-07 中国电子科技集团公司第三十四研究所 一种多路数字光模块误码率的测试装置和测试方法
CN209103132U (zh) * 2018-12-20 2019-07-12 武汉森岩科技有限公司 一种超声波一体化监测终端
WO2020133541A1 (zh) * 2018-12-29 2020-07-02 深圳迈瑞生物医疗电子股份有限公司 病人状态监测***及方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1331552A (zh) * 2000-06-30 2002-01-16 诺基亚移动电话有限公司 用于移动终端和其他设备的声音接近检测
US20090197615A1 (en) * 2008-02-01 2009-08-06 Kim Joo Min User interface for mobile devices
CN102436400A (zh) * 2011-12-06 2012-05-02 曙光信息产业股份有限公司 零拷贝驱动的实现方法和装置
CN105094662A (zh) * 2014-05-23 2015-11-25 Lg电子株式会社 移动终端及其控制方法
CN109117271A (zh) * 2018-08-10 2019-01-01 普联技术有限公司 自动调节cpu负载的方法、存储介质及终端设备
CN109254684A (zh) * 2018-08-22 2019-01-22 Oppo广东移动通信有限公司 触摸屏事件上报方法及其装置、终端设备、存储介质
CN110601771A (zh) * 2019-09-18 2019-12-20 Oppo(重庆)智能科技有限公司 基于超声波的丢帧处理方法、装置、移动终端及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4021058A4 *

Also Published As

Publication number Publication date
US20220196815A1 (en) 2022-06-23
CN110601771B (zh) 2021-04-13
EP4021058A1 (en) 2022-06-29
EP4021058A4 (en) 2022-09-07
CN110601771A (zh) 2019-12-20

Similar Documents

Publication Publication Date Title
WO2020187157A1 (zh) 一种控制方法和电子设备
WO2021017860A1 (zh) 信息处理方法、装置、电子设备及存储介质
US10475413B2 (en) Method and apparatus for adjusting backlight brightness of screen, and mobile terminal
WO2021017859A1 (zh) 屏幕状态控制方法、装置、移动终端以及存储介质
CN108391154B (zh) 弹幕显示控制方法、存储介质和终端
WO2022021895A1 (zh) 一种图像处理方法及电子设备
US11829581B2 (en) Display control method and terminal
WO2021017947A1 (zh) 终端控制方法、装置、移动终端及存储介质
WO2021017851A1 (zh) 屏幕状态控制方法、装置、移动终端以及存储介质
KR20160146972A (ko) 동적 프레임 레이트 지원을 이용한 전력 최적화 기법
WO2021017855A1 (zh) 响铃处理方法、装置、移动终端以及存储介质
WO2023098202A1 (zh) 应用启动方法、电子设备及可读存储介质
US20240221701A1 (en) Refresh Rate Adjustment Method And Electronic Device
WO2018161521A1 (en) Method for controlling image display and terminal
WO2023046164A1 (zh) 图像显示方法、ddic、显示屏模组及终端
WO2021052187A1 (zh) 基于超声波的丢帧处理方法、装置、移动终端及存储介质
CN115097994B (zh) 数据处理方法和相关装置
US20230261903A1 (en) Signal transmission method and apparatus, terminal device, smart device, and electronic device
JP2023540112A (ja) 常時表示方法および電子デバイス
WO2021077308A1 (zh) 触摸屏处理方法、装置、移动终端以及存储介质
CN106796489B (zh) 用于处理电子设备中的显示数据的方法和装置
US20240056668A1 (en) Camera setting adjustment based on event mapping
WO2021082911A1 (zh) 一种内容传输方法和终端设备
TWI632816B (zh) 具有能源節約的連續資料遞送技術
CN113038232A (zh) 视频播放方法、装置、设备、服务器及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20865716

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020865716

Country of ref document: EP

Effective date: 20220324