CN115686425A

CN115686425A - Audio playing method, failure detection method of screen sounding device and electronic equipment

Info

Publication number: CN115686425A
Application number: CN202111094726.2A
Authority: CN
Inventors: 杨枭; 许剑峰; 邱志强
Original assignee: Beijing Honor Device Co Ltd
Current assignee: Beijing Honor Device Co Ltd
Priority date: 2021-07-23
Filing date: 2021-09-17
Publication date: 2023-02-03

Abstract

The application provides an audio playing method, a failure detection method of a screen sound production device and an electronic device, which can solve the problem of silence or noise after the screen sound production device fails, so that the reliability of the electronic device is improved, and the user experience is improved. The audio playing method comprises the following steps: and receiving an audio playing instruction. The audio playing instruction is used for instructing the electronic equipment to play the first audio. And responding to the received audio playing instruction, and playing the detection audio through the screen sounding device. And acquiring a first parameter in the process of playing the detection audio. And determining whether the screen sounding device fails according to the first parameter. The first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound production device. And under the condition that the screen sounding device fails, switching the sounding device to be a loudspeaker and playing a first audio.

Description

Audio playing method, failure detection method of screen sounding device and electronic equipment

The present application claims priority of chinese patent application having application number 202110839831.8, entitled "an audio playing method and apparatus", filed by the national intellectual property office at 23.7/7/2021, the entire contents of which are incorporated herein by reference.

Technical Field

The present disclosure relates to the field of electronic technologies, and in particular, to an audio playing method, a failure detection method for a screen sound generating device, and an electronic device.

Background

At present, many electronic devices have a voice communication function, such as a mobile phone and a tablet. In order to realize the voice communication function, a sound generating device needs to be installed in the electronic device so that the user can hear the voice of the other party. With the requirement of electronic devices for screen occupation, it is necessary to reduce the number of holes on the front panel (i.e. screen) of the electronic device, so that a screen sounding device (e.g. a piezoelectric ceramic capacitive device) is usually disposed in the electronic device as a speaker (e.g. a headphone).

In the use process of the electronic device, the piezoelectric ceramic capacitive device may fail (such as fracture, electrode falling, and the like), and after the piezoelectric ceramic capacitive device fails, the electronic device may make a sound or generate a noise during voice communication, which affects the use experience of a user.

Disclosure of Invention

The embodiment of the application provides an audio playing method, a failure detection method of a screen sound production device and an electronic device, which can solve the problem of silence or noise after the screen sound production device fails, so that the reliability of the electronic device is improved, and the user experience is improved.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, the present application provides an audio playing method. The audio playing method is applied to electronic equipment, and the electronic equipment comprises a screen sounding device and a loudspeaker. The audio playing method comprises the following steps: and receiving an audio playing instruction. The audio playing instruction is used for instructing the electronic equipment to play the first audio. And responding to the received audio playing instruction, and playing the detected audio through the screen sound-producing device. And acquiring a first parameter in the process of playing the detection audio. And determining whether the screen sounding device fails according to the first parameter. The first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound production device. And under the condition that the screen sounding device fails, switching the sounding device to be a loudspeaker and playing a first audio. And under the condition that the screen sounding device is not failed, playing the first audio through the screen sounding device, or simultaneously playing the first audio through the screen sounding device and the loudspeaker.

Based on the audio playing method, before or in the process of playing the audio, the detection audio is played through the screen sound production device. The first parameter is obtained in the process of playing the detection audio, and whether the detection screen sounding device fails (such as breakage, electrode falling and the like) can be determined according to the first parameter. In the event that it is determined that the screen sound production device is disabled, the sound production device is switched, such as to a speaker to produce sound. Therefore, the problems of noise or silence caused by the failure of the screen sounding device can be avoided, the reliability of the electronic equipment is improved, and the user experience is improved.

In one possible implementation, the audio is detected as a second audio; the second audio is an audio signal different from the first audio. In response to receiving an audio playing instruction, playing detection audio through an on-screen sound-producing device, comprising: and responding to the received audio playing instruction, and playing a second audio through the screen sounding device before playing the first audio.

That is, before playing the first audio that the electronic device indicates to play, the second audio that is not audible to human ears or the audio signal that is audible to human ears and is used specifically for detecting whether the screen is disabled may be played first to detect whether the screen sound generating device is disabled. Therefore, the power consumption generated by the electronic equipment for detecting whether the screen sounding device fails in real time can be reduced.

In one possible implementation, it is characterized in that the detected audio is a first audio. In the process of playing the detection audio, acquiring a first parameter, including: in the process of playing the detection audio, acquiring a first parameter according to a preset period; the preset period is used for indicating the time interval for judging whether the screen sounding device is invalid or not twice. When the first audio is used as the detection audio, the electronic device may detect whether the screen sounding device fails in real time (e.g., every 1 second). Therefore, the electronic equipment can detect the failure of the screen sounding device in the audio playing process, so that the reliability of the electronic equipment is improved.

In a possible implementation manner, if the battery power of the electronic device is greater than a preset threshold, the audio is detected as the first audio. In the process of playing the detection audio, acquiring a first parameter, including: in the process of playing the detection audio, acquiring a first parameter according to a preset period; the preset period is used for indicating the time interval for judging whether the screen sounding device is invalid or not twice. Or if the battery power of the electronic device is less than or equal to the preset threshold, detecting that the audio is the second audio. The second audio is an audio signal different from the first audio. Responding to the received audio playing instruction, playing the detection audio through a screen sound production device, and comprising: in response to receiving the audio playing instruction, the second audio is played through the screen sound production device before the first audio is played.

Therefore, the timing of the sound generating device on the detection screen can be selected according to the battery power of the electronic equipment. When the electric quantity of the battery is larger than a preset threshold value, the first audio is used as a detection audio for detecting whether the screen sounding device fails or not, and whether the screen sounding device fails or not is detected in real time, so that sudden failure of the screen sounding device in the process of playing the audio can not be detected, and the reliability of the electronic equipment is improved. When the battery electric quantity is smaller than or equal to the preset threshold value, the second audio which is not audible by human ears is used as the detection audio for detecting whether the screen sounding device is invalid or not, and whether the screen sounding device is invalid or not is detected before the first audio is played, so that the power consumption of the electronic equipment is reduced.

In one possible implementation, the second audio comprises a single audio signal that is not audible to the human ear, or an audio signal that is audible to the human ear that is different from the first audio.

In one possible implementation, the audio playing instruction includes a call instruction, a music playing instruction, or a video file playing instruction.

In one possible implementation, the first parameter includes a real-time load current of the screen sound production device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time load current of the screen sounding device is larger than the maximum value of the current threshold range, or the real-time load current of the screen sounding device is smaller than the minimum value of the current threshold range, determining that the screen sounding device is invalid. Wherein, the current threshold range is: a current range corresponding to the first frequency when the screen sound producing device is not disabled. The first frequency is the frequency of the center frequency point of the detected audio. Generally, when the screen sounding device fails, the load current of the screen sounding device may change greatly. Therefore, whether the screen sounding device fails or not can be judged through the real-time load current of the screen sounding device.

In one possible implementation, the first parameter includes a real-time load voltage of the screen sound production device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time load voltage of the screen sounding device is larger than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sounding device is smaller than the minimum value of the voltage threshold range, determining that the screen sounding device fails. Wherein, the voltage threshold range is: a voltage range corresponding to the first frequency when the screen sound generating device is not disabled. The first frequency is the frequency of the central frequency point of the detected audio. Generally, when the screen sounding device fails, the load voltage of the screen sounding device also changes greatly. Therefore, whether the screen sounding device fails or not can be judged through the real-time load voltage of the screen sounding device.

In one possible implementation, the first parameter includes a real-time impedance of the screen sound production device. The real-time impedance of the screen sound device is determined by the real-time load voltage and the real-time load current of the screen sound device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time impedance of the screen sounding device is larger than the maximum value of the impedance threshold range, or the real-time impedance of the screen sounding device is smaller than the minimum value of the impedance threshold range, determining that the screen sounding device is invalid. Wherein, the impedance threshold range is: an impedance range corresponding to the first frequency when the screen sound production device is not disabled. The first frequency is the frequency of the center frequency point of the detected audio. It will be appreciated that the feedback voltage (i.e. real time load voltage) and feedback current (i.e. real time load current) of the screen sounder device may be obtained in the smart PA hardware circuit, and the real time impedance of the screen sounder device may be determined from the feedback voltage and feedback current. Generally, when the screen sound generating device fails, the impedance of the screen sound generating device changes greatly. Therefore, whether the screen sounding device fails or not can be judged through the real-time impedance of the screen sounding device.

In one possible implementation, the first parameter includes: real-time admittance of the screen sounding device. The real-time admittance of the screen sounding device is determined by the real-time load voltage and the real-time load current of the screen sounding device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time admittance of the screen sounding device is larger than the maximum value of the admittance threshold range, or the real-time admittance of the screen sounding device is smaller than the minimum value of the admittance threshold range, determining that the screen sounding device is invalid. Wherein the admittance threshold range is: an admittance range corresponding to the first frequency when the screen sounding device is not disabled; the first frequency is the frequency of the central frequency point of the detected audio. It should be understood that the feedback voltage (i.e., real-time load voltage) and the feedback current (i.e., real-time load current) of the screen sounding device may be obtained in smart PA hardware circuitry, and the real-time admittance of the screen sounding device may also be determined from the feedback voltage and the feedback current. Since the admittance of the screen sound production device is the reciprocal of the impedance of the screen sound production device, the admittance of the screen sound production device can also produce a large change in the impedance of the screen sound production device. Therefore, whether the screen sounding device fails or not can be judged through real-time admittance of the screen sounding device.

In one possible implementation, the real-time load current of the screen sounding device is: when the screen sound production device plays N frames of detection audio, the average value of M feedback currents obtained through detection is obtained. Wherein, N and M are positive integers which are more than 1. For example, each time the screen sounding device plays a frame of detection audio, a feedback current value may be obtained, where N and M may be equal. In the scheme, the real-time load current of the screen sounding device is the average value of a plurality of feedback currents, so that errors caused by noise existing on a detection path can be reduced.

In one possible implementation, the real-time load voltage of the screen sounding device is: when the screen sound production device plays N frames of detection audio, the average value of M feedback voltages obtained through detection is obtained. Wherein, N and M are positive integers which are more than 1. Similarly, in the scheme, the real-time load voltage of the screen sounding device is the average value of a plurality of feedback voltages, and the error caused by the noise existing on the detection path can also be reduced.

In a possible implementation manner, the real-time load voltage of the screen sound production device or the real-time load current of the screen sound production device is obtained by the intelligent power amplification module.

In a possible implementation manner, the method may further include: and displaying a preset prompt box under the condition that the screen sounding device fails. The preset prompt box comprises prompt information. The prompt message is used for indicating that the screen sounding device is disabled. Therefore, when the screen sounding device fails, the electronic equipment can prompt the user that the screen sounding device fails in time, and user experience can be improved.

In a possible implementation manner, the method may further include: and under the condition that the screen sounding device fails, turning off the screen sounding device. Therefore, the power consumption of the electronic equipment can be reduced, and noise caused by the failure of the screen sounding device is avoided.

In a second aspect, the present application provides a method for detecting a failure of a screen sound generating device. The method is applied to electronic equipment, and the electronic equipment comprises a screen sounding device. The failure detection method of the screen sounding device comprises the following steps: and responding to a preset operation or playing the detection audio through the screen sound production device based on a preset time point. The preset operation or the preset time point is used for triggering the electronic equipment to detect whether the screen sounding device fails or not. And acquiring a first parameter in the process of playing the detection audio. And determining whether the screen sounding device fails according to the first parameter. The first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound production device.

Based on the failure detection method of the screen sounding device, the electronic equipment can detect whether the screen sounding device fails or not based on preset operation or on a preset time point, so that the screen sounding device can be detected regularly, a user can be informed of the failure of the screen sounding device in time, and the user is prompted to maintain or modify the default configuration of the electronic equipment, and the reliability of the electronic equipment is improved.

In one possible implementation, the first parameter includes a real-time load current of the screen sound production device. Determining whether the screen sound production device fails according to a first parameter, comprising: and if the real-time load current of the screen sounding device is larger than the maximum value of the current threshold range, or the real-time load current of the screen sounding device is smaller than the minimum value of the current threshold range, determining that the screen sounding device fails. Wherein, the current threshold range is: a current range corresponding to the first frequency when the screen sound generating device is not deactivated. The first frequency is the frequency of the center frequency point of the detected audio.

In one possible implementation, the first parameter includes a real-time load voltage of the screen sound production device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time load voltage of the screen sounding device is larger than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sounding device is smaller than the minimum value of the voltage threshold range, determining that the screen sounding device fails. The voltage threshold range is: a voltage range corresponding to a first frequency when the screen sound generating device is not disabled; the first frequency is the frequency of the central frequency point of the detected audio.

In one possible implementation, the first parameter includes a real-time impedance of the screen sound production device. The real-time impedance of the screen sound device is determined by the real-time load voltage and the real-time load current of the screen sound device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time impedance of the screen sounding device is larger than the maximum value of the impedance threshold range, or the real-time impedance of the screen sounding device is smaller than the minimum value of the impedance threshold range, determining that the screen sounding device is invalid. The impedance threshold range is: an impedance range corresponding to the first frequency when the screen sound generating device is not disabled. The first frequency is the frequency of the center frequency point of the detected audio.

In one possible implementation, the first parameter includes: real-time admittance of the screen sounding device. The real-time admittance of the screen sounding device is determined by the real-time load voltage and the real-time load current of the screen sounding device. Determining whether the screen sounding device fails according to a first parameter, comprising: and if the real-time admittance of the screen sounding device is larger than the maximum value of the admittance threshold range, or the real-time admittance of the screen sounding device is smaller than the minimum value of the admittance threshold range, determining that the screen sounding device is invalid. Wherein the admittance threshold range is: an admittance range corresponding to the first frequency when the screen sounding device is not disabled. The first frequency is the frequency of the center frequency point of the detected audio.

In one possible implementation, the real-time load current of the screen sounding device is: when the screen sound production device plays N frames of detection audio, detecting the average value of M feedback currents; wherein, N and M are positive integers which are more than 1.

In one possible implementation manner, the real-time load voltage of the screen sound production device is: when the screen sound production device plays N frames of detection audio, detecting the average value of M feedback voltages; wherein, N and M are positive integers which are more than 1.

It should be understood that technical effects in the various possible implementations described above may refer to technical effects in relevant parts of the first aspect, and are not described herein again.

In a third aspect, the present application provides an electronic device. The electronic device includes: a screen sound generating device; a speaker; one or more processors; a memory; and a communication module. The screen sound production device and the loudspeaker are used for playing sound signals of the electronic equipment; the communication module is used for communicating with external equipment; the memory has stored therein one or more computer programs comprising instructions which, when executed by the processor, cause the electronic device to perform the method as described in any one of the possible implementations of the first or second aspect.

In a fourth aspect, embodiments of the present application provide a chip system that includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by a line. The chip system may be applied to an electronic device including a communication module and a memory. The interface circuit may read instructions stored in a memory in the electronic device and send the instructions to the processor. The instructions, when executed by the processor, may cause the electronic device to perform a method as described in any one of the possible implementations of the first aspect or the second aspect above.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium. The computer readable storage medium has instructions stored therein. The instructions, when executed on the electronic device, cause the electronic device to perform the method of any one of the possible implementations of the first aspect or the second aspect as described above.

In a sixth aspect, embodiments of the present application provide a computer program product, which when run on a computer causes the computer to execute the method as described in any one of the possible implementation manners of the first aspect or the second aspect.

It should be understood that, for the electronic device according to the third aspect, the chip system according to the fourth aspect, the computer-readable storage medium according to the fifth aspect, and the computer program product according to the sixth aspect, the advantageous effects that can be achieved by the electronic device according to the third aspect, may refer to the advantageous effects in the corresponding method according to the first aspect or the second aspect, and are not described herein again.

Drawings

Fig. 1A is a schematic view of a scenario in which a user performs voice communication through an electronic device according to an embodiment of the present application;

fig. 1B is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram illustrating comparison between before and after a failure of a sound-generating device on a screen provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of a screen sounding device provided in an embodiment of the present application;

FIG. 5 is a frequency-resistance characteristic curve diagram of 4.2 microfarads piezoelectric ceramic provided in the embodiments of the present application;

fig. 6 is a graph comparing frequency-resistance characteristic curves of a normal-screen sound-generating device and an abnormal-screen sound-generating device according to the embodiment of the present application;

fig. 7 is a circuit diagram of a smart power amplifier (smart PA) hardware circuit provided in an embodiment of the present application;

fig. 8 is a first flowchart of a method for detecting whether a screen sound generating device fails according to an embodiment of the present disclosure;

fig. 9 is a second flowchart of a method for detecting whether a screen sound generating device fails according to an embodiment of the present disclosure;

fig. 10A is a flowchart of a method for detecting whether a screen sound generating device fails according to an embodiment of the present disclosure;

FIG. 10B is a flowchart of a method for detecting whether a sound device on a screen fails according to an embodiment of the present disclosure;

fig. 11 is a fifth flowchart of a method for detecting whether a screen sound generating device fails according to an embodiment of the present disclosure;

fig. 12 is a block diagram of a software structure of an electronic device according to an embodiment of the present application;

fig. 13A is a first flowchart of an audio playing method according to an embodiment of the present application;

fig. 13B is a scene diagram of an audio playing method according to an embodiment of the present application;

fig. 14 is a flowchart of a second audio playing method according to an embodiment of the present application;

fig. 15 is a flowchart three of an audio playing method according to an embodiment of the present application;

fig. 16 is a flowchart of a failure detection method for a screen sound production device according to an embodiment of the present application;

fig. 17 is a first view of a first scenario of a method for detecting a failure of a screen sound generating device according to an embodiment of the present application;

fig. 18 is a second scenario of a method for detecting a failure of a sound-emitting device on a screen according to an embodiment of the present disclosure;

fig. 19 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, unless otherwise specified, "at least one" means one or more, "a plurality" means two or more. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish identical items or similar items with substantially identical functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.

Currently, many electronic devices have a voice communication function or an audio playing function. In order to implement the voice communication function, a sound generating device needs to be installed in the electronic device to enable the user to hear the opposite party's sound during voice communication. Similarly, in order to realize the audio playing function, the electronic device also needs to be provided with a sounding device. Taking the implementation of the voice communication function of electronic devices such as mobile phones as an example, a receiver (also called a speaker) is disposed on the top of the mobile phone to serve as a sound generation device for voice communication, so as to implement the voice communication function. In general, a handset is disposed inside a mobile phone, and a sound hole is formed in a front panel of the mobile phone. When the receiver sounds, the sound energy emitted by the receiver can be transmitted out through the sound outlet hole, so that the user can hear the sound emitted by the receiver. However, with the continuous development of mobile phones, the screen occupation ratio of the mobile phone screen is higher and higher in order to provide better screen viewing experience for users. Because the sound outlet holes arranged on the front panel occupy the partial area of the front panel of the mobile phone, the width of a frame of the mobile phone can be increased, and therefore the improvement of the screen occupation ratio of the mobile phone can be influenced.

With the development of large-screen and full-screen mobile phones, in order to increase the screen area of the mobile phone, the occupied area of the sound outlet hole of the receiver on the front panel of the mobile phone needs to be reduced. For example, the sound outlet hole of the handset is designed to be in a long seam shape, and the sound outlet hole is located at the joint of the handset middle frame and the front panel (also called as the handset side seam). In some cases, in order to ensure that the sound outlet hole of the mobile phone handset has good sound outlet effect, a hole can be formed on the top of the middle frame of the mobile phone as the sound outlet hole. In this case, when the user uses the mobile phone to perform voice communication, the auricle of the user cannot completely cover and wrap the sound outlet hole, and the sound energy of the mobile phone handset cannot be completely transmitted into the auricle of the user, so that a sound leakage phenomenon is generated.

Illustratively, taking a mobile phone as an example, during a voice communication process performed by a handheld mobile phone of a user through a handset, the handset is used to play a sound signal of an opposite user during the voice communication process (i.e. the handset is the above-mentioned speaker used for speaking during the voice communication). As shown in fig. 1A, the sound outlet hole 201 of the handset receiver is close to the ear (or auricle) of the user. At this time, since the sound outlet holes 201 of the handset (such as the sound outlet holes located at the side seams of the handset and the sound outlet holes at the top of the middle frame) cannot be completely covered by the ears of the user, the sound signals emitted from the sound outlet holes 201 can be heard by the user, and can also be heard by other users in a quiet environment, thereby generating a sound leakage phenomenon.

In order to avoid the sound leakage phenomenon when the earphone sounds, some electronic devices use screen sound production to replace the earphone sound production, or use the screen sound production and the earphone sound production simultaneously. For example, as shown in fig. 1B, it is a schematic structural diagram of an electronic device. The electronic device includes a housing structure 100. The housing structure 100 is enclosed by a front panel (including a screen and a bezel), a rear panel for supporting internal circuitry, and a center frame. As shown in fig. 1B (a), an earpiece 101 and a screen sound production device 104 are provided in a housing structure 100 of the electronic apparatus. The receiver 101 is a speaker for speaking in voice communication, and is also called a receiver, and is usually disposed at a top position of the housing structure. The screen sounder 104 may be a vibration source attached below the screen. As shown in (B) of fig. 1B, the electronic device is provided with two sound output holes, namely, a sound output hole 102 and a sound output hole 103, corresponding to the handset 101. Wherein, the sound outlet hole 102 is located at the connection position (i.e. the side seam) of the front panel and the middle frame of the electronic device. The sound outlet hole 103 is located on the middle frame of the electronic device at a position close to the earphone (i.e. the top position of the middle frame of the electronic device). Therefore, the electronic device shown in fig. 1B can sound through the earphone, or sound through the screen, or sound through both the earphone and the screen at the same time, so as to avoid the sound leakage phenomenon that occurs when the earphone only sounds.

It should be understood that the specific structure of the screen sounding device in the electronic device may vary for different screen sounding schemes. For example, the screen sound producing device may be a vibration source (e.g., a piezoelectric ceramic, a motor vibrator, an exciter, or other vibration unit) attached to the back of the screen. The vibration source can vibrate under the control action of the current signal to drive the screen to vibrate, so that the screen can sound. For another example, the screen sounding device may also be a piezoelectric ceramic fixed to the middle frame of the electronic device by a cantilever beam structure. The piezoelectric ceramic can vibrate under the control action of a current signal, and the vibration is transmitted to a screen by utilizing a middle frame of a mobile phone so as to drive the screen to vibrate, so that the screen can sound. For another example, the screen sounder device may also be an actuator fixed to a bezel of the electronic device. The exciter can vibrate under the control of current signals, and the vibration is transmitted to the screen by using the middle frame of the mobile phone to drive the screen to vibrate, so that the screen can sound. For another example, the screen sounding device can also be a split type magnetic suspension vibrator. One vibrator in the split type magnetic suspension vibrator is fixed on a middle frame of the electronic equipment, the other vibrator is fixed on the screen, and the vibrator capable of being fixed on the screen vibrates relative to the vibrator fixed on the middle frame of the electronic equipment under the control action of a current signal, so that the screen is pushed to vibrate, and the screen is sounded.

However, as shown in fig. 2, in an electronic device (e.g. a mobile phone) using the screen sound generating device, the screen sound generating device can generate a normal sound signal when the screen sound generating device is normal. With the long-term use of electronic devices, the screen sound generating device (e.g. piezoelectric ceramic) may fail (e.g. break, depolarization, etc.), thereby causing the problems of silence or noise, etc., so that the electronic device cannot normally play sound signals (e.g. voice communication or music), and further affecting the user experience.

In order to solve the above problem, an embodiment of the present application provides an audio playing method. In the audio playing method, before or in the process of playing audio, whether the screen sound generating device fails or not is detected, and the sound generating device is switched under the condition that the screen sound generating device fails, for example, the screen sound generating device is switched to a loudspeaker to generate sound, so that the problems of noise and silence caused by the failure of the screen sound generating device are avoided, and the user experience is improved.

Hereinafter, an audio playing method provided by the embodiments of the present application will be described with reference to the drawings.

The electronic device in the embodiment of the present application may be, for example, a mobile phone, a tablet computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), a wearable device (e.g., a smart watch, a smart bracelet), or other devices with a voice communication function, and the embodiment of the present application is not limited to a specific form of the electronic device.

Exemplarily, taking an electronic device as a mobile phone as an example, fig. 3 shows a schematic structural diagram of another electronic device provided in the embodiment of the present application. That is, the electronic device shown in fig. 3 may be a mobile phone, for example.

As shown in fig. 3, the mobile phone may include: the mobile terminal includes a processor 310, an external memory interface 320, an internal memory 321, a Universal Serial Bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display 394, a Subscriber Identity Module (SIM) card interface 395, a screen sounder 396, and the like.

The sensor module may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

It is to be understood that the structure illustrated in the present embodiment does not constitute a specific limitation to the mobile phone. In other embodiments, the handset may include more or fewer components than illustrated, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 310 may include one or more processing units, such as: the processor 310 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can be the neural center and the command center of the mobile phone. The controller can generate an operation control signal according to the instruction operation code and the time sequence signal to finish the control of instruction fetching and instruction execution.

The DSP can comprise an intelligent power amplifier (smart PA) hardware circuit, a smart PA algorithm module and an audio algorithm module. The smart PA hardware circuit can be respectively connected with the application processor and the screen sounding device (such as piezoelectric ceramics) and is used for controlling the screen sounding device to sound according to the instruction of the application processor. It should be understood that, in general, the smart PA hardware circuit may also be used to detect the feedback current and the feedback voltage of the screen sound production device during the process of playing audio by the screen sound production device, and calculate the impedance or admittance of the screen sound production device according to the feedback current and the feedback voltage of the screen sound production device. Where admittance is the inverse of impedance. The calculated impedance or admittance of the screen sound device may be used to control a physical parameter (e.g., temperature, amplitude) of the screen sound device (e.g., piezo-ceramic).

In the embodiment of the present application, the smart PA algorithm module is configured to determine whether the screen sound generating device (e.g., piezoelectric ceramic) is failed (abnormal) according to the feedback voltage and the feedback current of the screen sound generating device (e.g., piezoelectric ceramic), or according to the impedance or admittance of the screen sound generating device calculated by the feedback voltage and the feedback current. The smart PA algorithm module is also used for reporting the result when a screen sounding device (such as piezoelectric ceramics) is abnormal and reporting the result to the audio algorithm module. The audio algorithm module controls the switching of the sounding device, such as switching a screen sounding device (such as piezoelectric ceramics, namely a capacitive device) to a loudspeaker to sound.

It should be understood that the smart PA hardware circuit may also be disposed outside the DSP chip, and the embodiment of the present application is not particularly limited.

A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 310. If the processor 310 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 310, thereby increasing the efficiency of the system.

In some embodiments, processor 310 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

It should be understood that the connection relationship between the modules in this embodiment is only an exemplary illustration, and does not constitute a limitation on the structure of the mobile phone. In other embodiments, the mobile phone may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

In this embodiment, the electronic device may determine the type of the listening environment where the electronic device is currently located through the processor 310, and then adjust the frequency band of the sound generated by the earphone and the frequency band of the sound generated by the screen according to the type of the listening environment, so as to control the earphone and the sound generated by the screen to play the sound in the corresponding frequency bands in the sound signal, respectively, thereby avoiding sound leakage of the electronic device when a person listens to the sound in a quiet environment.

The charging management module 340 is used for receiving charging input from a charger (such as a wireless charger or a wired charger) to charge the battery 342. The power management module 341 is configured to connect the battery 342, the charging management module 340 and the processor 310. The power management module 341 receives input from the battery 342 and/or the charge management module 340 to power the various components of the electronic device.

The wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in a handset may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

In some embodiments, the handset antenna 1 is coupled to the mobile communication module 350 and the handset antenna 2 is coupled to the wireless communication module 360 so that the handset can communicate with the network and other devices via wireless communication techniques. The mobile communication module 350 may provide a solution including wireless communication such as 2G/3G/4G/5G applied to a mobile phone. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 350 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the filtered electromagnetic wave to the modem processor for demodulation.

The mobile communication module 350 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 350 may be provided in the processor 310. In some embodiments, at least some of the functional blocks of the mobile communication module 350 may be provided in the same device as at least some of the blocks of the processor 310.

The wireless communication module 360 may provide solutions for wireless communication applied to a mobile phone, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like.

The wireless communication module 360 may be one or more devices integrating at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 310. The wireless communication module 360 may also receive a signal to be transmitted from the processor 310, frequency-modulate and amplify the signal, and convert the signal into electromagnetic waves via the antenna 2 to radiate the electromagnetic waves.

Of course, the wireless communication module 360 may also support a mobile phone to perform voice communication. For example, a mobile phone may access a Wi-Fi network through the wireless communication module 360, and then interact with other devices using any application program that can provide a voice communication service, so as to provide the voice communication service for a user. For example, the application program capable of providing the voice communication service may be an instant messaging application.

The mobile phone can realize the display function through the GPU, the display screen 394, the application processor and the like. The GPU is an image processing microprocessor coupled to a display 394 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 may include one or more GPUs that execute program instructions to generate or alter display information. The display screen 394 is used to display images, video, and the like.

The mobile phone may implement the shooting function through the ISP, the camera 393, the video codec, the GPU, the display 394, the application processor, and the like. The ISP is used to process the data fed back by the camera 393. In some embodiments, the ISP may be located in camera 393. Camera 393 is used to capture still images or video. In some embodiments, the cell phone may include 1 or N cameras 393, N being a positive integer greater than 1.

The external memory interface 320 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the mobile phone. The internal memory 321 may be used to store computer-executable program code, which includes instructions. The processor 310 executes various functional applications of the cellular phone and data processing by executing instructions stored in the internal memory 321. For example, in the embodiment of the present application, the processor 310 may execute instructions stored in the internal memory 321, and the internal memory 321 may include a program storage area and a data storage area.

The handset may implement audio functions via the audio module 370, speaker 370A, receiver (i.e., earpiece) 370B, microphone 370C, headset interface 370D, and application processor, among others. Such as music playing, recording, etc.

The audio module 370 is used to convert digital audio signals into analog audio signal outputs and also to convert analog audio inputs into digital audio signals. The audio module 370 may also be used to encode and decode audio signals. In some embodiments, the audio module 370 may be disposed in the processor 310, or some functional modules of the audio module 370 may be disposed in the processor 310. The speaker 370A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The receiver 370B, also called "earpiece", is used to convert the electrical audio signal into a sound signal. Microphone 370C, also known as a "microphone," is used to convert sound signals into electrical signals. The earphone interface 370D is used to connect a wired earphone. The headset interface 370D may be the USB interface 330, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The receiver 370B (i.e., "receiver") may be the receiver 101 shown in fig. 1B.

For example, in the embodiment of the present application, the audio module 370 may convert an audio electrical signal received by the mobile communication module 350 and the wireless communication module 360 into a sound signal. The sound signal is played by the receiver 370B (i.e., "earpiece") of the audio module 370, while the screen (i.e., display screen) is driven by the screen sound generator 396 to produce a screen sound to play the sound signal.

Keys 390 include a power-on key, a volume key, etc. The motor 391 may generate a vibration cue. Indicator 392 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc. The SIM card interface 395 is for connecting a SIM card. The mobile phone can support 1 or N SIM card interfaces, and N is a positive integer greater than 1.

Of course, it should be understood that fig. 3 is only an exemplary illustration of the electronic device in the form of a mobile phone. If the electronic device is in the form of a tablet computer, a handheld computer, a PDA, a wearable device (e.g., a smart watch, a smart bracelet), or other devices, the structure of the electronic device may include fewer structures than those shown in fig. 3, or may include more structures than those shown in fig. 3, which is not limited herein.

An audio playing method provided in the embodiment of the present application is described in detail below by taking an electronic device as a mobile phone as an example. As described above, an audio playing method provided by the embodiments of the present application needs to detect whether a screen sounding device fails before or during audio playing. Therefore, the following description will be made on how to detect whether the screen sound generating device fails, taking the screen sound generating device as a piezoelectric ceramic as an example.

Fig. 4 is a schematic diagram of the screen sounder device. Wherein, the screen sounding device comprises multilayer piezoelectric ceramics. The multilayer piezoelectric ceramic forms a vibrating membrane, and after an alternating current driving signal is applied, the vibrating membrane can be bent and deformed under the piezoelectric effect to push the vibrating membrane to sound.

In general, the impedance of a piezoelectric ceramic (i.e., a capacitive device) satisfies the following relationship:

wherein z is the impedance of the piezoelectric ceramic, C is the capacitance, and f is the alternating current signal frequency. It can be seen that the equivalent impedance of the piezoelectric ceramic decreases as the frequency of the input ac signal increases. For example, as shown in fig. 5, the frequency-resistance characteristic curve of the piezoelectric ceramic of 4.2 microfarads (uF) is shown, the equivalent impedance of the piezoelectric ceramic of 4.2 microfarads (uF) is about 160 ohms (Ohm) when the frequency of the ac signal is 200 hertz (Hz), and the equivalent impedance of the piezoelectric ceramic of 4.2 microfarads (uF) is about 3.7 ohms (Ohm) when the frequency of the ac signal is 10 kilohertz (Hz).

It should be noted that, in practice, the screen sound production device formed by the multilayer piezoelectric ceramics does not only include the piezoelectric ceramics (i.e. the capacitive device), but also may include electrode leads, dielectric substances, other components, and the like. Thus, the equivalent impedance of a screen-sounding device formed of multiple layers of piezoelectric ceramics is a non-linear curve, which may be related to temperature, frequency, material, etc. In addition, under the condition that the screen sounding device is normal, the frequency resistance characteristic curve of the screen sounding device tends to be consistent. That is, as the frequency of the ac signal increases, the impedance of the screen sound generating device decreases.

However, during the use of the electronic device, the screen sounding device (such as piezoelectric ceramic) may be broken, and the inner layer electrode may be broken, short-circuited, broken, or depolarized. When a screen sound device (e.g., a piezoceramic) fails, the physical characteristics of the screen sound device change, typically as represented by changes in capacitance, impedance, load current, load voltage, and acoustic frequency response. For example, when the screen sound generating device fails, the impedance of the screen sound generating device may deviate from a normal value, such as becoming extremely small or large. As shown in fig. 6, the frequency-resistance characteristic curves of the normal-screen sound-producing device and the abnormal-screen sound-producing device are compared, wherein the abscissa of fig. 6 is frequency in Hz; the ordinate of fig. 6 is impedance in ohms (Ω). As can be seen from fig. 6, the impedance of the abnormal screen sound-generating device (i.e., the failed screen sound-generating device) is much larger than that of the normal screen sound-generating device, and the frequency-resistance characteristic curve of the abnormal screen sound-generating device has large fluctuations. It should be appreciated that since admittance is the inverse of impedance, there is also a large difference in admittance of the abnormal screen sound production device and the normal screen sound production device.

In summary, during the use of the electronic device, the load current and the load voltage of the screen sound production device can be detected, and the current impedance or admittance of the screen sound production device can be calculated according to the load current and the load voltage. Then, the detected load current may be compared with the load current of the screen sound production device under a normal condition, or the detected load voltage may be compared with the load voltage of the screen sound production device under a normal condition, or the current impedance or admittance of the screen sound production device may be compared with the impedance or admittance of the screen sound production device under a normal condition, so as to determine whether the screen sound production device is out of order.

Typically, a manufacturer of screen sound devices provides impedance-frequency data for the screen sound devices. For example, the following table 1 shows the average impedance and the impedance deviation of the piezoelectric ceramic (i.e., the screen sound device) with a capacitance of about 2.5uF at different frequencies.

TABLE 1

For example, in the embodiment of the present application, in a case where the screen sound generating device (e.g., a piezoelectric ceramic) is normal (not disabled), audio signals of various frequencies may also be played through the screen sound generating device, for example, a single audio signal of each frequency may be played. When the screen sounder plays a single audio signal of each frequency, the load voltage and the load current of the screen sounder are detected as the voltage threshold and the current threshold of the screen sounder in normal (non-failure) state.

It should be understood that, in order to perform intelligent control on the screen sounding devices, the screen sounding devices are usually connected with an intelligent power amplifier (smart PA) hardware circuit.

Exemplarily, as shown in fig. 7, it is a schematic structural diagram of a smart power amplifier (smart PA) hardware circuit. Referring to fig. 7, the screen sound generating device (e.g., piezoelectric ceramic) is coupled to an application processor of the electronic device, and is configured to detect a feedback current (i.e., a load current) and a feedback voltage (i.e., a load voltage) of the screen sound generating device through the smart power amplifier module during the process of playing audio on the screen sound generating device, and calculate an impedance of the screen sound generating device according to the feedback current and the feedback voltage of the screen sound generating device. The intelligent power amplifier module can control the physical parameters (such as temperature and amplitude) of the screen sounding device (such as piezoelectric ceramics) according to the calculated impedance of the screen sounding device. In addition, in order to avoid the device being burnt out due to overlarge current, a 4-ohm protective resistor R0 is connected in series on a current path of the screen sounding device in the hardware circuit.

The intelligent power amplifier module comprises a feedback voltage/feedback current detection module, an ADC module and a digital audio module. The feedback voltage/feedback current detection module is used for detecting load current and load voltage in real time, and the load current and the load voltage obtained by feedback voltage/feedback current detection are converted into digital signals through the ADC module and transmitted to the digital audio module. The digital audio module can calculate the load impedance according to the load current and the load voltage. According to the temperature and impedance change relationship of the screen sounding device (such as piezoelectric ceramics), the current temperature of the screen sounding device (such as piezoelectric ceramics) can be determined. When the current temperature of the screen sounding device (such as piezoelectric ceramics) exceeds the preset temperature of the screen sounding device, the digital audio module can control the amplification regulator to regulate the amplification factor of the amplifier.

Similarly, after the digital audio module calculates the load impedance, the amplitude of the screen sounding device (e.g., piezoelectric ceramic) can be determined according to the resistance, the current, and the TS parameter of the screen sounding device (e.g., piezoelectric ceramic). When the amplitude of the screen sounding device is too large, such as exceeding 0.6, the digital audio module may control the amplification regulator to adjust the amplification factor of the amplifier, so as to reduce the amplitude of the screen sounding device.

Thus, the load current and the load voltage of the screen sound production device can be detected and obtained by the smart power amplifier module as shown in fig. 7. It should be understood that, because the protection resistor R0 is connected in series in the circuit, the load voltage detected by the smart power amplifier module is the sum of the voltage of the protection resistor R0 and the voltage of the screen sound generating device (such as piezoelectric ceramic).

For example, in the embodiment of the present application, in the production test stage of the electronic device, the screen sounding device may be connected to the smart PA hardware circuit shown in fig. 7, and the screen sounding device may be controlled to play single audio signals with multiple frequencies (e.g., 20Hz, 31.25Hz, 50Hz, 62.5Hz, 125Hz, 250Hz, 500Hz, 1000Hz, 2000Hz, 4000Hz, 19KHz, 20KHz, 22KHz, etc.). When the on-screen sound generating device plays a single audio signal of each frequency, a plurality of sets of load voltage (i.e., feedback voltage) and load current (i.e., feedback current) are detected and obtained by the smart power amplifier module in fig. 7. For example, when the screen sound generating device plays a single audio signal with a frequency of 50Hz, the detected frequency corresponding to the load voltage and the load current is 50Hz.

It should be understood that, since some random noise may exist in the detection paths of the load current and the load voltage, in order to reduce the error, the feedback voltage and the feedback current of a plurality of frames (e.g. 10 frames, 20 frames or 30 frames) of the audio signal are usually detected, and then the effective value of the load voltage is obtained for the feedback voltage of the plurality of frames, or the effective value of the load current is obtained by averaging the feedback currents.

Illustratively, the effective value Z of the load voltage may be calculated by the following formula (one) _rms (ii) a The effective value I of the load current can be calculated by the following formula (II) _rms :

Wherein U represents the feedback voltage, I represents the feedback current, U _i Representing the feedback voltage corresponding to the ith frame of audio signal; i is _i Representing the feedback current corresponding to the ith frame of audio signal; n represents the number of samples of the feedback voltage U or the feedback current I.

Note that, after calculating the effective value of the load voltage and the effective value of the load current corresponding to a certain frequency, the load impedance Z corresponding to the frequency can be calculated by the following formula (three).

It should be understood that, since the protection resistor R0 is connected in series in the circuit, the load impedance Z calculated by the formula (three) is the impedance of the protection resistor R0 and the impedance Z of the screen sounding device (such as piezoelectric ceramic) _rms And (4) the sum. At this time, the impedance Z of the screen sound generating device _rms And (c) = Z-R0. Taking the calculated load impedance Z =4.194 Ω as an example, the impedance Z of the screen sounding device _rms =1.194 Ω. Since the admittance is the inverse of the impedance,after calculating the impedance of the screen sound generating device, the impedance can be inverted to obtain the admittance of the screen sound generating device, such as Z _rms =1.194 Ω, the admittance Y is _rms =1/1.194 Ω =0.837 siemens (S).

In addition, the audio signal played by the on-screen sound-producing device may not be of a single frequency. At this time, after the feedback voltage or the feedback current of the screen sounding device is obtained, high-pass filtering or low-pass filtering may be performed to obtain the feedback voltage or the feedback current of the screen sounding device at a specific frequency (e.g., 19KHz or 32.5 KHz). Then, the load impedance of the screen sounding device under the specific frequency is calculated according to the feedback voltage or the feedback current of the screen sounding device under the specific frequency.

In summary, in the production test stage of the electronic device, the voltage range, the current range, the impedance range or the admittance range corresponding to a certain frequency when the normal screen sound generating device is normal (not failed) can be obtained by performing the above-mentioned detection and calculation for a plurality of times when the normal screen sound generating device plays the audio frequency of a certain frequency. When detecting whether the screen sounding device fails or not in the subsequent process, the voltage range, the current range, the impedance range or the admittance range are used as a voltage threshold range, a current threshold range, an impedance threshold range or an admittance threshold range corresponding to a certain frequency when the screen sounding device is normal (does not fail), and the voltage range, the current threshold range, the impedance threshold range or the admittance threshold range are used as a basis for judging whether the screen sounding device fails or not.

In the embodiment of the application, whether the real-time load current of the screen sound production device exceeds the corresponding current threshold range or not can be detected, whether the real-time load voltage of the screen sound production device exceeds the corresponding voltage threshold range or not can be detected, whether the screen sound production device fails or not can be detected, whether the real-time admittance of the screen sound production device exceeds the corresponding admittance threshold range or not can be detected.

The method for detecting the failure of the screen sounding device is described in detail below.

In some embodiments, the real-time load current of the screen sound device is used to determine whether the screen sound device fails. Fig. 8 shows a first flowchart of a method for detecting whether a sound device on a screen is failed. Referring to fig. 8, the method includes:

s801, acquiring real-time load current of the screen sounding device.

For example, in the use process of the screen sound production device, for example, when the electronic device plays an audio signal (i.e., detects audio) through the screen sound production device, the real-time load current of the screen sound production device may be obtained through the intelligent power amplifier module as shown in fig. 7.

It should be understood that the audio signal played by the electronic device through the screen sound generating device may be a single audio which is not audible or difficult to hear by human ears, such as audio with frequencies of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., or a normal audio signal audible by human ears, such as a voice in a call, audio in a normally played music or video file, or audio which is specifically used for detecting whether the screen sound generating device is disabled, etc. In addition, the audio signal played by the electronic device through the screen sound production device may also be a pilot signal (for example, a signal with a frequency of 19 KHz) with a smaller amplitude superimposed on the normal audio signal.

In order to reduce the error, the feedback current of the audio signals of multiple frames (such as 10 frames, 20 frames or 30 frames) is usually detected, and then the effective value of the load current of the audio signals of the multiple frames is calculated by the above formula (two) and is used as the real-time load current I of the current screen sound production device _rms 。

S802, judging whether the real-time load current of the screen sounding device is in a current threshold range.

It should be understood that the current threshold range is obtained by analysis in advance in the case that the screen sounding device is normal, and is described above, and is not described herein again. In the embodiment of the present application, a current threshold range may be denoted as [ Imin, imax, F ], where F denotes a frequency corresponding to the current threshold range, imin denotes a lower limit of the current threshold range, and Imax denotes an upper limit of the current threshold range.

In general, if the load current of the screen sounding device is within the current threshold range, the screen sounding device is a normal device. Conversely, if the load current of the screen sound production device is not within the current threshold range, that is, the load current of the screen sound production device exceeds the upper limit of the normal current threshold range, or the load current of the screen sound production device is lower than the lower limit of the normal current threshold range, the screen sound production device is an abnormal device or a failed device.

At this time, the real-time load current of the screen sound production device obtained in step S801 may be compared with the current threshold range, so as to determine whether the real-time load current of the screen sound production device is within the current threshold range. When the load current of the screen sounding device is not within the normal current threshold range, S803, which is described below, may be performed to determine that the screen sounding device is disabled.

It should be understood that the current threshold ranges of the screen sound emitting devices are different when the screen sound emitting devices play audio signals of different frequencies. In the process of executing the judgment in S802, the frequency of the played audio signal needs to be determined first, and then the obtained real-time load current of the screen sound production device is compared with the current threshold range corresponding to the frequency of the audio signal.

For example, if the audio signal played is a single audio, such as a single audio of 19KHz, when the real-time load current of the screen sound-generating device is obtained in S801, the real-time load current of the screen sound-generating device obtained in S801 may be compared with the current threshold range of the screen sound-generating device at the frequency of 19 KHz.

For another example, if the audio signal played back is a normal audio signal audible to human ears, such as a voice signal during a call, normally played music or video, when the real-time load current of the screen sound generating device is obtained in S801, the frequency (denoted as frequency a) of the center frequency point of the frequency band where the main energy of the normal audio signal is located may be analyzed. The center frequency point of the frequency band where the main energy of the normal audio signal is located is analyzed, and the load current (namely, feedback current) or the load voltage (namely, feedback voltage) corresponding to the continuous N frames of audio signals can be obtained through the intelligent power amplifier module. Then, fast Fourier Transform (FFT) is performed on the load current or the load voltage to convert the load current or the load voltage into a frequency domain signal, and whether the frequency points where the most dominant energy of the consecutive N frames of audio signals is located are the same or not can be determined through analysis. If the current values are the same, the real-time load current of the screen sounding device can be obtained through calculation according to the formula (II), and the frequency corresponding to the real-time load current is the frequency A. If the audio signals are different, the audio signals are continuously played, load current (namely feedback current) corresponding to the audio signals of the subsequent frame is obtained, and the steps are repeated to analyze the central frequency point of the frequency band where the main energy of the normal audio signals is located. Finally, the real-time load current of the screen sounding device obtained in step S801 may be compared with the current threshold range of the screen sounding device at the frequency a.

For another example, if the real-time load current of the screen sound generating device is obtained in S801, the played audio signal is an audio signal superimposed with a pilot signal (e.g., 19KHz signal). Under normal conditions, when the impedance of the screen sound production device is increased sharply, the load current obtained by the intelligent power amplification module is also reduced sharply compared with that of a normal device, so that the real-time load current obtained in the step S801 is compared with the current threshold range in the full frequency domain, and whether the screen sound production device fails or not is judged. It should be understood that the current threshold range in the full frequency domain may be obtained by playing the audio signal in the full frequency domain under the condition that the screen sound production device is normal, and the obtaining method is similar to the obtaining method described above for the current threshold range in a single frequency, and is not described here again.

In this case, of course, the real-time load current corresponding to the frequency (denoted as frequency B) where the pilot signal is located may also be obtained by a high-pass filtering method, and then the real-time load current is compared with the current threshold range of the screen sound generating device at the frequency B.

For example, the following code may be used to determine if a screen sounder device has failed:

brookenflag = false; // default screen sound device not disabled;

if((I _rms >Imax)||(I _rms <imin))// resistance exceeds the upper limit of the current threshold range or is less than the currentA threshold range lower limit;

brookenflag = true; v/screen sound device flag disabled;

and S803, determining that the screen sounding device is invalid.

For example, when brookenflag = true in the code described above, it may be determined that the screen sounding device is disabled.

In some embodiments, the real-time load voltage is used to determine if the on-screen sound device has failed. Fig. 9 is a flowchart of a second method for determining whether the screen sound generating device is disabled. Referring to fig. 9, the method includes:

s901, acquiring the load voltage of the screen sounding device.

For example, in the use process of the screen sound production device, for example, when the electronic device plays an audio signal through the screen sound production device, the real-time load voltage of the screen sound production device may be obtained through the intelligent power amplifier module shown in fig. 7.

It should be understood that the audio signal played by the electronic device through the screen sound generating device may be a single audio which is not audible or difficult to hear by human ears, such as audio with frequencies of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., or a normal audio signal audible by human ears, such as a voice in a call, audio in a normally played music or video file, or audio which is specifically used for detecting whether the screen sound generating device is disabled, etc. In addition, the audio signal played by the electronic device through the screen sound production device may be a pilot signal (e.g. a signal with a frequency of 19 KHz) with a smaller amplitude superimposed on the normal audio signal.

In order to reduce the error, the feedback voltage of a plurality of frames (e.g. 10 frames, 20 frames or 30 frames) of audio signals is usually obtained, and then the effective value of the load voltage of the plurality of frames of audio signals is calculated by the above formula (one) and is used as the real-time load voltage U of the current screen sound-generating device _rms 。

And S902, judging whether the real-time load voltage of the screen sounding device is in a voltage threshold range.

It should be understood that the voltage threshold range is obtained by analysis in advance in the case that the screen sounding device is normal, and is described above and will not be described herein. In the embodiment of the present application, a voltage threshold range may be denoted as [ Umin, umax, F ], where F denotes a frequency corresponding to the voltage threshold range, umin denotes a lower limit of the voltage threshold range, and Umax denotes an upper limit of the voltage threshold range.

Generally, if the load voltage of the screen sounding device is within the voltage threshold range, the screen sounding device is a normal device. Conversely, if the load voltage of the screen sound production device is not within the voltage threshold range, that is, the load voltage of the screen sound production device exceeds the upper limit of the voltage threshold range, or the load voltage of the screen sound production device is lower than the lower limit of the voltage threshold range, the screen sound production device is an abnormal device or a failed device.

At this time, the real-time load voltage of the screen sound production device obtained in step S901 may be compared with the voltage threshold range, so as to determine whether the real-time load voltage of the screen sound production device is within the voltage threshold range. When the real-time load voltage of the screen sound production device is not within the voltage threshold range, S903, described below, may be performed to determine that the screen sound production device is failed.

It should be understood that when the screen sound production device plays audio signals with different frequencies, the voltage threshold ranges of the screen sound production device are different. In the process of executing the judgment of S902, the frequency of the played audio signal needs to be determined, and then the obtained real-time load voltage of the screen sound generating device is compared with the voltage threshold range corresponding to the frequency of the audio signal.

For example, if the audio signal played is a single audio frequency, such as a single audio frequency of 19KHz, when the real-time load voltage of the screen sound generating device is obtained in S901, the real-time load voltage of the screen sound generating device obtained in S901 may be compared with the voltage threshold range of the screen sound generating device at the frequency of 19 KHz.

For another example, if the real-time load voltage of the screen sound generating device is obtained in S901, and the played audio signal is a normal audio signal audible to human ears, such as a voice signal during a call, a normally played music or a video, the real-time load voltage of the screen sound generating device obtained in S901 may be compared with the voltage threshold range of the screen sound generating device at the frequency a by analyzing the frequency (denoted as frequency a) of the center frequency point of the frequency band where the main energy of the normal audio signal is located (the analysis process may refer to the related description in S802).

For another example, if the real-time load voltage of the on-screen sound generating device is obtained in S901, the played audio signal is an audio signal superimposed with a pilot signal (e.g., 19KHz signal). In this case, a real-time load voltage corresponding to the frequency (denoted as frequency B) where the pilot signal is located may be obtained by a high-pass filtering method, and then the real-time load voltage is compared with a voltage threshold range of the screen sound generating device at the frequency B.

brookenflag = false; // default screen sound device not disabled;

if((U _rms >Umax)||(U _rms <umin))// resistance exceeds the upper limit of the voltage threshold range or is less than the lower limit of the voltage threshold range;

brookenflag = true; v/screen sound device flag disabled;

and S903, determining that the screen sounding device is invalid.

For example, when brookenflag = true in the above code, it may be determined that the screen sounding device is failed.

In some embodiments, the real-time impedance of the screen sound device may be used to determine if the screen sound device has failed. Fig. 10A is a flowchart of a method for determining whether the screen sound generating device is disabled. Referring to fig. 10A, the method includes:

s1001, acquiring real-time load voltage and real-time load current of the screen sounding device.

For example, when the electronic device plays an audio signal through the screen sound production device, the load current and the load voltage of the screen sound production device may be obtained through the smart power amplifier module as shown in fig. 7.

In order to reduce the error, the feedback voltage value and the feedback current value of the audio signals of multiple frames (e.g. 10 frames, 20 frames or 30 frames) are usually obtained, and then the effective value of the load voltage of the audio signals of the multiple frames is calculated by the above formula (one) and is used as the load voltage of the current screen sound generating device. And calculating to obtain an effective value of the load current of the multi-frame audio signal through the formula (II), wherein the effective value is used as the real-time load current of the current screen sound production device.

And S1002, calculating a real-time impedance value of the screen sounding device.

It should be understood that, according to the real-time load voltage and the load current of the screen sound generating device obtained in the above step S1001, the load impedance Z may be calculated according to the above formula (iii), and since the smart PA hardware circuit shown in fig. 7 is provided with the protection resistor R0, the real-time impedance Z of the screen sound generating device may be calculated _rms = Z-R0, i.e. Z _rms ＝Z-4。

And S1003, judging whether the real-time impedance value of the screen sounding device is in the impedance threshold range.

It should be understood that the normal impedance range may be obtained from factory parameters of the screen sound production device, or may be obtained by analysis in advance in the case that the screen sound production device is normal, which has been described above and will not be described herein again. In the embodiment of the present application, an impedance threshold range may be denoted as [ Zmin, zmax, F ], where F denotes a frequency corresponding to the impedance threshold range, zmin denotes a lower limit of the impedance threshold range, and Zmax denotes an upper limit of the impedance threshold range.

In general, if the real-time impedance of the screen sound production device is within the impedance threshold range, the screen sound production device is a normal device. Conversely, if the real-time impedance of the screen sound production device is not within the impedance threshold range, that is, the real-time impedance of the screen sound production device exceeds the upper limit of the impedance threshold range, or the real-time impedance of the screen sound production device is lower than the lower limit of the impedance threshold range, the screen sound production device is an abnormal device or a failed device.

At this time, the real-time impedance of the screen sound production device calculated in S1002 may be compared with the impedance threshold range, and whether the real-time impedance of the screen sound production device is within the impedance threshold range may be determined. When the real-time impedance of the screen sounding device is not within the impedance threshold range, the following S1004 may be performed to determine that the screen sounding device is failed.

It should be appreciated that the impedance threshold ranges for the screen sound emitting devices are different when the screen sound emitting devices play audio signals of different frequencies. In the process of executing the judgment in S1003, the frequency of the played audio signal needs to be determined, and then the real-time impedance of the screen sound production device calculated in S1002 is compared with the impedance threshold range corresponding to the frequency of the audio signal.

For example, if the audio signal played is a single audio, such as a single audio of 19KHz, when the load voltage and the load current of the screen sound generating device are obtained in S1001, the impedance of the screen sound generating device calculated in S1002 may be compared with the normal impedance range of the screen sound generating device at the frequency of 19 KHz.

For another example, if the real-time load voltage and the real-time load current of the screen sound generating device are obtained in S1001, the played audio signal is a normal audio signal that can be heard by human ears, such as a voice signal during a call, a normally played music or video, and the like, the real-time impedance of the screen sound generating device calculated in S1002 may be compared with the impedance threshold range of the screen sound generating device at the frequency a by analyzing the frequency (denoted as the frequency a) of the center frequency point of the frequency band where the main energy of the normal audio signal is located (please refer to the related description in S802 in the analysis process).

For another example, if the real-time load voltage and the real-time load current of the screen sound generating device are obtained in S1001, the audio signal to be played is an audio signal superimposed with a pilot signal (e.g., 19KHz signal). In this case, after the real-time load voltage and the real-time load current of the screen sound generating device are obtained through the smart power amplifier module in S1001, the real-time load voltage and the real-time load current of the screen sound generating device at the frequency (denoted as frequency B) of the pilot signal may be obtained through a high-pass filtering manner. Then, in S1002, the real-time load voltage and the real-time load current corresponding to the frequency B are calculated by the above formula (three) to obtain the real-time impedance of the screen sounding device. Finally, the real-time impedance is compared with the impedance threshold range of the screen sounding device at the frequency B.

For example, the following codes may be used to determine whether a screen sound device is disabled:

brookenflag = false; // default screen sound device not failed;

if((Z _rms >Zmax)||(Z _rms <zmin)); // the impedance exceeds the upper limit of the impedance threshold range or is less than the lower limit of the impedance threshold range;

brookenflag = true; v/screen sound device flag disabled;

and S1004, determining that the screen sounding device is invalid.

In some embodiments, the real-time admittance of the screen sound device may be used to determine whether the screen sound device has failed. Fig. 10B is a flowchart of a fourth method for determining whether a screen sound generating device is failed. Referring to fig. 10B, the method is different from the method shown in fig. 10B in that S1002 is replaced with S1002a and S1003 is replaced with S1003a.

And S1002a, calculating a real-time admittance value of the screen sounding device.

Calculating the real-time impedance Z of the screen sounding device according to the S1002 _rms Then, real-time impedance Z of the screen sounding device can be achieved _rms Calculating the reciprocal to obtain the real-time admittance Y of the screen sound production device _rms I.e. Y _rms ＝1/Z-4。

And S1003a, judging whether the real-time admittance value of the screen sounding device is in the admittance threshold range.

Similarly, in the embodiment of the present application, an admittance threshold value range may be denoted as [ Ymin, ymax, F ], where F denotes a frequency corresponding to the admittance threshold value range, ymin denotes a lower limit of the admittance threshold value range, and Ymax denotes an upper limit of the admittance threshold value range.

In general, if the real-time admittance of the screen sounding device is within the admittance threshold range, the screen sounding device is a normal device. Conversely, if the real-time admittance of the screen sound production device is not within the admittance threshold range, that is, the real-time admittance of the screen sound production device exceeds the upper limit of the admittance threshold range, or the real-time admittance of the screen sound production device is lower than the lower limit of the admittance threshold range, the screen sound production device is an abnormal device or a failed device.

At this time, the real-time admittance of the screen sound production device calculated in S1002a may be compared with the admittance threshold range, so as to determine whether the real-time admittance of the screen sound production device is within the admittance threshold range. When the real-time admittance of the screen sound production device is not within the admittance threshold range, the above-mentioned S1004 may be executed to determine that the screen sound production device is failed.

It should be understood that the admittance threshold ranges of the screen sound production devices are different when the screen sound production devices play audio signals of different frequencies. In the process of executing the judgment in S1003a, the frequency of the played audio signal needs to be determined, and then the real-time admittance of the screen sound generating device calculated in S1002a is compared with the admittance threshold range corresponding to the frequency of the audio signal.

For example, if the audio signal played is a single audio, such as a single audio of 19KHz, when the load voltage and the load current of the screen sound generating device are obtained in S1001, the admittance of the screen sound generating device calculated in S1002a may be compared with the admittance threshold range of the screen sound generating device at the frequency of 19 KHz.

For another example, if the real-time load voltage and the real-time load current of the screen sound generating device are obtained in S1001, and the played audio signal is a normal audio signal that can be heard by human ears, such as a voice signal during a call, normally played music or video, etc., then the real-time admittance of the screen sound generating device calculated in S1002 may be compared with the admittance threshold range of the screen sound generating device at the frequency a by analyzing the frequency (denoted as frequency a) of the center frequency point of the frequency band where the main energy of the normal audio signal is located (please refer to the related description in S802 in the analysis process).

For another example, if the audio signal played back is an audio signal superimposed with a pilot signal (e.g., a 19KHz signal) when the real-time load voltage and the real-time load current of the screen sound generating device are obtained in S1001, reference may be made to the description of the relevant contents in S1003, and details are not repeated here.

brookenflag = false; // default screen sound device not disabled;

if((Y _rms >Ymax)||(Y _rms <ymin)); // admittance exceeds the upper admittance threshold range limit or is less than the lower admittance threshold range limit;

brookenflag = true; v/screen sound device flag disabled;

it should be noted that in some failure scenarios of the device, for example, failure scenarios such as electrode detachment, short circuit, and breakdown, the impedance of the device may increase sharply at the same frequency. In this case, the load current of the failed screen sound generating device is drastically reduced from that of the normal screen sound generating device, and thus it is possible to determine whether the screen sound generating device is failed (i.e., abnormal) by determining whether the load current is within the normal current range. In other device failure scenarios, such as device breakage, depolarization, etc., the load current of a failed screen sound device may be relatively close to the normal value (i.e., current threshold range). In this case, it can be determined whether the screen sound production device is failed (i.e., abnormal) by calculating whether the impedance of the screen sound production device at a certain frequency is within the impedance threshold range.

Based on this, in order to reduce the process, save power consumption, and improve the accuracy of detection, in some embodiments, whether the screen sounding device fails may be determined by a judgment mode combining the load current and the impedance. Fig. 11 is a flowchart of a fifth method for detecting whether the screen sound generating device is disabled. Referring to fig. 11, the detecting method includes:

s1101, acquiring real-time load voltage and real-time load current of the screen sounding device.

Please refer to the above S1001, which is not described herein again.

S1102, judging whether the real-time load current of the screen sounding device is in a current threshold range.

Please refer to the above S902, which is not described herein again.

And S1103, calculating a real-time impedance value or a real-time admittance value of the screen sounding device.

Please refer to S1002 or S1002a, which is not described herein.

S1104, judging whether the real-time impedance value of the screen sounding device is in the impedance threshold range or whether the real-time admittance value of the screen sounding device is in the admittance threshold range.

Please refer to the above S1004 or S1004a, which is not described herein again.

And S1105, determining that the screen sounding device is invalid.

An audio playing method provided by the embodiment of the present application is described in detail below by taking an electronic device as a mobile phone as an example and combining a system architecture and a flowchart.

The software system of the electronic device (such as a mobile phone) may adopt a hierarchical architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the application takes an Android system with a layered architecture as an example, and exemplifies a software structure of a mobile phone. Of course, in other operating systems, as long as the functions implemented by the respective functional modules are similar to the embodiments of the present application.

Fig. 12 is a block diagram of a software configuration of an electronic device according to an embodiment of the present application.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into five layers, which are an application layer, an application framework layer (framework), an Android runtime (Android runtime), and a system library (libraries), a HAL (hardware abstraction layer), and a kernel layer (kernel), from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 12, applications (applications) such as call, memo, browser, contact, camera, gallery, calendar, map, bluetooth, music, video, and short message may be installed in the application layer.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 12, an audio play management service is provided in the application framework layer. The audio playing management service can be used for initializing the audio and video player, acquiring the volume of the current audio, adjusting the volume of audio playing, increasing sound effect and the like.

In addition, the application framework layer may further include a window management service, a content providing service, a view system, a resource management service, a notification management service, and the like, which is not limited in this embodiment of the present application.

For example, the window management service described above is used to manage window programs. The window management service may obtain the size of the display screen, determine whether there is a status bar, lock the screen, intercept the screen, and the like. The content providing service is used to store and retrieve data and make the data accessible to applications. The data may include video, images, audio, calls made and answered, browsing history and bookmarks, phone books, etc. The view system described above can be used to build a display interface for an application. Each display interface may be composed of one or more controls. Generally, a control may include an interface element such as an icon, button, menu, tab, text box, dialog box, status bar, navigation bar, widget, and the like. The resource management service described above provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, and the like. The notification management service enables the application program to display notification information in the status bar, can be used for conveying notification type messages, can automatically disappear after a short stay, and does not need user interaction. Such as notification management services used to notify download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scrollbar text in a status bar at the top of the system, such as a notification of a running application in the background, or a notification that appears on the screen in the form of a dialog window. For example, to prompt text messages in the status bar, to emit a prompt tone, to vibrate, to flash an indicator light, etc.

Also as shown in fig. 12, HALs corresponding to different hardware modules of the handset are provided in the HAL of the handset, e.g. Audio HAL, camera HAL, wi-Fi HAL and smart PA control HAL.

Among other things, the Audio HAL may correspond to Audio output devices (e.g., speakers, screen sound devices) through Audio driving of the core layer. When the mobile phone is provided with a plurality of audio output devices (such as a plurality of speakers or screen sounding devices), the plurality of audio output devices respectively correspond to the plurality of audio drivers of the core layer.

The smart PA control HAL corresponds to the smart PA hardware circuit by a smart PA algorithm in the DSP. For example, the smart PA control HAL may control the smart PA algorithm to shut down and stop running when the screen sounding device fails. When the screen sounding device fails, the smart PA control HAL can also control a smart PA hardware circuit (such as a hardware circuit (smart PA 0) of the screen sounding device) to be turned off through an I2C signal, so as to reduce the power consumption of the electronic device.

The Android runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), and the like.

Wherein the surface manager is used for managing the display subsystem and providing the fusion of the 2D and 3D layers for a plurality of application programs. The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is located below the HAL and is the layer between hardware and software. The core layer may further include a display driver, a camera driver, a sensor driver, and the like, in addition to the audio driver, which is not limited in this application.

It should be noted that, below the kernel layer, there is a hardware circuit. Illustratively, in the embodiments of the present application, a Digital Signal Processing (DSP) chip is included, and a smart PA algorithm module, an audio algorithm module, and the like are run in the DSP chip. The smart PA algorithm module is used for judging whether the screen sounding device (such as piezoelectric ceramics) fails (is abnormal) or not according to the load voltage, the load current and the impedance or admittance of the screen sounding device (such as piezoelectric ceramics), reporting a result when the screen sounding device (such as piezoelectric ceramics) is abnormal, and reporting the result to the audio algorithm module. The audio algorithm module controls the switching of the sounding device, such as switching a screen sounding device (such as piezoelectric ceramics, namely a capacitive device) to a loudspeaker to sound.

The abnormal result detected by the smart PA algorithm module can be reported to the HAL layer through the audio algorithm module so as to inform a user to replace the device or close the switching function of the double-sound-emitting unit. The smart PA control HAL in the HAL layer may control the impedance detection function in the smart PA algorithm to be turned off, and control the smart PA hardware circuit (e.g., the hardware circuit of the screen sound generation device (smart PA 0)) to be turned off through the I2C signal, so as to reduce the power consumption of the electronic device.

The smart PA algorithm module comprises a threshold value writing module, a data capturing module, an abnormity judging module and a result reporting module.

The threshold writing module is used for writing a voltage threshold range, a current threshold range, an impedance threshold range, an admittance threshold range and the like of a screen sounding device (such as piezoelectric ceramics) under a normal condition.

The data capture module is used for acquiring the load voltage and the load current of the screen sounding device from a smart PA hardware circuit.

The abnormity judgment module can be used for comparing the load current acquired by the data capture module with the current threshold range in the threshold write-in module and judging whether the load current of the screen sounding device is in the current threshold range. The abnormity judgment module can also be used for comparing the load voltage acquired by the data capture module with the voltage threshold range in the threshold write-in module and judging whether the load voltage of the screen sounding device is in the voltage threshold range. The abnormality determination module may be further configured to calculate an impedance or an admittance of the screen sound generating device according to the feedback voltage and the feedback current acquired by the data capture module (the specific calculation method may refer to the description about the impedance or admittance calculation above), compare the calculated impedance with an impedance threshold range written in the threshold write module, determine whether the impedance of the screen sound generating device is within the impedance threshold range, or compare the calculated admittance with an admittance threshold range written in the threshold write module, and determine whether the admittance of the screen sound generating device is within the admittance threshold range.

The result reporting module is used for reporting the abnormal result of the screen sounding device to the audio algorithm module when the load current of the screen sounding device is not in the current threshold range, or the load voltage of the screen sounding device is not in the voltage threshold range, or the impedance of the screen sounding device is not in the impedance threshold range, or the admittance of the screen sounding device is not in the admittance threshold range, so that the audio algorithm module can switch the sounding device.

The following is a detailed description of the audio playing method provided in the embodiments of the present application.

In some embodiments, to save power consumption, only at the beginning of a period after the audio playing command is issued, a single audio (e.g., audio with frequencies of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc.) that is not audible or difficult to hear for human ears is played to detect whether the screen sound generating device is damaged, and the sound generating device is switched when damaged, such as to a loudspeaker for sounding, and then normal audio playing is started.

Illustratively, as shown in fig. 13A, the audio playing method includes:

s1301, receiving an audio playing instruction. The audio playing instruction is used for indicating the playing of the first audio.

For example, when the electronic device detects an operation of a user to make a call, an upper layer application (e.g., a call application) may send a call instruction to a processor of the electronic device. For another example, when the electronic device detects an operation of playing music by a user, an upper application (e.g., a music application) may issue a music playing instruction to a processor of the electronic device. For another example, when the electronic device detects an operation of playing a video file by a user, an upper application (e.g., a video application) may issue a video file playing instruction to a processor of the electronic device. The call instruction, the music playing instruction and the video file playing instruction can be regarded as audio playing instructions, and at this time, a DSP chip in a processor of the electronic device can control sound generating devices (such as a speaker and a screen sound generating device) to obtain corresponding parameters and start up the sound generating devices to prepare for audio playing.

S1302, in response to the received audio playing instruction, playing a second audio through the screen sound generating device.

For example, as shown in fig. 12, when the DSP chip receives an audio playing instruction, in response to receiving the audio playing instruction, the audio algorithm of the DSP chip may configure a sound-generating device (e.g., a speaker, a screen sound-generating device), and enable the sound-generating device to obtain corresponding parameters, so as to start the speaker to generate sound or start the screen sound-generating device to generate sound.

At this time, in order to detect whether the screen sound generating device is damaged, the screen sound generating device may be controlled to play a single audio (i.e., a second audio) that is inaudible or difficult to hear to the human ear, for example, an audio having an amplitude of-35 to-40 decibels (dB) and frequencies of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., after the screen sound generating device is activated.

In order to avoid that the user experience is affected by the too long playing time of the second audio, the playing time of the first audio does not exceed 1 second under the normal condition.

And S1303, detecting whether the screen sounding device is invalid.

For example, in the process of playing the second audio while the electronic device executes the above S1302, the electronic device may execute the detection method shown in fig. 8, fig. 9, fig. 10A, fig. 10B or fig. 11 to determine whether the screen sound generating device fails.

In the case where the screen sound generating device is not disabled, the following S1304 is performed.

In the case where the screen sounding device fails, the following S1305 is performed.

S1304, the first audio is played.

Wherein, the first audio is the audio played by the audio playing instruction. For example, if the audio playing instruction is issued after detecting an operation of a user to make a call, the first audio may be a sound of an opposite party during a call. For another example, if the audio playing instruction is issued after an operation of playing music by the user is detected, the first audio may be music. For another example, if the audio playing instruction is issued after an operation of the user for playing the video file is detected, the first audio may be an audio in the video file.

It should be understood that under the condition that the screen sound production device (such as piezoelectric ceramics) is normal, the screen sound production device can produce sound normally, and under the condition that the electronic equipment is provided with double-device sound production, the double-device sound production is kept, and the first audio is played through the screen sound production device and the loudspeaker. For example, the screen sound generation device plays a left channel audio of the first audio, and the speaker plays a right channel audio of the first audio. Of course, the screen sounding device may also play the right channel audio of the first audio, and the speaker may also play the left channel audio of the first audio. The screen sounding device and the speaker can be configured through the audio algorithm module to play the audio of which channel, and the embodiment of the present application is not particularly limited.

It should be noted that, in the case that the screen sound generating device (such as piezoelectric ceramics) is normal, the electronic device may also play the first audio only through the screen sound generating device.

S1305, the sounding device is switched to be a loudspeaker, and first audio is played.

It should be appreciated that in the event that the screen sound generating device (e.g., piezo ceramic) fails, the screen sound generating device may not normally play audio data, such as the first audio, and the screen sound generating device may also generate noise, which may affect the user experience. In this case, after receiving the detection result reported by the smart PA algorithm module, the audio algorithm module in the DSP chip reconfigures the sound generation device, and switches the sound generation device, for example, from the sound generation of the screen sound generation device to the sound generation of the speaker, or from the sound generation of the dual devices to the sound generation of the speaker.

In the process, after the audio algorithm of the DSP chip receives the detection result reported by the smart PA algorithm module, the detection result of whether the screen sounding device is failed or not is reported to an application program layer, so that a user is prompted that the screen sounding device is damaged and needs to be replaced and maintained in time. For example, if the audio playing instruction is issued after the operation of the user on the video call is detected, the electronic device may display a maintenance prompt box 1300 (i.e., a preset prompt box) on the video call interface shown in (a) in fig. 13B, for example, display prompt information such as "warm prompt screen sound generating device has failed, has switched to the speaker to generate sound, and please arrive at the maintenance site in time to perform maintenance". For another example, if the audio playing command is issued after detecting that the user views the video file, the electronic device may display the maintenance prompt box 1300 on the video playing interface shown in (B) of fig. 13B. For another example, if the audio playing instruction is issued after the user is detected to make a call, the electronic device may display the maintenance prompt box 1300 on a call interface shown in (c) in fig. 13B.

In addition, the electronic device can prompt the user to change the user setting, turn off the dual sound emitting unit switching function, and the like, for example, the user can set that only the speaker emits sound.

In addition, after the audio algorithm module of the DSP chip receives the detection result reported by the smart PA algorithm module, the detection result of the failure of the screen sounding device is reported to the HAL layer. The HAL layer may also automatically turn off the dual device switching function (the dual device switching function is turned on by default) when receiving a detection result of the failure of the on-screen sound generating device. The smart PA control HAL in the HAL layer may control the impedance detection function in the smart PA algorithm to be turned off, and control the smart PA hardware circuit (e.g., the hardware circuit of the screen sound generation device (smart PA 0)) to be turned off through the I2C signal, so as to reduce the power consumption of the electronic device.

It should be noted that, in the audio playing method shown in fig. 13A, the failure detection of the screen sounding device is only detected when the audio playing instruction is issued. However, in the process of playing audio, the screen sound generating device may also be damaged, causing silence or noise, which affects the user experience.

Therefore, in other embodiments, the electronic device may detect whether the screen sounding device fails in real time during the audio playing process. As shown in fig. 14, the audio playing method includes:

and S1401, receiving an audio playing instruction. The audio playing instruction is used for indicating the playing of the first audio.

Please refer to S1301 above, which is not described herein again.

S1402, responding to the received audio playing instruction, playing the first audio through the screen sound generating device.

For example, as shown in fig. 12, when the DSP chip receives an audio playing instruction, in response to receiving the audio playing instruction, the audio algorithm of the DSP chip may configure a sound generating device (e.g. a speaker, a screen sound generating device), and enable the sound generating device to obtain corresponding parameters, so as to start the speaker to sound or start the screen sound generating device to sound.

At this time, the electronic device may directly play the first audio after receiving the audio playing instruction, and in the process of playing the first audio, the following S1403 is executed at preset intervals to detect whether the screen sound generating device fails, so as to find out the failure of the screen sound generating device in the process of playing the normal audio in time, reduce the possibility of occurrence of silence or noise, and improve user experience.

And S1403, detecting whether the screen sounding device fails.

For example, in the process of playing the first audio when the electronic device executes the above S1402, the electronic device may execute the detection method shown in fig. 8, fig. 9, fig. 10A, fig. 10B or fig. 11 to determine whether the screen sounding device fails.

In the case where the screen sound generating device does not fail, S1403 is repeatedly performed every preset period (e.g., 1s, 2s).

In the case where the screen sounding device fails, the following S1404 is performed.

And S1404, switching the sounding device to be a loudspeaker, and continuously playing the first audio.

Please refer to the above step S1305, which is not described herein again.

It should be noted that, in the audio playing method shown in fig. 14, in the whole audio playing process, whether the screen sound generating device fails is detected in real time, which increases the power consumption of the electronic device.

In order to reduce the power consumption of the electronic device, the embodiment of the application further provides another audio playing method. As shown in fig. 15, the audio playing method includes:

s1501, receiving an audio playing instruction. The audio playing instruction is used for indicating the playing of the first audio.

Please refer to the above S1301, which is not described herein again.

S1502, determining whether the battery power of the electronic device is greater than a preset threshold.

Illustratively, the preset threshold may be 50%, 40%, 30% of the battery capacity, and may be set according to actual conditions.

After receiving the audio playing instruction, if the battery power of the electronic device is greater than the preset threshold, executing the following steps S1503-S1506, and playing the first audio through the screen sound generation device.

After receiving the audio playing command, if the battery power of the electronic device is less than or equal to the preset threshold, the following steps S1507 to S1510 are performed.

S1503, in response to the received audio playing instruction, starting a screen sounding device and playing a first audio.

Please refer to the above S1402, which is not described herein again.

S1504, detecting whether the screen sounding device is invalid.

For example, in the process of playing the first audio by the electronic device executing the above S1503, the electronic device may execute the detection method shown in fig. 8, fig. 9, fig. 10A, fig. 10B or fig. 11 to determine whether the screen sound generating device fails.

In case that the screen sounding device is not disabled, S1505 below is performed to determine whether the battery level of the electronic device is greater than a preset threshold.

In the case where the screen sound generation device fails, the following S1406 is performed.

S1505, determining whether the battery power of the electronic device is greater than a preset threshold.

For example, if the battery power of the electronic device is greater than the preset threshold, S1504 is repeatedly executed at intervals of a preset period (e.g., 1s, 2s). If the battery power of the electronic device is less than or equal to the predetermined threshold, the step S1504 is not executed.

And S1506, switching the sound generating device to be a loudspeaker, and continuously playing the first audio.

Please refer to the above step S1305, which is not described herein again.

S1507, in response to receiving the audio playing instruction, playing the second audio through the screen sound generating device.

Please refer to the above S1302, which is not described herein again.

And S1508, detecting whether the screen sounding device is failed.

Please refer to the above S1303, which is not described herein again.

S1509, the first audio is played.

Please refer to the above step S1304, which is not described herein again.

S1510, switching the sound generating device to be a loudspeaker, and playing the first audio.

Please refer to the above step S1305, which is not described herein again.

In summary, in the audio playing method shown in fig. 15, after the electronic device receives the audio playing instruction, it is first determined whether the battery power of the electronic device exceeds the preset threshold, and if the battery power exceeds the preset threshold, it indicates that the current power of the electronic device is more, the audio playing method shown in fig. 14 may be used to play the first audio, and when the battery power of the electronic device is lower than the preset threshold, the audio playing method stops executing the step S1504, and stops detecting whether the screen sound generating device fails. If the current power of the electronic device is not greater than the preset threshold, the current power of the electronic device is low, and in order to save power consumption, the audio playing method shown in fig. 13A may be used to play the first audio.

Therefore, in the audio playing method provided by the embodiment of the present application, before or during the audio playing, whether the screen sound generating device fails (e.g., cracks, electrode falls, etc.) may be detected, and the sound generating device may be switched to the speaker to generate sound when the screen sound generating device fails, so as to avoid the noise or silence problem caused by the failure of the screen sound generating device, thereby improving the user experience.

The embodiment of the application also provides a failure detection method of the screen sounding device. As shown in fig. 16, the method for detecting the failure of the screen sound generating device includes:

s1601, in response to a preset operation or based on a preset time point, the detection audio is played through a screen sound production device.

The preset operation or the preset time point is used for triggering the electronic equipment to detect whether the screen sounding device fails or not.

Illustratively, the preset operation may be a user operation such as an operation of a user making a call, an operation of a user playing music, and an operation of a user playing a video file. The preset operation may also be an operation of detecting whether the screen sound production device is failed by the user. For example, a start button for detecting whether the screen sound production device fails may be provided, and a user may click the start button to cause the electronic device to play a detection audio through the screen sound production device to detect whether the screen sound production device fails. At this time, the preset operation may be a click operation of a start button for detecting whether the screen sound production device is disabled by the user. Therefore, the embodiment of the present application is not particularly limited to specific contents of the user operation.

Illustratively, as shown in fig. 17 (a), a detection option 1702 of "screen sounding device failure detection" is set in a setting interface 1702 in the electronic apparatus. In response to the user clicking on the detection option 1702, the electronic device may display an on-screen device failure detection interface 1703 as shown in (b) of fig. 17. In response to a user's clicking operation of the open button 1704 in the on-screen device failure detection interface 1703, the electronic apparatus may display a detection interface 1801 as shown in (a) of fig. 18. At this time, the electronic device plays a detection audio through the screen sounding device, so that the electronic device performs failure detection on the screen sounding device.

The preset time point may be a time point for failure detection of the screen sound production device preset by the electronic device, may be a default time point set by the electronic device before the electronic device leaves a factory, or may be set by a user according to actual needs, and the embodiment of the present application is not particularly limited.

The detection audio may be audio specifically used for detecting whether the screen sound production device is failed, and the detection audio may be audio with sound (i.e., audible to human ears), for example, audio used for prompting a user that the screen sound production device failure detection is being performed; or may be silent (i.e., inaudible to the human ear) audio, such as a single audio that is inaudible to the human ear. Of course, the detection audio may also be a normal audio signal audible to the human ear, such as speech during a call, music being played normally, or audio in a video file.

S1602, in the process of playing the detection audio, a first parameter is obtained. The first parameter is at least one of a real-time load current, a real-time load voltage, a real-time impedance, and a real-time admittance of the screen sound production device.

It should be understood that S1602 may correspond to the combination of S801, S901, S1001 and S1002, and the combination of S1001 and S1002a, which are not described herein again.

S1603, determining whether the screen sounding device fails according to the first parameter.

It should be understood that the S1603 may correspond to the combination of the above S802 and S803, the combination of the above S902 and S903, the combination of the above S1003 and S1004, and the combination of the above S1003a and S1004, and thus, will not be described again.

Of course, the electronic device may also display a detection completion prompt interface after the screen sound device failure detection is completed. When it is determined that the screen sound generating device is out of order, for example, as shown in fig. 18 (b), prompt information such as "warm prompt that the screen sound generating device is out of order, switched to the speaker to generate sound, and please go to the maintenance site to be maintained" may be displayed in the detection completion prompt interface 1802.

Based on the failure detection method of the screen sounding device, the electronic equipment can detect whether the screen sounding device fails or not based on preset operation or on a preset time point so as to detect the screen sounding device regularly, so that a user can be informed of the failure of the screen sounding device in time, and the user is prompted to maintain or modify default configuration of the electronic equipment, so that the reliability of the electronic equipment is improved.

The embodiment of the present application provides a chip system, as shown in fig. 19, which includes at least one processor 1901 and at least one interface circuit 1902. The processor 1901 and the interface circuit 1902 may be interconnected by wires. For example, the interface circuit 1902 may be used to receive signals from other devices (e.g., a memory of an electronic apparatus). Also for example, the interface circuit 1902 may be used to send signals to other devices, such as the processor 1901.

For example, the interface circuit 1902 may read instructions stored in a memory in the electronic device and send the instructions to the processor 1901. The instructions, when executed by the processor 1901, may cause an electronic device (such as the electronic device shown in fig. 3) to perform the various functions or steps performed by the electronic device in the embodiments described above.

Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

Another embodiment of the present application provides a computer storage medium, which includes computer instructions, when the computer instructions are executed on an electronic device, cause the electronic device to perform the functions or steps performed by the electronic device in the above method embodiments.

Another embodiment of the present application provides a computer program product, which when run on a computer causes the computer to execute the functions or steps performed by the electronic device in the above method embodiments.

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of software products, such as: and (5) carrying out a procedure. The software product is stored in a program product, such as a computer readable storage medium, and includes several instructions for causing a device (which may be a single chip, a chip, or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

For example, embodiments of the present application may also provide a computer-readable storage medium having computer program instructions stored thereon. The computer program instructions, when executed by the electronic device, cause the electronic device to implement the audio processing method as described in the aforementioned method embodiments.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. The audio playing method is characterized by being applied to electronic equipment, wherein the electronic equipment comprises a screen sounding device and a loudspeaker;

the method comprises the following steps:

receiving an audio playing instruction; the audio playing instruction is used for instructing the electronic equipment to play a first audio;

in response to receiving the audio playing instruction, playing detection audio through the screen sound-generating device;

acquiring a first parameter in the process of playing the detection audio; the first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sounding device;

determining whether the screen sounding device fails according to the first parameter;

under the condition that the screen sounding device fails, switching the sounding device to be a loudspeaker, and playing a first audio through the loudspeaker;

and under the condition that the screen sounding device does not fail, playing a first audio through the screen sounding device, or simultaneously playing the first audio through the screen sounding device and the loudspeaker.

2. The method of claim 1, wherein the detected audio is a second audio; the second audio is an audio signal different from the first audio;

the responding to the received audio playing instruction, playing the detection audio through the screen sound production device, and including:

in response to receiving the audio playing instruction, the second audio is played through the screen sounding device before the first audio is played.

3. The method of claim 1, wherein the detected audio is the first audio;

in the process of playing the detection audio, acquiring a first parameter, including:

and in the process of playing the detection audio, acquiring the first parameter according to a preset period.

4. The method of claim 1, wherein if the battery power of the electronic device is greater than a preset threshold, the detected audio is the first audio;

in the process of playing the detection audio, acquiring the first parameter according to a preset period;

or,

if the battery electric quantity of the electronic equipment is smaller than or equal to a preset threshold value, the detected audio is a second audio; the second audio is an audio signal different from the first audio;

5. The method of claim 2 or 4, wherein the second audio comprises a mono audio signal that is not audible to the human ear or an audio signal that is audible to the human ear that is different from the first audio.

6. The method according to any one of claims 1 to 5, wherein the audio playing instruction comprises a call instruction, a music playing instruction, or a video file playing instruction.

7. The method according to any one of claims 1 to 6, wherein the first parameter comprises a real-time load current of the screen sound production device;

determining whether the screen sounding device is failed according to the first parameter, comprising:

if the real-time load current of the screen sounding device is larger than the maximum value of the current threshold range, or the real-time load current of the screen sounding device is smaller than the minimum value of the current threshold range, determining that the screen sounding device is invalid; the current threshold ranges are: a current range corresponding to a first frequency when the screen sound generating device is not deactivated; the first frequency is the frequency of the central frequency point of the detection audio.

8. The method of any of claims 1 to 7, wherein the first parameter comprises a real-time load voltage of the screen sound device;

determining whether the screen sounding device fails according to the first parameter, comprising:

if the real-time load voltage of the screen sounding device is larger than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sounding device is smaller than the minimum value of the voltage threshold range, determining that the screen sounding device is invalid; the voltage threshold ranges are: a voltage range corresponding to a first frequency when the screen sound production device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

9. The method according to any one of claims 1 to 8, wherein the first parameter comprises a real-time impedance of the screen sound production device; the real-time impedance of the screen sound production device is determined by the real-time load voltage and the real-time load current of the screen sound production device;

if the real-time impedance of the screen sounding device is larger than the maximum value of the impedance threshold range, or the real-time impedance of the screen sounding device is smaller than the minimum value of the impedance threshold range, determining that the screen sounding device is invalid; the impedance threshold range is: an impedance range corresponding to a first frequency when the screen sound generating device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

10. The method according to any one of claims 1 to 9, wherein the first parameter comprises: real-time admittance of the screen sounding device; the real-time admittance of the screen sounding device is determined by the real-time load voltage and the real-time load current of the screen sounding device;

if the real-time admittance of the screen sounding device is larger than the maximum value of the admittance threshold range, or the real-time admittance of the screen sounding device is smaller than the minimum value of the admittance threshold range, determining that the screen sounding device is invalid; the admittance threshold range is: an admittance range corresponding to a first frequency when the screen sounding device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

11. The method according to claim 7 or 9 or 10, wherein the real-time load current of the screen sound device is: when the screen sounding device plays N frames of detection audio, detecting the average value of M feedback currents; wherein, N and M are positive integers which are more than 1.

12. The method according to any one of claims 8 to 10, wherein the real-time load voltage of the screen sound device is: when the screen sound generating device plays N frames of detection audio, detecting the average value of M feedback voltages; wherein, N and M are positive integers which are more than 1.

13. The method according to any one of claims 7 to 12, wherein the real-time load voltage of the screen sounding device or the real-time load current of the screen sounding device is obtained by a smart power amplifier module.

14. The method of any one of claims 1 to 13, further comprising:

displaying a preset prompt box under the condition that the screen sounding device fails; the preset prompt box comprises prompt information; the prompt message is used for indicating that the screen sounding device is disabled.

15. The method according to any one of claims 1 to 14, further comprising:

and under the condition that the screen sounding device fails, closing the screen sounding device.

16. A failure detection method of a screen sounding device is applied to electronic equipment, wherein the electronic equipment comprises the screen sounding device, and the method comprises the following steps:

responding to a preset operation or based on a preset time point, and playing detection audio through the screen sound production device;

and determining whether the screen sounding device fails according to the first parameter.

17. The method of claim 16, wherein the first parameter comprises a real-time load current of the screen sound device;

if the real-time load current of the screen sounding device is larger than the maximum value of the current threshold range, or the real-time load current of the screen sounding device is smaller than the minimum value of the current threshold range, determining that the screen sounding device is invalid; the current threshold ranges are: a current range corresponding to a first frequency when the screen sound production device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

18. The method of claim 16 or 17, wherein the first parameter comprises a real-time load voltage of the screen sound device;

if the real-time load voltage of the screen sounding device is larger than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sounding device is smaller than the minimum value of the voltage threshold range, determining that the screen sounding device is invalid; the voltage threshold ranges are: a voltage range corresponding to a first frequency when the screen sound generating device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

19. The method of any one of claims 16 to 18, wherein the first parameter comprises a real-time impedance of the screen sound production device; the real-time impedance of the screen sounder is determined by the real-time load voltage and the real-time load current of the screen sounder;

if the real-time impedance of the screen sounding device is larger than the maximum value of the impedance threshold range, or the real-time impedance of the screen sounding device is smaller than the minimum value of the impedance threshold range, determining that the screen sounding device is invalid; the impedance threshold range is: an impedance range corresponding to a first frequency when the screen sound production device is not disabled; the first frequency is the frequency of the central frequency point of the detection audio.

20. The method according to any one of claims 16 to 19, wherein the first parameter comprises: real-time admittance of the screen sounding device; the real-time admittance of the screen sounding device is determined by the real-time load voltage and the real-time load current of the screen sounding device;

21. The method of claim 17 or 19 or 20, wherein the real-time load current of the screen sound device is: when the screen sound generating device plays N frames of detection audio, detecting the average value of M feedback currents; wherein, N and M are positive integers which are more than 1.

22. The method according to any one of claims 18 to 20, wherein the real-time load voltage of the screen sound device is: when the screen sound generating device plays N frames of detection audio, detecting the average value of M feedback voltages; wherein, N and M are positive integers which are more than 1.

23. The method according to any one of claims 17 to 22, wherein the real-time load voltage of the screen sounding device or the real-time load current of the screen sounding device is obtained by a smart power amplifier module.

24. An electronic device, characterized in that the electronic device comprises:

a screen sounding device;

a speaker;

one or more processors;

a memory;

a communication module;

the screen sounding device and the loudspeaker are used for playing sound signals of the electronic equipment; the communication module is used for communicating with external equipment;

the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the processor, cause the electronic device to perform the method of any of claims 1-23.

25. A computer-readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the method of any of claims 1-23.