WO2023000795A1 - 音频播放方法、屏幕发声器件的失效检测方法及电子设备 - Google Patents

音频播放方法、屏幕发声器件的失效检测方法及电子设备 Download PDF

Info

Publication number
WO2023000795A1
WO2023000795A1 PCT/CN2022/093638 CN2022093638W WO2023000795A1 WO 2023000795 A1 WO2023000795 A1 WO 2023000795A1 CN 2022093638 W CN2022093638 W CN 2022093638W WO 2023000795 A1 WO2023000795 A1 WO 2023000795A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen sound
emitting device
audio
real
screen
Prior art date
Application number
PCT/CN2022/093638
Other languages
English (en)
French (fr)
Inventor
杨枭
许剑峰
邱志强
Original Assignee
北京荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111094726.2A external-priority patent/CN115686425A/zh
Application filed by 北京荣耀终端有限公司 filed Critical 北京荣耀终端有限公司
Priority to EP22844962.5A priority Critical patent/EP4254168A4/en
Priority to US18/270,650 priority patent/US20240069862A1/en
Publication of WO2023000795A1 publication Critical patent/WO2023000795A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • H04R29/001Monitoring arrangements; Testing arrangements for loudspeakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • H04R29/004Monitoring arrangements; Testing arrangements for microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/11Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers

Definitions

  • the present application relates to the field of electronic technology, and in particular to an audio playback method, a failure detection method of a sound emitting device on a screen, and electronic equipment.
  • a sound emitting device needs to be installed in the electronic device so that the user can hear the other party's voice.
  • the screen sound emitting device such as a piezoelectric ceramic capacitive device
  • piezoelectric ceramic capacitive devices may fail (such as breakage, electrode shedding, etc.). After piezoelectric ceramic capacitive devices fail, electronic devices may make sounds or noises during voice communication , affecting the user experience.
  • Embodiments of the present application provide an audio playback method, a failure detection method of a screen sound generating device, and an electronic device, which can solve the problem of silence or noise after the screen sound generating device fails, thereby improving the reliability of the electronic device and user experience.
  • the present application provides an audio playing method.
  • the audio playing method is applied to an electronic device, and the electronic device includes a screen sound generating device and a loudspeaker.
  • the audio playing method includes: receiving an audio playing instruction.
  • the audio playing instruction is used to instruct the electronic device to play the first audio.
  • the detection audio is played through the screen sound emitting device.
  • the first parameter is obtained. According to the first parameter, it is determined whether the screen sound emitting device is invalid.
  • the first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound emitting device.
  • the sound generating device fails, the sound generating device is switched to a speaker, and the first audio is played. If the screen sound emitting device does not fail, the first audio is played through the screen sound emitting device, or the first audio is played simultaneously through the screen sound emitting device and the speaker.
  • the detection audio is played through the screen sound emitting device.
  • the first parameter is acquired during the process of playing the detection audio, and according to the first parameter, it can be determined whether the detection screen sound emitting device fails (such as breakage, electrode shedding, etc.).
  • switch the sound-generating device such as switching to a speaker for sounding. In this way, the problem of noise or silence caused by the failure of the screen sound emitting device can be avoided, the reliability of the electronic device can be improved, and the user experience can be improved.
  • the detected audio is the second audio; the second audio is an audio signal different from the first audio.
  • playing the detected audio through the screen sound emitting device includes: in response to receiving the audio playing instruction, playing the second audio through the screen sound emitting device before playing the first audio.
  • the second audio that is inaudible to the human ear can be played first, or an audio signal audible to the human ear that is specially used to detect whether the screen is invalid, so as to detect the screen sound emitting device Is it invalid.
  • the power consumption generated by the electronic device to detect whether the screen sound emitting device fails in real time can be reduced.
  • the detected audio is the first audio.
  • obtaining the first parameter includes: during the process of playing the detection audio, obtaining the first parameter according to a preset cycle; the preset cycle is used to indicate the time interval between two times of judging whether the screen sound emitting device is invalid.
  • the electronic device can detect in real time whether the screen sound emitting device fails (for example, every 1 second). In this way, the electronic device can detect the failure of the screen sound emitting device during audio playback, thereby improving the reliability of the electronic device.
  • the detected audio is the first audio.
  • obtaining the first parameter includes: during the process of playing the detection audio, obtaining the first parameter according to a preset cycle; the preset cycle is used to indicate the time interval between two times of judging whether the screen sound emitting device is invalid.
  • the detected audio is the second audio.
  • the second audio is an audio signal different from the first audio.
  • playing the detected audio through the screen sound emitting device includes: in response to receiving the audio playing instruction, playing the second audio through the screen sound emitting device before playing the first audio.
  • the timing of detecting the screen sound emitting device can be selected according to the battery power of the electronic device.
  • the first audio frequency is used as the detection audio of whether the screen sound emitting device is invalid, and whether the screen sound emitting device is invalid is detected in real time, so as to avoid being unable to detect the sudden failure of the screen sound emitting device during audio playback, thereby improving the electronic Equipment reliability.
  • the second audio that is inaudible to the human ear is used as the detection audio of whether the screen sound device is invalid, and whether the screen sound device is invalid before playing the first audio, so as to reduce the power consumption of electronic equipment .
  • the second audio includes a single audio signal inaudible to human ears, or an audio signal different from the first audio and audible to human ears.
  • the audio playback instruction includes a call instruction, a music playback instruction, or a video file playback instruction.
  • the first parameter includes a real-time load current of the screen sound emitting device.
  • determine whether the screen sound device fails including: if the real-time load current of the screen sound device is greater than the maximum value of the current threshold range, or the real-time load current of the screen sound device is smaller than the minimum value of the current threshold range, then determine the screen sound Device failure.
  • the current threshold range is: the current range corresponding to the first frequency when the screen sound emitting device does not fail.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the real-time load current of the screen sound device can be used to determine whether the screen sound device is invalid.
  • the first parameter includes a real-time load voltage of the screen sound emitting device.
  • determine whether the screen sound device fails including: if the real-time load voltage of the screen sound device is greater than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sound device is lower than the minimum value of the voltage threshold range, then determine the screen sound Device failure.
  • the voltage threshold range is: the voltage range corresponding to the first frequency when the screen sound emitting device is not in failure.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the load voltage of the sound emitting device of the screen will also change greatly. In this way, the real-time load voltage of the screen sound device can be used to determine whether the screen sound device is invalid.
  • the first parameter includes the real-time impedance of the screen sound emitting device.
  • the real-time impedance of the screen sound device is determined by the real-time load voltage and real-time load current of the screen sound device.
  • determine whether the screen sound emitting device is invalid including: if the real-time impedance of the screen sound emitting device is greater than the maximum value of the impedance threshold range, or the real-time impedance of the screen sound emitting device is smaller than the minimum value of the impedance threshold range, then determine that the screen sound emitting device is invalid .
  • the impedance threshold range is: the impedance range corresponding to the first frequency when the screen sound emitting device does not fail.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the feedback voltage (i.e. real-time load voltage) and feedback current (i.e. real-time load current) of the screen sound-emitting device can be obtained in the smart PA hardware circuit, and the real-time impedance of the screen sound-emitting device can be determined by the feedback voltage and feedback current.
  • the impedance of the sound emitting device of the screen will change greatly. In this way, the real-time impedance of the screen sound device can be used to determine whether the screen sound device is invalid.
  • the first parameter includes: real-time admittance of the screen sound emitting device.
  • the real-time admittance of the screen sound device is determined by the real-time load voltage and real-time load current of the screen sound device.
  • determining whether the screen sound-emitting device is invalid includes: if the real-time admittance of the screen sound-emitting device is greater than the maximum value of the admittance threshold range, or the real-time admittance of the screen sound-emitting device is smaller than the minimum value of the admittance threshold range, then determine Screen sound device fails.
  • the admittance threshold range is: the admittance range corresponding to the first frequency when the screen sound emitting device is not in failure; the first frequency is the frequency of the central frequency point of the detected audio.
  • the feedback voltage (i.e. real-time load voltage) and feedback current (i.e. real-time load current) of the screen sound-emitting device can be obtained in the smart PA hardware circuit, and the real-time admittance of the screen sound-emitting device can also be determined by the feedback voltage and feedback current. Since the admittance of the screen sound emitting device is the reciprocal of the impedance of the screen sound emitting device, when the impedance of the screen sound emitting device changes greatly, the admittance of the screen sound emitting device will also change greatly. Therefore, it is also possible to judge whether the screen sound emitting device is invalid through the real-time admittance of the screen sound emitting device.
  • the real-time load current of the screen sound device is: the average value of M feedback currents detected when the screen sound device plays N frames of detection audio.
  • N and M are both positive integers greater than 1.
  • a feedback current value can be obtained every time the screen sound generating device plays a frame of detection audio, and N and M can be equal at this time.
  • the real-time load current of the screen sound-emitting device is the average value of multiple feedback currents, which can reduce errors caused by noise on the detection path.
  • the real-time load voltage of the screen sound device is: the average value of M feedback voltages detected when the screen sound device plays N frames of detection audio. Wherein, N and M are both positive integers greater than 1.
  • the real-time load voltage of the screen sound emitting device is the average value of multiple feedback voltages, which can also reduce errors caused by noise on the detection path.
  • the real-time load voltage of the screen sound device or the real-time load current of the screen sound device is obtained by an intelligent power amplifier module.
  • the above method may further include: displaying a preset prompt box when the screen sound emitting device fails.
  • the preset prompt box includes prompt information.
  • the prompt information is used to indicate that the screen sound device has failed. In this way, when the screen sound generating device fails, the electronic device promptly prompts the user that the screen sound generating device has failed, which can improve user experience.
  • the above method may further include: when the screen sound generating device fails, turning off the screen sound emitting device. In this way, the power consumption of the electronic equipment can be reduced, and the noise caused by the failure of the screen sound emitting device can be avoided.
  • the present application provides a failure detection method for a screen sound emitting device.
  • the method is applied to electronic equipment, and the electronic equipment includes a screen sound emitting device.
  • the failure detection method of the screen sound emitting device includes: playing detection audio through the screen sound emitting device in response to a preset operation or based on a preset time point. Wherein, the preset operation or the preset time point is used to trigger the electronic device to detect whether the screen sound emitting device fails.
  • the first parameter is obtained. According to the first parameter, it is determined whether the screen sound emitting device is invalid.
  • the first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound emitting device.
  • the electronic device can detect whether the screen sound-emitting device is invalid based on a preset operation or a preset time point, so as to regularly detect the screen sound-emitting device, so as to promptly notify the user of the failure of the screen sound-emitting device , to prompt the user to repair or modify the default configuration of the electronic device, so as to improve the reliability of the electronic device.
  • the first parameter includes a real-time load current of the screen sound emitting device.
  • determine whether the screen sound device fails including: if the real-time load current of the screen sound device is greater than the maximum value of the current threshold range, or the real-time load current of the screen sound device is smaller than the minimum value of the current threshold range, then determine the screen sound Device failure.
  • the current threshold range is: the current range corresponding to the first frequency when the screen sound emitting device does not fail.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the first parameter includes a real-time load voltage of the screen sound emitting device.
  • determine whether the screen sound device fails including: if the real-time load voltage of the screen sound device is greater than the maximum value of the voltage threshold range, or the real-time load voltage of the screen sound device is lower than the minimum value of the voltage threshold range, then determine the screen sound Device failure.
  • the voltage threshold range is: the voltage range corresponding to the first frequency when the screen sound emitting device does not fail; the first frequency is the frequency of the center frequency point of the detected audio.
  • the first parameter includes the real-time impedance of the screen sound emitting device.
  • the real-time impedance of the screen sound device is determined by the real-time load voltage and real-time load current of the screen sound device.
  • determine whether the screen sound emitting device is invalid including: if the real-time impedance of the screen sound emitting device is greater than the maximum value of the impedance threshold range, or the real-time impedance of the screen sound emitting device is smaller than the minimum value of the impedance threshold range, then determine that the screen sound emitting device is invalid .
  • the impedance threshold range is: the impedance range corresponding to the first frequency when the screen sound emitting device does not fail.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the first parameter includes: real-time admittance of the screen sound emitting device.
  • the real-time admittance of the screen sound device is determined by the real-time load voltage and real-time load current of the screen sound device.
  • determining whether the screen sound-emitting device is invalid includes: if the real-time admittance of the screen sound-emitting device is greater than the maximum value of the admittance threshold range, or the real-time admittance of the screen sound-emitting device is smaller than the minimum value of the admittance threshold range, then determine Screen sound device fails.
  • the admittance threshold range is: the admittance range corresponding to the first frequency when the screen sound emitting device does not fail.
  • the first frequency is the frequency of the central frequency point of the detected audio.
  • the real-time load current of the screen sound device is: when the screen sound device plays N frames of detection audio, the average value of the M feedback currents detected; integer.
  • the real-time load voltage of the screen sound device is: when the screen sound device plays N frames of detection audio, the average value of the M feedback voltages detected; integer.
  • the real-time load voltage of the screen sound device or the real-time load current of the screen sound device is obtained by an intelligent power amplifier module.
  • the present application provides an electronic device.
  • the electronic equipment includes: a screen sound generating device; a loudspeaker; one or more processors; a memory; a communication module.
  • the screen sound generating device and the speaker are both used to play the sound signal of the electronic device;
  • the communication module is used to communicate with the external device;
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions.
  • the electronic device executes the method described in any possible implementation manner of the first aspect or the second aspect above.
  • the embodiment of the present application provides a chip system, where the chip system includes one or more interface circuits and one or more processors.
  • the interface circuit and the processor are interconnected by wires.
  • the chip system can be applied to an electronic device including a communication module and a memory.
  • the interface circuit can read instructions stored in the memory of the electronic device, and send the instructions to the processor.
  • the electronic device may be made to execute the method described in any possible implementation manner of the first aspect or the second aspect above.
  • the embodiment of the present application provides a computer-readable storage medium. Instructions are stored on a computer readable storage medium. When the instruction is run on the electronic device, the electronic device is made to execute the method in any possible implementation manner of the first aspect or the second aspect above.
  • the embodiment of the present application provides a computer program product, which, when the computer program product is run on a computer, enables the computer to execute the above-mentioned one of the possible implementations of the first aspect or the second aspect. the method described.
  • FIG. 1A is a schematic diagram of a scene where a user performs voice communication through an electronic device provided in an embodiment of the present application;
  • FIG. 1B is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
  • Fig. 2 is a schematic diagram of comparison before and after failure of a screen sound emitting device provided by the embodiment of the present application;
  • FIG. 3 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
  • Fig. 4 is a schematic diagram of the screen sound emitting device provided by the embodiment of the present application.
  • Fig. 5 is the frequency resistance characteristic curve of the 4.2 microfarad piezoelectric ceramic provided by the embodiment of the present application.
  • Fig. 6 is a comparison chart of the frequency resistance characteristic curves of the normal screen sound emitting device and the abnormal screen sound emitting device provided by the embodiment of the present application;
  • Fig. 7 is the intelligent power amplifier (smart PA) hardware circuit diagram that the embodiment of the present application provides;
  • Fig. 8 is a flow chart 1 of a method for detecting whether a screen sound emitting device fails according to an embodiment of the present application
  • FIG. 9 is the second flow chart of a method for detecting whether a screen sound emitting device fails according to an embodiment of the present application.
  • Fig. 10A is a flowchart three of a method for detecting whether a screen sound emitting device fails according to an embodiment of the present application
  • FIG. 10B is a flowchart 4 of a method for detecting whether a screen sound emitting device fails according to an embodiment of the present application
  • Fig. 11 is a flowchart five of a method for detecting whether a screen sound emitting device fails according to an embodiment of the present application
  • FIG. 12 is a block diagram of the software structure of the electronic device provided by the embodiment of the present application.
  • Fig. 13A is a flow chart 1 of an audio playback method provided by the embodiment of the present application.
  • FIG. 13B is a scene diagram of an audio playback method provided by an embodiment of the present application.
  • FIG. 14 is a flowchart 2 of an audio playback method provided by an embodiment of the present application.
  • FIG. 15 is a flowchart three of an audio playback method provided by an embodiment of the present application.
  • Fig. 16 is a flow chart of a failure detection method for a screen sound emitting device provided by an embodiment of the present application.
  • Fig. 17 is a scene diagram 1 of a failure detection method of a screen sound emitting device provided by an embodiment of the present application.
  • Fig. 18 is a scene diagram 2 of a failure detection method of a screen sound emitting device provided by an embodiment of the present application;
  • FIG. 19 is a schematic structural diagram of a chip system provided by an embodiment of the present application.
  • a sound emitting device needs to be installed in the electronic equipment so that the user can hear the other party's voice during voice communication.
  • the electronic equipment also needs to be equipped with a sound-generating device.
  • an earpiece also called a speaker
  • the earpiece is installed on the top of the mobile phone as a sounding device for voice communication to realize the voice communication function.
  • the earpiece is arranged inside the mobile phone, and a hole needs to be drilled on the front panel of the mobile phone to form a sound outlet.
  • the earpiece When the earpiece emits sound, the sound energy emitted by the earpiece can be transmitted through the sound outlet, so that the user can hear the sound emitted by the earpiece.
  • the screen-to-body ratio of mobile phone screens is getting higher and higher. Since the sound output holes arranged on the front panel occupy part of the front panel area of the mobile phone, the width of the frame of the mobile phone will be increased, which will affect the improvement of the screen-to-body ratio of the mobile phone.
  • the sound outlet of the handset of the mobile phone is designed as a long slit, and the sound outlet is located at the connection between the middle frame and the front panel of the mobile phone (also called the side seam of the mobile phone).
  • the sound output hole of the handset of the mobile phone it is also possible to open a hole on the top of the middle frame of the mobile phone as the sound output hole.
  • the user's auricle cannot completely cover and wrap the sound hole, and the sound energy of the handset of the mobile phone cannot be completely transmitted to the user's auricle, resulting in sound leakage.
  • the earpiece of the mobile phone is used to play the voice signal of the opposite user during the voice communication sounding speakers).
  • the sound output hole 201 of the handset of the mobile phone is close to the user's ear (or auricle).
  • the sound outlet 201 of the handset of the mobile phone (such as the sound outlet at the side seam of the mobile phone and the sound outlet at the top of the middle frame) cannot be completely covered by the user's ears, the sound emitted by the sound outlet 201 The signal can not only be heard by the user, but also can be heard by other users in a quiet environment, resulting in sound leakage.
  • FIG. 1B it is a schematic structural diagram of an electronic device.
  • the electronic device includes a casing structure 100 .
  • the housing structure 100 is enclosed by a front panel (including a screen and a frame), a rear panel for supporting internal circuits, and a middle frame.
  • the housing structure 100 of the electronic device is provided with an earpiece 101 and a screen sound emitting device 104 .
  • the earpiece 101 is a loudspeaker used for speaking in voice communication, also called a receiver, and is usually arranged at the top of the housing structure.
  • the screen sound generating device 104 may be a vibration source connected under the screen.
  • the electronic device is provided with two sound outlets, namely the sound outlet 102 and the sound outlet 103 .
  • the sound outlet 102 is located at the connection between the front panel and the middle frame of the electronic device (ie at the side seam).
  • the sound hole 103 is located on the middle frame of the electronic device at a position closer to the earpiece (that is, at the top of the middle frame of the electronic device). In this way, the electronic device shown in FIG. 1B can produce sound through the earpiece, or through the screen, or simultaneously through the earpiece and the screen, so as to avoid the sound leakage phenomenon that occurs only when the earpiece is used.
  • the screen sound emitting device may be a vibration source (such as piezoelectric ceramics, motor vibrator, exciter or other vibration units) connected to the back of the screen.
  • the vibration source can vibrate under the control of the current signal to drive the screen to vibrate, so as to realize the sound from the screen.
  • the screen sound emitting device may also be a piezoelectric ceramic fixed on the middle frame of the electronic device through a cantilever beam structure.
  • the piezoelectric ceramic can vibrate under the control of the current signal, and use the middle frame of the mobile phone to transmit the vibration to the screen to drive the screen to vibrate, so as to realize the sound of the screen.
  • the screen sound emitting device may also be an exciter fixed on the middle frame of the electronic device. The exciter can vibrate under the control of the current signal, and use the middle frame of the mobile phone to transmit the vibration to the screen to drive the screen to vibrate, so as to realize the sound of the screen.
  • the sound emitting device on the screen may also be a split type magnetic levitation vibrator. One of the vibrators in the split-type magnetic levitation vibrator is fixed on the middle frame of the electronic device, and the other vibrator is fixed on the screen. The vibrator that can be fixed on the screen is under the control of the current signal The vibrator on the frame vibrates, thereby pushing the screen to vibrate, so as to realize the sound of the screen.
  • the sound emitting device on the screen can emit normal sound signals when the sound emitting device on the screen is normal.
  • the screen sound-generating device such as piezoelectric ceramics
  • the screen sound-generating device may fail (such as breakage, depolarization, etc.), resulting in problems such as silence or noise in the screen sound-generating device, making the electronic device unable to play normally.
  • Sound signals (such as voice communication or playing music), which in turn affect the user experience.
  • an embodiment of the present application provides an audio playback method.
  • the audio playback method before playing the audio or during the audio playback, it is detected whether the sound emitting device of the screen is invalid (such as breakage, electrode falling off, etc.), and the sound emitting device is switched when the sound emitting device of the screen fails, such as switching to a speaker for sounding , so as to avoid the problem of noise or silence caused by the failure of the screen sound-generating device, so as to improve the user experience.
  • the electronic equipment in the embodiment of the present application may be a mobile phone, a tablet computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, a cellular phone, a personal digital assistant (personal digital assistant, PDA),
  • PDA personal digital assistant
  • the embodiment of the present application does not specifically limit the specific form of the electronic devices.
  • FIG. 3 shows a schematic structural diagram of another electronic device provided by an embodiment of the present application. That is, for example, the electronic device shown in FIG. 3 may be a mobile phone.
  • mobile phone can comprise: processor 310, external memory interface 320, internal memory 321, universal serial bus (universal serial bus, USB) interface 330, charging management module 340, power management module 341, battery 342, Antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver (i.e. handset) 370B, microphone 370C, earphone jack 370D, sensor module 380, button 390, motor 391, indicator 392 , a camera 393, a display screen 394, a subscriber identification module (subscriber identification module, SIM) card interface 395, a screen sound emitting device 396, etc.
  • SIM subscriber identification module
  • the above-mentioned sensor module may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.
  • sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.
  • the structure shown in this embodiment does not constitute a specific limitation on the mobile phone.
  • the mobile phone may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller can be the nerve center and command center of the phone.
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • DSP can include smart power amplifier (smart PA) hardware circuit, smart PA algorithm module, audio algorithm module.
  • the smart PA hardware circuit can be connected with the application processor and the screen sound device (such as piezoelectric ceramics) respectively, and is used to control the screen sound device to produce sound according to the instruction of the application processor. It should be understood that under normal circumstances, the smart PA hardware circuit can also be used to detect the feedback current and feedback voltage of the screen sound device during the audio playback process of the screen sound device, and calculate the screen sound according to the feedback current and feedback voltage of the screen sound device.
  • the impedance or admittance of the device is the reciprocal of impedance.
  • the calculated impedance or admittance of the screen sound emitting device can be used to control the physical parameters (such as temperature, amplitude) of the screen sound emitting device (such as piezoelectric ceramics).
  • the smart PA algorithm module is used to determine the Whether the screen sound emitting device (such as piezoelectric ceramics) fails (abnormal).
  • the smart PA algorithm module is also used to report the result when the screen sound emitting device (such as piezoelectric ceramics) is abnormal, and report it to the audio algorithm module.
  • the switching of the sound-generating device is controlled by the audio algorithm module, such as switching the screen sound-generating device (such as a piezoelectric ceramic, that is, a capacitive device) to a speaker for sounding.
  • the smart PA hardware circuit may also be arranged outside the DSP chip, which is not specifically limited in this embodiment of the present application.
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is a cache memory.
  • the memory may hold instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 310 is reduced, thereby improving the efficiency of the system.
  • processor 310 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the interface connection relationship between modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the mobile phone.
  • the mobile phone may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the electronic device can determine the category of the current listening environment through the processor 310, and then adjust the frequency band of the earpiece and the frequency band of the screen according to the category, so as to control the earpiece and the screen. Play the sound in the corresponding frequency band in the sound signal respectively, so as to avoid the sound leakage of the electronic device when the human ear listens to the sound in a quiet environment.
  • the charging management module 340 is configured to receive a charging input from a charger (such as a wireless charger or a wired charger) to charge the battery 342 .
  • the power management module 341 is used for connecting the battery 342 , the charging management module 340 and the processor 310 .
  • the power management module 341 receives the input of the battery 342 and/or the charging management module 340 to supply power to various components of the electronic device.
  • the wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in a mobile phone can be used to cover single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the antenna 1 of the mobile phone is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the mobile phone can communicate with the network and other devices through wireless communication technology.
  • the above-mentioned mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G applied to mobile phones.
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 350 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 350 may be set in the processor 310 .
  • at least part of the functional modules of the mobile communication module 350 and at least part of the modules of the processor 310 may be set in the same device.
  • the wireless communication module 360 can provide applications on mobile phones including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system ( Global navigation satellite system (GNSS), frequency modulation (frequency modulation, FM), near field communication (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 360 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 360 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310.
  • the wireless communication module 360 can also receive the signal to be sent from the processor 310 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the above wireless communication module 360 can also support the mobile phone to perform voice communication.
  • the mobile phone can access the Wi-Fi network through the wireless communication module 360, and then use any application program that can provide voice communication services to interact with other devices to provide users with voice communication services.
  • the above-mentioned application program that can provide voice communication service may be an instant messaging application.
  • the mobile phone can realize the display function through the GPU, the display screen 394, and the application processor.
  • the GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 394 is used to display images, videos and the like.
  • the mobile phone can realize shooting function through ISP, camera 393 , video codec, GPU, display screen 394 and application processor.
  • the ISP is used for processing the data fed back by the camera 393 .
  • the ISP may be located in the camera 393 .
  • Camera 393 is used to capture still images or video.
  • the mobile phone may include 1 or N cameras 393, where N is a positive integer greater than 1.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone.
  • the internal memory 321 may be used to store computer-executable program code, which includes instructions.
  • the processor 310 executes various functional applications and data processing of the mobile phone by executing instructions stored in the internal memory 321 .
  • the processor 310 may execute instructions stored in the internal memory 321, and the internal memory 321 may include a program storage area and a data storage area.
  • the mobile phone can realize the audio function through the audio module 370, the loudspeaker 370A, the receiver (that is, the handset) 370B, the microphone 370C, the earphone interface 370D, and the application processor. Such as music playback, recording, etc.
  • the audio module 370 is used to convert digital audio signals into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 370 may also be used to encode and decode audio signals.
  • the audio module 370 can be set in the processor 310 , or some functional modules of the audio module 370 can be set in the processor 310 .
  • Speaker 370A also called “horn” is used to convert audio electrical signals into sound signals.
  • Receiver 370B also called “earpiece”, is used to convert audio electrical signals into audio signals.
  • the microphone 370C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the earphone interface 370D is used to connect wired earphones.
  • the earphone interface 370D may be a USB interface 330, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • CTIA cellular
  • the receiver 370B (that is, the "earpiece") may be the earpiece 101 shown in FIG. 1B .
  • the audio module 370 may convert audio electrical signals received by the mobile communication module 350 and the wireless communication module 360 into sound signals.
  • the sound signal is played by the receiver 370B of the audio module 370 (ie, the "earpiece"), and at the same time, the screen sound generator 396 drives the screen (ie, the display screen) to produce sound on the screen to play the sound signal.
  • the keys 390 include a power key, a volume key and the like.
  • the motor 391 can generate a vibrating prompt.
  • the indicator 392 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and the like.
  • the SIM card interface 395 is used for connecting a SIM card.
  • the mobile phone can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • FIG. 3 is only an exemplary description when the electronic device is in the form of a mobile phone. If the electronic device is in the form of a tablet computer, a handheld computer, a PDA, a wearable device (such as a smart watch, a smart bracelet) and other devices, the structure of the electronic device may include fewer structures than those shown in Figure 3, More structures than those shown in FIG. 3 may also be included, without limitation.
  • the audio playback method provided by the embodiment of the present application needs to detect whether the sound-generating device on the screen fails before or during the audio playback. Therefore, the following uses piezoelectric ceramics as an example of the sound emitting device on the screen to describe how to detect whether the sound emitting device on the screen fails.
  • FIG. 4 is a schematic diagram of the screen sound emitting device.
  • the screen sound emitting device includes multilayer piezoelectric ceramics.
  • the multilayer piezoelectric ceramic forms a vibrating film, and after an AC driving signal is applied, it can undergo bending deformation under the piezoelectric effect to push the vibrating film to produce sound.
  • the impedance of piezoelectric ceramics (that is, capacitive devices) satisfies the following relationship: Among them, z is the impedance of the piezoelectric ceramic, C is the capacitance, and f is the frequency of the AC signal. It can be seen that the equivalent impedance of piezoelectric ceramics decreases as the frequency of the input AC signal increases.
  • the frequency resistance characteristic curve of a piezoelectric ceramic of 4.2 microfarads when the frequency of an AC signal of a piezoelectric ceramic of 4.2 microfarads (uF) is 200 hertz (Hz), the equivalent of piezoelectric ceramics
  • the impedance is about 160 ohms (Ohm)
  • the equivalent impedance of piezoelectric ceramics with 4.2 microfarads (uF) is about 3.7 ohms (Ohm) when the frequency of the AC signal is 10k hertz (Hz).
  • the screen sound-emitting device formed of multilayer piezoelectric ceramics does not only include piezoelectric ceramics (ie, capacitive devices), but may also include electrode leads, dielectric materials, and other components. Therefore, the equivalent impedance of the screen sound emitting device formed of multilayer piezoelectric ceramics is a nonlinear curve, which is related to temperature, frequency and materials.
  • the frequency resistance characteristic curve of the sound emitting device on the screen tends to be consistent. That is to say, as the frequency of the AC signal increases, the impedance of the screen sound emitting device will decrease.
  • screen sound-emitting devices such as piezoelectric ceramics
  • inner electrodes may fail, such as shedding, short circuit, breakdown or depolarization.
  • the screen sound emitting device such as piezoelectric ceramics
  • the physical characteristics of the screen sound emitting device will change, usually manifested in changes in capacitance, impedance, load current, load voltage, and acoustic frequency response.
  • the impedance of the sound emitting device of the screen will deviate from a normal value, such as becoming extremely small or extremely large.
  • the load current and load voltage of the screen sound emitting device can be detected, and the current impedance or admittance of the screen sound emitting device can also be calculated through the load current and load voltage. Then the detected load current can be compared with the load current of the screen sound device under normal conditions, or the detected load voltage can be compared with the load voltage of the screen sound device under normal conditions, or the current of the screen sound device. The impedance or admittance is compared with the impedance or admittance of the screen sound emitting device under normal conditions to determine whether the screen sound emitting device fails.
  • the manufacturer of the sound emitting device on the screen will provide the impedance-frequency corresponding data of the sound emitting device on the screen.
  • Table 1 shows the average impedance and impedance deviation of piezoelectric ceramics (ie, screen sound emitting devices) with a capacitance of about 2.5uF at different frequencies.
  • the screen sound device such as piezoelectric ceramics
  • the screen sound device such as piezoelectric ceramics
  • the screen sound device such as piezoelectric ceramics
  • the screen sound device plays a single audio signal of each frequency
  • the load voltage and load current of the screen sound device are detected as the normal (non-failure) voltage threshold and current threshold of the screen sound device.
  • the screen sound generating device is connected with a smart power amplifier (smart PA) hardware circuit.
  • a smart power amplifier smart PA
  • FIG. 7 it is a schematic structural diagram of a smart power amplifier (smart PA) hardware circuit.
  • the screen sound emitting device such as piezoelectric ceramics
  • the application processor of the electronic device is used to detect the feedback current of the screen sound emitting device (that is, the load Current) and feedback voltage (ie load voltage), and calculate the impedance of the screen sound device according to the feedback current and feedback voltage of the screen sound device.
  • the intelligent power amplifier module can control the physical parameters (such as temperature and amplitude) of the screen sound emitting device (such as piezoelectric ceramics) according to the calculated impedance of the screen sound emitting device.
  • a 4-ohm protection resistor R0 is connected in series with the current path of the screen sound device in the hardware circuit.
  • the intelligent power amplifier module includes a feedback voltage/feedback current detection module, an ADC module and a digital audio module.
  • the feedback voltage/feedback current detection module is used to detect the load current and load voltage in real time, and the load current and load voltage obtained by the feedback voltage/feedback current detection are converted into digital signals by the ADC module and transmitted to the digital audio module.
  • the digital audio module can calculate the load impedance according to the load current and load voltage.
  • the current temperature of the screen sound emitting device (such as piezoelectric ceramic) can be determined according to the relationship between the temperature and impedance of the screen sound emitting device (such as piezoelectric ceramic). When the current temperature of the screen sound emitting device (such as piezoelectric ceramics) exceeds the preset temperature of the screen sound emitting device, the digital audio module can control the amplification regulator to adjust the amplification factor of the amplifier.
  • the amplitude of the screen sound emitting device (such as piezoelectric ceramic) can be determined according to the resistance, current and TS parameters of the screen sound emitting device (such as piezoelectric ceramic).
  • the digital audio module can control the amplification regulator to adjust the amplification factor of the amplifier, so as to reduce the amplitude of the sound emitting device on the screen.
  • the load current and load voltage of the screen sound emitting device can be detected and obtained through the intelligent power amplifier module shown in Figure 7 .
  • the load voltage detected by the intelligent power amplifier module is the sum of the voltage of the protective resistor R0 and the voltage of the screen sound emitting device (such as piezoelectric ceramic).
  • the screen sound generating device in the production test stage of the electronic equipment, can be connected to the smart PA hardware circuit shown in FIG. 20Hz, 31.25Hz, 50Hz, 62.5Hz, 125Hz, 250Hz, 500Hz, 1000Hz, 2000Hz, 4000Hz, 19KHz, 20KHz, 22KHz, etc.) single audio signal.
  • the screen sound device plays a single audio signal of each frequency, multiple sets of load voltage (ie, feedback voltage) and load current (ie, feedback current) are detected and obtained through the intelligent power amplifier module in FIG. 7 .
  • load voltage ie, feedback voltage
  • load current ie, feedback current
  • the frequency corresponding to the detected load voltage and load current is 50 Hz.
  • the feedback voltage and the feedback current of the audio signal of multiple frames are usually detected, and then The effective value of the load voltage is obtained for the multi-frame feedback voltage, or the effective value of the load current is obtained by averaging the feedback current.
  • the effective value Z rms of the load voltage can be calculated by the following formula (1);
  • the effective value I rms of the load current can be calculated by the following formula (2):
  • U represents the feedback voltage
  • I represents the feedback current
  • U i represents the feedback voltage corresponding to the i-th frame audio signal
  • I i represents the feedback current corresponding to the i-th frame audio signal
  • n represents the sampling number of the feedback voltage U or the feedback current I .
  • the load impedance Z corresponding to the frequency can be calculated by the following formula (3).
  • the admittance is the reciprocal of impedance
  • the audio signal played by the screen sound device may not be a single frequency.
  • high-pass filtering or low-pass filtering can be performed after obtaining the feedback voltage or feedback current of the screen sound emitting device to obtain the feedback voltage or feedback current of the screen sound emitting device at a specific frequency (such as 19KHz or 32.5Khz). Then, according to the feedback voltage or feedback current of the screen sound emitting device at the specific frequency, the load impedance of the screen sound emitting device at the specific frequency is calculated.
  • the above-mentioned multiple detections and calculations can be obtained, and the normal (non-failure) screen sound-generating device corresponds to A voltage range, current range, impedance range, or admittance range at a frequency.
  • the above-mentioned voltage range, current range, impedance range or admittance range is used as the voltage threshold range and current threshold corresponding to a certain frequency when the screen sound emitting device is normal (not failed). Range, impedance threshold range or admittance threshold range, as the basis for judging whether the screen sound emitting device fails.
  • the real-time load current of the screen sound-emitting device exceeds the corresponding current threshold range by detection, or judge whether the real-time load voltage of the screen sound-emitting device exceeds the corresponding voltage threshold range by detection, or judge the screen by detection.
  • Whether the real-time impedance of the sounding device exceeds the corresponding impedance threshold range is used to detect whether the screen sounding device is invalid, or whether the screen sounding device fails by detecting whether the real-time admittance of the screen sounding device exceeds the corresponding admittance threshold range.
  • the failure detection method of the screen sound emitting device is introduced in detail below.
  • the method includes:
  • the real-time load current of the screen sound emitting device can be obtained through the intelligent power amplifier module as shown in Figure 7 .
  • the audio signal played by the above-mentioned electronic device through the screen sound device can be inaudible or hard to hear single audio, such as audio with a frequency of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., or it can be Normal audio signals audible to the human ear, such as voice in a call, audio in normally played music or video files, or audio specially used to detect whether a screen sound device fails, etc.
  • the audio signal played by the above-mentioned electronic device through the sound emitting device on the screen may also be a pilot signal with a smaller amplitude (such as a signal with a frequency of 19KHz) superimposed on the normal audio signal.
  • the feedback current of the audio signal of multiple frames (such as 10 frames, 20 frames or 30 frames) is usually detected, and then the effective value of the load current of the above-mentioned multi-frame audio signal is calculated by the above formula (2), as The current real-time load current I rms of the screen sound emitting device.
  • the current threshold range is obtained through analysis in advance when the screen sound emitting device is normal, which has been described above and will not be repeated here.
  • the current threshold range can be recorded as [Imin, Imax, F], where F represents the frequency corresponding to the current threshold range, Imin represents the lower limit of the current threshold range, and Imax represents the upper limit of the current threshold range.
  • the screen sound device is a normal device. Conversely, if the load current of the screen sound device is not within the current threshold range, that is, the load current of the screen sound device exceeds the upper limit of the normal current threshold range, or the load current of the screen sound device is lower than the lower limit of the normal current threshold range, the screen The sound-generating device is an abnormal device or a failure device.
  • the real-time load current of the screen sound-generating device acquired according to S801 can be compared with the current threshold range to determine whether the real-time load current of the screen sound-generating device is within the current threshold range.
  • the load current of the screen sound emitting device is not within the normal current threshold range, the following S803 may be executed to determine that the screen sound emitting device is invalid.
  • the current threshold ranges of the screen sound device are different.
  • the frequency of the audio signal to be played needs to be determined first, and then the obtained real-time load current of the screen sound emitting device is compared with the current threshold range corresponding to the frequency of the audio signal.
  • the real-time load current of the screen sound device acquired by S801 can be compared with the screen sound device at 19KHz The current threshold range at the frequency is compared.
  • the audio signal played is a normal audio signal audible to the human ear, such as a voice signal during a call, music or video played normally, etc.
  • the audio signal played is a normal audio signal audible to the human ear, such as a voice signal during a call, music or video played normally, etc.
  • it can be analyzed by analyzing the above-mentioned normal audio signal.
  • the frequency of the center frequency point of the frequency band where the main energy of the signal is located (denoted as frequency A).
  • the load current (ie feedback current) or load voltage (ie feedback voltage) corresponding to the continuous N frames of audio signals can be obtained through the intelligent power amplifier module.
  • FFT fast Fourier transform
  • the real-time load current of the screen sound emitting device can be calculated by the above formula (2), and the frequency corresponding to the real-time load current is frequency A. If not, continue to play, obtain the load current corresponding to the audio signal of the subsequent frame (ie the feedback current), repeat the above steps to analyze the center frequency point of the frequency band where the main energy of the normal audio signal is located.
  • the real-time load current of the screen sound emitting device acquired in S801 may be compared with the current threshold range of the screen sound emitting device at frequency A.
  • the audio signal to be played is an audio signal superimposed with a pilot signal (such as a 19KHz signal).
  • a pilot signal such as a 19KHz signal.
  • the load current obtained by the intelligent power amplifier module will also decrease sharply compared with the normal device, so the real-time load current obtained by the S801 and the current in the full frequency domain Compare the threshold range to determine whether the screen sound device is invalid.
  • the current threshold range in the full frequency domain can be acquired by playing an audio signal in the full frequency domain when the sound emitting device on the screen is normal.
  • the acquisition method is similar to the acquisition method for the current threshold range for a single frequency described above. , which will not be repeated here.
  • the real-time load current corresponding to the frequency of the pilot signal (referred to as frequency B) can also be obtained through high-pass filtering, and then the real-time load current is compared with the frequency of the screen sound device at frequency B. current threshold range for comparison.
  • the following code can be used to determine whether the screen sound device is invalid:
  • the real-time load voltage is used to determine whether the screen sound emitting device fails.
  • FIG. 9 it is the second flow chart of the method for judging whether the screen sound emitting device fails. Referring to Figure 9, the method includes:
  • the real-time load voltage of the screen sound emitting device can be obtained through the intelligent power amplifier module as shown in FIG. 7 .
  • the audio signal played by the above-mentioned electronic device through the screen sound device can be inaudible or hard to hear single audio, such as audio with a frequency of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., or it can be Normal audio signals audible to the human ear, such as voice in a call, audio in normally played music or video files, or audio specially used to detect whether a screen sound device fails, etc.
  • the audio signal played by the above-mentioned electronic device through the sound emitting device on the screen may also be a pilot signal with a smaller amplitude (such as a signal with a frequency of 19KHz) superimposed on the normal audio signal.
  • the feedback voltage of the audio signal of multiple frames (such as 10 frames, 20 frames or 30 frames) is usually obtained, and then the effective value of the load voltage of the above-mentioned multi-frame audio signal is calculated by the above formula (1), as The current real-time load voltage U rms of the screen sound emitting device.
  • the voltage threshold range is obtained through analysis in advance when the screen sound emitting device is normal, which has been described above and will not be repeated here.
  • the voltage threshold range can be recorded as [Umin, Umax, F], where F represents the frequency corresponding to the voltage threshold range, Umin represents the lower limit of the voltage threshold range, and Umax represents the upper limit of the voltage threshold range.
  • the screen sound device is a normal device. Conversely, if the load voltage of the screen sound device is not within the voltage threshold range, that is, the load voltage of the screen sound device exceeds the upper limit of the voltage threshold range, or the load voltage of the screen sound device is lower than the lower limit of the voltage threshold range, the screen sound device It is an abnormal device or a failed device.
  • the real-time load voltage of the screen sound-emitting device acquired according to S901 can be compared with the voltage threshold range to determine whether the real-time load voltage of the screen sound-emitting device is within the voltage threshold range.
  • the following S903 may be executed to determine that the screen sound generating device is invalid.
  • the voltage threshold ranges of the screen sound device are different.
  • the frequency of the audio signal to be played needs to be determined first, and then the obtained real-time load voltage of the screen sound emitting device is compared with the voltage threshold range corresponding to the frequency of the audio signal.
  • the real-time load voltage of the screen sound device acquired by S901 can be compared with the screen sound device at 19KHz The voltage threshold range at the frequency is compared.
  • the audio signal played is a normal audio signal audible to the human ear, such as a voice signal during a call, music or video played normally, etc.
  • it can be analyzed by analyzing the above normal audio signal.
  • the frequency of the center frequency point of the frequency band where the main energy of the signal is located (denoted as frequency A) (the analysis process can refer to the relevant description in the above S802), and then the real-time load voltage of the screen sound device obtained by S901 can be compared with the screen sound Devices are compared across a range of voltage thresholds at frequency A.
  • the audio signal to be played is an audio signal superimposed with a pilot signal (such as a 19KHz signal).
  • a pilot signal such as a 19KHz signal
  • the real-time load voltage corresponding to the frequency of the pilot signal can be obtained by high-pass filtering, and then the real-time load voltage is compared with the voltage threshold range of the screen sound device at frequency B Compare.
  • the following code can be used to determine whether the screen sound device is invalid:
  • the method includes:
  • the load current and load voltage of the screen sound device can be obtained through the intelligent power amplifier module as shown in FIG. 7 .
  • the audio signal played by the above-mentioned electronic device through the screen sound device can be inaudible or hard to hear single audio, such as audio with a frequency of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc., or it can be Normal audio signals audible to the human ear, such as voice in a call, audio in normally played music or video files, or audio specially used to detect whether a screen sound device fails, etc.
  • the audio signal played by the above-mentioned electronic device through the sound emitting device on the screen may also be a pilot signal with a smaller amplitude (such as a signal with a frequency of 19KHz) superimposed on the normal audio signal.
  • the feedback voltage value and the feedback current value of the audio signal of multiple frames are usually obtained, and then the load voltage of the above multi-frame audio signal is calculated by the above formula (1)
  • the effective value of is used as the load voltage of the current screen sound device.
  • the effective value of the load current of the above multi-frame audio signal is calculated and used as the real-time load current of the current screen sound emitting device.
  • the normal impedance range can be obtained from the factory parameters of the screen sound emitting device, or can be obtained through analysis in advance when the screen sound emitting device is normal, which has been described above and will not be repeated here.
  • the impedance threshold range can be recorded as [Zmin, Zmax, F], where F represents the frequency corresponding to the impedance threshold range, Zmin represents the lower limit of the impedance threshold range, and Zmax represents the upper limit of the impedance threshold range.
  • the screen sound device is a normal device. Conversely, if the real-time impedance of the screen sound device is not within the impedance threshold range, that is, the real-time impedance of the screen sound device exceeds the upper limit of the impedance threshold range, or the real-time impedance of the screen sound device is lower than the lower limit of the impedance threshold range, the screen sound device It is an abnormal device or a failed device.
  • the real-time impedance of the screen sound-generating device calculated according to S1002 can be compared with the impedance threshold range to determine whether the real-time impedance of the screen sound-generating device is within the impedance threshold range.
  • the following S1004 may be executed to determine that the screen sound generating device is invalid.
  • the impedance threshold ranges of the screen sound device are different.
  • the frequency of the audio signal to be played needs to be determined first, and then the real-time impedance of the screen sound emitting device calculated in S1002 is compared with the impedance threshold range corresponding to the frequency of the audio signal.
  • the impedance of the screen sound device calculated by S1002 can be compared with the screen sound device at 19KHz Compare the normal impedance range at a given frequency.
  • the audio signal played is a normal audio signal audible to the human ear, such as a voice signal during a call, normally played music or video, etc.
  • the audio signal to be played is an audio signal superimposed with a pilot signal (such as a 19KHz signal).
  • a pilot signal such as a 19KHz signal.
  • the frequency of the screen sound-emitting device at the location of the pilot signal can be obtained by means of high-pass filtering (record is the real-time load voltage and real-time load current of frequency B).
  • the real-time load voltage and real-time load current corresponding to the frequency B are calculated by the above-mentioned formula (3) to obtain the real-time impedance of the screen sound emitting device. Finally, the real-time impedance is compared with the impedance threshold range of the screen sound emitting device at frequency B.
  • the following code can be used to determine whether the screen sound device is invalid:
  • the impedance exceeds the upper limit of the impedance threshold range or is less than the lower limit of the impedance threshold range;
  • FIG. 10B it is the fourth flowchart of the method for judging whether the screen sound emitting device fails. Please refer to FIG. 10B , the difference between this method and the method shown in FIG. 10B is that S1002 is replaced by the following S1002a, and S1003 is replaced by the following S1003a.
  • the admittance threshold range can be recorded as [Ymin, Ymax, F], where F represents the frequency corresponding to the admittance threshold range, Ymin represents the lower limit of the admittance threshold range, and Ymax represents the admittance threshold range.
  • F represents the frequency corresponding to the admittance threshold range
  • Ymin represents the lower limit of the admittance threshold range
  • Ymax represents the admittance threshold range.
  • the screen sound emitting device is a normal device. Conversely, if the real-time admittance of the screen sound-emitting device is not within the admittance threshold range, that is, the real-time admittance of the screen sound-emitting device exceeds the upper limit of the admittance threshold range, or the real-time admittance of the screen sound-emitting device is lower than the upper limit of the admittance threshold range. lower limit, the screen sound device is an abnormal device or a failure device.
  • the real-time admittance of the screen sound-emitting device calculated according to S1002a may be compared with the admittance threshold range to determine whether the real-time admittance of the screen sound-emitting device is within the admittance threshold range.
  • the above S1004 may be executed to determine that the screen sound emitting device is invalid.
  • the admittance threshold range of the screen sound device is different.
  • the frequency of the played audio signal needs to be determined first, and then the real-time admittance of the screen sound emitting device calculated in S1002a is compared with the admittance threshold range corresponding to the frequency of the audio signal.
  • the admittance of the screen sound emitting device calculated in S1002a can be compared with the screen sound emitting device in The admittance threshold range at a frequency of 19KHz was compared.
  • the audio signal played is a normal audio signal audible to the human ear, such as a voice signal during a call, normally played music or video, etc.
  • the audio signal played is an audio signal superimposed with a pilot signal (such as a 19KHz signal), you can refer to the description of the relevant content in S1003 above, I won't repeat them here.
  • a pilot signal such as a 19KHz signal
  • the following code can be used to determine whether the screen sound device is invalid:
  • the impedance of the device will increase sharply at the same frequency.
  • the load current of the failed screen sound device will decrease sharply compared with the load current of the normal screen sound device. Therefore, it can be determined whether the screen sound device is invalid (that is, abnormal) by judging whether the load current is within the normal current range. ).
  • the load current of the failed screen sound emitting device may be relatively close to the normal value (ie, the current threshold range). In this case, it can be determined whether the screen sound emitting device is invalid (that is, abnormal) by calculating whether the impedance of the screen sound emitting device at a certain frequency is within the impedance threshold range.
  • the detection method includes:
  • S1102. Determine whether the real-time load current of the screen sound generating device is within the current threshold range.
  • the software system of the above-mentioned electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • the Android system with layered architecture is taken as an example to illustrate the software structure of the mobile phone.
  • the functions implemented by each functional module are similar to the embodiments of the present application.
  • Fig. 12 is a block diagram of the software structure of the electronic device according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into five layers, which are application program layer, application program framework layer (framework), Android runtime (Android runtime) and system libraries (libraries), HAL (hardware abstraction) from top to bottom. layer, hardware abstraction layer) and the kernel layer (kernel).
  • the application layer can consist of a series of application packages.
  • applications such as call, memo, browser, contact, camera, gallery, calendar, map, bluetooth, music, video, and short message can be installed in the application layer.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the audio playback management service is set in the application framework layer.
  • the audio playback management service can be used to initialize the audio and video player, obtain the volume of the current audio, adjust the volume of the audio playback, add sound effects, etc.
  • the application framework layer may also include window management services, content provision services, view systems, resource management services, notification management services, etc., which are not limited in this embodiment of the present application.
  • the above-mentioned window management service is used to manage window programs.
  • the window management service can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • the above content provides services to store and retrieve data, and make these data accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the above view system can be used to build the display interface of the application.
  • Each display interface can consist of one or more controls.
  • controls may include interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets (Widgets).
  • the resource management service above provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the above-mentioned notification management service enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification management service is used to notify the download completion, message reminder and so on.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sending out prompt sounds, vibrating, and flashing lights, etc.
  • the HAL of the mobile phone provides HALs corresponding to different hardware modules of the mobile phone, for example, Audio HAL, Camera HAL, Wi-Fi HAL, and smart PA control HAL.
  • Audio HAL can correspond to audio output devices (such as speakers, screen sound devices) through the audio driver of the kernel layer.
  • audio output devices such as speakers, screen sound devices
  • these multiple audio output devices correspond to multiple audio drivers in the kernel layer respectively.
  • the smart PA control HAL corresponds to the smart PA hardware circuit through the smart PA algorithm in the DSP.
  • the smart PA control HAL can control the smart PA algorithm to shut down and stop running.
  • the smart PA control HAL can also control the smart PA hardware circuit (such as the hardware circuit (smart PA0) of the screen sound device) to turn off through the I2C signal to reduce the power consumption of electronic equipment.
  • Android runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem, and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is located below the HAL and is the layer between hardware and software.
  • the kernel layer may also include a display driver, a camera driver, a sensor driver, etc., which are not limited in this embodiment of the present application.
  • the embodiment of the present application includes a digital signal processing (digital signal processing, DSP) chip, and a smart PA algorithm module, an audio algorithm module, etc. are run in the DSP chip.
  • the smart PA algorithm module is used to judge whether the screen sound device (such as piezoelectric ceramic) is invalid (abnormal) according to the load voltage, load current, impedance or admittance of the screen sound device (such as piezoelectric ceramic), and make a sound on the screen.
  • the device such as piezoelectric ceramics
  • the switching of the sound-generating device is controlled by the audio algorithm module, such as switching the screen sound-generating device (such as a piezoelectric ceramic, that is, a capacitive device) to a speaker for sounding.
  • the abnormal results detected by the smart PA algorithm module can also be reported to the HAL layer through the audio algorithm module to inform the user to replace the device or turn off the dual sound unit switching function.
  • the smart PA control HAL in the HAL layer can control the shutdown of the impedance detection function in the smart PA algorithm, and control the shutdown of the smart PA hardware circuit (such as the hardware circuit of the screen sound device (smart PA0)) through the I2C signal to reduce the power of the electronic device. consumption.
  • the smart PA algorithm module includes a threshold value writing module, a data capture module, an abnormal judgment module and a result reporting module.
  • the threshold writing module is used to write the voltage threshold range, current threshold range, impedance threshold range and admittance threshold range of the screen sound emitting device (such as piezoelectric ceramics) under normal conditions.
  • the data capture module is used to obtain the load voltage and load current of the screen sound device from the smart PA hardware circuit.
  • the abnormality judging module can be used to compare the load current obtained by the data capture module with the current threshold range in the threshold value writing module, and judge whether the load current of the screen sound device is within the current threshold range.
  • the abnormality judging module can also be used to compare the load voltage obtained by the data capture module with the voltage threshold range in the threshold value writing module to judge whether the load voltage of the screen sound emitting device is within the voltage threshold range.
  • the abnormal judgment module can also be used to calculate the impedance or admittance of the screen sound emitting device according to the feedback voltage and feedback current obtained by the data capture module (for the specific calculation method, please refer to the above description about impedance or admittance calculation), and Compare the calculated impedance with the impedance threshold range in the threshold writing module to determine whether the impedance of the screen sound emitting device is within the impedance threshold range, or write the calculated admittance and threshold into the admittance threshold range in the module By comparison, it is judged whether the admittance of the screen sound emitting device is within the admittance threshold range.
  • the result reporting module is used when the load current of the screen sound device is not within the current threshold range, or when the load voltage of the screen sound device is not within the voltage threshold range, or when the impedance of the screen sound device is not within the impedance threshold range, or when When the admittance of the screen sound emitting device is no longer within the admittance threshold range, the abnormal result of the screen sound emitting device is reported to the audio algorithm module, so that the audio algorithm module switches the sound generating device.
  • a single audio that is inaudible to the human ear or hard to hear (for example, the frequency is 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz , 22KHz, etc.) to detect whether the screen sound-generating device is damaged, and switch the sound-generating device when damaged, such as switching to the speaker to sound, and then start normal audio playback.
  • the above audio playback method includes:
  • the audio playing instruction is used to instruct to play the first audio.
  • an upper layer application (such as a call application) will issue a call instruction to the processor of the electronic device.
  • an upper-layer application (such as a music application) will issue a music playing instruction to the processor of the electronic device.
  • an upper-layer application (such as a video application) will issue a video file playback instruction to the processor of the electronic device.
  • the above call instructions, music playback instructions, and video file playback instructions can all be regarded as audio playback instructions.
  • the DSP chip in the processor of the electronic device can control the sound emitting device (such as a speaker, a screen sound emitting device) to obtain corresponding parameters and start. Prepare for audio playback.
  • the audio algorithm of the DSP chip can configure the sound generating device (such as a speaker, a screen sound emitting device), and make the sound output
  • the device obtains the corresponding parameters, and starts the speaker to make sound or the screen sound device to make sound.
  • the screen sound device can be controlled to play a single audio (that is, the second audio frequency) that is inaudible or hard to be heard by the human ear, for example, the amplitude is -35 to - 40 decibels (dB), audio frequency of 20Hz, 31.25Hz, 50Hz, 19KHz, 20KHz, 22KHz, etc.
  • a single audio that is, the second audio frequency
  • dB decibels
  • the played time of the first audio does not exceed 1 second.
  • the electronic device when the electronic device executes the above S1302 and plays the second audio, the electronic device can execute the detection method shown in FIG. 8, FIG. 9, FIG. 10A, FIG. 10B or FIG. .
  • the first audio is the audio that is instructed to be played by the above-mentioned audio playing instruction.
  • the audio playback instruction is issued after the user's operation of making a call is detected
  • the first audio may be the voice of the other party during the call.
  • the above-mentioned audio playing instruction is issued after detecting the user's operation of playing music
  • the first audio may be music.
  • the audio playing instruction is issued after detecting the user's operation to play a video file
  • the first audio may be the audio in the video file.
  • the screen sound emitting device can produce sound normally; an audio.
  • the screen sound device plays the left channel audio of the first audio
  • the speaker plays the right channel audio of the first audio.
  • the screen sound device can also play the right channel audio of the first audio
  • the speaker can also play the left channel audio of the first audio.
  • the screen sound generating device and the audio channel played by the speaker can be configured through the audio algorithm module, which is not specifically limited in this embodiment of the present application.
  • the electronic device may also play the first audio only through the screen sound emitting device.
  • the screen sound emitting device such as piezoelectric ceramics
  • the screen sound emitting device cannot normally play audio data, such as the first audio
  • the screen sound generating device may also produce noise, which affects user experience.
  • the audio algorithm module in the DSP chip receives the detection result reported by the smart PA algorithm module, it reconfigures the sound-generating device and switches the sound-generating device, such as switching from the screen sound-generating device to the speaker, or by dual-device Switch to sound from the speaker.
  • the audio algorithm of the DSP chip After the audio algorithm of the DSP chip receives the detection result reported by the smart PA algorithm module, it will also report the detection result of whether the screen sound device is invalid to the application layer to remind the user that the screen sound device is damaged and needs to be replaced in time repair. For example, if the above-mentioned audio playback instruction is issued after detecting the user's operation on the video call, the electronic device may display a maintenance prompt box 1300 (that is, a preset Set a prompt box), if there is a prompt message such as "Warm reminder that the sound device on the screen has failed, and the sound has been switched to the speaker, please go to the maintenance outlet for repair in time".
  • a maintenance prompt box 1300 that is, a preset Set a prompt box
  • the electronic device may display the above-mentioned maintenance prompt box 1300 on the video playback interface as shown in (b) in FIG. 13B .
  • the electronic device may display the above-mentioned maintenance prompt box 1300 on the call interface as shown in (c) in FIG. 13B .
  • the electronic device can also prompt the user to change the user settings, turn off the switching function of the dual sounding units, etc., for example, it can be set that only the speaker emits sound, etc.
  • the audio algorithm module of the DSP chip receives the detection result reported by the smart PA algorithm module, it will also report the detection result of the failure of the screen sound device to the HAL layer.
  • the HAL layer can also automatically turn off the dual-device switching function (by default, the dual-device switching function is enabled) when receiving the detection result that the screen sound emitting device fails.
  • the smart PA control HAL in the HAL layer can control the shutdown of the impedance detection function in the smart PA algorithm, and control the shutdown of the smart PA hardware circuit (such as the hardware circuit of the screen sound device (smart PA0)) through the I2C signal to reduce the power of the electronic device. consumption.
  • the failure detection of the sound-generating device on the screen is only detected when an audio playing instruction is issued.
  • the screen sound generating device may also be damaged, resulting in silence or noise, affecting user experience.
  • the electronic device can detect in real time whether the screen sound generating device fails during audio playback.
  • the audio playback method includes:
  • the audio playing instruction is used to instruct to play the first audio.
  • the audio algorithm of the DSP chip can configure the sound generating device (such as a speaker, a screen sound emitting device), and make the sound output
  • the device obtains the corresponding parameters, and starts the speaker to make sound or the screen sound device to make sound.
  • the electronic device can directly play the first audio after receiving the audio playback instruction, and during the process of playing the first audio, execute the following S1403 every preset period to detect whether the screen sound-generating device is invalid, so as to find the screen in time.
  • the failure of the sound-generating device in the process of playing normal audio reduces the possibility of silence or noise and improves user experience.
  • the electronic device when the electronic device executes the above S1402 and plays the first audio, the electronic device may execute the detection method shown in FIG. 8, FIG. 9, FIG. 10A, FIG. 10B or FIG. .
  • S1403 is repeatedly executed at intervals of preset periods (eg, 1s, 2s).
  • S1404 switch the sound generating device to a speaker, and continue to play the first audio.
  • the embodiment of the present application also provides another audio playing method.
  • the audio playback method includes:
  • the audio playing instruction is used to instruct to play the first audio.
  • S1502. Determine whether the battery power of the electronic device is greater than a preset threshold.
  • the preset threshold may be 50%, 40%, or 30% of the battery capacity, which may be specifically set according to actual conditions.
  • the following steps S1503-S1506 are executed to play the first audio through the screen sound generating device.
  • the electronic device when the electronic device executes the above S1503 and plays the first audio, the electronic device can execute the detection method shown in FIG. 8, FIG. 9, FIG. 10A, FIG. 10B or FIG. 11 to determine whether the screen sound emitting device is invalid .
  • the following S1505 is executed to determine whether the battery power of the electronic device is greater than a preset threshold.
  • S1504 is repeatedly executed every preset period (eg, 1s, 2s). If the battery power of the electronic device is less than or equal to the preset threshold, the above S1504 will not be executed.
  • the electronic device After the electronic device receives the audio playback instruction, it first judges whether the battery power of the electronic device exceeds a preset threshold, and if it exceeds the preset threshold, it indicates that the electronic device If the current power of the electronic device is high, the first audio can be played using the audio playback method shown in Figure 14 above.
  • the battery power of the electronic device is lower than the preset threshold, stop executing the above S1504 and stop detecting whether the screen sound emitting device is invalid. If it does not exceed the preset threshold, it means that the current power of the electronic device is low.
  • the audio playing method shown in FIG. 13A can be used to play the first audio.
  • the audio playback method before playing the audio or during the audio playback, it is possible to detect whether the screen sound-generating device fails (such as breakage, electrode shedding, etc.), And switch the sound-generating device when the screen sound-generating device fails, such as switching to the speaker to produce sound, so as to avoid the problem of noise or silence caused by the failure of the screen sound-generating device, so as to improve user experience.
  • the screen sound-generating device fails (such as breakage, electrode shedding, etc.)
  • switch the sound-generating device when the screen sound-generating device fails such as switching to the speaker to produce sound, so as to avoid the problem of noise or silence caused by the failure of the screen sound-generating device, so as to improve user experience.
  • the embodiment of the present application also provides a failure detection method of a screen sound emitting device.
  • the failure detection method of the screen sound device includes:
  • the preset operation or the preset time point is used to trigger the electronic device to detect whether the screen sound emitting device fails.
  • the preset operation may be an operation for the user to make a call, an operation for the user to play music, an operation for the user to play a video file, and other user operations.
  • the preset operation may also be an operation for the user to detect whether the screen sound emitting device fails.
  • an activation button for detecting whether the screen sound emitting device fails can be set, and the user can click the activation button to make the electronic device play detection audio through the screen sound emitting device to detect whether the screen sound emitting device is invalid.
  • the preset operation may be the user's click operation on the start button for detecting whether the screen sound emitting device fails. Therefore, the embodiment of the present application does not specifically limit the specific content of user operations.
  • a detection option 1702 of "detection of failure of a sound emitting device on the screen” is set in the setting interface 1702 of the electronic device.
  • the electronic device may display a failure detection interface 1703 on the screen as shown in (b) of FIG. 17 .
  • the electronic device may display a detection interface 1801 as shown in (a) in FIG. 18 .
  • the electronic device will play the detection audio through the screen sound device, so that the electronic device can detect the failure of the screen sound device.
  • the preset time point may be the time point preset by the electronic device to detect the failure of the screen sound emitting device. It may be the default setting of the electronic device before leaving the factory, or it may be set by the user according to actual needs. Make a special limit.
  • the above-mentioned detection audio may be an audio specially used for detecting whether the sound emitting device of the screen is invalid, and the detection audio may be audible (that is, audible to the human ear) audio, for example, an audio used to prompt the user that the failure detection of the sound emitting device of the screen is in progress; It may be a silent (ie, inaudible to the human ear) tone, such as a single tone inaudible to the human ear.
  • the detected audio may also be a normal audio signal audible to human ears, such as voice in a call, normally played music or audio in a video file.
  • the first parameter is at least one of real-time load current, real-time load voltage, real-time impedance and real-time admittance of the screen sound emitting device.
  • this S1602 may correspond to the above-mentioned combination of S801, S901, S1001 and S1002, and the combination of S1001 and S1002a, which will not be repeated here.
  • this S1603 may correspond to the above-mentioned combination of S802 and S803, the above-mentioned combination of S902 and S903, the above-mentioned combination of S1003 and S1004, and the above-mentioned combination of S1003a and S1004, which will not be repeated here.
  • the electronic device may also display a detection completion prompt interface after the failure detection of the sound emitting device on the screen is completed.
  • the detection completion prompt interface 1802 may display "A warm reminder that the screen sound generating device has failed and has been switched to the speaker to produce sound, please go to the maintenance site in time Maintenance" and other prompt messages.
  • the electronic device can detect whether the screen sound-emitting device is invalid based on a preset operation or a preset time point, so as to regularly detect the screen sound-emitting device, so as to promptly notify the user of the failure of the screen sound-emitting device , to prompt the user to repair or modify the default configuration of the electronic device, so as to improve the reliability of the electronic device.
  • the chip system includes at least one processor 1901 and at least one interface circuit 1902 .
  • the processor 1901 and the interface circuit 1902 can be interconnected through wires.
  • interface circuit 1902 may be used to receive signals from other devices (eg, memory of an electronic device).
  • the interface circuit 1902 may be used to send signals to other devices (such as the processor 1901).
  • the interface circuit 1902 can read instructions stored in the memory of the electronic device, and send the instructions to the processor 1901 .
  • the electronic device (such as the electronic device shown in FIG. 3 ) may be made to perform various functions or steps performed by the electronic device in the foregoing embodiments.
  • the chip system may also include other discrete devices, which is not specifically limited in this embodiment of the present application.
  • Another embodiment of the present application provides a computer storage medium, the computer storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device is made to perform the various functions performed by the electronic device in the above method embodiments or step.
  • Another embodiment of the present application provides a computer program product.
  • the computer program product is run on a computer, the computer is made to execute each function or step performed by the electronic device in the method embodiment above.
  • the disclosed devices and methods may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be Incorporation or may be integrated into another device, or some features may be omitted, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places . Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the software product is stored in a program product, such as a computer-readable storage medium, and includes several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all of the methods described in various embodiments of the present application. or partial steps.
  • the aforementioned storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.
  • the embodiments of the present application may also provide a computer-readable storage medium on which computer program instructions are stored.
  • the computer program instructions are executed by the electronic device, the electronic device is made to implement the audio playing method described in the foregoing method embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Otolaryngology (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)

Abstract

一种音频播放方法、屏幕发声器件(104, 396)的失效检测方法及电子设备,能够解决屏幕发声器件(104, 396)失效后出现的无声或杂声的问题,从而提高电子设备的可靠性,以及用户体验。其中的音频播放方法包括:接收音频播放指令。其中,音频播放指令用于指示电子设备播放第一音频。响应于接收到音频播放指令,通过屏幕发声器件(104, 396)播放检测音频。在播放检测音频的过程中,获取第一参数。根据第一参数,确定屏幕发声器件(104, 396)是否失效。其中,第一参数为屏幕发声器件(104, 396)的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种。在屏幕发声器件(104, 396)失效的情况下,切换发声器件为扬声器扬声器(370A),播放第一音频。

Description

音频播放方法、屏幕发声器件的失效检测方法及电子设备
本申请要求于2021年7月23日提交国家知识产权局、申请号为202110839831.8、申请名称为“一种音频播放方法及设备”的中国专利申请的优先权,以及要求于2021年9月17日提交国家知识产权局、申请号为202111094726.2、申请名称为“音频播放方法、屏幕发声器件的失效检测方法及电子设备”的中国专利申请的优先权,其全部内容均通过引用结合在本申请中。
技术领域
本申请涉及电子技术领域,尤其涉及一种音频播放方法、屏幕发声器件的失效检测方法及电子设备。
背景技术
目前,较多的电子设备均具有语音通信功能,如手机、平板等。为了实现语音通信功能,电子设备中需要安装发声器件才能使用户听到对方的声音。随着电子设备对屏幕屏占比的要求,需减少电子设备前面板(即屏幕)的开孔,因此电子设备中通常会设置屏幕发声器件(如压电陶瓷类容性器件)作为扬声器(如听筒)。
在电子设备的使用过程中,压电陶瓷类容性器件可能会失效(如发生断裂、电极脱落等),压电陶瓷类容性器件失效后,电子设备可能在语音通信时发出声音或者出现杂音,影响用户的使用体验。
发明内容
本申请实施例提供一种音频播放方法、屏幕发声器件的失效检测方法及电子设备,能够解决屏幕发声器件失效后出现的无声或杂声的问题,从而提高电子设备的可靠性,以及用户体验。
为达到上述目的,本申请采用如下技术方案:
第一方面,本申请提供一种音频播放方法。该音频播放方法应用于电子设备,该电子设备包括屏幕发声器件和扬声器。该音频播放方法包括:接收音频播放指令。其中,音频播放指令用于指示电子设备播放第一音频。响应于接收到音频播放指令,通过屏幕发声器件播放检测音频。在播放检测音频的过程中,获取第一参数。根据第一参数,确定屏幕发声器件是否失效。其中,第一参数为屏幕发声器件的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种。在屏幕发声器件失效的情况下,切换发声器件为扬声器,播放第一音频。在屏幕发声器件未失效的情况下,通过屏幕发声器件播放第一音频,或者通过屏幕发声器件和扬声器同时播放第一音频。
基于上述音频播放方法,在播放音频之前或者播放音频的过程中,通过屏幕发声器件播放检测音频。在播放检测音频的过程中获取第一参数,并根据第一参数,可以确定检测屏幕发声器件是否失效(如断裂、电极脱落等)。在确定屏幕发声器件失效的情况下,切换发声器件,如切换至扬声器发声。如此一来,可以避免屏幕发声器件失效出现的杂音或无声问题,提高电子设备的可靠性并提高用户体验。
在一种可能的实现方式中,检测音频为第二音频;第二音频为与第一音频不同的音频信号。响应于接收到音频播放指令,通过屏幕发声器件播放检测音频,包括:响应于接收到音频播放指令,在播放第一音频之前,通过屏幕发声器件播放第二音频。
也就是说,在播放电子设备指示播放的第一音频之前,可以先播放人耳不可听的第二音频,或者专门用于检测屏幕是否失效的人耳可听的音频信号,以检测屏幕发声器件是否失效。如此一来,可以减小电子设备实时检测屏幕发声器件是否失效而产生的功耗。
在一种可能的实现方式中,其特征在于,检测音频为第一音频。在播放检测音频的过程中,获取第一参数,包括:在播放检测音频的过程中,按照预设周期获取第一参数;预设周期用于指示两次判断屏幕发声器件是否失效的时间间隔。当第一音频作为检测音频时,电子设备可以实时检测屏幕发声器件是否失效(如每间隔1秒)。如此一来,电子设备可以检测到音频播放过程中,屏幕发声器件出现的失效,从而提高电子设备的可靠性。
在一种可能的实现方式中,其特征在于,若电子设备的电池电量大于预设阈值,则检测音频为第一音频。在播放检测音频的过程中,获取第一参数,包括:在播放检测音频的过程中,按照预设周期获取第一参数;预设周期用于指示两次判断屏幕发声器件是否失效的时间间隔。或者,若电子设备的电池电量小于或等于预设阈值,则检测音频为第二音频。第二音频为与第一音频不相同的音频信号。响应于接收到音频播放指令,通过屏幕发声器件播放检测音频,包括:响应于接收到音频播放指令,在播放第一音频之前,通过屏幕发声器件播放第二音频。
如此一来,可以通过电子设备的电池电量选择检测屏幕发声器件的时机。当电池电量大于预设阈值时,将第一音频作为屏幕发声器件是否失效的检测音频,实时检测屏幕发声器件是否失效,以避免无法检测屏幕发声器件在播放音频过程中的突然失效,从而提高电子设备的可靠性。当电池电量小于或等于预设阈值时,将人耳不可听的第二音频作为屏幕发声器件是否失效的检测音频,在播放第一音频之前检测屏幕发声器件是否失效,以降低电子设备的功耗。
在一种可能的实现方式中,第二音频包括人耳不可听的单音频信号,或者与第一音频不同的人耳可听的音频信号。
在一种可能的实现方式中,音频播放指令包括通话指令、音乐播放指令或视频文件播放指令。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时负载电流。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时负载电流大于电流阈值范围的最大值,或者屏幕发声器件的实时负载电流小于电流阈值范围的最小值,则确定屏幕发声器件失效。其中,电流阈值范围为:屏幕发声器件未失效时对应于第一频率的电流范围。第一频率为检测音频的中心频点的频率。通常情况下,当屏幕发声器件失效后,屏幕发声器件的负载电流会发生较大的变化。如此一来,可以通过屏幕发声器件的实时负载电流,判断屏幕发声器件是否失效。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时负载电压。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时负载电压大于电压阈值范围的最大值,或者屏幕发声器件的实时负载电压小于电压阈值范围的最小值,则确 定屏幕发声器件失效。其中,电压阈值范围为:屏幕发声器件未失效时对应于第一频率的电压范围。第一频率为检测音频的中心频点的频率。通常情况下,当屏幕发声器件失效后,屏幕发声器件的负载电压也会发生较大的变化。如此一来,可以通过屏幕发声器件的实时负载电压,判断屏幕发声器件是否失效。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时阻抗。屏幕发声器件的实时阻抗由屏幕发声器件的实时负载电压和实时负载电流确定。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时阻抗大于阻抗阈值范围的最大值,或者屏幕发声器件的实时阻抗小于阻抗阈值范围的最小值,则确定屏幕发声器件失效。其中,阻抗阈值范围为:屏幕发声器件未失效时对应于第一频率的阻抗范围。第一频率为检测音频的中心频点的频率。应理解,在smart PA硬件电路中可以获取屏幕发声器件的反馈电压(即实时负载电压)和反馈电流(即实时负载电流),屏幕发声器件的实时阻抗可以由反馈电压和反馈电流确定。通常情况下,当屏幕发声器件失效后,屏幕发声器件的阻抗会发生较大的变化。如此一来,可以通过屏幕发声器件的实时阻抗,判断屏幕发声器件是否失效。
在一种可能的实现方式中,第一参数包括:屏幕发声器件的实时导纳。屏幕发声器件的实时导纳由屏幕发声器件的实时负载电压和实时负载电流确定。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时导纳大于导纳阈值范围的最大值,或者屏幕发声器件的实时导纳小于导纳阈值范围的最小值,则确定屏幕发声器件失效。其中,导纳阈值范围为:屏幕发声器件未失效时对应于第一频率的导纳范围;第一频率为检测音频的中心频点的频率。应理解,在smart PA硬件电路中可以获取屏幕发声器件的反馈电压(即实时负载电压)和反馈电流(即实时负载电流),屏幕发声器件的实时导纳也可以由反馈电压和反馈电流确定。由于屏幕发声器件的导纳为屏幕发声器件的阻抗的倒数,在屏幕发声器件的阻抗变化较大的情况下,屏幕发声器件的导纳也会发声较大的变化。因此,还可以通过屏幕发声器件的实时导纳,判断屏幕发声器件是否失效。
在一种可能的实现方式中,屏幕发声器件的实时负载电流为:屏幕发声器件播放N帧检测音频时,检测得到的M个反馈电流的平均值。其中,N、M均为大于1的正整数。例如,屏幕发声器件每播放一帧检测音频,则可以获取一个反馈电流值,此时N和M可以相等。在该方案中,屏幕发声器件的实时负载电流为多个反馈电流的平均值,可以减小因检测通路上存在的噪声而产生的误差。
在一种可能的实现方式中,屏幕发声器件的实时负载电压为:屏幕发声器件播放N帧检测音频时,检测得到的M个反馈电压的平均值。其中,N、M均为大于1的正整数。类似地,在该方案中,屏幕发声器件的实时负载电压为多个反馈电压的平均值,也可以减小因检测通路上存在的噪声而产生的误差。
在一种可能的实现方式中,屏幕发声器件的实时负载电压或屏幕发声器件的实时负载电流,由智能功放模块获取。
在一种可能的实现方式中,上述方法还可以包括:在屏幕发声器件失效的情况下,显示预设提示框。预设提示框包括提示信息。提示信息用于指示屏幕发声器件已失效。如此一来,当屏幕发声器件失效时,通过电子设备及时提示用户屏幕发声器件已失效, 可以提高用户体验。
在一种可能的实现方式中,上述方法还可以包括:在屏幕发声器件失效的情况下,关闭屏幕发声器件。如此一来,可以降低电子设备的功耗,并且避免屏幕发声器件失效出现的杂音。
第二方面,本申请提供一种屏幕发声器件的失效检测方法。该方法应用于电子设备,电子设备包括屏幕发声器件。该屏幕发声器件的失效检测方法包括:响应于预设操作或基于预设时间点,通过屏幕发声器件播放检测音频。其中,预设操作或预设时间点,用于触发电子设备检测屏幕发声器件是否失效。在播放检测音频的过程中,获取第一参数。根据第一参数,确定屏幕发声器件是否失效。其中,第一参数为屏幕发声器件的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种。
基于上述屏幕发声器件的失效检测方法,电子设备可以基于预设操作或基于预设时间点,对屏幕发声器件是否失效进行检测,以便定期对屏幕发声器件进行检测,便于及时告知用户屏幕发声器件失效,提示用户维修或者修改电子设备的默认配置,以提高电子设备的可靠性。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时负载电流。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时负载电流大于电流阈值范围的最大值,或者屏幕发声器件的实时负载电流小于电流阈值范围的最小值,则确定屏幕发声器件失效。其中,电流阈值范围为:屏幕发声器件未失效时对应于第一频率的电流范围。第一频率为检测音频的中心频点的频率。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时负载电压。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时负载电压大于电压阈值范围的最大值,或者屏幕发声器件的实时负载电压小于电压阈值范围的最小值,则确定屏幕发声器件失效。电压阈值范围为:屏幕发声器件未失效时对应于第一频率的电压范围;第一频率为检测音频的中心频点的频率。
在一种可能的实现方式中,第一参数包括屏幕发声器件的实时阻抗。屏幕发声器件的实时阻抗由屏幕发声器件的实时负载电压和实时负载电流确定。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时阻抗大于阻抗阈值范围的最大值,或者屏幕发声器件的实时阻抗小于阻抗阈值范围的最小值,则确定屏幕发声器件失效。阻抗阈值范围为:屏幕发声器件未失效时对应于第一频率的阻抗范围。第一频率为检测音频的中心频点的频率。
在一种可能的实现方式中,第一参数包括:屏幕发声器件的实时导纳。屏幕发声器件的实时导纳由屏幕发声器件的实时负载电压和实时负载电流确定。根据第一参数,确定屏幕发声器件是否失效,包括:若屏幕发声器件的实时导纳大于导纳阈值范围的最大值,或者屏幕发声器件的实时导纳小于导纳阈值范围的最小值,则确定屏幕发声器件失效。其中,导纳阈值范围为:屏幕发声器件未失效时对应于第一频率的导纳范围。第一频率为检测音频的中心频点的频率。
在一种可能的实现方式中,屏幕发声器件的实时负载电流为:屏幕发声器件播放N帧检测音频时,检测得到的M个反馈电流的平均值;其中,N、M均为大于1的正整数。
在一种可能的实现方式中,屏幕发声器件的实时负载电压为:屏幕发声器件播放N 帧检测音频时,检测得到的M个反馈电压的平均值;其中,N、M均为大于1的正整数。
在一种可能的实现方式中,屏幕发声器件的实时负载电压或屏幕发声器件的实时负载电流,由智能功放模块获取。
应理解,上述各种可能的实现方式中的技术效果可以参考第一方面中相关部分的技术效果,此处不再赘述。
第三方面,本申请提供一种电子设备。该电子设备包括:屏幕发声器件;扬声器;一个或多个处理器;存储器;通信模块。其中,屏幕发声器件和扬声器均用于播放电子设备的声音信号;通信模块用于与外接设备通信;存储器中存储有一个或多个计算机程序,一个或多个计算机程序包括指令,当指令被处理器执行时,使得电子设备执行如上第一方面或第二方面中任一种可能的实现方式中所述的方法。
第四方面,本申请实施例提供一种芯片***,该芯片***包括一个或多个接口电路和一个或多个处理器。该接口电路和处理器通过线路互联。该芯片***可以应用于包括通信模块和存储器的电子设备。该接口电路可以读取电子设备中存储器中存储的指令,并将该指令发送给处理器。当所述指令被处理器执行时,可使得电子设备执行如上第一方面或第二方面中任一种可能的实现方式中所述的方法。
第五方面,本申请实施例提供一种计算机可读存储介质。计算机可读存储介质中存储有指令。当指令在电子设备上运行时,使得电子设备执行如上第一方面或第二方面中任一种可能的实现方式中的方法。
第六方面,本申请实施例提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如上第一方面或第二方面中任一种可能的实现方式中的所述的方法。
可以理解地,上述提供的第三方面所述的电子设备,第四方面所述的芯片***,第五方面所述的计算机可读存储介质,以及第六方面所述的计算机程序产品,其所能达到的有益效果可参考上文第一方面或第二方面所提供的对应的方法中的有益效果,此处不再赘述。
附图说明
图1A为本申请实施例提供的一种用户通过电子设备进行语音通信的场景示意图;
图1B为本申请实施例提供的一种电子设备的结构示意图;
图2为本申请实施例提供的一种屏幕发声器件失效前后的对比示意图;
图3为本申请实施例提供的另一种电子设备的结构示意图;
图4为本申请实施例提供的屏幕发声器件的原理图;
图5为本申请实施例提供的4.2微法的压电陶瓷的频阻特性曲线图;
图6为本申请实施例提供的正常屏幕发声器件和异常屏幕发声器件的频阻特性曲线对比图;
图7为本申请实施例提供的智能功放(smart PA)硬件电路图;
图8为本申请实施例提供的一种屏幕发声器件是否失效的检测方法的流程图一;
图9为本申请实施例提供的一种屏幕发声器件是否失效的检测方法的流程图二;
图10A为本申请实施例提供的一种屏幕发声器件是否失效的检测方法的流程图三;
图10B为本申请实施例提供的一种屏幕发声器件是否失效的检测方法的流程图四;
图11为本申请实施例提供的一种屏幕发声器件是否失效的检测方法的流程图五;
图12为本申请实施例提供的电子设备的软件结构框图;
图13A为本申请实施例提供的一种音频播放方法的流程图一;
图13B为本申请实施例提供的一种音频播放方法的场景图;
图14为本申请实施例提供的一种音频播放方法的流程图二;
图15为本申请实施例提供的一种音频播放方法的流程图三;
图16为本申请实施例提供的一种屏幕发声器件的失效检测方法的流程图;
图17为本申请实施例提供的一种屏幕发声器件的失效检测方法的场景图一;
图18为本申请实施例提供的一种屏幕发声器件的失效检测方法的场景图二;
图19为本申请实施例提供的一种芯片***的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请的描述中,除非另有说明,“至少一个”是指一个或多个,“多个”是指两个或多于两个。另外,为了便于清楚描述本申请实施例的技术方案,在本申请的实施例中,采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分。本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定,并且“第一”、“第二”等字样也并不限定一定不同。
目前,较多的电子设备均具有语音通信功能或音频播放功能。为了实现语音通信功能,电子设备中需要安装发声器件才能使用户在语音通信时听到对方的声音。类似地,为实现音频播放功能,电子设备也需要安装发声器件。以手机这类电子设备实现语音通信功能为例,手机的顶部会设置听筒(也可称为扬声器)作为用于语音通信的发声器件,实现语音通信功能。通常情况下,听筒是设置在手机的内部,需要在手机的前面板上开孔形成出音孔。当听筒发声时,听筒发出的声音能量能够通过出音孔传出,以使用户听到听筒发出的声音。然而,随着手机的不断发展,为了向用户提供更好的屏幕观看体验,手机屏幕的屏占比越来越高。由于设置在前面板上的出音孔占用了手机的前面板部分区域,会增加手机边框的宽度,因此会对手机的屏占比的提高造成影响。
随着大屏以及全面屏手机的发展,为提高手机的屏占比,需要减小听筒的出音孔在手机前面板上的占用面积。例如,将手机听筒的出音孔设计为长缝形态,并且使该出音孔位于手机中框和前面板的连接处(也可称为手机侧缝处)。在某些情况下,为了确保手机听筒的出音孔具有良好出音效果,还可以在手机中框的顶部开孔作为出音孔。在此情况下,当用户使用手机进行语音通信时,用户的耳廓无法完全覆盖包裹出音孔,手机听筒的声音能量无法完全传递至用户的耳廓内,从而产生漏音现象。
示例性地,以手机为例,在用户手持手机通过听筒进行语音通信的过程中,手机听筒用于在语音通信过程中播放对侧用户的声音信号(即手机听筒为上述用于语音通信中通话发声的扬声器)。如图1A所示,手机听筒的出音孔201靠近用户的耳朵(或者耳廓)。在此时,由于手机听筒的出音孔201(如位于手机侧缝处的出音孔和中框顶部的出音孔)无法被用户的耳朵完全包裹覆盖,因此由出音孔201发出的声音信号不仅能够被该用户听到,在安静环境下还能够被其他用户听到,从而产生漏音现象。
为了避免听筒发声时出现漏音现象,一些电子设备会采用屏幕发声来替代听筒发声, 或采用屏幕发声和听筒同时发声。例如,如图1B所示,为电子设备的结构示意图。其中,电子设备包括壳体结构100。该壳体结构100是由前面板(包括屏幕和边框)、用于支撑内部电路的后面板以及中框围合形成的。如图1B中的(a)所示,电子设备的壳体结构100内设置有听筒101和屏幕发声器件104。其中,听筒101即为用于语音通信中通话发声的扬声器,也称为受话器,通常设置于壳体结构的顶部位置处。屏幕发声器件104可以为连接在屏幕下方的振动源。结合图1B中的(b)所示,对应于该听筒101,电子设备设置有两处出音孔,分别为出音孔102和出音孔103。其中,出音孔102位于该电子设备前面板和中框的连接处(即侧缝处)。出音孔103位于该电子设备的中框上距离上述听筒较近的位置(即电子设备的中框顶部位置)。如此一来,该图1B所示的电子设备能够通过听筒发声,或通过屏幕发声,或通过听筒和屏幕发声同时发声,以避免单纯听筒发声出现的漏音现象。
应理解,针对不同的屏幕发声方案,电子设备中的屏幕发声器件的具体结构有所不同。例如,屏幕发声器件可以是连接在屏幕背面的振动源(如压电陶瓷、马达振子、激励器或其他振动单元)。该振动源可以在电流信号的控制作用下振动以带动屏幕振动,从而实现屏幕发声。又例如,屏幕发声器件还可以是通过悬臂梁结构固定在电子设备的中框上的压电陶瓷。该压电陶瓷可以在电流信号的控制作用下振动,并利用手机中框将振动传递至屏幕以带动屏幕振动,从而实现屏幕发声。又例如,屏幕发声器件还可以是固定在电子设备的中框上的激励器。该激励器可以在电流信号的控制作用下振动,并利用手机中框将振动传递至屏幕以带动屏幕振动,从而实现屏幕发声。再例如,屏幕发声器件还可以是分体式磁悬浮振子。该分体式磁悬浮振子中的其中一个振子固定在电子设备的中框上,另一个振子固定在屏幕上,可以固定在屏幕上的振子在电流信号的控制作用下,相对于固定在电子设备的中框上的振子振动,从而推动屏幕振动,以实现屏幕发声。
然而,如图2所示,采用屏幕发声器件的电子设备(如手机),在屏幕发声器件正常的情况下,屏幕发声器件能够发出正常的声音信号。随着电子设备的长时间使用,屏幕发声器件(如压电陶瓷)可能发生失效(如出现断裂、退极化等),从而造成屏幕发声器件无声或者出现杂音等问题,使得电子设备不能正常播放声音信号(如语音通信或播放音乐),进而影响用户体验。
为解决上述问题,本申请实施例提供一种音频播放方法。在该音频播放方法中,在播放音频之前或者播放音频的过程中,检测屏幕发声器件是否失效(如断裂、电极脱落等),并在屏幕发声器件失效的情况切换发声器件,如切换至扬声器发声,从而避免屏幕发声器件失效出现的杂音或无声问题,以提高用户体验。
以下,将结合附图对本申请实施例提供的音频播放方法进行说明。
示例性的,本申请实施例中的电子设备可以是手机、平板电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、可穿戴式设备(如:智能手表、智能手环),等具备语音通信功能的设备,本申请实施例对该电子设备的具体形态不作特殊限制。
示例地,以电子设备为手机为例,图3示出了本申请实施例提供的另一种电子设备的结构示意图。也即,示例性的,图3所示的电子设备可以是手机。
如图3所示,手机可以包括:处理器310,外部存储器接口320,内部存储器321,通用串行总线(universal serial bus,USB)接口330,充电管理模块340,电源管理模块341,电池342,天线1,天线2,移动通信模块350,无线通信模块360,音频模块370,扬声器370A,受话器(即听筒)370B,麦克风370C,耳机接口370D,传感器模块380,按键390,马达391,指示器392,摄像头393,显示屏394,以及用户标识模块(subscriber identification module,SIM)卡接口395,屏幕发声器件396等。
其中,上述传感器模块可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器和骨传导传感器等传感器。
可以理解的是,本实施例示意的结构并不构成对手机的具体限定。在另一些实施例中,手机可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以是手机的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
DSP可以包括智能功放(smart PA)硬件电路、smart PA算法模块、音频算法模块。其中,smart PA硬件电路可以分别与应用处理器和屏幕发声器件(如压电陶瓷)连接,用于根据应用处理器的指令控制屏幕发声器件发声。应理解,通常情况下,smart PA硬件电路还可以用于在屏幕发声器件播放音频的过程中,检测屏幕发声器件的反馈电流和反馈电压,并根据屏幕发声器件的反馈电流和反馈电压计算屏幕发声器件的阻抗或导纳。其中,导纳为阻抗的倒数。计算得到的屏幕发声器件的阻抗或导纳可以用于控制屏幕发声器件(如压电陶瓷)的物理参数(如温度、振幅)。
在本申请实施例中,smart PA算法模块用于根据屏幕发声器件(如压电陶瓷)的反馈电压、反馈电流,或根据反馈电压和反馈电流计算得到的屏幕发声器件的阻抗或导纳,判断屏幕发声器件(如压电陶瓷)是否失效(异常)。smart PA算法模块还用于在屏幕发声器件(如压电陶瓷)异常时进行结果上报,上报给音频算法模块。通过音频算法模块控制发声器件的切换,如切换屏幕发声器件(如压电陶瓷,即容性器件)至扬声器发声。
应理解,smart PA硬件电路也可以设置在DSP芯片的外部,本申请实施例不做特殊限定。
处理器310中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器310的等待时间,因而提高了***的效率。
在一些实施例中,处理器310可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对手机的结构限定。在另一些实施例中,手机也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
在本申请实施例中,电子设备可以通过处理器310来确定当前所处的听音环境的类别,然后根据该类别对听筒发声的频段和屏幕发声的频段分别进行调整,以控制听筒和屏幕发声分别播放声音信号中对应频段内的声音,从而避免安静环境下人耳听音时电子设备出现漏音。
充电管理模块340用于从充电器(如无线充电器或有线充电器)接收充电输入,为电池342充电。电源管理模块341用于连接电池342,充电管理模块340与处理器310。电源管理模块341接收电池342和/或充电管理模块340的输入,为电子设备的各个器件供电。
手机的无线通信功能可以通过天线1,天线2,移动通信模块350,无线通信模块360,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。手机中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
在一些实施例中,手机的天线1和移动通信模块350耦合,天线2和无线通信模块360耦合,使得手机可以通过无线通信技术与网络以及其他设备通信。上述移动通信模块350可以提供应用在手机上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块350可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。
移动通信模块350还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块350的至少部分功能模块可以被设置于处理器310中。在一些实施例中,移动通信模块350的至少部分功能模块可以与处理器310的至少部分模块被设置在同一个器件中。
无线通信模块360可以提供应用在手机上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。
无线通信模块360可以是集成至少一个通信处理模块的一个或多个器件。无线通信 模块360经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器310。无线通信模块360还可以从处理器310接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
当然,上述无线通信模块360也可以支持手机进行语音通信。例如,手机可以通过无线通信模块360接入Wi-Fi网络,然后使用任一种可提供语音通信服务的应用程序与其他设备进行交互,为用户提供语音通信服务。例如,上述可提供语音通信服务的应用程序可以是即时通讯应用。
手机可以通过GPU,显示屏394,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏394和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器310可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。显示屏394用于显示图像,视频等。
手机可以通过ISP,摄像头393,视频编解码器,GPU,显示屏394以及应用处理器等实现拍摄功能。ISP用于处理摄像头393反馈的数据。在一些实施例中,ISP可以设置在摄像头393中。摄像头393用于捕获静态图像或视频。在一些实施例中,手机可以包括1个或N个摄像头393,N为大于1的正整数。
外部存储器接口320可以用于连接外部存储卡,例如Micro SD卡,实现扩展手机的存储能力。内部存储器321可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令,从而执行手机的各种功能应用以及数据处理。例如,在本申请实施例中,处理器310可以通过执行存储在内部存储器321中的指令,内部存储器321可以包括存储程序区和存储数据区。
手机可以通过音频模块370,扬声器370A,受话器(即听筒)370B,麦克风370C,耳机接口370D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块370用于将数字音频信号转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块370还可以用于对音频信号编码和解码。在一些实施例中,音频模块370可以设置于处理器310中,或将音频模块370的部分功能模块设置于处理器310中。扬声器370A,也称“喇叭”,用于将音频电信号转换为声音信号。受话器370B,也称“听筒”,用于将音频电信号转换成声音信号。麦克风370C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。耳机接口370D用于连接有线耳机。耳机接口370D可以是USB接口330,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
其中,该受话器370B(即“听筒”)可以是图1B所示的听筒101。
示例性的,本申请实施例中,音频模块370可以将移动通信模块350和无线通信模块360接收到的音频电信号转换为声音信号。由音频模块370的受话器370B(即“听筒”)播放该声音信号,同时由屏幕发声器件396来驱动屏幕(即显示屏)进行屏幕发声以播放该声音信号。
按键390包括开机键,音量键等。马达391可以产生振动提示。指示器392可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。SIM卡接口395用于连接SIM卡。手机可以支持1个或N个SIM卡接口,N为大于1 的正整数。
当然,可以理解的,上述图3所示仅仅为电子设备的设备形态为手机时的示例性说明。若电子设备是平板电脑,手持计算机,PDA,可穿戴式设备(如:智能手表、智能手环)等其他设备形态时,电子设备的结构中可以包括比图3中所示更少的结构,也可以包括比图3中所示更多的结构,在此不作限制。
下面以电子设备为手机为例,对本申请实施例提供的一种音频播放方法进行详细说明。如上文描述,本申请实施例提供的一种音频播放方法需要在音频播放之前或音频播放的过程中检测屏幕发声器件是否失效。因此,下面以屏幕发声器件为压电陶瓷为例,对如何检测屏幕发声器件是否失效进行说明。
如图4所示为屏幕发声器件的原理图。其中,该屏幕发声器件包括多层压电陶瓷。该多层压电陶瓷形成振动膜,在施加交流驱动信号后,能够在压电效应下发生弯曲形变推动振动膜发声。
通常情况下,压电陶瓷(即容性器件)的阻抗满足如下关系式:
Figure PCTCN2022093638-appb-000001
其中,z为压电陶瓷的阻抗,C为电容,f为交流信号频率。由此可见,压电陶瓷的等效阻抗随着输入的交流信号的频率上升而下降。例如,如图5所示为4.2微法的压电陶瓷的频阻特性曲线,4.2微法(uF)的压电陶瓷在交流信号的频率为200赫兹(Hz)时,压电陶瓷的等效阻抗约为160欧姆(Ohm),4.2微法(uF)的压电陶瓷在交流信号的频率为10k赫兹(Hz)时,压电陶瓷的等效阻抗约为3.7欧姆(Ohm)。
需要说明的是,实际上,由多层压电陶瓷形成的屏幕发声器件中并非仅仅包括压电陶瓷(即容性器件),还可能包括电极引线、介电物质以及其他组件等。因而,由多层压电陶瓷形成的屏幕发声器件的等效阻抗为非线性曲线,会与温度、频率和材料等相关。此外,在屏幕发声器件正常的情况下,屏幕发声器件的频阻特性曲线趋于一致性。也就是说,随着交流信号的频率升高,屏幕发声器件的阻抗会减小。
然而,在电子设备的使用过程中,屏幕发声器件(如压电陶瓷)可能发生断裂,内层电极出现脱落、短路、击穿或退极化等器件失效情形。当屏幕发声器件(如压电陶瓷)失效后,屏幕发声器件的物理特性会发生变化,通常表现在电容、阻抗、负载电流、负载电压以及声学频响的变化上。例如,当屏幕发声器件失效后,屏幕发声器件的阻抗会偏离正常值,如变得极小或极大。如图6所示,为正常屏幕发声器件和异常屏幕发声器件的频阻特性曲线对比,其中,图6的横坐标为频率,单位Hz;图6的纵坐标为阻抗,单位为欧姆(Ω)。从图6中可以看出,异常屏幕发声器件(即失效后的屏幕发声器件)的阻抗远大于正常屏幕发声器件的阻抗,并且异常屏幕发声器件的频阻特性曲线具有较大的波动。应理解,由于导纳为阻抗的倒数,因此异常屏幕发声器件的导纳与正常屏幕发声器件的导纳也具有较大的差异。
综上所述,在电子设备的使用过程中,可以对屏幕发声器件的负载电流和负载电压进行检测,并且还可以通过负载电流和负载电压计算出屏幕发声器件的当前阻抗或导纳。然后可以将检测得到的负载电流与屏幕发声器件在正常情况下的负载电流进行对比,或者将检测得到的负载电压与屏幕发声器件在正常情况下的负载电压进行对比,或者将屏幕发声器件的当前阻抗或导纳与屏幕发声器件在正常情况下的阻抗或导纳进行对比,以确定屏幕发声器件是否失效。
通常情况下,屏幕发声器件的生产厂商会提供该屏幕发声器件的阻抗-频率的对应数据。例如,如下表1为容值约为2.5uF压电陶瓷(即屏幕发声器件)在不同频率下对应的平均阻抗,以及阻抗偏差。
表1
Figure PCTCN2022093638-appb-000002
示例性地,在本申请实施例中,也可以在屏幕发声器件(如压电陶瓷)正常(未失效)的情况下,通过屏幕发声器件播放各种频率的音频信号,如可以播放各频率的单音频信号。在屏幕发声器件播放每一种频率的单音频信号时,检测屏幕发声器件的负载电压和负载电流,作为屏幕发声器件在正常(未失效)的电压阈值和电流阈值。
应理解,为了对屏幕发声器件进行智能控制,通常情况下屏幕发声器件均连接有智能功放(smart PA)硬件电路。
示例性地,如图7所示,为智能功放(smart PA)硬件电路的结构示意图。请参考图7,屏幕发声器件(如压电陶瓷)与电子设备的应用处理器耦合连接,用于在屏幕发声器件播放音频的过程中,通过智能功放模块检测屏幕发声器件的反馈电流(即负载电流)和反馈电压(即负载电压),并根据屏幕发声器件的反馈电流和反馈电压计算屏幕发声器件的阻抗。智能功放模块可以根据计算得到的屏幕发声器件的阻抗,控制屏幕发声器件(如压电陶瓷)的物理参数(如温度、振幅)。此外,为避免电流过大烧毁器件,在该硬件电路中屏幕发声器件的电流通路上串联有4欧姆的保护电阻R0。
智能功放模块包括反馈电压/反馈电流检测模块、ADC模块和数字音频模块。其中,反馈电压/反馈电流检测模块用于实时检测负载电流和负载电压,反馈电压/反馈电流检测得到的负载电流和负载电压经过ADC模块转换为数字信号,传输至数字音频模块。数字音频模块可以根据负载电流和负载电压,计算出负载阻抗。根据屏幕发声器件(如压电陶瓷)的温度与阻抗的变化关系,可以确定屏幕发声器件(如压电陶瓷)的当前温度。当屏幕发声器件(如压电陶瓷)的当前温度超过屏幕发声器件的预设温度时,数字音频模块可以控制放大调节器调节放大器的放大倍数。
类似地,数字音频模块计算出负载阻抗后,可以根据电阻、电流以及屏幕发声器件(如压电陶瓷)的TS参数,确定屏幕发声器件(如压电陶瓷)的振幅。当屏幕发声器件的振幅过大,如超过0.6时,数字音频模块可以控制放大调节器调节放大器的放大倍数,以降低屏幕发声器件的振幅。
因而,通过如图7所示的智能功放模块可以检测并获得屏幕发声器件的负载电流和 负载电压。应理解,由于电路中串联有保护电阻R0,因此智能功放模块检测得到的负载电压为保护电阻R0的电压与屏幕发声器件(如压电陶瓷)的电压之和。
示例性地,在本申请实施例中,可以在电子设备的生产测试阶段,将屏幕发声器件连接至上述图7所示的smart PA硬件电路中,并控制屏幕发声器件分别播放多种频率(如20Hz、31.25Hz、50Hz、62.5Hz、125Hz、250Hz、500Hz、1000Hz、2000Hz、4000Hz、19KHz、20KHz、22KHz等)的单音频信号。在屏幕发声器件播放每一种频率的单音频信号时,通过图7中的智能功放模块检测并获得多组负载电压(即反馈电压)和负载电流(即反馈电流)。例如,屏幕发声器件播放50Hz频率的单音频信号时,检测得到的负载电压和负载电流对应的频率为50Hz。
应理解,由于负载电流和负载电压的检测通路上可能存在一些随机噪声,为减小误差,通常会检测多帧(如10帧、20帧或30帧)音频信号的反馈电压和反馈电流,然后对多帧反馈电压得到负载电压的有效值,或者对反馈电流求平均得到负载电流的有效值。
示例性地,可以通过如下公式(一)计算得到负载电压的有效值Z rms;可以通过如下公式(二)计算得到负载电流的有效值I rms:
Figure PCTCN2022093638-appb-000003
Figure PCTCN2022093638-appb-000004
其中,U表示反馈电压,I表示反馈电流,U i表示第i帧音频信号对应的反馈电压;I i表示第i帧音频信号对应的反馈电流;n表示反馈电压U或反馈电流I的采样数量。
需要说明的是,针对某一频率,计算得到对应于该频率的负载电压的有效值和负载电流的有效值之后,可以通过如下公式(三)计算对应于该频率的负载阻抗Z。
Figure PCTCN2022093638-appb-000005
应理解,由于电路中串联有保护电阻R0,因此通过公式(三)计算得到的负载阻抗Z为保护电阻R0的阻抗与屏幕发声器件(如压电陶瓷)的阻抗Z rms之和。此时,屏幕发声器件的阻抗Z rms=Z-R0。以计算得到的负载阻抗Z=4.194Ω为例,屏幕发声器件的阻抗Z rms=1.194Ω。由于导纳为阻抗的倒数,计算得到屏幕发声器件的阻抗后可以对阻抗求倒数,得到屏幕发声器件的导纳,例如Z rms=1.194Ω,则导纳Y rms=1/1.194Ω=0.837西门子(S)。
此外,屏幕发声器件播放的音频信号可能并非为单一频率。此时,可以在获取屏幕发声器件的反馈电压或反馈电流之后,进行高通滤波或低通滤波,获得特定频率下(如19KHz或32.5Khz)的屏幕发声器件的反馈电压或反馈电流。然后,在根据特定频率下的屏幕发声器件的反馈电压或反馈电流,计算得到特定频率下的屏幕发声器件的负载阻抗。
综上所述,在电子设备的生产测试阶段,在对正常的屏幕发声器件播放某一频率的音频时进行如上的多次检测和计算,可以得到屏幕发声器件在正常(未失效)时对应于某一频率的电压范围、电流范围、阻抗范围或导纳范围。在后续进行屏幕发声器件是否失效的检测时,将上述电压范围、电流范围、阻抗范围或导纳范围,作为屏幕发声器件在正常(未失效)时对应于某一频率的电压阈值范围、电流阈值范围、阻抗阈值范围或 导纳阈值范围,以此作为判断屏幕发声器件是否失效的依据。
在本申请实施例中,可以通过检测判断屏幕发声器件的实时负载电流是否超出对应的电流阈值范围,或者通过检测判断屏幕发声器件的实时负载电压是否超出对应的电压阈值范围,或者通过检测判断屏幕发声器件的实时阻抗是否超出对应的阻抗阈值范围,来检测屏幕发声器件是否失效,或者通过检测判断屏幕发声器件的实时导纳是否超出对应的导纳阈值范围,来检测屏幕发声器件是否失效。
以下详细介绍屏幕发声器件的失效检测方法。
在一些实施例中,通过屏幕发声器件的实时负载电流来判断屏幕发声器件是否失效。如图8所示,为屏幕发声器件是否失效的检测方法的流程图一。请参考图8,该方法包括:
S801,获取屏幕发声器件的实时负载电流。
示例性地,在屏幕发声器件的使用过程中,如在电子设备通过屏幕发声器件播放音频信号(即检测音频)时,可通过如图7所示的智能功放模块获取屏幕发声器件的实时负载电流。
应理解,上述电子设备通过屏幕发声器件播放的音频信号可以是人耳不可听的或者难以听见的单音频,例如频率为20Hz、31.25Hz、50Hz、19KHz、20KHz、22KHz的音频等,也可以是人耳可听的正常音频信号,如通话中的语音、正常播放的音乐或视频文件中的音频,或者用于专门用于检测屏幕发声器件是否失效的音频等。此外,上述电子设备通过屏幕发声器件播放的音频信号还可以是在正常音频信号中叠加幅值较小的导频信号(如频率为19KHz的信号)。
为减小误差,通常会检测多帧(如10帧、20帧或30帧)音频信号的反馈电流,然后通过上述公式(二),计算得到上述多帧音频信号的负载电流的有效值,作为当前屏幕发声器件的实时负载电流I rms
S802,判断屏幕发声器件的实时负载电流是否处于电流阈值范围。
应理解,电流阈值范围是在屏幕发声器件正常的情况下,提前通过分析得出,上文已描述,此处不再赘述。在本申请实施例中,可以将电流阈值范围记为[Imin,Imax,F],其中F表示该电流阈值范围对应的频率,Imin表示电流阈值范围的下限,Imax表示电流阈值范围的上限。
通常情况下,若屏幕发声器件的负载电流处于电流阈值范围内时,屏幕发声器件为正常器件。相反地,若屏幕发声器件的负载电流不在电流阈值范围内时,即屏幕发声器件的负载电流超过正常电流阈值范围的上限,或者屏幕发声器件的负载电流低于正常电流阈值范围的下限,则屏幕发声器件为异常器件或失效器件。
此时,可以根据S801获取得到的屏幕发声器件的实时负载电流与电流阈值范围进行比较,判断屏幕发声器件的实时负载电流是否处于电流阈值范围。当屏幕发声器件的负载电流不在正常电流阈值范围内时,则可以执行下述S803,确定屏幕发声器件失效。
应理解,当屏幕发声器件播放不同频率的音频信号时,屏幕发声器件的电流阈值范围不同。在执行S802的判断过程中,需先确定播放的音频信号的频率,然后将获取得到的屏幕发声器件的实时负载电流,与该音频信号的频率对应的电流阈值范围进行对比。
例如,若在S801获取屏幕发声器件的实时负载电流时,播放的音频信号为单音频, 如19KHz的单音频,则可以将S801获取得到的屏幕发声器件的实时负载电流,与屏幕发声器件在19KHz的频率下的电流阈值范围进行比较。
又例如,若S801获取屏幕发声器件的实时负载电流时,播放的音频信号为人耳可听的正常音频信号,如通话中的语音信号、正常播放的音乐或视频等,则可以通过分析上述正常音频信号的主要能量所在的频带的中心频点的频率(记为频率A)。分析上述正常音频信号的主要能量所在的频带的中心频点,可以先通过智能功放模块获取连续N帧音频信号所对应的负载电流(即反馈电流)或负载电压(即反馈电压)。然后,对负载电流或负载电压进行快速傅里叶变换(fast Fourier transform,FFT)转换为频域的信号,通过分析可以确定该连续N帧音频信号的最主要能量所在的频点是否相同。若相同,则可以通过上述公式(二)计算得到屏幕发声器件的实时负载电流,并且该实时负载电流对应的频率为频率A。若不同,则继续播放,获取后续帧的音频信号对应的负载电流(即反馈电流),重复上述步骤分析正常音频信号的主要能量所在的频带的中心频点。最后,可以将S801获取得到的屏幕发声器件的实时负载电流,与屏幕发声器件在频率A的电流阈值范围进行比较。
再例如,若S801获取屏幕发声器件的实时负载电流时,播放的音频信号为叠加了导频信号(如19KHz的信号)的音频信号。由于在通常情况下,当屏幕发声器件的阻抗急剧增大时,智能功放模块获取得到的负载电流也会比正常器件急剧减小,因此将S801获取得到的实时负载电流与全频域下的电流阈值范围进行对比,判断屏幕发声器件是否失效。应理解,全频域下的电流阈值范围可以是在屏幕发声器件正常的情况下,播放全频域的音频信号获取的,获取方法与上文描述的针对单一频率的电流阈值范围的获取方法类似,此处不再赘述。
当然,在此情况下,也可以通过高通滤波的方式,获取得到导频信号所在的频率(记为频率B)对应的实时负载电流,再将该实时负载电流,与屏幕发声器件在频率B的电流阈值范围进行比较。
示例性地,可以采用如下代码判断屏幕发声器件是否失效:
brokenFlag=false;//默认屏幕发声器件未失效;
if((I rms>Imax)||(I rms<Imin))//电阻超过电流阈值范围上限或者小于电流阈值范围下限;
brokenFlag=true;//屏幕发声器件标记为失效;
S803,确定屏幕发声器件失效。
示例性地,当上述代码中brokenFlag=true时,可以确定屏幕发声器件失效。
在一些实施例中,通过实时负载电压来判断屏幕发声器件是否失效。如图9所示,为屏幕发声器件是否失效的判断方法的流程图二。请参考图9,该方法包括:
S901,获取屏幕发声器件的负载电压。
示例性地,在屏幕发声器件的使用过程中,如在电子设备通过屏幕发声器件播放音频信号时,可通过如图7所示的智能功放模块获取屏幕发声器件的实时负载电压。
应理解,上述电子设备通过屏幕发声器件播放的音频信号可以是人耳不可听的或者难以听见的单音频,例如频率为20Hz、31.25Hz、50Hz、19KHz、20KHz、22KHz的音频等,也可以是人耳可听的正常音频信号,如通话中的语音、正常播放的音乐或视频文 件中的音频,或者用于专门用于检测屏幕发声器件是否失效的音频等。此外,上述电子设备通过屏幕发声器件播放的音频信号还可以是在正常音频信号中叠加幅值较小的导频信号(如频率为19KHz的信号)。
为减小误差,通常会获取多帧(如10帧、20帧或30帧)音频信号的反馈电压,然后通过上述公式(一),计算得到上述多帧音频信号的负载电压的有效值,作为当前屏幕发声器件的实时负载电压U rms
S902,判断屏幕发声器件的实时负载电压是否处于电压阈值范围。
应理解,电压阈值范围是在屏幕发声器件正常的情况下,提前通过分析得出,上文已描述,此处不再赘述。在本申请实施例中,可以将电压阈值范围记为[Umin,Umax,F],其中F表示该电压阈值范围对应的频率,Umin表示电压阈值范围的下限,Umax表示电压阈值范围的上限。
通常情况下,若屏幕发声器件的负载电压处于电压阈值范围内时,屏幕发声器件为正常器件。相反地,若屏幕发声器件的负载电压不在电压阈值范围内时,即屏幕发声器件的负载电压超过电压阈值范围的上限,或者屏幕发声器件的负载电压低于电压阈值范围的下限,则屏幕发声器件为异常器件或失效器件。
此时,可以根据S901获取得到的屏幕发声器件的实时负载电压与电压阈值范围进行比较,判断屏幕发声器件的实时负载电压是否处于电压阈值范围。当屏幕发声器件的实时负载电压不在电压阈值范围内时,则可以执行下述S903,确定屏幕发声器件失效。
应理解,当屏幕发声器件播放不同频率的音频信号时,屏幕发声器件的电压阈值范围不同。在执行S902的判断过程中,需先确定播放的音频信号的频率,然后将获取得到的屏幕发声器件的实时负载电压,与该音频信号的频率对应的电压阈值范围进行对比。
例如,若在S901获取屏幕发声器件的实时负载电压时,播放的音频信号为单音频,如19KHz的单音频,则可以将S901获取得到的屏幕发声器件的实时负载电压,与屏幕发声器件在19KHz的频率下的电压阈值范围进行比较。
又例如,若S901获取屏幕发声器件的实时负载电压时,播放的音频信号为人耳可听的正常音频信号,如通话中的语音信号、正常播放的音乐或视频等,则可以通过分析上述正常音频信号的主要能量所在的频带的中心频点的频率(记为频率A)(分析过程可参考上述S802中的相关描述),然后可以将S901获取得到的屏幕发声器件的实时负载电压,与屏幕发声器件在频率A的电压阈值范围进行比较。
再例如,若S901获取屏幕发声器件的实时负载电压时,播放的音频信号为叠加了导频信号(如19KHz的信号)的音频信号。在此情况下,可以通过高通滤波的方式,获取得到导频信号所在的频率(记为频率B)对应的实时负载电压,再将该实时负载电压,与屏幕发声器件在频率B的电压阈值范围进行比较。
示例性地,可以采用如下代码判断屏幕发声器件是否失效:
brokenFlag=false;//默认屏幕发声器件未失效;
if((U rms>Umax)||(U rms<Umin))//电阻超过电压阈值范围上限或者小于电压阈值范围下限;
brokenFlag=true;//屏幕发声器件标记为失效;
S903,确定屏幕发声器件失效。
示例性地,当上述代码中brokenFlag=true时,可以确定屏幕发声器件失效。
在一些实施例中,可以通过屏幕发声器件的实时阻抗来判断屏幕发声器件是否失效。如图10A所示,为屏幕发声器件是否失效的判断方法的流程图三。请参考图10A,该方法包括:
S1001,获取屏幕发声器件的实时负载电压和实时负载电流。
示例性地,在电子设备通过屏幕发声器件播放音频信号时,可通过如图7所示的智能功放模块获取屏幕发声器件的负载电流和负载电压。
应理解,上述电子设备通过屏幕发声器件播放的音频信号可以是人耳不可听的或者难以听见的单音频,例如频率为20Hz、31.25Hz、50Hz、19KHz、20KHz、22KHz的音频等,也可以是人耳可听的正常音频信号,如通话中的语音、正常播放的音乐或视频文件中的音频,或者用于专门用于检测屏幕发声器件是否失效的音频等。此外,上述电子设备通过屏幕发声器件播放的音频信号还可以是在正常音频信号中叠加幅值较小的导频信号(如频率为19KHz的信号)。
为减小误差,通常会获取多帧(如10帧、20帧或30帧)音频信号的反馈电压值和反馈电流值,然后通过上述公式(一),计算得到上述多帧音频信号的负载电压的有效值,作为当前屏幕发声器件的负载电压。通过上述公式(二),计算得到上述多帧音频信号的负载电流的有效值,作为当前屏幕发声器件的实时负载电流。
S1002,计算屏幕发声器件的实时阻抗值。
应理解,根据上述S1001获取到的屏幕发声器件的实时负载电压和上述负载电流,可以根据上述公式(三)计算出负载阻抗Z,由于图7所示的smart PA硬件电路中设置有保护电阻R0,因此屏幕发声器件的实时阻抗Z rms=Z-R0,即Z rms=Z-4。
S1003,判断屏幕发声器件的实时阻抗值是否处于阻抗阈值范围。
应理解,正常阻抗范围可以从屏幕发声器件的出厂参数中获取,也可以在屏幕发声器件正常的情况下,提前通过分析得出,上文已描述,此处不再赘述。在本申请实施例中,可以将阻抗阈值范围记为[Zmin,Zmax,F],其中F表示该阻抗阈值范围对应的频率,Zmin表示阻抗阈值范围的下限,Zmax表示阻抗阈值范围的上限。
通常情况下,若屏幕发声器件的实时阻抗处于阻抗阈值范围内时,屏幕发声器件为正常器件。相反地,若屏幕发声器件的实时阻抗不在阻抗阈值范围内时,即屏幕发声器件的实时阻抗超过阻抗阈值范围的上限,或者屏幕发声器件的实时阻抗低于阻抗阈值范围的下限,则屏幕发声器件为异常器件或失效器件。
此时,可以根据S1002计算得到的屏幕发声器件的实时阻抗与阻抗阈值范围进行比较,判断屏幕发声器件的实时阻抗是否处于阻抗阈值范围。当屏幕发声器件的实时阻抗不在阻抗阈值范围内时,则可以执行下述S1004,确定屏幕发声器件失效。
应理解,当屏幕发声器件播放不同频率的音频信号时,屏幕发声器件的阻抗阈值范围不同。在执行S1003的判断过程中,需先确定播放的音频信号的频率,然后将S1002计算得到的屏幕发声器件的实时阻抗与该音频信号的频率对应的阻抗阈值范围进行对比。
例如,若在S1001获取屏幕发声器件的负载电压和负载电流时,播放的音频信号为单音频,如19KHz的单音频,则可以将S1002计算得到的屏幕发声器件的阻抗,与屏幕发声器件在19KHz的频率下的正常阻抗范围进行比较。
又例如,若S1001获取屏幕发声器件的实时负载电压和实时负载电流时,播放的音频信号为人耳可听的正常音频信号,如通话中的语音信号、正常播放的音乐或视频等,则可以通过分析上述正常音频信号的主要能量所在的频带的中心频点的频率(记为频率A)(分析过程请参考上述S802中的相关描述),然后可以将S1002计算得到的屏幕发声器件的实时阻抗,与屏幕发声器件在频率A的阻抗阈值范围进行比较。
再例如,若S1001获取屏幕发声器件的实时负载电压和实时负载电流时,播放的音频信号为叠加了导频信号(如19KHz的信号)的音频信号。在此情况下,在上述S1001中通过智能功放模块获取得到屏幕发声器件的实时负载电压和实时负载电流后,可以通过高通滤波的方式,获取得到该屏幕发声器件在导频信号所在的频率(记为频率B)的实时负载电压和实时负载电流。然后,在S1002中将该频率B对应的实时负载电压和实时负载电流,通过上述公式(三)计算得到屏幕发声器件的实时阻抗。最后,再将该实时阻抗与屏幕发声器件在频率B的阻抗阈值范围进行比较。
示例性地,可以采用如下代码判断屏幕发声器件是否失效:
brokenFlag=false;//默认屏幕发声器件未失效;
if((Z rms>Zmax)||(Z rms<Zmin));//阻抗超过阻抗阈值范围上限或者小于阻抗阈值范围下限;
brokenFlag=true;//屏幕发声器件标记为失效;
S1004,确定屏幕发声器件失效。
示例性地,当上述代码中brokenFlag=true时,可以确定屏幕发声器件失效。
在一些实施例中,可以通过屏幕发声器件的实时导纳来判断屏幕发声器件是否失效。如图10B所示,为屏幕发声器件是否失效的判断方法的流程图四。请参考图10B,该方法与图10B所示的方法的区别在于将S1002替换为如下S1002a,将S1003替换为如下S1003a。
S1002a,计算屏幕发声器件的实时导纳值。
根据上述S1002计算得到屏幕发声器件的实时阻抗Z rms之后,可以对屏幕发声器件的实时阻抗Z rms求倒数,得到屏幕发声器件的实时导纳Y rms,即Y rms=1/Z-4。
S1003a,判断屏幕发声器件的实时导纳值是否处于导纳阈值范围。
类似地,在本申请实施例中,可以将导纳阈值范围记为[Ymin,Ymax,F],其中F表示该导纳阈值范围对应的频率,Ymin表示导纳阈值范围的下限,Ymax表示导纳阈值范围的上限。
通常情况下,若屏幕发声器件的实时导纳处于导纳阈值范围内时,屏幕发声器件为正常器件。相反地,若屏幕发声器件的实时导纳不在导纳阈值范围内时,即屏幕发声器件的实时导纳超过导纳阈值范围的上限,或者屏幕发声器件的实时导纳低于导纳阈值范围的下限,则屏幕发声器件为异常器件或失效器件。
此时,可以根据S1002a计算得到的屏幕发声器件的实时导纳与导纳阈值范围进行比较,判断屏幕发声器件的实时导纳是否处于导纳阈值范围。当屏幕发声器件的实时导纳不在导纳阈值范围内时,则可以执行上述S1004,确定屏幕发声器件失效。
应理解,当屏幕发声器件播放不同频率的音频信号时,屏幕发声器件的导纳阈值范围不同。在执行S1003a的判断过程中,需先确定播放的音频信号的频率,然后将S1002a 计算得到的屏幕发声器件的实时导纳与该音频信号的频率对应的导纳阈值范围进行对比。
例如,若在S1001获取屏幕发声器件的负载电压和负载电流时,播放的音频信号为单音频,如19KHz的单音频,则可以将S1002a计算得到的屏幕发声器件的导纳,与屏幕发声器件在19KHz的频率下的导纳阈值范围进行比较。
又例如,若S1001获取屏幕发声器件的实时负载电压和实时负载电流时,播放的音频信号为人耳可听的正常音频信号,如通话中的语音信号、正常播放的音乐或视频等,则可以通过分析上述正常音频信号的主要能量所在的频带的中心频点的频率(记为频率A)(分析过程请参考上述S802中的相关描述),然后可以将S1002计算得到的屏幕发声器件的实时导纳,与屏幕发声器件在频率A的导纳阈值范围进行比较。
再例如,若S1001获取屏幕发声器件的实时负载电压和实时负载电流时,播放的音频信号为叠加了导频信号(如19KHz的信号)的音频信号,则可参考上述S1003中相关内容的描述,此处不再赘述。
示例性地,可以采用如下代码判断屏幕发声器件是否失效:
brokenFlag=false;//默认屏幕发声器件未失效;
if((Y rms>Ymax)||(Y rms<Ymin));//导纳超过导纳阈值范围上限或者小于导纳阈值范围下限;
brokenFlag=true;//屏幕发声器件标记为失效;
需要说明的是,在一些器件的失效场景中,例如电极脱落、短路、击穿等失效场景,在同一频率下,器件的阻抗会急剧增大。在此情况下,失效的屏幕发声器件的负载电流,会比正常的屏幕发声器件的负载电流急剧减小,因此可以通过判断负载电流是否在正常电流范围内,确定屏幕发声器件是否失效(即异常)。在另一些器件的失效场景中,例如器件断裂、退极化等失效场景,失效的屏幕发声器件的负载电流可能会比较接近正常值(即电流阈值范围)。在此情况下,可以通过计算某一频率下的屏幕发声器件的阻抗是否在阻抗阈值范围内,确定屏幕发声器件是否失效(即异常)。
基于此,为了减少流程,节约功耗,提高检测的准确率,在一些实施例中,可以通过负载电流和阻抗相结合的判断方式来确定屏幕发声器件是否失效。如图11所示,为屏幕发声器件是否失效的检测方法的流程图五。请参考图11,该检测方法包括:
S1101,获取屏幕发声器件的实时负载电压和实时负载电流。
请参考上述S1001,此处不再赘述。
S1102,判断屏幕发声器件的实时负载电流是否处于电流阈值范围。
请参考上述S902,此处不再赘述。
S1103,计算屏幕发声器件的实时阻抗值或实时导纳值。
请参考上述S1002或S1002a,此处不再赘述。
S1104,判断屏幕发声器件的实时阻抗值是否处于阻抗阈值范围,或者判断屏幕发声的实时导纳值是否处于导纳阈值范围。
请参考上述S1004或S1004a,此处不再赘述。
S1105,确定屏幕发声器件失效。
下面以电子设备为手机为例,并结合***架构和流程图,对本申请实施例提供的一种音频播放方法进行详细说明。
上述电子设备(如手机)的软件***可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android***为例,示例性说明手机的软件结构。当然,在其他操作***中,只要各个功能模块实现的功能和本申请的实施例类似。
图12是本申请实施例的电子设备的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android***分为五层,从上至下分别为应用程序层,应用程序框架层(framework),安卓运行时(Android runtime)和***库(libraries),HAL(hardware abstraction layer,硬件抽象层)以及内核层(kernel)。
应用程序层可以包括一系列应用程序包。
如图12所示,应用程序层中可以安装通话,备忘录,浏览器,联系人,相机,图库,日历,地图,蓝牙,音乐,视频,短信息等应用(application)。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图12所示,应用程序框架层中设置有音频播放管理服务。音频播放管理服务可以用于初始化音视频播放器,获取当前音频的音量大小,调节音频播放的音量大小,增加音效等。
另外,应用程序框架层还可以包括窗口管理服务,内容提供服务,视图***,资源管理服务,通知管理服务等,本申请实施例对此不做任何限制。
例如,上述窗口管理服务用于管理窗口程序。窗口管理服务可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。上述内容提供服务用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。上述视图***可用于构建应用程序的显示界面。每个显示界面可以由一个或多个控件组成。一般而言,控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、微件(Widget)等界面元素。上述资源管理服务为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。上述通知管理服务使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理服务被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在***顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,振动,指示灯闪烁等。
仍如图12所示,手机的HAL中提供了与手机的不同硬件模块对应的HAL,例如,Audio HAL、Camera HAL、Wi-Fi HAL以及smart PA控制HAL等。
其中,Audio HAL通过内核层的音频驱动可与音频输出器件(如扬声器、屏幕发声器件)对应。当手机设置有多个音频输出器件(如多个扬声器或屏幕发声器件)时,这多个音频输出器件分别与内核层的多个音频驱动对应。
smart PA控制HAL通过DSP中的smart PA算法与smart PA硬件电路相对应。示例性地,当屏幕发声器件失效时,smart PA控制HAL可以控制smart PA算法关闭,停止运行。当屏幕发声器件失效时,smart PA控制HAL还可以通过I2C信号控制smart PA 硬件电路(如屏幕发声器件的硬件电路(smart PA0))关闭,以降低电子设备的功耗。
Android runtime包括核心库和虚拟机。Android runtime负责安卓***的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
***库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
其中,表面管理器用于对显示子***进行管理,并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。2D图形引擎是2D绘图的绘图引擎。
内核层位于HAL之下,是硬件和软件之间的层。内核层除了包括上述音频驱动以外,还可以包括显示驱动,摄像头驱动,传感器驱动等,本申请实施例对此不做任何限制。
需要说明的是,在内核层之下便是硬件电路。示例性地,在本申请实施例中包括数字信号处理(digital signal processing,DSP)芯片,在该DSP芯片中运行有smart PA算法模块、音频算法模块等。其中,smart PA算法模块用于根据屏幕发声器件(如压电陶瓷)的负载电压、负载电流以及阻抗或导纳,判断屏幕发声器件(如压电陶瓷)是否失效(异常),并在屏幕发声器件(如压电陶瓷)异常时进行结果上报,上报给音频算法模块。通过音频算法模块控制发声器件的切换,如切换屏幕发声器件(如压电陶瓷,即容性器件)至扬声器发声。
smart PA算法模块的检测出的异常结果还可以通过音频算法模块上报至HAL层,以告知用户更换器件或关闭双发声单元切换功能。HAL层中的smart PA控制HAL可以控制smart PA算法中的阻抗检测功能关闭,并且通过I2C信号控制smart PA硬件电路(如屏幕发声器件的硬件电路(smart PA0))关闭,以降低电子设备的功耗。
smart PA算法模块包括阈值写入模块、数据抓取模块、异常判断模块和结果上报模块。
其中,阈值写入模块用于写入屏幕发声器件(如压电陶瓷)在正常情况下的电压阈值范围、电流阈值范围、阻抗阈值范围以及导纳阈值范围等。
数据抓取模块用于从smart PA硬件电路中获取屏幕发声器件的负载电压和负载电流。
异常判断模块可以用于根据数据抓取模块获取的负载电流,与阈值写入模块中的电流阈值范围进行对比,判断屏幕发声器件的负载电流是否处于电流阈值范围内。异常判断模块还可以用于根据数据抓取模块获取的负载电压,与阈值写入模块中的电压阈值范围进行对比,判断屏幕发声器件的负载电压是否处于电压阈值范围内。异常判断模块还可以用于根据数据抓取模块获取的反馈电压和反馈电流,计算得到屏幕发声器件的阻抗或导纳(具体计算方法可参考上文关于阻抗或导纳计算的描述),并将该计算得到的阻抗与阈值写入模块中的阻抗阈值范围进行对比,判断屏幕发声器件的阻抗是否处于阻抗 阈值范围内,或者将该计算得到的导纳与阈值写入模块中的导纳阈值范围进行对比,判断屏幕发声器件的导纳是否处于导纳阈值范围内。
结果上报模块用于在屏幕发声器件的负载电流不在电流阈值范围内时,或者在屏幕发声器件的负载电压不在电压阈值范围内时,或者在屏幕发声器件的阻抗不在阻抗阈值范围内时,或者在屏幕发声器件的导纳不再导纳阈值范围内时,将屏幕发声器件的异常结果上报给音频算法模块,以使音频算法模块切换发声器件。
以下是对本申请实施例提供的音频播放方法的详细说明。
在一些实施例中,为了节约功耗,仅在音频播放指令下发后的开始一段时间,播放人耳不可听的或者难以听见的单音频(例如频率为20Hz、31.25Hz、50Hz、19KHz、20KHz、22KHz等的音频),以检测屏幕发声器件是否损坏,并在损坏时切换发声器件,如切换至扬声器发声,然后开始正常音频的播放。
示例性地,如图13A所示,上述音频播放方法包括:
S1301,接收音频播放指令。该音频播放指令用于指示播放第一音频。
例如,电子设备检测到用户拨打电话的操作,上层应用(如通话应用)会向电子设备的处理器下通话指令。又例如,电子设备检测到用户播放音乐的操作,上层应用(如音乐应用)会向电子设备的处理器下发音乐播放指令。再例如,电子设备检测到用户播放视频文件的操作,上层应用(如视频应用)会向电子设备的处理器下发视频文件播放指令。上述通话指令、音乐播放指令、视频文件播放指令均可以视为音频播放指令此时,电子设备的处理器中的DSP芯片可以控制发声器件(如扬声器、屏幕发声器件)获取相应的参数并启动,准备音频播放。
S1302,响应于接收到音频播放指令,通过屏幕发声器件播放第二音频。
示例性地,如图12所示,当DSP芯片接收到音频播放指令,响应于接收到音频播放指令,DSP芯片的音频算法可以对发声器件(如扬声器、屏幕发声器件)进行配置,并使发声器件获取相应地参数,启动扬声器发声或屏幕发声器件发声。
在此时,为了检测屏幕发声器件是否损坏,可以在启动屏幕发声器件后,控制屏幕发声器件播放一段人耳不可听或者难以听见的单音频(即第二音频),例如幅度为-35至-40分贝(dB),频率为20Hz、31.25Hz、50Hz、19KHz、20KHz、22KHz等的音频。
为避免第二音频的播放时间过长影响用户体验,通常情况下,第一音频的播放时长不超过1秒。
S1303,检测屏幕发声器件是否失效。
示例性地,在电子设备执行上述S1302,播放第二音频的过程中,电子设备可以执行上述图8、图9、图10A、图10B或图11所示的检测方法,确定屏幕发声器件是否失效。
在屏幕发声器件未失效的情况下,执行下述S1304。
在屏幕发声器件失效的情况下,执行下述S1305。
S1304,播放第一音频。
其中,第一音频为上述音频播放指令所指示播放的音频。例如,若上述音频播放指令是在检测到用户拨打电话的操作后下发的,则该第一音频可以是通话过程中对方的声音。又例如,若上述音频播放指令是在检测到用户播放音乐的操作后下发的,则该第一 音频可以是音乐。再例如,若上述音频播放指令是在检测到用户播放视频文件的操作后下发的,则该第一音频可以是视频文件中的音频。
应理解,在屏幕发声器件(如压电陶瓷)正常的情况下,屏幕发声器件能够正常发声,在电子设备设置了双器件发声的情况下,保持双器件发声,通过屏幕发声器件和扬声器播放第一音频。例如屏幕发声器件播放第一音频的左声道音频,扬声器播放第一音频的右声道音频。当然,屏幕发声器件也可以播放第一音频的右声道音频,扬声器也可以播放第一音频的左声道音频。屏幕发声器件以及扬声器播放哪个声道的音频,可以通过音频算法模块进行配置,本申请实施例不做特殊限定。
需要说明的是,在屏幕发声器件(如压电陶瓷)正常的情况下,电子设备也可以仅通过屏幕发声器件播放第一音频。
S1305,切换发声器件为扬声器,播放第一音频。
应理解,在屏幕发声器件(如压电陶瓷)失效的情况下,屏幕发声器件不能正常播放音频数据,如第一音频,并且屏幕发声器件还可能出现杂音,影响用户体验。在此情况下,DSP芯片中的音频算法模块接收到smart PA算法模块上报的检测结果后,重新对发声器件配置,切换发声器件,例如由屏幕发声器件发声切换至由扬声器发声,或者由双器件发声切换至由扬声器发声。
在此过程中,DSP芯片的音频算法接收到smart PA算法模块上报的检测结果后,还会将屏幕发声器件是否失效的检测结果上报至应用程序层,以提示用户屏幕发声器件损坏,需及时更换维修。例如,若上述音频播放指令是在检测到用户对视频通话的操作后下发的,则电子设备可以在如图13B中的(a)所示的视频通话界面,显示维修提示框1300(即预设提示框),如显示“温馨提示屏幕发声器件已失效,已切换至扬声器发声,请及时到维修网点维修”等提示信息。又例如,若上述音频播放指令是在检测到用户观看视频文件的操作后下发的,则电子设备可以在如图13B中的(b)所示的视频播放界面,显示上述维修提示框1300。再例如,若上述音频播放指令是在检测到用户拨打电话后下发的,则电子设备可以在如图13B中的(c)所示的通话界面,显示上述维修提示框1300。
此外,电子设备的还可以提示用户更改用户设置,关闭双发声单元切换功能等,例如可以设置仅由扬声器发声等。
此外,DSP芯片的音频算法模块接收到smart PA算法模块上报的检测结果后,还会将屏幕发声器件失效的检测结果上报至HAL层。HAL层可以在接收到屏幕发声器件失效的检测结果时,也可以自动关闭双器件切换功能(默认情况下双器件切换功能开启)。HAL层中的smart PA控制HAL可以控制smart PA算法中的阻抗检测功能关闭,并且通过I2C信号控制smart PA硬件电路(如屏幕发声器件的硬件电路(smart PA0))关闭,以降低电子设备的功耗。
需要说明的是,在图13A所示的音频播放方法中,屏幕发声器件的失效检测仅在音频播放指令下发时进行检测。然而,电子设备在播放音频的过程中,屏幕发声器件也可能出现损坏,而造成无声或杂音,影响用户体验。
因此,在另一些实施例中,电子设备可以在音频播放的过程中,对屏幕发声器件是否失效进行实时检测。如图14所示,该音频播放方法包括:
S1401,接收音频播放指令。该音频播放指令用于指示播放第一音频。
请参考上述S1301,此处不再赘述。
S1402,响应于接收到音频播放指令,通过屏幕发声器件播放第一音频。
示例性地,如图12所示,当DSP芯片接收到音频播放指令,响应于接收到音频播放指令,DSP芯片的音频算法可以对发声器件(如扬声器、屏幕发声器件)进行配置,并使发声器件获取相应地参数,启动扬声器发声或屏幕发声器件发声。
在此时,电子设备可以在接收到音频播放指令后直接播放第一音频,在播放第一音频的过程中,每间隔预设周期执行下述S1403,检测屏幕发声器件是否失效,以便及时发现屏幕发声器件在播放正常的音频的过程中出现的失效,减少出现无声或杂声的可能性,提高用户体验。
S1403,检测屏幕发声器件是否失效。
示例性地,在电子设备执行上述S1402,播放第一音频的过程中,电子设备可以执行上述图8、图9、图10A、图10B或图11所示的检测方法,确定屏幕发声器件是否失效。
在屏幕发声器件未失效的情况下,每间隔预设周期(如1s,2s)重复执行S1403。
在屏幕发声器件失效的情况下,执行下述S1404。
S1404,切换发声器件为扬声器,继续播放第一音频。
请参考上述S1305,此处不再赘述。
需要说明的是,在图14所示的音频播放方法中,会在整个音频播放过程,对屏幕发声器件是否失效进行实时检测,会增加电子设备的功耗。
为降低电子设备的功耗,本申请实施例还提供另一种音频播放方法。如图15所示,该音频播放方法包括:
S1501,接收音频播放指令。该音频播放指令用于指示播放第一音频。
请参考上述S1301,此处不再赘述。
S1502,判断电子设备的电池电量是否大于预设阈值。
示例性地,预设阈值可以是电池容量的50%、40%、30%,具体可以根据实际情况设置。
当接收到音频播放指令后,若电子设备的电池电量大于预设阈值,则执行下述S1503-S1506,通过屏幕发声器件播放第一音频。
当接收到音频播放指令后,若电子设备的电池电量小于或等于预设阈值,则执行下述S1507-S1510。
S1503,响应于接收到音频播放指令,启动屏幕发声器件,播放第一音频。
请参考上述S1402,此处不再赘述。
S1504,检测屏幕发声器件是否失效。
示例性地,在电子设备执行上述S1503,播放第一音频的过程中,电子设备可以执行上述图8、图9、图10A、图10B或图11所示的检测方法,确定屏幕发声器件是否失效。
在屏幕发声器件未失效的情况下,执行下述S1505,判断电子设备的电池电量是否大于预设阈值。
在屏幕发声器件失效的情况下,执行下述S1406。
S1505,判断电子设备的电池电量是否大于预设阈值。
示例性地,若电子设备的电池电量大于预设阈值,则每间隔预设周期(如1s,2s)重复执行S1504。若电子设备的电池电量小于或等于预设阈值,则不再执行上述S1504。
S1506,切换发声器件为扬声器,继续播放第一音频。
请参考上述S1305,此处不再赘述。
S1507,响应于接收到音频播放指令,通过屏幕发声器件播放第二音频。
请参考上述S1302,此处不再赘述。
S1508,检测屏幕发声器件是否失效。
请参考上述S1303,此处不再赘述。
S1509,播放第一音频。
请参考上述S1304,此处不再赘述。
S1510,切换发声器件为扬声器,播放第一音频。
请参考上述S1305,此处不再赘述。
综上所述,在图15所示的音频播放方法中,电子设备接收到音频播放指令后,先判断电子设备的电池电量是否超过预设阈值,在超过预设阈值的情况下,表示电子设备的当前电量较多,可以采用上述图14所示的音频播放方法播放第一音频,当电子设备的电池电量低于预设阈值时,则停止执行上述S1504,停止检测屏幕发声器件是否失效。在未超过预设阈值的情况下,表示电子设备的当前电量较少,为节约功耗,可以采用上述图13A所示的音频播放方法播放第一音频。
如此一来,在本申请实施例提供的音频播放方法中,可以在该音频播放方法中,在播放音频之前或者播放音频的过程中,检测屏幕发声器件是否失效(如断裂、电极脱落等),并在屏幕发声器件失效的情况切换发声器件,如切换至扬声器发声,从而避免屏幕发声器件失效出现的杂音或无声问题,以提高用户体验。
本申请实施例还提供一种屏幕发声器件的失效检测方法。如图16所示,该屏幕发声器件的失效检测方法,包括:
S1601,响应于预设操作或基于预设时间点,通过屏幕发声器件播放检测音频。
其中,预设操作或预设时间点用于触发电子设备检测屏幕发声器件是否失效。
示例性地,该预设操作可以是用户拨打电话的操作、用户播放音乐的操作、用户播放视频文件的操作等用户使用操作。该预设操作也可以是用户对屏幕发声器件是否失效进行检测的操作。例如,可以设置检测屏幕发声器件是否失效的启动按钮,用户可以对该启动按钮进行点击操作,以使电子设备通过屏幕发声器件播放检测音频,以检测屏幕发声器件是否失效。此时,该预设操作可以是用户对检测屏幕发声器件是否失效的启动按钮的点击操作。因此,针对用户操作的具体内容,本申请实施例不做特殊限定。
示例性地,如图17中的(a)所示,在电子设备中的设置界面1702中设置有“屏幕发声器件失效检测”的检测选项1702。响应于用户对该检测选项1702的点击操作,电子设备可以显示如图17中的(b)所示的屏幕发声器件失效检测界面1703。响应于用户对该屏幕发声器件失效检测界面1703中的开启按钮1704的点击操作,电子设备可以显示如图18中的(a)所示的检测界面1801。此时,电子设备会通过屏幕发声器件播放检测音频,以使电子设备对屏幕发声器件进行失效检测。
该预设时间点,可以是电子设备预先设置的对屏幕发声器件进行失效检测的时间点,可以是电子设备在出厂之前默认设置的,也可以是用户根据实际需要设置的,本申请实施例不做特殊限定。
上述检测音频可以是专门用于检测屏幕发声器件是否失效的音频,该检测音频可以是有声的(即人耳可听)音频,例如,用于提示用户正在进行屏幕发声器件失效检测的音频;也可以是无声的(即人耳不可听)音频,例如人耳不可听的单音频。当然,该检测音频也可以是人耳可听的正常音频信号,如通话中的语音、正常播放的音乐或视频文件中的音频。
S1602,在播放检测音频的过程中,获取第一参数。第一参数为屏幕发声器件的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种。
应理解,该S1602可以对应于上述S801、S901、S1001和S1002的结合,以及S1001和S1002a的结合,此处不再赘述。
S1603,根据第一参数,确定屏幕发声器件是否失效。
应理解,该S1603可以对应于上述S802和S803的结合,上述S902和S903的结合,上述S1003和S1004的结合,以及上述S1003a和S1004的结合,此处不再赘述。
当然,电子设备还可以在屏幕发声器件失效检测完成后,显示检测完成提示界面。当确定屏幕发声器件失效时,例如,如图18中的(b)所示,在检测完成提示界面1802中可以显“温馨提示屏幕发声器件已失效,已切换至扬声器发声,请及时到维修网点维修”等提示信息。
基于上述屏幕发声器件的失效检测方法,电子设备可以基于预设操作或基于预设时间点,对屏幕发声器件是否失效进行检测,以便定期对屏幕发声器件进行检测,便于及时告知用户屏幕发声器件失效,提示用户维修或者修改电子设备的默认配置,以提高电子设备的可靠性。
本申请实施例提供一种芯片***,如图19所示,该芯片***包括至少一个处理器1901和至少一个接口电路1902。处理器1901和接口电路1902可通过线路互联。例如,接口电路1902可用于从其它装置(例如,电子设备的存储器)接收信号。又例如,接口电路1902可用于向其它装置(例如处理器1901)发送信号。
例如,接口电路1902可读取电子设备中存储器中存储的指令,并将该指令发送给处理器1901。当所述指令被处理器1901执行时,可使得电子设备(如图3所示的电子设备)执行上述实施例中电子设备所执行的各个功能或者步骤。
当然,该芯片***还可以包含其他分立器件,本申请实施例对此不作具体限定。
本申请另一实施例提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在电子设备上运行时,使得电子设备执行上述方法实施例中电子设备所执行的各个功能或者步骤。
本申请另一实施例提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行上述方法实施例中电子设备所执行的各个功能或者步骤。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以 完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,如:程序。该软件产品存储在一个程序产品,如计算机可读存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
例如,本申请实施例还可以提供一种计算机可读存储介质,其上存储有计算机程序指令。当计算机程序指令被电子设备执行时,使得电子设备实现如前述方法实施例中所述的音频播放方法。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (25)

  1. 一种音频播放方法,其特征在于,应用于电子设备,所述电子设备包括屏幕发声器件和扬声器;
    所述方法包括:
    接收音频播放指令;所述音频播放指令用于指示所述电子设备播放第一音频;
    响应于接收到所述音频播放指令,通过所述屏幕发声器件播放检测音频;
    在播放所述检测音频的过程中,获取第一参数;所述第一参数为所述屏幕发声器件的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种;
    根据所述第一参数,确定所述屏幕发声器件是否失效;
    在所述屏幕发声器件失效的情况下,切换发声器件为扬声器,通过所述扬声器播放第一音频;
    在所述屏幕发声器件未失效的情况下,通过所述屏幕发声器件播放第一音频,或者通过所述屏幕发声器件和所述扬声器同时播放第一音频。
  2. 根据权利要求1所述的方法,其特征在于,所述检测音频为第二音频;所述第二音频为与所述第一音频不同的音频信号;
    所述响应于接收到所述音频播放指令,通过所述屏幕发声器件播放检测音频,包括:
    响应于接收到所述音频播放指令,在播放所述第一音频之前,通过所述屏幕发声器件播放所述第二音频。
  3. 根据权利要求1所述的方法,其特征在于,所述检测音频为所述第一音频;
    所述在播放所述检测音频的过程中,获取第一参数,包括:
    在播放所述检测音频的过程中,按照预设周期获取所述第一参数。
  4. 根据权利要求1所述的方法,其特征在于,若所述电子设备的电池电量大于预设阈值,则所述检测音频为所述第一音频;
    所述在播放所述检测音频的过程中,获取第一参数,包括:
    在播放所述检测音频的过程中,按照预设周期获取所述第一参数;
    或者,
    若所述电子设备的电池电量小于或等于预设阈值,则所述检测音频为第二音频;所述第二音频为与所述第一音频不相同的音频信号;
    所述响应于接收到所述音频播放指令,通过所述屏幕发声器件播放检测音频,包括:
    响应于接收到所述音频播放指令,在播放所述第一音频之前,通过所述屏幕发声器件播放所述第二音频。
  5. 根据权利要求2或4所述的方法,其特征在于,所述第二音频包括人耳不可听的单音频信号,或者与所述第一音频不同的人耳可听的音频信号。
  6. 根据权利要求1至5任一项所述的方法,其特征在于,所述音频播放指令包括通话指令、音乐播放指令或视频文件播放指令。
  7. 根据权利要求1至6任一项所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时负载电流;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时负载电流大于电流阈值范围的最大值,或者所述屏幕发 声器件的实时负载电流小于所述电流阈值范围的最小值,则确定所述屏幕发声器件失效;所述电流阈值范围为:所述屏幕发声器件未失效时对应于第一频率的电流范围;所述第一频率为所述检测音频的中心频点的频率。
  8. 根据权利要求1至7任一项所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时负载电压;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时负载电压大于电压阈值范围的最大值,或者所述屏幕发声器件的实时负载电压小于所述电压阈值范围的最小值,则确定所述屏幕发声器件失效;所述电压阈值范围为:所述屏幕发声器件未失效时对应于第一频率的电压范围;所述第一频率为所述检测音频的中心频点的频率。
  9. 根据权利要求1至8任一项所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时阻抗;所述屏幕发声器件的实时阻抗由所述屏幕发声器件的实时负载电压和实时负载电流确定;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时阻抗大于阻抗阈值范围的最大值,或者所述屏幕发声器件的实时阻抗小于所述阻抗阈值范围的最小值,则确定所述屏幕发声器件失效;所述阻抗阈值范围为:所述屏幕发声器件未失效时对应于第一频率的阻抗范围;所述第一频率为所述检测音频的中心频点的频率。
  10. 根据权利要求1至9任一项所述的方法,其特征在于,所述第一参数包括:所述屏幕发声器件的实时导纳;所述屏幕发声器件的实时导纳由所述屏幕发声器件的实时负载电压和实时负载电流确定;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时导纳大于导纳阈值范围的最大值,或者所述屏幕发声器件的实时导纳小于所述导纳阈值范围的最小值,则确定所述屏幕发声器件失效;所述导纳阈值范围为:所述屏幕发声器件未失效时对应于第一频率的导纳范围;所述第一频率为所述检测音频的中心频点的频率。
  11. 根据权利要求7或9或10所述的方法,其特征在于,所述屏幕发声器件的实时负载电流为:所述屏幕发声器件播放N帧所述检测音频时,检测得到的M个反馈电流的平均值;其中,N、M均为大于1的正整数。
  12. 根据权利要求8至10任一项所述的方法,其特征在于,所述屏幕发声器件的实时负载电压为:所述屏幕发声器件播放N帧所述检测音频时,检测得到的M个反馈电压的平均值;其中,N、M均为大于1的正整数。
  13. 根据权利要求7至12任一项所述的方法,其特征在于,所述屏幕发声器件的实时负载电压或所述屏幕发声器件的实时负载电流,由智能功放模块获取。
  14. 根据权利要求1至13任一项所述的方法,其特征在于,所述方法还包括:
    在所述屏幕发声器件失效的情况下,显示预设提示框;所述预设提示框包括提示信息;所述提示信息用于指示所述屏幕发声器件已失效。
  15. 根据权利要求1至14任一项所述的方法,其特征在于,所述方法还包括:
    在所述屏幕发声器件失效的情况下,关闭所述屏幕发声器件。
  16. 一种屏幕发声器件的失效检测方法,其特征在于,应用于电子设备,所述电子设备包括屏幕发声器件,所述方法包括:
    响应于预设操作或基于预设时间点,通过所述屏幕发声器件播放检测音频;
    在播放所述检测音频的过程中,获取第一参数;所述第一参数为所述屏幕发声器件的实时负载电流、实时负载电压、实时阻抗和实时导纳中的至少一种;
    根据所述第一参数,确定所述屏幕发声器件是否失效。
  17. 根据权利要求16所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时负载电流;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时负载电流大于电流阈值范围的最大值,或者所述屏幕发声器件的实时负载电流小于所述电流阈值范围的最小值,则确定所述屏幕发声器件失效;所述电流阈值范围为:所述屏幕发声器件未失效时对应于第一频率的电流范围;所述第一频率为所述检测音频的中心频点的频率。
  18. 根据权利要求16或17所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时负载电压;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时负载电压大于电压阈值范围的最大值,或者所述屏幕发声器件的实时负载电压小于所述电压阈值范围的最小值,则确定所述屏幕发声器件失效;所述电压阈值范围为:所述屏幕发声器件未失效时对应于第一频率的电压范围;所述第一频率为所述检测音频的中心频点的频率。
  19. 根据权利要求16至18任一项所述的方法,其特征在于,所述第一参数包括所述屏幕发声器件的实时阻抗;所述屏幕发声器件的实时阻抗由所述屏幕发声器件的实时负载电压和实时负载电流确定;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时阻抗大于阻抗阈值范围的最大值,或者所述屏幕发声器件的实时阻抗小于所述阻抗阈值范围的最小值,则确定所述屏幕发声器件失效;所述阻抗阈值范围为:所述屏幕发声器件未失效时对应于第一频率的阻抗范围;所述第一频率为所述检测音频的中心频点的频率。
  20. 根据权利要求16至19任一项所述的方法,其特征在于,所述第一参数包括:所述屏幕发声器件的实时导纳;所述屏幕发声器件的实时导纳由所述屏幕发声器件的实时负载电压和实时负载电流确定;
    根据所述第一参数,确定所述屏幕发声器件是否失效,包括:
    若所述屏幕发声器件的实时导纳大于导纳阈值范围的最大值,或者所述屏幕发声器件的实时导纳小于所述导纳阈值范围的最小值,则确定所述屏幕发声器件失效;所述导纳阈值范围为:所述屏幕发声器件未失效时对应于第一频率的导纳范围;所述第一频率为所述检测音频的中心频点的频率。
  21. 根据权利要求17或19或20所述的方法,其特征在于,所述屏幕发声器件的实时负载电流为:所述屏幕发声器件播放N帧所述检测音频时,检测得到的M个反馈电流的平均值;其中,N、M均为大于1的正整数。
  22. 根据权利要求18至20任一项所述的方法,其特征在于,所述屏幕发声器件的实时负载电压为:所述屏幕发声器件播放N帧所述检测音频时,检测得到的M个反馈电压的平均值;其中,N、M均为大于1的正整数。
  23. 根据权利要求17至22任一项所述的方法,其特征在于,所述屏幕发声器件的实时负载电压或所述屏幕发声器件的实时负载电流,由智能功放模块获取。
  24. 一种电子设备,其特征在于,所述电子设备包括:
    屏幕发声器件;
    扬声器;
    一个或多个处理器;
    存储器;
    通信模块;
    其中,所述屏幕发声器件和所述扬声器均用于播放所述电子设备的声音信号;所述通信模块用于与外接设备通信;
    所述存储器中存储有一个或多个计算机程序,所述一个或多个计算机程序包括指令,当所述指令被所述处理器执行时,使得所述电子设备执行如权利要求1-23中任一项所述的方法。
  25. 一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1-23中任一项所述的方法。
PCT/CN2022/093638 2021-07-23 2022-05-18 音频播放方法、屏幕发声器件的失效检测方法及电子设备 WO2023000795A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22844962.5A EP4254168A4 (en) 2021-07-23 2022-05-18 AUDIO PLAYBACK METHOD, ERROR DETECTION METHOD FOR A SCREEN SOUND GENERATING DEVICE AND ELECTRONIC DEVICE
US18/270,650 US20240069862A1 (en) 2021-07-23 2022-05-18 Audio playback method, failure detection method for screen sound production component, and electronic device

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202110839831 2021-07-23
CN202110839831.8 2021-07-23
CN202111094726.2A CN115686425A (zh) 2021-07-23 2021-09-17 音频播放方法、屏幕发声器件的失效检测方法及电子设备
CN202111094726.2 2021-09-17

Publications (1)

Publication Number Publication Date
WO2023000795A1 true WO2023000795A1 (zh) 2023-01-26

Family

ID=84978916

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/093638 WO2023000795A1 (zh) 2021-07-23 2022-05-18 音频播放方法、屏幕发声器件的失效检测方法及电子设备

Country Status (3)

Country Link
US (1) US20240069862A1 (zh)
EP (1) EP4254168A4 (zh)
WO (1) WO2023000795A1 (zh)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030069255A (ko) * 2002-02-19 2003-08-27 삼성전자주식회사 스피커의 음질 및 특성 테스트 시스템 및 그 방법
CN202406292U (zh) * 2011-11-25 2012-08-29 常州中策仪器有限公司 一种用于压电陶瓷扬声器的可靠性测试***
US20150084902A1 (en) * 2012-05-29 2015-03-26 Kyocera Corporation Electronic device, non-transitory computer-readable recording medium, and method for controlling electronic device
CN108616797A (zh) * 2018-05-23 2018-10-02 歌尔股份有限公司 直驱式激励器以及屏幕发声装置
CN109032556A (zh) * 2018-07-09 2018-12-18 Oppo广东移动通信有限公司 发声控制方法、装置、电子装置以及存储介质
CN109086022A (zh) * 2018-07-09 2018-12-25 Oppo广东移动通信有限公司 发声控制方法、装置、电子装置以及存储介质
CN109361797A (zh) * 2018-10-30 2019-02-19 维沃移动通信有限公司 一种发声方法及移动终端
CN110018808A (zh) * 2018-12-25 2019-07-16 瑞声科技(新加坡)有限公司 一种音质调整方法及装置
CN110868683A (zh) * 2019-11-05 2020-03-06 维沃移动通信有限公司 超声模块失效检测方法及电子设备
CN112047734A (zh) * 2020-09-16 2020-12-08 中科传感技术(青岛)研究院 一种屏幕发声用压电陶瓷及制备方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102419512B1 (ko) * 2017-12-08 2022-07-12 삼성전자주식회사 복수의 스피커의 상태에 기반하여 오디오 신호의 볼륨 레벨을 제어하는 방법 및 전자 장치
KR102183339B1 (ko) * 2019-08-21 2020-11-26 박인구 장애진단을 통한 앰프와 스피커 보호용 스위칭 장치 및 그 방법

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030069255A (ko) * 2002-02-19 2003-08-27 삼성전자주식회사 스피커의 음질 및 특성 테스트 시스템 및 그 방법
CN202406292U (zh) * 2011-11-25 2012-08-29 常州中策仪器有限公司 一种用于压电陶瓷扬声器的可靠性测试***
US20150084902A1 (en) * 2012-05-29 2015-03-26 Kyocera Corporation Electronic device, non-transitory computer-readable recording medium, and method for controlling electronic device
CN108616797A (zh) * 2018-05-23 2018-10-02 歌尔股份有限公司 直驱式激励器以及屏幕发声装置
CN109032556A (zh) * 2018-07-09 2018-12-18 Oppo广东移动通信有限公司 发声控制方法、装置、电子装置以及存储介质
CN109086022A (zh) * 2018-07-09 2018-12-25 Oppo广东移动通信有限公司 发声控制方法、装置、电子装置以及存储介质
CN109361797A (zh) * 2018-10-30 2019-02-19 维沃移动通信有限公司 一种发声方法及移动终端
CN110018808A (zh) * 2018-12-25 2019-07-16 瑞声科技(新加坡)有限公司 一种音质调整方法及装置
CN110868683A (zh) * 2019-11-05 2020-03-06 维沃移动通信有限公司 超声模块失效检测方法及电子设备
CN112047734A (zh) * 2020-09-16 2020-12-08 中科传感技术(青岛)研究院 一种屏幕发声用压电陶瓷及制备方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4254168A4

Also Published As

Publication number Publication date
EP4254168A1 (en) 2023-10-04
EP4254168A4 (en) 2024-06-19
US20240069862A1 (en) 2024-02-29

Similar Documents

Publication Publication Date Title
CN103581791B (zh) 移动设备及其控制方法
CN110166890B (zh) 音频的播放采集方法、设备及存储介质
JP2023532078A (ja) ヘッドセットノイズ処理方法、装置及びヘッドセット
CN108810198B (zh) 发声控制方法、装置、电子装置及计算机可读介质
WO2021139535A1 (zh) 播放音频的方法、装置、***、设备及存储介质
CN110989961A (zh) 一种声音处理方法及其装置
CN109524016B (zh) 音频处理方法、装置、电子设备及存储介质
WO2022068694A1 (zh) 电子设备及其唤醒方法
WO2023103503A1 (zh) 频率响应一致性的校准方法及电子设备
WO2023000795A1 (zh) 音频播放方法、屏幕发声器件的失效检测方法及电子设备
CN115643339B (zh) 调节音量的方法、电子设备及计算机可读存储介质
CN116095595B (zh) 音频处理方法和装置
CN115686425A (zh) 音频播放方法、屏幕发声器件的失效检测方法及电子设备
CN116567489B (zh) 一种音频数据处理方法及相关装置
WO2023160204A1 (zh) 音频处理方法及电子设备
WO2024082855A1 (zh) 一种音频业务处理方法、电子设备及计算机存储介质
CN115623123B (zh) 一种音频处理方法及设备
WO2024093452A1 (zh) 通话控制方法、电子设备及存储介质
CN116744187B (zh) 扬声器控制方法及设备
CN109144462A (zh) 发声控制方法、装置、电子装置及计算机可读介质
CN113163305B (zh) 音频播放终端及其扬声器的保护方法
CN111866226B (zh) 终端及发声方法
WO2024046416A1 (zh) 一种音量调节方法、电子设备及***
CN117692848A (zh) 驱动发声器件进行发声的方法及相关装置
WO2020097914A1 (zh) 一种音频模式调节的方法、装置及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22844962

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18270650

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2022844962

Country of ref document: EP

Effective date: 20230629

NENP Non-entry into the national phase

Ref country code: DE