CN117939343A - Earphone, vibration measuring method and computer readable medium - Google Patents

Earphone, vibration measuring method and computer readable medium Download PDF

Info

Publication number
CN117939343A
CN117939343A CN202211255952.9A CN202211255952A CN117939343A CN 117939343 A CN117939343 A CN 117939343A CN 202211255952 A CN202211255952 A CN 202211255952A CN 117939343 A CN117939343 A CN 117939343A
Authority
CN
China
Prior art keywords
vibration
signal
frequency
processor
tympanic membrane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211255952.9A
Other languages
Chinese (zh)
Inventor
刘福龙
彭霄
吴英超
曾子敬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202211255952.9A priority Critical patent/CN117939343A/en
Publication of CN117939343A publication Critical patent/CN117939343A/en
Pending legal-status Critical Current

Links

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The application discloses an earphone, a vibration measurement method and a computer readable medium, relating to the technical field of earphones, wherein the earphone comprises: the device comprises an exciter, a detector and a processor, wherein the exciter and the detector are connected with the processor, the exciter is used for outputting an excitation signal towards the tympanic membrane, and the excitation signal is used for exciting the tympanic membrane to vibrate; the detector is used for transmitting a detection signal towards the tympanic membrane in a vibration state, receiving the detection signal reflected by the tympanic membrane, serving as a reflected signal, and sending the reflected signal to the processor; the processor is configured to obtain a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal. The vibration characteristic of the eardrum can be detected rapidly through the earphone, and in the environment with the auditory canal being more closed, the interference suffered by the detection process is smaller, and the detected data are more reliable.

Description

Earphone, vibration measuring method and computer readable medium
Technical Field
The present application relates to the field of headphones technology, and more particularly, to a headphone, a vibration measurement method, and a computer-readable medium.
Background
The current personal audio devices such as smart phones and walkman have increasingly improved use rates for listening to audio, and thus the anxiety of hearing impairment is also increasingly raised. However, most of the hearing testers currently use specialized knowledge to perform hearing test, and thus, a device for conveniently and rapidly detecting the vibration characteristics of the tympanic membrane of the user is needed.
Disclosure of Invention
The application provides an earphone, a vibration measuring method and a computer readable medium, so as to improve the defects.
In a first aspect, an embodiment of the present application provides an earphone, including an exciter, a detector, and a processor, where the exciter and the detector are connected to the processor, and the exciter is configured to output an excitation signal toward a tympanic membrane, where the excitation signal is configured to excite the tympanic membrane to vibrate; the detector is used for transmitting a detection signal towards the tympanic membrane in a vibration state, receiving the detection signal reflected by the tympanic membrane, serving as a reflected signal, and sending the reflected signal to the processor; the processor is configured to obtain a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
In a second aspect, an embodiment of the present application further provides a vibration measurement method applied to an earphone, where the earphone includes an exciter, a detector, and a processor, and the exciter and the detector are both connected to the processor, and the method includes: the exciter outputs an excitation signal towards a target object to excite the target object to vibrate; the detector emits a detection signal toward the target object in a vibration state, and receives the detection signal reflected back through the target object as a reflected signal and sends the reflected signal to the processor; the processor obtains a vibration characteristic of the target object based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
In a third aspect, embodiments of the present application also provide a computer readable medium storing program code executable by a processor, the program code when executed by the processor causing the processor to perform the above method.
The application provides a headset, a vibration measurement method and a computer readable medium. The exciter is used for outputting an excitation signal towards the tympanic membrane, and the excitation signal is used for exciting the tympanic membrane to vibrate; the detector is used for transmitting a detection signal towards the tympanic membrane in a vibration state, receiving the detection signal reflected by the tympanic membrane, serving as a reflected signal, and sending the reflected signal to the processor; the processor is configured to obtain a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal. The vibration characteristic of the eardrum can be detected rapidly through the earphone, and in the environment with the auditory canal being more closed, the interference suffered by the detection process is smaller, and the detected data are more reliable.
Additional features and advantages of embodiments of the application will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of embodiments of the application. The objectives and other advantages of embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present application;
fig. 2 shows a schematic connection diagram of an electronic device in a headset according to an embodiment of the application;
Fig. 3 shows a schematic connection diagram of an electronic device in a headset according to another embodiment of the present application;
FIG. 4 is a schematic waveform diagram of an excitation signal according to an embodiment of the present application;
fig. 5 is a schematic diagram of an earphone in a wearing state according to an embodiment of the present application;
FIG. 6 shows a block diagram of a detector provided by an embodiment of the application;
Fig. 7 is a schematic diagram showing connection of electronic devices in a headset according to another embodiment of the present application;
Fig. 8 is a schematic view showing a vibration characteristic curve of a tympanic membrane according to an embodiment of the present disclosure;
Fig. 9 is a schematic diagram showing the performance of vibration characteristics of a tympanic membrane on various frequency bands according to an embodiment of the present disclosure;
FIG. 10 is a flow chart illustrating a method of vibration measurement according to one embodiment of the present application;
FIG. 11 is a block diagram of a square module of a vibration measuring apparatus according to an embodiment of the present application;
FIG. 12 is a block diagram of an electronic device according to an embodiment of the present application;
FIG. 13 shows a block diagram of a computer readable medium provided by an embodiment of the application;
Fig. 14 shows a block diagram of a computer program product provided by an embodiment of the application.
Detailed Description
In order to make the present application better understood by those skilled in the art, the following description will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the application, as presented in the figures, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance.
The current personal audio devices such as smart phones and walkman have increasingly improved use rates for listening to audio, and thus the anxiety of hearing impairment is also increasingly raised. The vibration characteristics of the tympanic membrane are strongly correlated to the state of hearing health. However, most of the hearing testers currently use specialized knowledge to perform hearing test, and thus, a device for conveniently and rapidly detecting the vibration characteristics of the tympanic membrane of the user is needed.
In order to conveniently and quickly detect the vibration characteristics of the tympanic membrane of a user, the detector is arranged on the earphone, and the detector can change the waveform, such as frequency, phase or energy after being reflected by the vibrating tympanic membrane, so that the characteristics of vibration amplitude, vibration frequency and the like of the tympanic membrane can be detected and obtained based on the change, and in a more closed environment of the auditory canal, the interference on the detection process is smaller, and the detected data is more reliable.
It should be noted that, before describing the structure provided by the embodiment of the present application, a general structure of the earphone is described. As shown in fig. 1, the earphone 10 includes a main body including a front cover 120, a rear case 110, and a speaker (not shown in fig. 1), as shown in fig. 2. The front cover 120 covers the rear case 110, the front cover 120 and the rear case 110 form an accommodating space, the speaker is fixed in the accommodating space, and the sound emitting part of the speaker faces the front cover 120. The front cover 120 and the rear case 110 are made of plastic or metal so that the main body is of a hard structure to protect the electronic components inside the main body. The end surface of the front cover 120, which is far away from the end of the rear case 110, forms an end surface 121, the front cover 120 includes a sound outlet nozzle 126 protruding from the end surface 121, the sound outlet nozzle 126 may have a cylindrical structure (the shape is not limited herein), the sound outlet nozzle 126 is provided with a sound outlet channel 128 communicating with the accommodating space, and sound emitted from the speaker can be transmitted through the sound outlet channel 128. The tip of play sound mouth 126 keeping away from terminal surface 121 is equipped with screens 127, and screens 127 enclose to establish in the periphery of play sound mouth 126, and the outline diameter of the cross-section of screens 127 is greater than the diameter of the outline of play sound mouth 126's cross-section for earplug 300 detachably installs in the main part, and screens 127 can block earplug 300, avoid earplug 300 to drop. The front cover 120 and the rear case 110 may be integrally formed, or may be detachable, and are not limited herein. In another embodiment, the cross section of the sound outlet 126 may have an outer contour of a triangle, a quadrangle, a pentagon, or the like, which is not particularly limited herein. An external microphone is provided in the earphone, and as shown in fig. 2, an external sound pickup port 111 is also provided in the rear case 110, and ambient noise around the external microphone is picked up through the external sound pickup port 111. As shown in fig. 1, the earphone includes a processor 101, a memory 102, a power supply circuit 103, an external microphone 104, an operational amplifier 105 and a speaker 106, where the power supply circuit 103 is connected to the processor 101, the memory 102 and the external microphone 104, respectively, the power supply circuit 103 is used to supply power to the processor 101, the memory 102 and the external microphone 104, and after the processor 101 amplifies the audio data to be played by the operational amplifier 105, the audio data is played by the speaker 106, and then transferred to the ear of the user through an audio output channel 128. The external microphone 104 is capable of capturing ambient noise, the processor generates inverse noise based on the ambient noise, and the speaker 106 is configured to play the inverse noise, thereby achieving the objective of eliminating the noise.
Referring to fig. 2, fig. 2 shows a headset comprising an exciter 210, a detector 220 and a processor 203, both the exciter 210 and the detector 220 being connected to the processor 203. The exciter 210 is configured to output an excitation signal toward the tympanic membrane, the excitation signal being configured to excite the tympanic membrane to vibrate. The detector 220 is configured to emit a detection signal toward the tympanic membrane in a vibration state, and to receive the detection signal reflected back through the tympanic membrane as a reflected signal and to transmit the reflected signal to the processor. The processor 203 is configured to derive a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
Illustratively, the exciter 210 has an excitation signal having a wavelength that is radiated outwardly, which may be acoustic, for example, with the exciter 210 emitting the excitation signal in a direction toward the tympanic membrane. The direction of emission of the excitation signal by the exciter 210 will be described below in connection with the structure of the earphone.
As an embodiment, the exciter 210 may be a device capable of emitting sound waves other than the above speaker, that is, in the case where the earphone is provided with the speaker, the exciter 210 is further provided, and since the exciter 210 needs to be capable of emitting signals of different frequencies when the vibration characteristics of the eardrum with respect to different frequencies need to be measured, even the exciter 210 needs to be controlled to sequentially emit signals of different frequencies by sweeping, the device capable of emitting sound waves other than one speaker may be provided outside the earphone in the case where the speaker does not have a sweeping function. The direction of emission of the excitation signal of the exciter 210 is far from the rear housing 110, that is, away from the rear housing 110, and may be, for example, the same direction as the end face 121 of the front cover 120, which is disposed at the end far from the rear housing 110, so that the direction of emission of the excitation signal of the exciter 210 is exactly toward the eardrum of the wearer when the earphone is worn by the user. For example, the exciter 210 may be disposed in the receiving space formed by the front cover 120 and the rear case 110, and the transmitting direction of the exciting signal of the exciter 210 is toward the sound outlet of the earphone, that is, the aforementioned sound outlet channel 128, and the exciting signal of the exciter 210 may be transmitted to the eardrum of the wearer through the sound outlet channel 128, and may be vibrated after reaching the eardrum.
As another embodiment, the exciter 210 may include the above-mentioned speaker of the earphone in consideration of the size, power consumption, and cost of the earphone, that is, the exciter 210 may emit an excitation signal toward the eardrum of the wearer through the speaker of the earphone. Illustratively, the exciter 210 includes a speaker, the processor 203 has an audio codec built-in, either as an electronic component within the processor or as a program module, and the audio encoder is configured to trigger the speaker to vibrate based on the specified audio signal to play the excitation signal toward the tympanic membrane, i.e., to generate a drive signal capable of driving the speaker to occur based on the specified audio signal. It should be noted that the audio codec may also be an external processor and belong to an electronic component of the exciter, as shown in fig. 3, the exciter 210 includes a speaker 212 and an audio codec 211, the processor 203 is connected to the audio codec 211, and the audio codec 211 is connected to the speaker 212. The processor 203 is configured to input a specified audio signal to the audio encoder, the audio encoder being configured to trigger the speaker to vibrate based on the specified audio signal to play the excitation signal toward the tympanic membrane.
Illustratively, the audio encoder 211 is configured to control the speaker 212 to vibrate, i.e., to parse a specified signal into a driving signal, and to input the driving signal to the speaker to drive the speaker to vibrate. The specified audio signal may be an audio signal of a single frequency, and accordingly, the speaker outputs an excitation signal that is an acoustic wave of the same frequency as the first frequency of the specified audio signal based on the audio signal of the first frequency. Illustratively, the audio encoder 211 may be an audio encoding chip, corresponding to a sound card, for example, the audio encoder 211 may be a DAC chip, which is not limited herein. Therefore, when the vibration of the tympanic membrane is excited by an excitation signal with a single frequency, the vibration characteristic of the tympanic membrane vibration at the frequency can be detected by the detector, and the vibration characteristic of the tympanic membrane can be conveniently corresponding to the frequency.
In order to be able to measure the vibration characteristics of the tympanic membrane at a plurality of different frequencies, it is necessary to set the frequencies of the specific audio signal differently, that is, the exciter may output excitation signals of different vibration frequencies towards the target object, each of the excitation signals of different vibration frequencies corresponding to a frequency point. For example, the exciter may control the speaker 212 to vibrate based on the specified audio signals of different frequency points according to the preset frequency sweep strategy to trigger the speaker 212 to play the excitation signals of different frequencies, wherein the specified audio signals of different frequency points may be sent to the audio codec by the processor, and the audio codec 211 may control the speaker 212 to vibrate based on the specified audio signals of different frequency points according to the preset frequency sweep strategy to trigger the speaker 212 to play the excitation signals of different frequencies. Of course, the audio codec 211 may generate the specified audio signals of different frequency points according to the preset frequency sweep strategy, and then generate the driving signals corresponding to the specified audio signals of each frequency point to drive the speaker to generate. It should be noted that the foregoing different vibration frequencies may include a plurality of vibration frequencies, and the plurality of vibration frequencies may cover a preset hearing range, which is at least a partial range of the hearing frequency range of the human ear.
For example, a frequency emission sequence may be preset, for example, f= [ f1, f2 … fn ], where f1, f2 … fn are frequency points of the specified audio signal, and the preset frequency sweep strategy is to sequentially send the audio signals of each frequency point in the frequency emission sequence according to the frequency emission sequence. It is assumed that, as shown in fig. 4, the audio signal is a sine wave signal with an amplitude a, and the frequency of the sine wave signal is f, where f is sequentially changed into each frequency in the frequency transmission sequence according to the foregoing preset sweep strategy.
As an embodiment, the audio encoder 211 may pre-store a specific audio signal corresponding to each frequency point in the frequency emission sequence, and the processor 203 is configured to trigger the audio encoder 211 to adjust the pre-stored specific audio signal to a driving signal, and send the driving light signal to the speaker 212. As another embodiment, the audio encoder 211 may have a signal generator built in, and the processor 203 sends each frequency value to the audio encoder 211, that is, the processor 203 sends a frequency point corresponding to the vibration characteristic of the tympanic membrane to be detected to the audio encoder 211, and the audio encoder 211 controls the speaker 212 to send an excitation signal corresponding to the frequency point to be detected so as to excite the tympanic membrane to vibrate at different frequencies. As yet another embodiment, the processor 203 may also send the specified audio signal directly to the audio encoder 211, for example, the processor 203 sends the specified audio signal of different frequencies to the signal encoder according to a preset sweep strategy. Illustratively, the audio codec 211 and the processor 203 are connected through an audio data transmission (INTEGRATED INTERCHIP Sound, I2S) protocol, and the processor 203 transmits the specified audio signal to the audio encoder 211 through the I2S protocol.
In an embodiment of the present application, the detector 220 is configured to emit a detection signal toward the tympanic membrane in a vibration state, and receive the detection signal reflected back through the tympanic membrane as a reflected signal, and send the reflected signal to the processor. The detection signal may be an electromagnetic wave, for example, may be a radio wave such as an ultrasonic wave, a microwave, etc., and in the embodiment of the present application, the detection signal may be selected to be a microwave, for example, the detection signal is a millimeter wave, and the detector 220 is a millimeter wave sensor, for example, the center frequency of the detector is 24G or 60GHz. As shown in fig. 5, the detector 220 and the exciter 210 are both disposed on the circuit board 230 of the headset, and the processor 203 is also disposed on the circuit board 230. The signal emission directions of the detector 220 and the exciter 210 are both towards the tympanic membrane 30, the processor 203 may control the exciter 210 to emit an excitation signal, the excitation signal reaches the tympanic membrane 30 to drive the tympanic membrane 30 to vibrate, then, the processor 203 controls the detector 220 to emit a detection signal to the tympanic membrane 30, the tympanic membrane 30 is in a vibration state, the vibrating tympanic membrane 30 reflects the detection signal back to the detector 220, and the detection signal is received by the detector 220, so as to obtain a reflected signal, and the processor 203 obtains vibration characteristics of the tympanic membrane based on the reflected signal.
As illustrated in fig. 6 and 7, the detector 220 may include a transmitting antenna 221, a transmitting circuit 222, a control circuit 223, a receiving circuit 224, and a receiving antenna 225, the transmitting antenna 221 is connected to the transmitting circuit 222, the receiving antenna 225 is connected to the receiving circuit 224, the transmitting circuit 222 and the receiving circuit 224 are both connected to the control circuit 223, the processor 203 is connected to the control circuit 223, and the control circuit 223 is configured to control the transmitting circuit 222 to transmit a detection signal to the tympanic membrane in a vibration state through the transmitting antenna 221, receive the reflection signal through the receiving antenna 225 and the receiving circuit 224, and input the reflection signal to the processor 203.
It should be noted that, in some embodiments, the detector may be a millimeter wave sensor, where the millimeter wave sensor may detect minute vibrations, so that the sensitivity of vibration detection with respect to the magnitude of the minute vibrations is high, and by adjusting the transmitting and receiving frequencies of the millimeter wave sensor, vibrations in a high-frequency response may also be detected, so that the millimeter wave sensor may well detect the frequency response characteristics of the tympanic membrane at different excitation frequencies. The loudspeaker can be a small-size loudspeaker based on MEMS, which is more beneficial to the structural space of the earphone. Furthermore, the millimeter wave sensor is connected with the processor through a synchronous serial communication (SERIAL PERIPHERAL INTERFACE Bus, SPI) protocol, a reflected signal received by the millimeter wave sensor is sent to the processor 203 through the SPI protocol, and a control command of the processor may also be sent to the millimeter wave sensor through the SPI protocol.
For some embodiments, the transmitting circuit 222 may transmit the detection signal to the detected tympanic membrane of the user based on the control of the control circuit 223, and the transmitting circuit 222 may modulate the detection signal to radiate the detection signal outwards through the transmitting antenna 221; the receiving circuit 224 may obtain a detection signal reflected from the measured tympanic membrane based on control of the control circuit 223, and the receiving antenna 225 may transmit the received wireless signal to the receiving circuit 224, and the receiving circuit 224 modulates the signal to obtain a reflected signal, and transmits the reflected signal to the control circuit 223, which in turn transmits the reflected signal to the processor 203. The control circuit 223 may be a micro control unit (Microcontroller Unit, MCU), a digital signal Processing unit (DIGITAL SIGNAL Processing, DSP), or the like.
In an embodiment of the present application, the processor 203 may analyze the reflected signal to obtain the vibration characteristics of the tympanic membrane. For example, when the tympanic membrane is vibrated by the excitation signal, the position of the tympanic membrane in vibration corresponds to the position of the earphone, and is in a relatively far away and near state, that is, when the detector 220 emits the detection signal toward the tympanic membrane in vibration, the tympanic membrane corresponds to the tympanic membrane in doppler motion, and according to the doppler effect, the wavelength of the object radiation changes due to the relative motion of the wave source (mobile terminal) and the observer (object), the doppler effect equation is as follows:
f' is the observed frequency; f is the original emission frequency from which the emission originated in the medium; v is the propagation velocity of the wave in the medium; v 0 is the moving speed of the observer, if the observer approaches the emission source, the front operation symbol is +number, otherwise, the front operation symbol is-number; v s is the moving speed of the emission source, if the emission source is close to the observer, the front operation sign is the number-and vice versa is the number +and vice versa.
As shown by the doppler effect formula, when the emission source is relatively close to the observer, the frequency of the signal received by the observer becomes large; when the emission source is relatively far away from the observer, the frequency of the signal received by the observer becomes small; when the emission source is relatively stationary with respect to the observer, the observer receives a signal at a frequency consistent with the emission source. That is, assuming that the tympanic membrane is in an unoibrated state (the position is referred to as a resting position), the number of wavelengths experienced from the transmitting antenna to the resting position is the same as the format of wavelengths experienced between the positions at which the resting position is reflected to the receiving antenna during the detection signal emitted by the detector 220 toward the tympanic membrane, and at this time, the frequency of the reflected signal is not shifted. And when the tympanic membrane is in vibration, the frequency of the detection signal reflected by the tympanic membrane becomes larger when the tympanic membrane is moved in a direction approaching the detector 220, and the frequency of the detection signal reflected by the tympanic membrane becomes smaller when the tympanic membrane is moved in a direction separating from the detector 220. This shift in frequency corresponds to the number of wavelength variations experienced by the foregoing emission and reflection processes, and is represented in the time domain as a change in phase, and in general, the distance between the position of the tympanic membrane and the detector 220 is proportional to the phase difference between the detection signal emitted by the detector and the reflected signal reflected by the received tympanic membrane. The vibration detection process is actually a process of detecting a plurality of times to obtain the maximum displacement of the vibration of the tympanic membrane and a time point of the maximum displacement, and the maximum displacement corresponds to the vibration amplitude.
Currently, the time difference determination method and the phase difference determination method determine the distance between the detector and the tympanic membrane. The time difference method is that a transmitting circuit of a detector of the earphone transmits detection signals at intervals through a transmitting antenna, a receiving circuit of the detector of the earphone receives the reflected and direct detection signals through a receiving antenna, an algorithm determines the relative distance between a target object and the detector by comparing the time differences of the received different detection signals, the relative speed can be calculated through the relative distance, and further vibration characteristics such as vibration speed, vibration frequency and the like are determined. In addition, the phase difference method is that a transmitting circuit of a detector of the earphone transmits detection signals through a transmitting antenna interval, a receiving circuit of the detector of the earphone receives reflected and direct detection signals through a receiving antenna, a processor determines a phase difference generated by the detector after the detection signals are reflected by calculating correlation indexes between the transmission signals and the receiving signals, and determines a relative distance between a shielding object and the mobile terminal according to the phase difference, so as to determine vibration characteristics such as vibration speed, vibration frequency and the like.
As one embodiment, since the excitation signal emitted by the exciter generates a certain pressure value at the measured tympanic membrane of the user, the excitation signal causes a certain displacement of the measured tympanic membrane to trigger the vibration of the measured tympanic membrane. After the measured tympanic membrane is displaced, the distance that the measured tympanic membrane passes through when the measured tympanic membrane receives the reflected excitation signal is prolonged, and the time that the measured tympanic membrane receives the excitation signal is prolonged, so that a displacement-time relation curve can be drawn according to the reflected signal received by the receiving circuit, wherein the displacement can be determined based on the speed of the signal and the time length that the measured tympanic membrane passes through. The displacement versus time curve can be used to characterize the displacement versus time of the tympanic membrane being measured. Based on the relationship between the displacement and time, it can be determined at which point in time the maximum displacement is reached, whereby the amplitude and frequency of vibration of the tympanic membrane can be determined.
As an embodiment, by using the principle that the millimeter wave sensor detects micro-vibration, a signal f (x) is emitted from the millimeter wave sensor, and the emitted signal is reflected at the tympanic membrane, so that the detector 220 obtains a signal g (x), where g (x) includes information about vibration caused by the tympanic membrane after the tympanic membrane is excited by the excitation signal. In the case of an excitation signal driving the tympanic membrane to vibrate, the detection signal reaches the tympanic membrane, is modulated onto the excitation signal as the tympanic membrane vibrates, is reflected back to the detector, i.e. signal g (x), and the vibration signal is obtained by signal processing g (x), i.e. the reflected detection signal is demodulated from the excitation signal, thus obtaining the reflected signal. A processor obtains a frequency of the reflected signal, and obtains a vibration amplitude of the tympanic membrane by a phase estimation method based on a frequency offset between the detected signal and the reflected signal. That is, the processor fourier transforms the transmitted signal to obtain the frequency of the reflected signal, i.e., extracts the frequency of the reflected signal by performing a spectral analysis of the reflected signal, and then obtains the vibration amplitude of the tympanic membrane by a phase estimation method.
As an embodiment, in order to more intuitively understand the vibration characteristics of the tympanic membrane, the vibration characteristic curve of the tympanic membrane may be obtained, as shown in fig. 8, fig. 8 shows the vibration characteristic curve of the tympanic membrane, where the horizontal axis coordinates are each frequency point of the vibration of the tympanic membrane, that is, the frequency point f= [ f1, f2 … fn ] of the excitation signal, the vertical axis corresponds to the attenuation degree of the amplitude of the vibration signal of the tympanic membrane relative to the excitation signal, and the value is a relatively-characterized value, and the calculation mode of the value is 20log (B/a); after the frequency response characteristic curve of the tympanic membrane vibration is obtained, the biomechanical characteristics of the tympanic membrane can be evaluated. The ordinate of the vibration characteristic curve of the tympanic membrane may be the vibration signal amplitude of the tympanic membrane, and is not limited herein.
For example, a certain classification may be performed according to the obtained vibration frequency response characteristic curve of the tympanic membrane, for example, a threshold may be set, where the threshold is a threshold corresponding to each vibration frequency of the tympanic membrane, and by determining a relationship between the vibration amplitude corresponding to each vibration frequency and the threshold, the vibration effect of the tympanic membrane at each frequency may be determined, for example, the vibration amplitude at a low frequency is lower than the threshold at the low frequency, and the difference between the vibration amplitude at the frequency and the threshold at the low frequency is greater than a specified value, and it may be determined that the vibration at the low frequency band of the tympanic membrane is too low.
As an embodiment, as shown in fig. 9, the dashed lines in each frequency response characteristic region in the figure are threshold curves, and curves of the threshold values of each frequency point, if the frequency response characteristic of the full frequency band is lower than the threshold value, it may be determined that the full frequency band is lower; the low frequency band is low, so that the low frequency response characteristic is poor, and the like, the method can be used for pushing to the medium frequency and the high frequency; it is generally considered that f <150Hz is a low frequency band, 150Hz < f <2000Hz is a medium frequency band, 2000Hz < f <80000Hz is a high frequency band.
In addition, in order to avoid the influence of the signals other than the detection signals on the detection result of the vibration characteristics of the tympanic membrane, a filter can be built in the processor, and the processor is used for calling the filter to filter the signals other than the specified frequency band, wherein the specified frequency band is set based on the frequency band of the detection signals. The specified frequency band may be a frequency band of the detection signal, or may be a frequency band based on the detection signal floating up and down by a certain frequency, for example, the frequency band of the detection signal is [18000hz,22000hz ], then the specified frequency band is [18000-aHz, 22000+bhhz ], and the a and b may be set based on actual requirements, so that filtering of the transmitted detection signal can be avoided. For example, a and b may be set based on the frequency difference between the detection signal reflected back from the tympanic membrane and the detection signal emitted by the detector.
In addition, in order to avoid interference of external sounds, the processor may detect the wearing degree of fit before detecting the vibration characteristics of the tympanic membrane, and if the wearing degree of fit meets the wearing requirement, the processor triggers the exciter to output an excitation signal toward the tympanic membrane, then triggers the detector to transmit a detection signal toward the tympanic membrane in a vibration state, and receives the detection signal reflected back through the tympanic membrane as a reflected signal, and transmits the reflected signal to the processor. For example, whether the earphone is in a wearing state is detected, for example, a capacitive touch sensor, a capacitive detector, an infrared sensor and the like are adopted, for example, the capacitive sensor can be caused to change in capacitance value along with the change of the distance between a human body and a metal conductive layer, the capacitive detector can accurately detect a tiny capacitance change amount, and the capacitive detector is connected with the capacitive touch sensor and is used for detecting the capacitance value of the capacitive touch sensor and identifying that the earphone is in the wearing state according to the change trend of the capacitance value. If the earphone is in a worn state, the fitting degree of the earphone is detected. The worn state means that the user wears the earphone on the ear of the user, and the front cover of the earphone contacts with the ear, so that the audio played by the speaker of the earphone can directly enter the ear canal of the user. If the earphone is in-ear, the earplug of the earphone is inserted into the ear canal when the earphone is in a worn state, and audio played by the loudspeaker of the earphone is transmitted into the ear canal of the user through the sound outlet channel wrapped by the earplug.
As one embodiment, the fitting degree of the earphone is used to represent the fitting degree of the earphone to the ear of the user, which can reflect the wearing comfort of the user and the leakage degree, and the fitting degree of the earphone is divided into a normal state and an abnormal state. Wherein, the laminating degree is normal means that the laminating degree satisfies the requirement of wearing, and the laminating degree is unusual means that the ear laminating degree does not satisfy the requirement. Wherein, earphone and user's ear laminating degree can be to the laminating degree of the earplug of earphone and user's ear canal, and this earphone and user's ear laminating degree satisfy the operation requirement and can be to the earphone and do not take place the sound leakage phenomenon, and earphone and user's ear laminating degree do not satisfy the operation requirement and are the earphone and take place the sound leakage phenomenon. It should be noted that, the fact that the earphone does not leak sound may not mean that the earphone leaks sound completely, but the leak sound volume is small, and specifically, whether the fitting degree of the earphone and the user's ear meets the use requirement may be set based on actual use.
Therefore, when the fitting degree of the earphone meets the wearing requirement, that is, when the fitting degree of the earphone and the auditory canal is good, the detection of the vibration characteristics of the eardrum is performed, and the influence of other signals received by the detection of the vibration characteristics of the eardrum can be reduced.
Referring to fig. 10, fig. 10 shows a vibration measurement method according to an embodiment of the present application, where the method is applied to the above-mentioned earphone, and specifically includes: s1001 to S1003.
S1001: the exciter outputs an excitation signal toward the target object to excite the target object to vibrate.
Illustratively, the exciter outputs excitation signals of different vibration frequencies toward the target object.
S1002: a detector emits a detection signal toward the target object in a vibration state, and receives the detection signal reflected back through the target object as a reflected signal and sends the reflected signal to the processor.
S1003: a processor obtains a vibration characteristic of the target object based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
The target object may be an object that can be vibrated, for example, if the excitation signal is an acoustic wave, the target object is an object that can be driven by the acoustic wave.
Illustratively, a processor acquires the frequency of the reflected signal; the processor obtains a vibration amplitude of the target object through a phase estimation method based on a frequency offset between the detection signal and the reflected signal. The processor acquires a reflected signal corresponding to each vibration frequency, and obtains the vibration amplitude corresponding to each vibration frequency based on the reflected signal corresponding to each vibration frequency.
As one embodiment, the processor obtains a reflected signal corresponding to each vibration frequency, obtains a vibration amplitude corresponding to each vibration frequency based on the reflected signal corresponding to each vibration frequency, and then obtains an absolute value of a difference value between the vibration amplitude of each vibration frequency and a reference amplitude of an excitation signal corresponding to the vibration frequency as an attenuation value corresponding to the vibration frequency; and obtaining a frequency response characteristic curve of the vibration of the target object based on all the vibration frequencies and attenuation values corresponding to each vibration frequency. Analyzing the magnitude relation between the attenuation value corresponding to each vibration frequency and the threshold value of the vibration frequency; and determining vibration mechanical characteristics of the target object based on the magnitude relation corresponding to each vibration frequency.
It should be noted that, the portions of the steps not described in detail may refer to the foregoing embodiments, and are not described herein again.
Referring to fig. 11, a block diagram of a vibration measuring apparatus 1100 according to an embodiment of the application is shown, and the apparatus is applied to the earphone. Specifically, the apparatus may include: a playback unit 1101, a detection unit 1102, and an analysis unit 1103.
A playing unit 1101, which is disposed in the exciter, and may be an audio codec, for example, disposed in the exciter, the playing unit 1101 being configured to output an excitation signal toward a target object to excite vibration of the target object.
Further, the playing unit 1101 is further configured to output excitation signals of different vibration frequencies toward the target object.
A detection unit 1102 is arranged in the detector, for example in a control circuit of the detector, which detection unit 1102 is arranged to emit a detection signal towards the target object in a vibrating state and to receive the detection signal reflected back via the target object as a reflected signal and to send the reflected signal to the processor.
And an analysis unit 1103, disposed in the processor, for obtaining a vibration characteristic of the target object based on the reflected signal, where the vibration characteristic corresponds to the frequency of the excitation signal.
Further, the vibration characteristics include a vibration amplitude, and the analysis unit 1103 is further configured to acquire a frequency of the reflected signal; and acquiring the vibration amplitude of the target object through a phase estimation method based on the frequency offset between the detection signal and the reflection signal. Further, the analysis unit 1103 is further configured to obtain a reflected signal corresponding to each vibration frequency, and obtain a vibration amplitude corresponding to each vibration frequency based on the reflected signal corresponding to each vibration frequency.
Further, the analysis unit 1103 is further configured to obtain a reflected signal corresponding to each vibration frequency, obtain, based on the reflected signal corresponding to each vibration frequency, a difference value between the vibration amplitude of each vibration frequency and a reference amplitude of an excitation signal corresponding to the vibration frequency, and then obtain, as an attenuation value corresponding to the vibration frequency, an absolute value of the difference value; and obtaining a frequency response characteristic curve of the vibration of the target object based on all the vibration frequencies and attenuation values corresponding to each vibration frequency.
Further, the analysis unit 1103 is further configured to obtain an absolute value of a difference value between the vibration amplitude of each of the vibration frequencies and the reference amplitude of the excitation signal corresponding to the vibration frequency, and analyze, as an attenuation value corresponding to the vibration frequency, a magnitude relationship between the attenuation value corresponding to each of the vibration frequencies and a threshold value of the vibration frequency; and determining vibration mechanical characteristics of the target object based on the magnitude relation corresponding to each vibration frequency.
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus and modules described above may refer to the corresponding process in the foregoing method embodiment, which is not repeated herein.
In several embodiments provided by the present application, the coupling of the modules to each other may be electrical, mechanical, or other.
In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module. The integrated modules may be implemented in hardware or in software functional modules.
Referring to fig. 12, a block diagram of an electronic device according to an embodiment of the present application is shown. The headset 200 may be an electronic device capable of running applications such as a smart phone, tablet, electronic book, etc. The headset 200 of the present application may include one or more of the following components: a processor 203, a memory 204, and one or more application programs, wherein the one or more application programs may be stored in the memory 204 and configured to be executed by the one or more processors 203, the one or more program(s) configured to perform the method as described in the foregoing method embodiments.
The processor 203 may include one or more processing cores. The processor 203 connects the various parts within the overall headset 200 using various interfaces and lines, performs various functions of the headset 200 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 204, and invoking data stored in the memory 204. Alternatively, the processor 203 may be implemented in at least one hardware form of digital signal Processing (DIGITAL SIGNAL Processing, DSP), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 203 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for being responsible for rendering and drawing of display content; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 203 and may be implemented solely by a communication chip.
Memory 204 may include random access Memory (Random Access Memory, RAM) or Read-Only Memory (ROM). Memory 204 may be used to store instructions, programs, code sets, or instruction sets. The memory 204 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described below, etc. The storage data area may also store data created by the headset 200 in use (e.g., phonebook, audio-video data, chat-record data), etc.
Referring to fig. 13, a block diagram of a computer readable storage medium according to an embodiment of the present application is shown. The computer readable medium 1300 has stored therein program code that can be invoked by a processor to perform the methods described in the method embodiments above.
The computer readable storage medium 1300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, computer readable storage medium 1000 includes non-volatile computer readable media (non-transitory computer-readable storage medium). The computer readable storage medium 1300 has storage space for program code 1310 that performs any of the method steps described above. The program code can be read from or written to one or more computer program products. Program code 1310 may be compressed, for example, in a suitable form.
Referring to FIG. 14, a block diagram of a computer program product 1400 provided by an embodiment of the present application is shown. The computer program product comprises a computer program/instruction 1410 which, when executed by a processor, implements the above-described method.
In summary, the earphone, the vibration measuring method and the computer readable medium provided by the application comprise an exciter, a detector and a processor. The exciter is used for outputting an excitation signal towards the tympanic membrane, and the excitation signal is used for exciting the tympanic membrane to vibrate; the detector is used for transmitting a detection signal towards the tympanic membrane in a vibration state, receiving the detection signal reflected by the tympanic membrane, serving as a reflected signal, and sending the reflected signal to the processor; the processor is configured to obtain a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal. The vibration characteristic of the eardrum can be detected rapidly through the earphone, and in the environment with the auditory canal being more closed, the interference suffered by the detection process is smaller, and the detected data are more reliable.
The method for detecting the micro-vibration by the millimeter wave sensor is a mature method, the millimeter wave sensor is utilized to detect the vibration capability, and meanwhile, the millimeter wave sensor is integrated on the earphone, so that the detection of the millimeter wave sensor is less interfered in the environment with more closed auditory meatus, and the detection obtained data is more reliable.
The characteristic of the frequency response characteristic curve of the vibration of the tympanic membrane, which can be used for reacting with the frequency response characteristic curve, is a method for directly reflecting the biomechanical characteristic of the tympanic membrane, is a detection on the characteristic of the tympanic membrane, and is a more reliable method.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not drive the essence of the corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (13)

1. An earphone, comprising an exciter, a detector and a processor, wherein the exciter and the detector are connected with the processor;
The exciter is used for outputting an excitation signal to the tympanic membrane, and the excitation signal is used for exciting the tympanic membrane to vibrate;
the detector is used for transmitting a detection signal to the tympanic membrane in a vibration state, receiving the detection signal reflected by the tympanic membrane, serving as a reflected signal, and transmitting the reflected signal to the processor;
the processor is configured to obtain a vibration characteristic of the tympanic membrane based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
2. The earphone of claim 1, wherein the exciter comprises a speaker, the speaker and the detector are disposed in an internal cavity of a housing of the earphone, the housing comprises a sound outlet, and a sound outlet face of the speaker and a signal transmitting and receiving direction of the detector are both toward the sound outlet.
3. The headset of claim 1, wherein the detector is a millimeter wave sensor and the detection signal is a millimeter wave signal.
4. The earphone of claim 1, wherein the vibration characteristics include vibration amplitude, and wherein the processor is configured to obtain the frequency of the reflected signal, and wherein the vibration amplitude of the tympanic membrane is obtained by a phase estimation method based on a frequency offset between the detected signal and the reflected signal.
5. The headset of claim 4, wherein the processor incorporates a filter, the processor configured to invoke the filter to filter out signals outside a specified frequency band, the specified frequency band being based on a frequency band setting of the detected signal.
6. The headset of claim 5, wherein the filter is further configured to filter out signals having a frequency offset from the detected signal that is less than a specified threshold.
7. A method of vibration measurement, for use with a headset, the headset including an exciter, a detector, and a processor, the exciter and the detector each being coupled to the processor, the method comprising:
The exciter outputs an excitation signal towards a target object to excite the target object to vibrate;
the detector emits a detection signal toward the target object in a vibration state, and receives the detection signal reflected back through the target object as a reflected signal and sends the reflected signal to the processor;
the processor obtains a vibration characteristic of the target object based on the reflected signal, the vibration characteristic corresponding to a frequency of the excitation signal.
8. The method of claim 7, wherein the vibration characteristics include vibration amplitude; a processor obtains a vibration characteristic of the target object based on the reflected signal, comprising:
the processor acquires the frequency of the reflected signal;
the processor obtains a vibration amplitude of the target object through a phase estimation method based on a frequency offset between the detection signal and the reflected signal.
9. The method of claim 7, wherein the vibration characteristics include vibration amplitude;
The actuator outputs an excitation signal toward a target object, comprising:
the exciter outputs excitation signals with different vibration frequencies towards the target object;
The processor obtains a vibration characteristic of the target object based on the reflected signal, including:
the processor acquires a reflected signal corresponding to each vibration frequency, and obtains vibration amplitude corresponding to each vibration frequency based on the reflected signal corresponding to each vibration frequency.
10. The method of claim 9, wherein the processor obtains a reflected signal corresponding to each vibration frequency, and wherein after obtaining the vibration amplitude corresponding to each vibration frequency based on the reflected signal corresponding to each vibration frequency, further comprises:
Acquiring an absolute value of a difference value between the vibration amplitude of each vibration frequency and the reference amplitude of the excitation signal corresponding to the vibration frequency, and taking the absolute value as an attenuation value corresponding to the vibration frequency;
and obtaining a frequency response characteristic curve of the vibration of the target object based on all the vibration frequencies and attenuation values corresponding to each vibration frequency.
11. The method according to claim 10, wherein the obtaining the absolute value of the difference value before the vibration amplitude of each of the vibration frequencies and the reference amplitude of the excitation signal corresponding to the vibration frequency as the attenuation value corresponding to the vibration frequency further includes:
Analyzing the magnitude relation between the attenuation value corresponding to each vibration frequency and the threshold value of the vibration frequency;
And determining vibration mechanical characteristics of the target object based on the magnitude relation corresponding to each vibration frequency.
12. The method of any one of claims 7-11, wherein the target object is a tympanic membrane.
13. A computer readable medium, characterized in that the computer readable medium stores a program code executable by a processor, which program code, when executed by the processor, causes the processor to perform the method of any of claims 7-12.
CN202211255952.9A 2022-10-13 2022-10-13 Earphone, vibration measuring method and computer readable medium Pending CN117939343A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211255952.9A CN117939343A (en) 2022-10-13 2022-10-13 Earphone, vibration measuring method and computer readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211255952.9A CN117939343A (en) 2022-10-13 2022-10-13 Earphone, vibration measuring method and computer readable medium

Publications (1)

Publication Number Publication Date
CN117939343A true CN117939343A (en) 2024-04-26

Family

ID=90761627

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211255952.9A Pending CN117939343A (en) 2022-10-13 2022-10-13 Earphone, vibration measuring method and computer readable medium

Country Status (1)

Country Link
CN (1) CN117939343A (en)

Similar Documents

Publication Publication Date Title
US10924614B2 (en) Speech signal processing method and apparatus
US9674625B2 (en) Passive proximity detection
CN108763901B (en) Ear print information acquisition method and device, terminal, earphone and readable storage medium
KR102571141B1 (en) Electronic device including speaker and microphone
EP3016410B1 (en) Measurement device and measurement system
WO2020019821A1 (en) Microphone hole-blockage detection method and related product
CN108540900B (en) Volume adjusting method and related product
CN106851460B (en) Earphone and sound effect adjusting control method
CN108668009B (en) Input operation control method, device, terminal, earphone and readable storage medium
CN104581526B (en) Sensor
US20140341386A1 (en) Noise reduction
CN111356053A (en) Earphone and wearing state detection method thereof
CN108958697A (en) Screen sounding control method, device and electronic device
JPWO2018216121A1 (en) Earpad and earphone using the same
CN114727212A (en) Audio processing method and electronic equipment
CN109189360A (en) Screen sounding control method, device and electronic device
EP4175316A1 (en) Headphone call method and headphones
CN109086025A (en) Sounding control method, device, electronic device and computer-readable medium
JP6234082B2 (en) Measuring system
CN110505335A (en) Sounding control method, device, electronic device and computer-readable medium
CN117939343A (en) Earphone, vibration measuring method and computer readable medium
CN108810787B (en) Foreign matter detection method and device based on audio equipment and terminal
CN114928785A (en) Feedback noise reduction method and device for earphone equipment, earphone equipment and storage medium
CN109032008A (en) Sounding control method, device and electronic device
CN109144461A (en) Sounding control method, device, electronic device and computer-readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination