WO2022121743A1 - Method for optimizing functions of hearables and hearables - Google Patents

Method for optimizing functions of hearables and hearables Download PDF

Info

Publication number
WO2022121743A1
WO2022121743A1 PCT/CN2021/134629 CN2021134629W WO2022121743A1 WO 2022121743 A1 WO2022121743 A1 WO 2022121743A1 CN 2021134629 W CN2021134629 W CN 2021134629W WO 2022121743 A1 WO2022121743 A1 WO 2022121743A1
Authority
WO
WIPO (PCT)
Prior art keywords
transfer function
wearer
path
hearable
audio signal
Prior art date
Application number
PCT/CN2021/134629
Other languages
French (fr)
Chinese (zh)
Inventor
熊伟
仇存收
田立生
缪海波
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022121743A1 publication Critical patent/WO2022121743A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016—Earpieces of the intra-aural type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091—Details not provided for in groups H04R1/1008 - H04R1/1083
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation

Definitions

  • the embodiments of the present application relate to the field of acoustic technologies, and in particular, to a method for optimizing a function of a hearable device and a hearable device.
  • Hearables are wearable electronic devices that are worn near the human ear.
  • the hearables include earphones, hearing aids, and cochlear implants. These hearable devices can provide the wearer with services such as playback of audio, voice services, and more.
  • the hearable device wears the earphone, and the earphone plays music, and the wearer can hear the music played by the earphone.
  • the sound heard by the human ear is actually produced by the vibration of the eardrum of the human ear caused by the sound wave signal.
  • the sound wave signal propagates to the position of the eardrum of the human ear. Since the sound wave signal changes the pressure at the eardrum of the human ear, sound pressure is formed, and the sound pressure causes the eardrum to vibrate so that the human ear can hear the sound. Therefore, if the earphone can obtain the sound pressure signal at the eardrum of the human ear, the earphone can adjust the sound wave signal played by the earphone according to the relationship between the sound pressure signal at the entrance of the ear canal and the sound pressure signal at the eardrum of the human ear, so as to realize the realization of the earphone.
  • the active noise reduction or transparent transmission function provides the wearer with a sound playback service with good sound effect.
  • the present application provides a method for optimizing the function of a hearable device and a hearable device.
  • the hearable device When the hearable device is in a working state, the effect of the noise reduction function or the transparent transmission function of the hearable device is improved, thereby improving the performance of the hearable device.
  • the wearer of the device provides a better user experience.
  • the present application provides a method for optimizing the function of a listenable device, the method may include: the listenable device plays an audio signal, and collects the response information of the audio signal in the ear canal of the wearer (that is, the sound pressure signal of the ERP). ), wherein the hearable device is worn by the wearer, and the audio signal generates response information as it propagates through the wearer's ear canal.
  • the hearable device sends the response information and the audio signal to the first device, then the first device can generate a second (Secondary Path, SP) path according to the response information and the audio signal, and the SP path is used to represent the audio signal and the external reference of the ear canal The relationship between the sound pressure signal of the point ERP.
  • SP Secondary Path
  • the first device generates an ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. .
  • the first device sends the ED transfer function and the SP path to the hearable device, and the hearable device receives the ED transfer function and the SP path, and can adjust the audio signal according to the ED transfer function.
  • the SP path represents the relationship between the audio signal played by the wearable device and the sound pressure of the ERP
  • the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
  • the listening device adjusts the audio signal according to the SP path, which can change the sound pressure signal of the ERP, and determine the sound pressure signal of the DRP according to the sound pressure signal of the ERP and the ED transfer function. That is, when the hearable device adjusts the audio signal, it can change the sound pressure signal of the DRP. Therefore, the hearable device can adjust the audio signal according to the SP path and the ED transfer function for the purpose of optimizing the function of the hearable device.
  • the above steps can be repeatedly performed, so that the hearable device can adjust the audio signal in real time, so that the purpose of optimizing the function of the hearable device in real time can be achieved.
  • the function of the hearable device may be an active noise reduction function or a transparent transmission function.
  • the hearable device can adjust the audio signal according to the SP path and the ED transfer function to achieve real-time optimization of the active noise reduction and/or pass-through function.
  • adjusting the audio signal by the listenable device may be adjusting the volume of the sound signal played by the listenable device, or may be adjusting the playback frequency of the sound signal played by the listenable device, or the like.
  • the physical quantity in the adjusted audio signal is not specifically limited here.
  • the first device may further include multiple preset SP paths, multiple preset ED transfer functions, and a preset mapping relationship between the preset SP paths and the preset ED transfer functions.
  • the preset SP path is generated according to the wearer's response information
  • the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP.
  • the preset SP path is generated according to the response information of the current wearer of the hearable device.
  • the response information and audio signals obtained from multiple tests of the wearable device are used to generate multiple sets of preset SP paths, and the sound pressure information at the DRP obtained from multiple tests is obtained to generate multiple sets of preset ED transfer functions.
  • the above-mentioned first device generates an ED transfer function corresponding to the ear canal reference point DRP from the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
  • the first device obtains personalized data
  • the personalized data is used to create the ED transfer function
  • the personalized data at least includes: the type of the hearable device, the tightness of the wearable device, and the type of the wearer's ear canal.
  • the first device obtains the first mapping relationship according to the wearer's personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function.
  • the first device generates an ED transfer function by using the first mapping relationship and the SP path.
  • the first device includes multiple sets of preset SP paths and preset ED transfer functions for the wearer, and a mapping relationship between the preset SP paths and the preset ED transfer functions.
  • the mapping relationship between the SP path and the ED transfer function can be modified according to the wearer's personalized data, so that the hearable device can obtain an accurate ED transfer function through the modified mapping relationship.
  • the first device may further include multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions.
  • the basic SP path is generated according to the response information
  • the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
  • the basic SP path and the basic ED transfer function are generated by collecting data from multiple wearers through multiple tests.
  • the collected data includes response information, audio signals, and sound pressure signals at the DRP. And generate the mapping relationship between the basic SP path and the basic ED transfer function.
  • the above-mentioned first device generates an ED transfer function corresponding to the ear canal reference point DRP from the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. .
  • it may include: the first device obtains the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearer's ear and the wearer's ear.
  • One of the Tao types One of the Tao types.
  • the first device obtains the first mapping relationship according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function.
  • the first device obtains the ED transfer function through the first mapping relationship and the SP path.
  • the first device presets the base SP path and the base ED transfer function.
  • the mapping relationship between the SP path and the ED transfer function can be modified according to the wearer's personalized data, so that the hearable device can obtain an accurate ED transfer function according to the modified mapping relationship.
  • the functionality of the hearable can be optimized as the hearable adjusts the audio signal according to the SP path and ED transfer function.
  • the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method may further include: enabling active noise reduction of the listenable device and/or or transparent transmission.
  • the above-mentioned listening and wearing device adjusts the audio signal according to the ED transfer function, including: the listening and wearing device adjusts the audio signal according to the ED transfer function, so as to realize the purpose of adjusting the noise reduction depth of active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function. .
  • the smaller the noise reduction depth the better the active noise reduction (also referred to as noise reduction) effect of the hearable device.
  • the transparent transmission function can be optimized.
  • the present application provides a method for optimizing the function of a hearable device.
  • the method is applied to the hearable device.
  • the method may include: the hearable device plays an audio signal, and collects the audio signal in the ear canal of the wearer. Response information, wherein the hearable device is worn by the wearer and the audio signal generates the response information when propagated in the wearer's ear canal.
  • the hearable device generates an SP path according to the response information and the audio signal, and the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal.
  • the hearable device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer.
  • the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
  • the hearable device adjusts the audio signal according to the ED transfer function.
  • the hearable device may further include multiple preset SP paths, multiple preset ED transfer functions, and a mapping relationship between the preset SP paths and the preset ED transfer functions; wherein, The preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the EDR.
  • the above-mentioned listening-worn device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the obtained personalized data of the wearer.
  • the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
  • the wearer's personalized data obtained by the hearable device the personalized data is used to create the ED transfer function
  • the personalized data at least includes: the type of the hearable device, the tightness of the wearable device and the wearer's ear canal one of the types.
  • the hearable device obtains the first mapping relationship according to the personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function.
  • the hearable device generates an ED transfer function through the first mapping relationship and the SP path.
  • the hearable device may further include multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions.
  • the basic SP path is generated according to the response information
  • the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
  • the above-mentioned hearable device obtains the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearable device and the type of the wearer's ear canal one of the.
  • the hearable device obtains the first mapping relationship according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function.
  • the hearable device obtains the ED transfer function through the first mapping relationship and the SP path.
  • the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method may further include: enabling active noise reduction of the listenable device and/or or transparent transmission.
  • the above-mentioned listening and wearing device adjusts the audio signal according to the ED transfer function, including: the listening and wearing device adjusts the audio signal according to the ED transfer function, so as to realize the purpose of adjusting the noise reduction depth of active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function. .
  • the present application provides a hearable device comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions.
  • the listenable device When the instruction is executed by the listenable device, the listenable device is caused to perform the following steps: playing the audio signal, and collecting the response information of the audio signal in the ear canal of the wearer.
  • the hearable device is worn by the wearer, and the audio signal generates response information when the audio signal propagates through the wearer's ear canal.
  • Send the response information and the audio signal to the first device so that the first device generates the ED transfer function corresponding to the external reference point ERP of the ear canal to the reference point DRP of the eardrum according to the response information, and the ED transfer function represents the sound pressure signal of the ERP and the sound pressure of the DRP. signal relationship.
  • the hearable device when the instruction is executed by the hearable device, the hearable device is further caused to perform the following steps: enable the active noise reduction and/or transparent transmission function of the hearable device;
  • the hearable device When the audio signal is adjusted according to the ED transfer function, the hearable device specifically performs the following steps: adjusting the audio signal according to the ED transfer function, so as to adjust the noise reduction depth of the active noise reduction and/or adjust the sound pressure signal of the transparent transmission function. Purpose.
  • the present application provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions.
  • the hearable device When the instructions are executed by the hearable device, the hearable device is caused to perform the steps of: receiving response information and audio signals from the hearable device.
  • the listenable device is worn by the wearer, and when the shown listenable device plays an audio signal, the audio signal generates response information when the audio signal propagates through the wearer's ear canal.
  • an SP path is generated, and the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal.
  • the ED transfer function corresponding to the ERP to the eardrum reference point DRP is generated.
  • the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
  • the ED transfer function is sent to the hearable device so that the listenable device adjusts the audio signal according to the ED transfer function.
  • the electronic device may further include: multiple preset SP paths, multiple preset ED transfer functions, and a preset mapping relationship between the preset SP paths and the preset ED transfer functions.
  • the preset SP path is generated according to the wearer's response information
  • the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP.
  • the electronic device When the instruction is executed by the hearable device, the electronic device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer.
  • the ED transfer function represents the sound pressure signal of the ERP and the DRP sound pressure signal relationship.
  • the electronic device specifically performs the following steps: acquiring personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the listening device, the tightness of the listening device, and the type of the wearer's ear canal. one of.
  • the first mapping relationship is obtained according to the wearer's personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. Through the first mapping relationship and the SP path, an ED transfer function is generated.
  • the electronic device may further include: multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions.
  • the basic SP path is generated according to the response information
  • the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
  • the electronic device When the instruction is executed by the hearable device, the electronic device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer.
  • the ED transfer function represents the sound pressure signal of the ERP and the DRP sound pressure signal relationship.
  • the electronic device specifically performs the following steps: acquiring personalized data of the wearer, and the personalized data is used to create the ED transfer function.
  • the first mapping relationship is obtained according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. Through the first mapping relationship and the SP path, the ED transfer function is obtained.
  • the present application further provides a hearable device, comprising: one or more processors; a memory; and one or more computer programs.
  • a hearable device comprising: one or more processors; a memory; and one or more computer programs.
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the hearable device, cause the hearable device to perform the second aspect and any possible design methods thereof Methods for optimizing the functionality of a hearable device in .
  • an embodiment of the present application provides a computer-readable storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device is made to perform the above-mentioned first aspect, the second aspect, and any possible possibility thereof Methods for optimizing the functionality of hearables in the design of .
  • an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the electronic device in the first aspect, the second aspect, and any possible design thereof. Ways to optimize the functionality of a hearable device.
  • an embodiment of the present application provides a chip system, where the chip system is applied to an electronic device.
  • the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the interface circuit is used for receiving signals from the memory of the electronic device and sending signals to the processor, and the signals are included in the memory Stored computer instructions; when the processor executes the computer instructions, it causes the electronic device to perform the method for optimizing the function of the hearable device in the first aspect, the second aspect, and any possible designs thereof.
  • FIG. 1A is a schematic diagram of different types of earphones worn by human ears according to an embodiment of the present application
  • FIG. 1B is a schematic structural diagram of a human ear canal provided by an embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of an equivalent circuit of a human ear canal provided by an embodiment of the present application
  • FIG. 3 is a schematic structural diagram of a hearable device according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application.
  • FIG. 5 is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application
  • FIG. 6 is a flowchart of another method for optimizing the function of a hearable device provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a system structure of an optimized listen-worn device provided by an embodiment of the present application.
  • FIG. 9A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application.
  • 9B is a schematic block diagram of an algorithm provided by an embodiment of the present application.
  • FIG. 10A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application.
  • 10B is a schematic block diagram of an algorithm provided by an embodiment of the present application.
  • 11 is a noise reduction depth curve diagram corresponding to an ANC function provided by an embodiment of the application.
  • FIG. 12A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application.
  • 12B is a schematic block diagram of an algorithm provided by an embodiment of the present application.
  • FIG. 13A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application.
  • 13B is a schematic block diagram of an algorithm provided by an embodiment of the present application.
  • FIG. 15 is a flowchart of another method for optimizing the function of a hearable device provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features.
  • a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
  • plural means two or more.
  • the present application is described here by taking a hearable device represented by an earphone as an example.
  • the noise in the environment interferes with the sound played by the headphones.
  • the earphone is worn by the wearer, when the earphone is playing music, the wearer can hear the noise in the environment while listening to the sound played by the earphone.
  • headphones In order to provide good sound services, headphones generally have an Active Noise Cancellation (ANC) function.
  • ANC Active Noise Cancellation
  • the principle of active noise reduction is that the microphone in the earphone collects the noise signal in the environment where the earphone is located, and the earphone transmits the collected noise signal to the control circuit.
  • the control circuit can generate a sound wave signal with an opposite phase and similar amplitude to the noise signal.
  • the control circuit transmits the generated sound wave signal to the speaker in the earphone, and the sound wave signal is played through the speaker. Since the phase and amplitude of the sound wave signal are opposite to those of the noise signal, the sound wave signal played by the speaker can weaken the noise signal, thereby weakening the noise signal transmitted to the human ear through the earphone, so as to realize the function of active noise reduction of the earphone.
  • the range of hybrid active noise reduction is roughly 50Hz-3kHz
  • the range of feedback active noise reduction is roughly 50Hz-1kHz.
  • wearing headphones with ANC function can reduce the interference of noise to the wearer.
  • people still need to maintain a certain sensitivity to the sound in the environment to monitor real-time changes in the surrounding environment. For example, during a voice call, people use headphones to answer voices.
  • the headphones use active noise reduction to reduce the interference of noise in the environment on the sound heard by the wearer of the headphones.
  • the wearer of the headset needs to be aware of the alarm sound in the surrounding environment, etc., so that it can respond according to the sound in the environment. Therefore, the earphone needs to have a hear through (HT) function so that the earphone wearer can hear part of the sound in the environment.
  • HT hear through
  • the principle of transparent transmission of the earphone is that the microphone in the earphone collects the sound signal in the environment and transmits the sound signal to the signal processing circuit.
  • the signal processing circuit can filter and process the sound signal in the environment to obtain the analog sound signal, transmit the analog sound signal to the speaker, and play the analog sound signal through the speaker.
  • the earphone wearer can hear part of the sound in the environment.
  • the earphone collects the sound signal in the environment, and detects that the sound signal includes an alarm sound, and the signal processing circuit can remove the noise in the sound signal through the filter circuit and retain the alarm sound.
  • the alarm sound signal is simulated and amplified in sequence, and the amplified alarm sound signal is transmitted to the speaker. In this way, the speaker can play the alarm sound signal, so that the earphone wearer can hear the alarm sound in the environment, and the interference of the noise in the environment to the earphone wearer's hearing is reduced.
  • the earphone when the earphone is worn by the wearer, the sound emitted by the earphone propagates to the external reference point (ERP) at the entrance of the ear canal, and then the sound propagates to the eardrum reference point (Drum Reference Point, DRP) through the ear canal ).
  • the sound signal causes the sound pressure at the eardrum of the human ear to change, and the eardrum of the human ear vibrates under the action of the sound pressure, so that the earphone wearer hears the sound played by the earphone.
  • FIG. 1A is a schematic diagram of the speaker in the earphone and the ERP after different types of earphones are worn by the wearer.
  • Figure 1A (a) is a schematic diagram of the positional relationship between the speaker in the ear-mounted earphone and the ERP after the ear-mounted earphone is worn by the wearer.
  • Figure 1A (b) is a schematic diagram of the positional relationship between the speaker in the headset and the ERP after the headset is worn by the wearer.
  • Figure 1A (c) is a schematic diagram of the positional relationship between the speaker in the semi-in-ear headphones and the ERP after the semi-in-ear headphones are worn by the wearer, as shown in Figure 1A (d), after the in-ear headphones are worn by the wearer, Schematic diagram of the positional relationship between the speaker and the ERP in the in-ear headphones.
  • the propagation direction of the sound wave is the same as the vibration direction of the air particles, that is, the sound wave is a longitudinal wave. Therefore, when the sound wave propagates in the air, the density of the air particles changes with the propagation of the sound wave, and the pressure there also changes. This change in pressure due to the propagation of sound waves is called sound pressure. Sound waves (which can also be understood as sound) propagate from the ERP to the DRP, so that the sound pressure at the DRP changes, the sound pressure causes the eardrum of the human ear to vibrate, and the human can hear the sound.
  • the transfer function of the sound pressure signal at the EPR and the sound pressure signal at the DRP can be obtained.
  • the transfer function represents the mathematical representation of the sound pressure signal of the EPR and the sound pressure signal of the DRP. Therefore, the sound pressure signal at the ERP can be collected during the audio playback process of the headset, and the sound pressure signal at the DRP can be determined according to the transfer function.
  • the earphone can adjust the audio signal played by the speaker according to the transfer function, and the sound pressure signal at the ERP will also be adjusted. In this way, the sound pressure signal at the DRP can be adjusted through the transfer function.
  • the audio signal played by the speaker can be adjusted according to the transfer function, so that the earphone can provide a good active noise reduction or transparent transmission function and improve the sound effect of the sound played by the earphone.
  • the sound pressure signal at the DRP can be obtained by direct measurement, or the sound pressure signal at the DRP can be deduced by modeling the human ear.
  • a Doppler laser vibrometer can be used to measure the vibration of the human eardrum, and the vibration of the human eardrum can be converted into a sound pressure signal at the DRP through signal conversion.
  • the process of modeling the ear canal is to measure the geometric shape of the ear canal and segment the ear canal between the external auditory canal orifice and the eardrum reference point.
  • the ear canal from the external auditory canal orifice to the eardrum is divided into i segments.
  • the path between DRP and ERP at the entrance of the external auditory canal includes the D1 segment, the D2 segment...and the Di segment, and each segment of the ear canal can be equivalent to a circuit model. Based on the equivalent circuit model of each segment in the ear canal, the ear can be modeled.
  • FIG. 2 is a schematic diagram of an equivalent circuit of a human ear structure.
  • the D1 segment, D2 segment... and Di segment shown in Fig. 1B can all be equivalent to circuit models formed by acoustic impedance, acoustic capacitive reactance and acoustic inductive reactance.
  • P1 represents the sound pressure signal at the ERP
  • the equivalent circuit model of the ear canal of the D1 segment includes acoustic impedance R1, acoustic capacitive reactance C1 and acoustic inductive reactance L1.
  • the acoustic capacitive reactance C1 and the acoustic inductive reactance L1 are connected in parallel, and are connected in series with the acoustic impedance R1.
  • the circuit model of the ear canal of the Di segment includes the acoustic impedance Ri, the acoustic capacitive reactance Ci and the acoustic inductive reactance Li, and D as the load represents the sound pressure signal at the DRP.
  • the circuit model of each segment of the ear canal is the same, so the model of each segment of the ear canal will not be described in detail.
  • the multi-segment circuit model is connected in a cascaded manner, and the eardrum is placed in the modeled circuit in the form of an acoustic load.
  • the propagation of sound waves in the air is actually the perturbation of the sound waves that make the medium (ie, air particles) deviated from the equilibrium state, so as to realize sound propagation.
  • Acoustic impedance is the resistance that the sound wave needs to overcome to cause the displacement of the medium, that is, the resistance that the sound needs to overcome to propagate in the ear canal.
  • the acoustic impedance is equivalent to the resistance in the circuit, and the acoustic impedance can absorb part of the sound energy.
  • Acoustic capacitive reactance and acoustic inductive reactance are equivalent to capacitance and inductance in a circuit. Acoustic capacitive reactance and acoustic inductive reactance do not absorb the energy of sound and can change the direction or form of sound propagation.
  • the derivation of the circuit relationship, and the simulation analysis Based on the analysis of the circuit model shown in Figure 2, the derivation of the circuit relationship, and the simulation analysis. It can be collected under different models (ie different human ears), the cross-sectional area at the entrance of the ear canal is different, and the equivalent length of the ear canal is also different. According to the circuit model shown in Figure 2, the cross-sectional area S of the external auditory canal and the Mathematical relationship of track length L. The transfer function between the ERP and the DRP can be corrected by using individualized ear canal information such as the external auditory canal cross-sectional area S and the ear canal length L.
  • the method for measuring the shape and structure of the ear canal may be to inject foam into the human ear, and take out the ear canal model of the human ear after the foam is rapidly formed.
  • 3D three-dimensional
  • the model data of the human ear canal is obtained.
  • the human ear model created by this method is a smooth channel, which is different from the actual ear canal and cannot completely replace the real human ear. Therefore, after modeling the human ear, it also needs to be tested in the actual sound tube in order to correct the transfer function.
  • the physical modeling method can be used to model a specific ear, and a human ear model with high modeling accuracy can be obtained.
  • this modeling method includes steps such as acquiring, modeling, measuring, and revising the model results of the ear canal model.
  • the operation process is cumbersome, the requirements for the implementation environment are relatively high, and the implementation complexity is high.
  • the analysis of the modeling results is for a specific ear canal shape. If the method is directly applied to the earphone, it is difficult for the earphone to obtain the equivalent cross-sectional area of the ear canal and the equivalent human ear canal length, etc. parameters, it is difficult to model the ear canal for the current earphone wearer.
  • the acoustic pressure signal at the DRP is determined based on the acoustic signal at the ERP and the estimated ERP to DRP transfer function ED.
  • a certain excitation sound signal is played through the speaker, and the response of the ear canal is collected by the microphone at the ERP.
  • the headset infers the characteristics of the wearer's ear canal structure, so that the headset can obtain the signal at the DRP by solving the ED transfer function according to the ED transfer function closest to the current response in the historical database. estimate.
  • the earphone can adjust the sound signal played by the earphone according to the signal estimation at the DRP, so that the earphone can meet the better active noise reduction or transparent transmission function, and can also provide the wearer with a better sound effect.
  • the embodiment of the present application provides a method for optimizing the function of a hearable device, and the method can be applied to a hearable device.
  • the listenable device is preset with a second path (Secondary Path, SP) (or referred to as the SP path) obtained based on big data, the ERP to DRP (ED) transfer function, and the mapping relationship H between the SP path and the ED function domain.
  • SP Secondary Path
  • ED DRP
  • the hearable device is worn by the wearer, and a preset test audio signal can be played to obtain the ED inv transfer function modeling for the wearer's ear canal.
  • the listening device plays the test sound, which can collect the sound pressure signal at the ERP and the sound information fed back by the ear canal.
  • the listening device can calculate the SP according to the sound pressure signal at the ERP and the sound information fed back by the ear canal. inv path. Further, the hearable device can determine the ED inv transfer function according to the SP inv path. That is to say, the ED inv transfer function obtained in the embodiment of the present application is related to the wearer of the hearable device. In addition, the hearable device can also obtain personalized data related to the wearer, for example, the personalized data can be the size of the earmuffs used by the hearable device, the tightness of the hearing device, the type of ear canal Wait. The hearable device can correct the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data input by the wearer.
  • the hearable device can collect the mapping relationship H inv between the SP inv path and the ED inv transfer function distribution domain for the wearer of the hearable device, so that the hearable device can adjust noise reduction in real time during use.
  • the purpose of the function and the transparent transmission function is to provide the wearer of the hearable device with a good active noise reduction function, a transparent transmission function, and a better sound effect.
  • the second path is a path in which noise in the environment is a sound source, and the noise propagates through the earphone to the DER of the human ear.
  • the earphone is worn by the wearer, the earphone can play a preset prompt tone, and the microphone in the earphone collects the sound pressure signal at the ERP, and acquires the signal coupled with the information of the wearer's ear canal.
  • the headset can establish the SP inv path and ED inv transfer function for the wearer.
  • headphones can be used in conjunction with electronic devices.
  • the earphone is worn by the wearer, and the earphone establishes a communication connection with the electronic device.
  • the headset may provide the wearer with the function of interacting with the electronic device voice, or the headset may only provide the wearer with the function of playing the voice.
  • the headset establishes a communication connection with the electronic device, the headset is worn, when the electronic device plays an audio file, the electronic device decodes the audio file to generate voice information, the electronic device transmits the voice information to the headset, and the headset plays the voice information, the headset wearer hears the mobile phone Played audio file.
  • the display screen of the electronic device displays the video image
  • the headset provides the wearer with audio information in the video.
  • the wearer uses an electronic device to make a call, and the electronic device communicates with another electronic device.
  • the headset can be used to collect the voice signal sent by the wearer and transmit it to the electronic device.
  • the electronic device can transmit the collected voice signal to another electronic device. equipment.
  • the electronic device receives a voice signal transmitted by another electronic device, and the electronic device can play the voice signal through the earphone.
  • the method provided by the embodiments of the present application can create a personalized SP path and ED transfer function for the wearer of the hearable device, and correct the mapping relationship H inv between the SP path and the ED transfer function according to the collected personalized parameters.
  • the wearer can always provide the wearer with real-time active noise reduction and pass-through functions when the hearable device is used by the wearer, provide the wearer with a good listening experience, and improve the sound quality played by the hearable device. sound effects.
  • the hearable device 300 may include a processor 310, an internal memory 320, a charging interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a radio frequency module 350, a communication module 360, audio module 370, speaker 370A, call microphone 370B, feed-forward (Feed-Forward, FF) microphone 370C, feedback (Feed-Back, FB) microphone 370D, voice processing unit (Voice Process Unit, VPU) sensor 380, Button 390, etc.
  • a processor 310 may include a processor 310, an internal memory 320, a charging interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a radio frequency module 350, a communication module 360, audio module 370, speaker 370A, call microphone 370B, feed-forward (Feed-Forward, FF) microphone 370C, feedback (Feed-Back, FB) microphone 370D,
  • the hearable device 300 shown in FIG. 3 is only an example of the hearable device.
  • the structure illustrated in FIG. 3 does not constitute a limitation on the hearable device 300 . More or fewer components than shown may be included, or some components may be combined, or some components may be split, or a different arrangement of components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, if the hearable device 300 is a hearing aid, the hearable device 300 does not include the communication module 350, the radio frequency module 360, the receiver 370B, and the like.
  • the processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (application processor, AP), a modem processor, a controller, a memory, a digital signal processor (digital signal processor, DSP) ), baseband processor, and/or neural-network processing unit (NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor a controller
  • memory a digital signal processor (digital signal processor, DSP) ), baseband processor, and/or neural-network processing unit (NPU), etc.
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the decision maker that directs the various components of the hearable device 300 to work in harmony as instructed. It is the nerve center and command center of the hearable device 300 .
  • the controller generates an operation control signal according to the instruction operation code and timing signal, and completes the control of fetching and executing instructions.
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in the processor is a cache memory. Instructions or data that have just been used or recycled by the processor can be saved. If the processor needs to use the instruction or data again, it can be called directly from memory. Repeated access is avoided, and the waiting time of the processor is reduced, thereby improving the efficiency of the system.
  • the processor 310 may store the transfer function of the SP db path and the ED db obtained by summarizing the big data, and the mapping relationship H db between the SP db path and the ED db function distribution domain.
  • the hearable device 300 may directly call the data stored in the processor 310 to create the corresponding SP inv path and ED inv transfer function for the wearer.
  • the processor 310 may include an interface.
  • the interface may include an integrated circuit (Inter-Integrated Circuit, I2C) interface, an integrated circuit built-in audio (Inter-Integrated Circuit Sound, I2S) interface, a pulse code modulation (Pulse Code Modulation, PCM) interface, Universal Asynchronous Receiver Transmitter (Universal) Asynchronous Receiver/Transmitter, UART) interface, and/or Universal Serial Bus (Universal Serial Bus, USB) interface, etc.
  • I2C Inter-Integrated Circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • Universal Asynchronous Receiver Transmitter Universal Asynchronous Receiver Transmitter
  • UART Universal Asynchronous Receiver Transmitter
  • USB Universal Serial Bus
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (Serial Data Line, SDA) and a serial clock line (Derail Clock Line, SCL).
  • SDA Serial Data Line
  • SCL Serial Clock Line
  • the processor may contain multiple sets of I2C buses. The processor can separately couple touch sensors, chargers, etc. through different I2C bus interfaces.
  • the I2S interface can be used for audio communication.
  • the processor may contain multiple sets of I2S buses.
  • the processor can be coupled with the audio module through the I2S bus to realize the communication between the processor and the audio module.
  • the audio module can transmit audio signals to the communication module through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module and the communication module may be coupled through a PCM bus interface.
  • the audio module can also transmit audio signals to the communication module through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication, and the sampling rates of the two interfaces are different.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the hearable device 300 .
  • the hearable device 300 may use different interface connection manners in the embodiments of the present application, or a combination of multiple interface connection manners.
  • the charging management module 340 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the power management module 341 is used to connect the battery 342 , the charging management module 340 and the processor 310 .
  • the power management module receives input from the battery and/or charging management module, and supplies power to the processor, internal memory, and communication module.
  • the power management module can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance).
  • the wireless communication function of the hearable device 300 may be implemented by the antenna 1, the antenna 2, the radio frequency module 350, the communication module 360, the modem, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in hearable device 300 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the radio frequency module 350 may provide a communication processing module applied on the hearable device 300 including 2G/3G/4G/5G wireless communication solutions.
  • the radio frequency module receives electromagnetic waves from the antenna 1, filters and amplifies the received electromagnetic waves, and transmits them to the modem for demodulation.
  • the radio frequency module can also amplify the signal modulated by the modem, and then turn it into electromagnetic waves and radiate it out through the antenna 1 .
  • a modem may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high-frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs audio signals through audio devices (not limited to speakers, receivers, etc.).
  • the listen-worn device provided by the embodiment of the present application can interact with a remote server (or cloud device), and the listen-worn device can transmit the acquired personalized parameters to the remote server, and the remote server can update the listen-worn device according to the personalized data.
  • the mapping relationship H db of the SP inv path of the type device and the transfer function of the ED inv is corrected to improve the sound effect of the headphones.
  • the communication module 360 can provide wireless local area network (Wireless Local Area Networks, WLAN), (such as Wireless Fidelity (Wireless Fidelity, Wi-Fi) network), Bluetooth (Blue Tooth, BT), A communication processing module for wireless communication solutions such as Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR).
  • the communication module 360 may be one or more devices integrating at least one communication processing module.
  • the communication module receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor.
  • the communication module 360 can also receive the signal to be sent from the processor, perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the Bluetooth headset can establish a communication connection with the electronic device through the antenna 2, so as to achieve the purpose of playing the sound of the electronic device through the Bluetooth headset.
  • Internal memory 321 may be used to store computer executable program code, which includes instructions.
  • the processor 310 executes various functional applications and data processing of the hearable device 300 by executing the instructions stored in the internal memory 321 .
  • the memory 321 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, a noise reduction function, a transparent transmission function, etc.), and the like.
  • the storage data area can store data created during the use of the hearable device 300 (such as audio data, the transfer function of the SP db path and the ED db based on big data, and the mapping relationship between the SP db path and the function distribution domain of the ED db ) H db etc.) etc.
  • data created during the use of the hearable device 300 such as audio data, the transfer function of the SP db path and the ED db based on big data, and the mapping relationship between the SP db path and the function distribution domain of the ED db ) H db etc.
  • the above-mentioned internal memory 321 includes the data partition (eg, data partition) described in the embodiments of the present application.
  • the data partition stores files or data that need to be read and written when the operating system starts, as well as wearer data created during the use of the hearable device (for example, the wearer's personalization obtained during the use of the hearable device). parameters, etc.).
  • the data partition may be a predetermined storage area in the above-mentioned internal memory 321 .
  • the data partition may be contained in RAM in the internal memory 321 .
  • the virtual data partition in this embodiment of the present application may be a storage area of the RAM in the internal memory 321 .
  • the virtual data partition may be a storage area of the ROM in the internal memory 321 .
  • the hearable device 300 can implement audio functions through the audio module 370, the speaker 370A, the call microphone 370B, the FF microphone 370C, the FB microphone 370D, the VPU sensor 380, and the application processor. Such as music playback, voice calls, recording, etc.
  • the audio module is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input to digital audio signal.
  • the audio module can also be used to encode and decode audio signals.
  • the audio module may be provided in the processor 310 , or some functional modules of the audio module may be provided in the processor 310 .
  • Speaker 370A also referred to as “speaker”, is used to convert audio electrical signals into audio signals.
  • the hearable device may play audio signals through speaker 370A.
  • the call microphone 370B also called “microphone” or “microphone” is used to convert audio signals into electrical signals.
  • the wearer can make a sound by approaching the call microphone 370B through the human mouth, and input an audio signal into the call microphone 370B.
  • the FF microphone 370C can be disposed outside the hearable device 300 to collect noise in the environment where the hearable device is located.
  • the FB microphone 370D is disposed on the side of the hearable device close to the human ear, and is used to collect audio signals coupled with channel information of the human ear, so as to realize the function of active noise reduction of the hearable device 300 .
  • the hearable device 300 may be provided with at least one microphone.
  • a microphone may also be provided in the earpiece part of the earphone to collect sound in the environment, so that the earphone can realize functions such as noise reduction and transparent transmission.
  • the hearable device 300 may further be provided with three, four or more microphones to collect audio signals, reduce noise, identify sound sources, and implement directional recording functions.
  • VPU sensor 380 is a bone conduction sensor. It is a single-axis accelerometer using piezoelectric materials, which can be used to sense and measure the movement of the vocal cords. The VPU sensor 380 has low power consumption and can extract speech information when the hearable device 300 is in a high noise environment.
  • the keys 390 include a power-on key, a volume key, and the like.
  • the keys may be mechanical keys. It can also be a touch key.
  • the hearable device 300 receives key inputs and generates key signal inputs related to wearer settings and functional control of the hearable device 300 .
  • the hearing-worn device provided by the embodiment of the present application may be a hearing aid, a cochlear implant, an in-ear type, a semi-in-ear type, an on-ear type, a headphone, etc., an electronic device worn on the ear.
  • the embodiment of the present application does not limit the specific form of the hearable device.
  • the embodiment of the present application provides a method for optimizing the function of a hearable device, and the method can be applied to a hearable device. It can be understood that the method can be applied to a variety of hearable devices.
  • the hearable device is an earphone as an example to describe the method provided by the embodiment of the present application.
  • a general SP db path that is, the above-mentioned basic SP path
  • an ED db transfer function that is, the above-mentioned basic ED transfer function obtained based on big data
  • H db Domain mapping relationship
  • the headset can interact with a first device (such as an electronic device, a remote server, a cloud device, etc.) (or called a master device), and create an SP inv path for the wearer through the first device (That is, the above-mentioned preset SP path) and the ED inv transfer function (that is, the above-mentioned preset ED transfer function).
  • the first device may preset a general SP db path and ED db transfer function obtained based on big data, and a mapping relationship H db between the SP db path and the ED db function domain.
  • the earphone when the earphone is worn by the wearer and is used. Based on big data, the earphone can generate, for the current wearer, the SP inv path and the ED inv transfer function, and the corresponding relationship H inv between the SP inv path and the ED inv function domain. That is to say, the related information of the big data is preset in the hearable device, and the related information is the SP db path and the ED db transfer function, and the mapping relationship between the SP db and the ED db function domain.
  • the structure of the test equipment used in the experiment may be different from the structure of the earphones sold in the market.
  • the test equipment used in the measurement includes a probe microphone.
  • the probe microphone can obtain the accurate sound pressure signal at the DRP.
  • the principle of the specific experiment is: for different people (ie different ear canal shapes), using the test equipment under various earmuff sizes (for in-ear headphones), wearing the test equipment with different degrees of tightness, wearing the test equipment to measure the sound of the equipment
  • the relevant data used to create the SP db path and the ED db transfer function were collected at different distances from the loudspeaker to the ERP. So that testers can process the collected data to determine the SP db and ED db transfer functions under big data.
  • the specific measurement process can be: determine the test scene and record the test scene data, such as the test object, the shape of the ear canal of the test object, the type of test equipment worn by the test object (for example, whether there are earmuffs, etc.), the wearing tightness of the test equipment degree, the distance between the speaker of the test equipment and the ERP, etc.
  • the test equipment plays the preset test music, and the test equipment collects and generates the related data of the SP db path and the ED db transfer function.
  • the relevant data for generating the SP db path and the ED db transfer function may include: the sound pressure signal at the ERP, the sound pressure signal at the DRP, the response signal collected by the speaker, the primary path (PP) response signal, and the acoustic feedback Path (feedback path, FP) response signal and so on.
  • multiple sets of experimental data are obtained through repeated experiments and multiple measurements. Multiple sets of experimental data can be input into the computer, and the SP db and ED db transfer functions under big data can be obtained through computer processing and simulation calculation, and the mapping relationship H db of the SP db and ED db function domains can be obtained.
  • the above-mentioned related data for generating the SP db path and the ED db transfer function are collected in an offline state, that is, the test data can be obtained after measurement by the test equipment.
  • FIG. 4 is a schematic diagram of a scenario in which a hearable device interacts with a main control device to acquire test data according to an embodiment of the present application.
  • the wearer 100 can interact with the electronic device 200 so that the electronic device 200 is connected to the hearable device 300 through communication.
  • the electronic device 200 may be a mobile phone.
  • the electronic device 200 receives an operation instruction from the wearer 100 to establish a communication connection with the electronic device 200 (ie, the electronic device 200 interacts with the wearer 100 ), and responds to The operation command of the wearer 100 is connected with the listenable device 300 via Bluetooth.
  • FIG. 5 is a schematic diagram of a system provided by an embodiment of the present application.
  • 501 represents a schematic diagram of the system during offline training, and the system structure of offline training is used to obtain relevant data for creating SP db paths and ED db transfer functions.
  • 502 represents a database, and the database is used to store the SP db path and the ED db transfer function obtained by offline training, and the mapping relationship H db between the SP db path and the ED db function domain.
  • 503 represents the personalization database of the current user, which is used to store the SP inv path and the ED inv transfer function obtained according to the personalized data of the earphone wearer, and the mapping relationship H inv between the SP inv path and the ED inv transfer function.
  • 504 represents a schematic diagram of a system corresponding to a product of a hearable device (eg, earphones), and the hearable device is used to obtain the wearer's personalized data, such as for creating the SP inv path and the related parameters of the ED inv transfer function.
  • the system of 501 can collect the relevant data created to the SP db path and the ED db transfer function, then 501 can transmit the collected data to 502 so that 502 can generate the SP db path and the ED db transfer function.
  • 502 may generate SP db paths and ED db transfer functions of multiple sets of test data, so as to obtain the mapping relationship H db between the SP db paths and the ED db function domains.
  • 501 can also transmit the collected data to 503, and 503 can also obtain the wearer's personalized data of the hearable device, so that 503 can obtain the wearer's SP inv path and ED inv according to the data and personalized data transmitted by 501.
  • Transfer Function The wearer's personalized data in the 503 database can be used to modify the SP inv path and the ED inv transfer function, so as to obtain the mapping relationship H db between the modified SP db path and the ED db function domain.
  • the 501 offline training system includes a probe microphone, so that the offline training system can collect the sound pressure signal at the DRP of the human ear.
  • 504 is that the system of the hearable device does not include a probe microphone, then 504 cannot collect the sound pressure signal at the wearer's DRP.
  • 504 may obtain 503 the mapping relationship H db between the revised SP db path and the ED db function domain in the database, so as to perform ED modeling for the wearer of the hearable device according to H db .
  • the test equipment includes a probe microphone, the test equipment plays a preset test audio signal (eg, test music), and collects the sound pressure signal at the ERP, the sound pressure signal at the DRP, the response signal collected by the speaker, and the primary path. (primary path, PP) response signal, acoustic feedback path (feedback path, FP) response signal, etc.
  • PP primary path
  • FP acoustic feedback path
  • ERP(z) represents the response at the ERP collected by the feedback (Feed-back, FB) microphone;
  • Ref(z) represents the response collected by the feed-forward microphone (Feed-Forward, FF) microphone in the hearable device;
  • Spk(z) represents the response of the speaker;
  • SP(z) represents the transfer function response from the speaker to the FB microphone;
  • PP(z) represents the transfer function response from the FF microphone to the FB microphone;
  • FP(z) represents the transfer function from the speaker to the FF microphone response.
  • the modeling can use the following formula 2 to generate the ED model:
  • DRP(z) represents the response at the DRP collected by the probe microphone
  • ERP(z) represents the response at the ERP collected by the microphone
  • a database is established according to multiple sets of data.
  • the database includes the mapping relationship of multiple sets of data.
  • the database can be represented by the following formula 3:
  • EC represents different ear canals (EC) of different testers
  • ES represents the earmuff size (ES) used by the earphone wearer
  • WP represents the wearing posture (wear posture, WP) of the earphone wearer.
  • the relevant data obtained by the experiment is preset in the hearable device, and the relevant data includes: the general SP db path and the ED db transfer function, and the mapping relationship between the SP db path and the ED db function domain Hdb .
  • the hearable device can be used independently, that is, it does not need to cooperate with the first device to realize its function, such as a cochlear implant, a hearing aid and other types of hearable device products.
  • the wearer of the hearable device can train the ED inv transfer function of the hearable device according to their own hearing conditions and the shape of the ear canal, so that the hearable device is more Suitable for the hearing condition of the wearer.
  • the relevant data of SP inv modeling and ED inv modeling are collected to generate SP inv and ED inv transfer of the wearer. function.
  • the listening device collects SP inv modeling and ED inv modeling. relevant data to generate a personalised database for that wearer.
  • the wearable device in the process of collecting the wearer's personalized data, the wearable device cannot obtain the wearer's personalized data in all possible usage scenarios. Therefore, the mapping relationship H db between the SP db path and the ED db function domain in the large database can be used to correct the wearer's personalized data, so that the hearable device can better provide the wearer with good performance in various scenarios. auditory experience.
  • the wearer's personalized data includes information such as whether the wearer uses earmuffs, the tightness of the wearer wearing the hearable device, and the movement state of the wearer.
  • the hearable device may collect relevant personalized data by interacting with the wearer's voice. For example, after the hearing-worn device starts the test, it asks questions for each personalized data through voice interaction, and collects the wearer's voice information to determine the wearer's personalized data. For example, if the listening device sends a question, "Please confirm whether to use earmuffs", if the listening device collects the wearer's voice information, the answer is "no earmuffs" or "no" or "no". The hearable can determine that the wearer is currently using a hearable that does not have eartips. In this case, the hearable device will no longer ask the wearer for personalization data such as the size of the earmuffs.
  • the hearable device can be connected to the main control device (or called the first device), and works under the control of the main control device, then the wearer's personalized data can be collected through the main control device.
  • the main control device is an electronic device such as a mobile phone and a computer, and the main control device includes a display screen.
  • the listening device establishes a communication connection with the main control device, and the display screen of the main control device displays an input interface for personalized data, and the input interface can obtain the information input by the wearer.
  • the wearer interacts with the main control device, and inputs personalized data through the input interface, so that the wearable device collects the wearer's personalized data, so as to establish the wearer's personalized database.
  • the listening device is an earphone
  • the first device is a mobile phone
  • the earphone and the mobile phone cooperate to implement the training of the transfer function in the earphone.
  • the process is as follows: the wearer wears the earphone, the mobile phone receives the operation information of the wearer, and the mobile phone is connected with the earphone through Bluetooth.
  • the wearer wears the earphones the earmuffs to be used (for in-ear earphones) are determined, the wearing posture is adjusted, and the tightness of the earphones worn is adjusted.
  • the mobile phone receives the operation of collecting the wearer's personalized data, and the mobile phone can receive the wearer's input information to collect the relevant personalized data.
  • the mobile phone receives the size of the earphone and earmuff input by the wearer, the wearing posture of the earphone, and the tightness of the earphone wearing.
  • the mobile phone sends a preset test audio signal to the headset, and the headset collects relevant data, and the headset can transmit the collected data to the mobile phone.
  • the mobile phone can use the data transmitted by the headset to create the SP inv path and ED inv transfer function for the wearer.
  • the mobile phone can use its computing power to combine the wearer’s personalized data collected by the mobile phone to obtain a personalized nonlinear mapping relationship H. inv .
  • the mobile phone can also obtain the big data to obtain H db , in this way, the mobile phone can obtain the personalized nonlinear mapping relationship H inv according to the personalized data and H db , the mobile phone can transmit the mapping relationship H inv to the headset, and use the initial data or the original data as the original data.
  • the form is set in the headset. In this way, when the headset is used by the wearer again, the wearer can be provided with a good active noise reduction or transparent transmission function according to the wearer's personalized data.
  • the listening device is an earphone
  • the general SP db path and ED db transfer function obtained based on big data are preset in the earphone, as well as the mapping relationship H db between the SP db path and the ED db function domain.
  • FIG. 6 is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application. As shown in FIG. 6 , the method may include steps 601 to 606 .
  • Step 601 the earphone is worn by the wearer, and the active noise reduction and/or transparent transmission of the earphone is turned on.
  • the earphone is worn by the wearer, and the ANC and/or HT function of the earphone is turned on, so that the earphone can provide a good sound playback effect during the working process.
  • the earphone may include buttons, and the buttons on the earphone may be used to trigger the ANC and/or HT function of the earphone.
  • the earphone can acquire noise information in the current environment, and activate the ANC and/or HT function according to the noise information, so that the earphone can provide the wearer with a good listening experience.
  • Step 602 Play a preset audio signal, and collect response information from the wearer's ear canal, where the response information is used to create an SP inv path.
  • the earphone can collect the response information coupled with the ear canal information during the process of transmitting the sound wave of the audio signal in the ear canal.
  • the response information collected by the hearable device may include: the response at the ERP; the response of the speaker; the response on the primary path; the response on the feedback path, and the like.
  • the response information collected by the headset is related to the hardware structure of the headset.
  • the headset includes an FF microphone, a FB microphone, a speaker, and the like. After the earphone plays the preset audio signal, the speaker can collect the speaker response, the FF microphone can collect the response on the feedback path, the FB microphone can collect the response on the primary path, and so on.
  • Step 603 Create an SP inv path of the ear canal according to the response information.
  • the earphone does not include a probe microphone, so the earphone cannot directly obtain the sound pressure signal at the DRP.
  • the earphone can model the SP inv path based on the collected response signal to obtain the real-time SP cur (z).
  • Step 604 Obtain the ear canal modeling ED inv transfer function and the mapping relationship H inv between the SP inv path and the ED inv transfer function based on the obtained personalized data.
  • the earphone when the switch of the earphone is triggered, the earphone is in a working state, and the earphone can collect personalized data of the wearer.
  • the headset can obtain personalized data of the wearer through voice interaction.
  • the headset may include buttons, and the wearer's personalized data is collected based on the wearer's operation of the buttons.
  • the headset can use other input devices (such as a display, a touch keyboard, etc.), the headset is connected to the input device, and the headset can obtain the wearer's personalized data through the input device, or the input device can obtain the wearer's personality. data and send personalized data to the headset.
  • the embodiments of the present application do not specifically limit the manner in which the earphone collects the wearer's personalized data.
  • the headset wearing status in the personalization data may be determined by the headset.
  • the headset may include a direction sensor and a gyroscope sensor, so that the headset can determine the posture information of the headset according to the data of the direction sensor and the gyroscope sensor, and the headset can determine the tightness of the headset and whether the wearing posture of the headset has changed.
  • the headset may also include an acceleration sensor, and the headset may reflect whether the headset is carried by the wearer according to the data of the acceleration sensor and is in a motion state, and the headset can determine whether the headset wearer is in a motion state. That is to say, the personalization data of the wearer may be determined by the earphone according to the data of its own sensor, or the personalized data may be obtained by the interaction between the earphone and the wearer.
  • the earphone collects the wearer's personalized data, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data.
  • the preset audio signal played by the earphone is coupled with the wearer's ear canal, and the earphone can obtain the response information of the current wearer coupling the wearer's ear canal information, so that the earphone can model the real-time transfer function ED cur (z).
  • the earphone plays a preset audio signal
  • the earphone obtains the personalized data of the earphone wearer
  • the earphone can generate the real-time SP cur (z) path and ED cur (z) transfer function for the wearer.
  • the real-time ED cur (z) transfer function can reflect the relationship between the sound pressure signal at the ERP and the DRP. Since the feedforward microphone in the headset can collect the audio signal at the ERP, the headset can determine the location of the ear canal at the ERP according to the audio signal at the ERP. sound pressure signal.
  • the earphone plays an audio signal, and the earphone can adjust the sound pressure signal at the DRP according to the ED cur (z) transfer function and the sound pressure signal at the ERP.
  • the purpose of optimizing the ANC and/or HT function of the headset is achieved, and the sound effect of the audio signal played by the headset is improved, so as to provide the wearer with a good listening experience.
  • Step 605 Play the audio information, collect the response information of the wearer's ear canal, and update the SP cur path and the ED cur transfer function in real time.
  • the headphones can collect the sound pressure signal at the ERP in real time, and adjust the audio signal played by the headphones in real time according to the ED cur (z) transfer function to provide good noise reduction. or pass-through effect.
  • Step 606 Adjust the audio information played by the earphone based on the SP cur path and the ED cur transfer function updated in real time, so that the earphone realizes real-time active noise reduction and/or real-time transparent transmission.
  • the headset can also collect personalized data in real time in the process of use to update the SP cur path and the ED cur transfer function.
  • personalized data can be determined by the headset according to its own sensor data, such as the tightness of the headset, whether the wearer is in motion, etc. For example, if the headset is worn by the wearer, and the wearer is in a state of motion (such as walking, running, etc.), then as the wearer's pace changes, the acceleration sensor in the headset can detect the motion state of the headset, and the headset can detect the motion state of the headset according to the acceleration Data from the sensors determines the state of the wearer in real time.
  • the movement of the wearer may affect the tightness of the earphone, and the sensor in the earphone can detect the tightness of the earphone.
  • the headset can detect the tightness of the headset in real time.
  • the earphone can determine whether the tightness of the earphone has changed greatly by collecting the sound pressure signal at the ERP. If the tightness of the earphone is changed, the earphone can adjust the ED cur transfer function in real time according to the change of the tightness of the earphone (ie, the change of the personalized data), so that the earphone can optimize the functions such as ANC and/or HT in real time.
  • the method provided by the embodiments of the present application will be described below by using the hearable device to interact with the first device, and the listenable device to cooperate with the first device so that the hearable device is in a working state.
  • the headset can interact with the first device, and the first device can obtain the general SP db path and ED db transfer function obtained based on big data, and the mapping relationship H db between the SP db path and the ED db function domain.
  • the first device can interact with the earphone wearer to obtain personalized data of the wearer, and the first device creates an SP inv path and an ED inv transfer function for the earphone wearer.
  • the earphone can utilize the computing and data processing capabilities of the mobile phone to create the SP inv path and the ED inv transfer function for the earphone wearer.
  • the headset can communicate with the first device through the communication module.
  • the headset can utilize the computing and data processing capabilities of the remote device to create the SP inv path and the ED inv transfer function for the headset wearer.
  • the listening device is an earphone
  • the first device may be a mobile phone
  • the earphone establishes a connection through a communication method such as Bluetooth or WLAN
  • the earphone can receive an audio signal from the mobile phone and play the audio signal.
  • the headset may include a communication module, so that the headset can establish a communication connection with a mobile phone, a computer, and the like.
  • the headset establishes a communication connection with the mobile phone by means of short-range communication (eg, Bluetooth, WLAN, NB-IoT, etc.). In this way, the headset can interact with the mobile phone, and the mobile phone can collect the wearer's personalized data.
  • the earphone can play the test audio signal, collect the response information coupled with the wearer's ear canal information, and the earphone can send the response information to the mobile phone.
  • the mobile phone can obtain the SP inv path according to the response information, and correct the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data, and obtain the ED inv transfer function.
  • the mobile phone can transmit the SP inv path and ED inv transfer function for the current wearer to the headset, so that the headset can adjust the playback audio signal for the current wearer, optimizing the ANC and/or HT functions of the headset.
  • the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain can be preset in the headset. After the headset establishes a communication connection with the mobile phone, the headset sends the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain to the mobile phone.
  • the headset sends the download address to the mobile phone, and the mobile phone can access the download address, and download the SP db path and ED db transfer function based on big data, as well as the mapping of the SP db path and the ED db function domain. relation H db .
  • a radio frequency module may be included in the headset, so that the headset can interact with a remote server or cloud device.
  • the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain can be set on the remote server or cloud device.
  • the headset can be used to interact with the wearer, collect the wearer's personalized data, and transmit the collected wearer's personalized data to the mobile phone through the radio frequency module.
  • the cell phone can create the wearer's SP inv path and ED inv transfer function based on the wearer of the headset.
  • the remote server can send the obtained SP inv path and ED inv transfer function of the wearer to the headset, so that the headset can adjust the playing audio signal for the current wearer during the process of playing audio, providing good active noise reduction and transparency. transfer function.
  • the method provided by the embodiments of the present application is described by taking the listening device as an earphone and the first device as a mobile phone as an example.
  • FIG. 7 is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application. As shown in FIG. 7 , the method includes steps 701 to 709 .
  • the earphone can create and obtain the SP inv path and the ED inv transfer function for the wearer according to the personalized data.
  • the mobile phone creates the SP inv path and the ED inv transfer function for the wearer.
  • step 702, step 703, and step 708 in the embodiment of the present application are the same as step 601, step 602, and step 605 in the foregoing embodiment.
  • Step 701 Establish a communication connection between the headset and the mobile phone.
  • the communication connection between the headset and the mobile phone is established by using a Bluetooth connection.
  • the Bluetooth function of the mobile phone and the headset are both turned on, and the headset and the mobile phone are successfully connected via Bluetooth, then the headset can interact with the mobile phone data through Bluetooth.
  • Step 702 The earphone is worn by the wearer, and the active noise reduction and/or transparent transmission function of the earphone is turned on.
  • the earphone is connected to the mobile phone through Bluetooth, and the mobile phone can send control information to the earphone, and the control information is used to control the state of the function provided by the earphone.
  • a Bluetooth connection is established between the headset and the mobile phone, and the mobile phone can display a control interface of the headset, and the control interface includes switch controls for functions in the headset. For example, switch controls for active noise reduction and switch controls for transparent transmission.
  • the mobile phone receives the trigger operation of the active noise reduction switch control by the wearer, and the mobile phone sends the control information to enable the active noise reduction function to the headset.
  • the earphone is worn by the wearer, the earphone includes buttons, and the buttons on the earphone can be used to enable the function of the earphone.
  • the headset includes a button for the active noise reduction function and a button for the transparent transmission function. The button for the active noise reduction function on the headset is triggered, and the headset activates the active noise reduction function.
  • Step 703 The earphone plays the preset audio signal, and collects the response information of the wearer's ear canal, and the response information is used to create the SP inv path.
  • the preset audio signal played by the earphone may be an audio signal pre-stored in the earphone.
  • the audio signal is an audio signal sent by the mobile phone to the headset.
  • the mobile phone can send a preset audio signal to the headset, and the headset plays the preset audio signal.
  • the earphone plays a preset audio signal for the earphone to collect the feedback response information of the ear canal, so that the SP inv path can be created according to the response information.
  • Step 704 The headset transmits the collected response information to the mobile phone.
  • the headset transmits the collected response information to the mobile phone, so that the mobile phone can process the response information, and generate the SP inv path according to the response information.
  • Step 705 The mobile phone receives the response information transmitted by the headset, and collects the wearer's personalized data, and the personalized data is used for ED inv modeling.
  • the mobile phone may display a personalized data collection interface, and the mobile phone may acquire information input by the wearer on the personalized data collection interface, so that the mobile phone may acquire the wearer's personalized information.
  • the personalized data may include whether the earphones worn by the wearer include earmuffs, the size of the earmuffs, the tightness of the earphones, and the like.
  • Step 706 The mobile phone creates the SP inv path of the wearer's ear canal according to the obtained response information, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data to obtain the ED inv transfer function.
  • the mobile phone obtains the SP db path and ED db transfer function according to the big data, and the mapping relationship H db between the SP db path and the ED db function domain, and obtains the SP inv path and ED inv transfer function personalized for the wearer.
  • the specific implementations of steps 605 to 605 are the same as the above-mentioned steps 503 and 504, and the specific implementation may refer to the above-mentioned steps 503 and 504, which will not be repeated here.
  • Step 707 The mobile phone transmits the generated ED inv transfer function for the wearer to the earphone, and sends audio data to the earphone.
  • the earphone can adjust the played audio signal according to the ED inv transfer function, so as to satisfy the function of active noise reduction or transparent transmission.
  • Step 708 The earphone adjusts the played audio signal according to the ED inv transfer function, collects the response information of the wearer's ear canal, and sends the response information to the mobile phone.
  • Step 709 The mobile phone uses the response information to update the SP inv path and the ED inv transfer function, and transmits the updated ED transfer function to the headset, so that the headset can perform active noise reduction and/or transparent transmission in real time.
  • the mobile phone obtains the SP inv path and the ED inv transfer function according to the personalized data and response information.
  • the mobile phone in the process of using the headset, the mobile phone obtains the SP inv path curve of the headset wearer according to the real-time data.
  • the schematic diagram of the ED inv transfer function curve in the process of using the headset, the mobile phone obtains the SP inv path curve of the headset wearer according to the real-time data.
  • the SP curve shown in FIG. 8 is the power gain on the SP path collected by the headset in different frequency bands of the audio file currently being played by the headset.
  • the ED curve is the power gain change of the sound pressure at ERP and DRP when the current headset is playing an audio file.
  • the modeling switch of the ED inv transfer function can be controlled by the wearer during use of the earphone, the wearer can trigger the modeling switch, and the earphone obtains the wearer's personalized data to create the ED inv transfer function.
  • the wearer can also not trigger the modeling switch, and the headset will not obtain the wearer's personalized data, nor will the ED inv transfer function be created.
  • FIG. 9A is a schematic diagram of an application scenario in which a mobile phone and a headset are used together.
  • 801 denotes a human ear
  • 802 denotes an earphone
  • 803 denotes a mobile phone.
  • the earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth.
  • the display interface of the mobile phone 803 shows that the ANC function is on, and the switch for creating the ED transfer function is off.
  • FIG. 9B is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset.
  • the headset can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED transfer function and SP path obtained based on big data.
  • Ref represents the response information collected by the feedforward microphone
  • W ff (Z) represents the response information on the feedback path obtained according to the response information collected by Ref.
  • W fb (Z) represents the response information on the primary path collected by the earphone.
  • SPK represents the audio signal played by the speaker of the headset.
  • ED(z) 1.
  • the feedforward microphone collects the response information Ref to obtain W ff (Z).
  • the earphone can collect the sound pressure signal at ERP and transmit it to the calculator.
  • SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer.
  • the earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL.
  • the ED transfer function for the wearer is not considered, and noise reduction is only achieved at the entrance of the ear canal, then the noise reduction degree at the ERP is better than that at the DRP. noise depth.
  • FIG. 10A is a schematic diagram of an application scenario in which a mobile phone and a headset are used together.
  • 801 denotes a human ear
  • 802 denotes an earphone
  • 803 denotes a mobile phone.
  • the earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth.
  • the display interface of the mobile phone 803 shows that the ANC function is turned on, and the switch for creating the ED transfer function is turned on.
  • FIG. 10B is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset.
  • the headset can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED transfer function and SP path obtained based on big data.
  • W ff (Z) represents the response information on the feedback path collected by the earphone
  • W fb (Z) represents the response information on the primary path collected by the earphone.
  • the headset plays an audio signal
  • the SP(z) detection module and the ED(z) estimation module work synchronously to collect relevant parameters for creating the SP path, and update the relevant parameters of the SP path in real time.
  • the SP(z) detection module is used to detect the related data of the SP path
  • the SP(z) update module is used to update the related data of the SP path.
  • SP(z) can update the SP path in real time according to the data of the SP(z) update module.
  • SP(z) can get the real-time SP cur (z) and transmit SP cur (z) to the operator.
  • the calculator can also obtain the response information of the ERP to obtain parameters for generating the ED transfer function.
  • the ED(z) estimation module is used to estimate the current sound pressure signal at the DRP, and the ED(z) update module estimates the ED db transfer function according to the sound pressure signal at the DRP.
  • the ED(z) module generates a real-time ED transfer function based on the ED(z) update module and data from the operator.
  • the ED(z) update module is used to update the parameters in the ED cur (z) transfer function to obtain W fb (Z).
  • the earphone can adjust the audio signal of the speaker in the earphone according to W ff (Z), W fb (Z) and DL.
  • the ED transfer function for the wearer is considered to achieve noise reduction at the DRP. Therefore, the noise reduction degree at the DRP is better than that at the ERP.
  • FIG. 11 is a schematic diagram of the comparison between the noise reduction effect of creating the ED inv transfer function and the noise reduction effect of closing the creation of the ED inv transfer function in the process of active noise reduction.
  • the value of the noise reduction depth corresponding to the ANC curve after the ED is turned on is smaller, and the noise reduction effect after the ED is turned on is better. Therefore, compared with the noise reduction at the ERP, the effect of noise reduction at the EDP is better if the ED transfer function is used.
  • the method provided by the embodiment of the present application has better noise reduction degree and wider bandwidth, and has better noise reduction effect when the ED transfer function is activated, compared with the active noise reduction at the ERP.
  • modeling through the ED transfer function can bring a better transparent transmission effect.
  • FIG. 12A is a schematic diagram of an application scenario in which a mobile phone and a headset are used together.
  • 801 denotes a human ear
  • 802 denotes an earphone
  • 803 denotes a mobile phone.
  • the earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth.
  • the display interface of the mobile phone 803 shows that the HT function is on, and the switch for creating the ED transfer function is off.
  • FIG. 12B is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset.
  • the earphone can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED db transfer function and SP db path obtained based on big data.
  • W ff (Z) represents the response information on the feedback path collected by the earphone
  • W fb (Z) represents the response information on the primary path collected by the earphone.
  • the feedforward microphone collects the response information Ref.
  • the response information W ff (Z) on the primary path of the earphone is obtained.
  • the earphone can collect the sound pressure signal at ERP and transmit it to the calculator.
  • SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer. .
  • the earphone can obtain the response information W fb (Z) on the primary path according to the SP inv path and the ED inv transfer function.
  • the earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL, so that the earphone realizes the transparent transmission function.
  • the ED transfer function for the wearer is not considered, and only the transparent transmission effect at the ERP can be guaranteed, so it can be determined that the transparent transmission bandwidth at the ERP is better than that at the DRP.
  • FIG. 13A is a schematic diagram of an application scenario in which a mobile phone and a headset are used together.
  • 801 denotes a human ear
  • 802 denotes an earphone
  • 803 denotes a mobile phone.
  • the earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth.
  • the display interface of the mobile phone 803 shows that the HT function is in an on state, and the switch for creating the ED transfer function is in an on state.
  • FIG. 13B is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset.
  • the earphone can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED db transfer function and SP db path obtained based on big data.
  • W ff (Z) represents the response information on the feedback path collected by the earphone
  • W fb (Z) represents the response information on the primary path collected by the earphone.
  • the earphone plays a preset audio signal, and the HT function of the earphone is turned on.
  • the earphone can collect the sound pressure signal at ERP and transmit it to the calculator.
  • SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer.
  • the earphone can obtain the response information W fb (Z) on the primary path according to the SP inv path and the ED inv transfer function.
  • the earphone obtains Ref through feed-forward microphone acquisition, and the ED(z) module obtains ED(z) according to the Ref collected in real time and the relevant parameters for creating the ED function.
  • the earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL.
  • the SP(z) detection module is in a working state, and the response data is collected to create the SP path.
  • the SP(z) detection module can update SP cur (z) in real time according to the currently collected data.
  • the ED(z) estimation module obtains the estimation of ED cur (z) according to the personalized nonlinear mapping function H inv and SP cur (z) obtained by offline training, and then the ED (z) update module estimates the ED cur (z) in the system parameters are updated.
  • the earphone in the process of transparently transmitting the sound, the earphone can achieve the purpose of the audio signal at the DRP, which can improve the transparent transmission effect at the DRP. Therefore, the transparent transmission bandwidth at the DRP point is stronger than that at the ERP point. transmission bandwidth.
  • the headset enables the transparent transmission function to create a schematic diagram of the value change of the real-time transparent transmission when the ED transfer function module is turned on and off.
  • Figure 14 taking the waveform of the audio signal heard by the human ear when the earphone is not worn as the reference standard, the sound signal heard by the human ear is closer when the ED transfer function module is turned on, and the audio signal received by the human ear when the earphone is not worn. Signal. The closer the sound pressure signal of the DRP is to the sound pressure when no headphones are worn, the better the transparent transmission effect will be.
  • the ED transfer function creation module when the ED is turned on, the sound pressure transparently transmitted by the earphone is closer to the sound pressure signal of the human ear DRP when the earphone is not worn. Therefore, when the ED transfer function creation module is enabled, the transparent transmission effect of the headset is better, the bandwidth of the transparent transmission of the headset is wider, and the transparent transmission bandwidth at the DRP point is stronger than the transparent transmission bandwidth at the ERP point.
  • the listenable device is an earphone
  • the first device is a cloud device as an example to describe the method provided by the embodiments of the present application. As shown in FIG. 15 , the method includes steps 901 to 909 .
  • Step 901 The headset establishes a connection with the cloud device.
  • the headset includes a radio frequency module, and the headset can establish a communication connection with the cloud device through the radio frequency module, so as to achieve the purpose of data transmission between the headset and the cloud device.
  • the cloud device is provided with big data to obtain the SP db path and the ED db transfer function, and the mapping relationship H db between the SP db and the ED db function domain.
  • the headset establishes communication with the cloud device, and the message sent by the headset to the cloud device includes the logo of the headset, so that the cloud device can model the headset to obtain the SP inv path and ED inv transmission of the wearer of the headset. function.
  • Step 902 The earphone is worn by the wearer, and the active noise reduction and/or transparent transmission of the earphone is turned on.
  • Step 903 The earphone plays a preset audio signal, and collects the response information of the wearer's ear canal, and the response information is used to create the SP path.
  • Step 904 The headset transmits the collected response information to the cloud device, the headset acquires the wearer's personalized data, and sends the personalized data to the cloud device.
  • Step 905 The cloud device receives the response information and personalized data transmitted by the headset, and the personalized data is used for ED inv modeling.
  • Step 906 The cloud device creates the SP inv path of the wearer's ear canal according to the obtained response information, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data to obtain the ED inv transfer function.
  • Step 907 The cloud device transmits the generated ED inv transfer function for the wearer to the headset.
  • Step 908 The headset adjusts the played audio signal according to the ED inv transfer function, collects the response information of the wearer's ear canal, and transmits the response information to the cloud device.
  • Step 909 The cloud device uses the response information to update the SP inv path and the ED inv transfer function, and transmits the updated ED inv transfer function to the headset, so that the headset can implement real-time noise reduction and/or real-time transparent transmission.
  • the hearable device is an earphone.
  • the hearable device is another device, the above method can also be used. It will not be repeated here.
  • the above-mentioned listen-worn device includes corresponding hardware structures and/or software modules for executing each function.
  • the embodiments of the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Experts may use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the embodiments of the present application.
  • the electronic device may be divided into functional modules according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • Embodiments of the present application further provide an electronic device, including: one or more processors and one or more memories.
  • One or more memories coupled to one or more processors for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to execute
  • the above related method steps are to implement the method for optimizing the function of the hearable device in the above embodiment.
  • Embodiments of the present application further provide a chip system, where the chip system includes at least one processor and at least one interface circuit.
  • the processor and interface circuits may be interconnected by wires.
  • an interface circuit may be used to receive signals from other devices, such as the memory of an electronic device.
  • an interface circuit may be used to send signals to other devices, such as a processor.
  • the interface circuit may read the instructions stored in the memory and send the instructions to the processor. When executed by the processor, the instructions can cause the electronic device to perform each step in the above-described embodiments.
  • the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.
  • Embodiments of the present application further provide a computer storage medium, where the computer storage medium includes computer instructions, when the computer instructions are executed on the above-mentioned electronic device, the electronic device is made to perform various functions or steps performed by the mobile phone in the above-mentioned method embodiments .
  • Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, enables the computer to perform various functions or steps performed by the mobile phone in the above method embodiments.
  • the disclosed apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Headphones And Earphones (AREA)

Abstract

The embodiments of the present application provide a method for optimizing functions of hearables and hearables, relating to the field of acoustic technology. In said method, when the hearables are in a working state, the effects of the active noise reduction function or pass-through function of the hearables can be improved, thereby providing a better user experience for the wearer of the hearables. Said method comprises: when an audio signal is played back by hearables, acquiring response information; sending the response information and audio information to a first device, and the first device generating an SP according to the response information and the audio information; and the first device generating an ED transfer function according to the SP and the acquired personalized data, and sending the ED transfer function to the hearables, and the hearables adjusting the played audio signal according to the ED transfer function. In this way, the noise reduction depth of the active noise reduction of the hearables and/or the passed-through acoustic pressure signal are adjusted, so as to achieve the purpose of optimizing the function of the hearables.

Description

一种优化听戴式设备功能的方法及听戴式设备A method for optimizing the function of a hearable device and the hearable device
本申请要求于2020年12月10日提交国家知识产权局、申请号为202011435355.5、申请名称为“一种优化听戴式设备功能的方法及听戴式设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the State Intellectual Property Office on December 10, 2020, the application number is 202011435355.5, and the application name is "A Method for Optimizing the Function of a Hearable Device and the Hearable Device". The entire contents of this application are incorporated by reference.
技术领域technical field
本申请实施例涉及声学技术领域，尤其涉及一种优化听戴式设备功能的方法及听戴式设备。The embodiments of the present application relate to the field of acoustic technologies, and in particular, to a method for optimizing a function of a hearable device and a hearable device.
背景技术Background technique
可听戴设备(Hearables)(或称为听戴式设备、耳戴式装置)是佩戴在人耳附近的可穿戴类电子设备，例如，可听戴设备包括耳机、助听器和人工耳蜗等。这些可听戴设备可以为佩戴者提供播放音频、语音服务等服务。以可听戴设备是耳机为例，佩戴者佩戴耳机，耳机播放音乐，则佩戴者可以听到耳机播放的音乐。Hearables (or called hearables, ear-worn devices) are wearable electronic devices that are worn near the human ear. For example, the hearables include earphones, hearing aids, and cochlear implants. These hearable devices can provide the wearer with services such as playback of audio, voice services, and more. Taking the hearable device as an earphone as an example, the wearer wears the earphone, and the earphone plays music, and the wearer can hear the music played by the earphone.
其中，人耳听到的声音实际上是声波信号引起人耳耳膜振动产生的。声波信号传播至人耳耳膜的位置，由于声波信号改变人耳耳膜处的压强，形成声压，声压使得耳膜产生振动从而使人耳听到声音。因此，如果耳机可以获取到人耳耳膜处的声压信号，耳机就可以根据耳道入口处的声压信号和人耳耳膜处的声压信号的关系，调节耳机播放的声波信号，以实现耳机的主动降噪或透传功能，为佩戴者提供音效良好的声音播放服务。Among them, the sound heard by the human ear is actually produced by the vibration of the eardrum of the human ear caused by the sound wave signal. The sound wave signal propagates to the position of the eardrum of the human ear. Since the sound wave signal changes the pressure at the eardrum of the human ear, sound pressure is formed, and the sound pressure causes the eardrum to vibrate so that the human ear can hear the sound. Therefore, if the earphone can obtain the sound pressure signal at the eardrum of the human ear, the earphone can adjust the sound wave signal played by the earphone according to the relationship between the sound pressure signal at the entrance of the ear canal and the sound pressure signal at the eardrum of the human ear, so as to realize the realization of the earphone. The active noise reduction or transparent transmission function provides the wearer with a sound playback service with good sound effect.
发明内容SUMMARY OF THE INVENTION
本申请提供一种优化听戴式设备功能的方法及听戴式设备，在听戴式设备处于工作状态时，提高听戴式设备的降噪功能或透传功能的效果，进而为听戴式设备的佩戴者提供更好的用户体验。The present application provides a method for optimizing the function of a hearable device and a hearable device. When the hearable device is in a working state, the effect of the noise reduction function or the transparent transmission function of the hearable device is improved, thereby improving the performance of the hearable device. The wearer of the device provides a better user experience.
为实现上述技术目的，本申请采用如下技术方案：In order to realize the above-mentioned technical purpose, the application adopts the following technical solutions:
第一方面，本申请提供一种优化听戴式设备功能的方法，该方法可以包括：听戴式设备播放音频信号，并采集音频信号在佩戴者耳道的响应信息(即ERP的声压信号)，其中，听戴式设备被佩戴者佩戴，音频信号在佩戴者耳道传播时产生响应信息。In a first aspect, the present application provides a method for optimizing the function of a listenable device, the method may include: the listenable device plays an audio signal, and collects the response information of the audio signal in the ear canal of the wearer (that is, the sound pressure signal of the ERP). ), wherein the hearable device is worn by the wearer, and the audio signal generates response information as it propagates through the wearer's ear canal.
听戴式设备向第一设备发送响应信息和音频信号，则第一设备可以根据响应信息和音频信号，生成第二(Secondary Path，SP)路径，SP路径用于表示音频信号与耳道外部参考点ERP的声压信号的关系。The hearable device sends the response information and the audio signal to the first device, then the first device can generate a second (Secondary Path, SP) path according to the response information and the audio signal, and the SP path is used to represent the audio signal and the external reference of the ear canal The relationship between the sound pressure signal of the point ERP.
进一步的，第一设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。Further, the first device generates an ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. .
第一设备向听戴式设备发送ED传递函数和SP路径，听戴式设备接收到ED传递函数和SP路径，可以根据ED传递函数调整音频信号。The first device sends the ED transfer function and the SP path to the hearable device, and the hearable device receives the ED transfer function and the SP path, and can adjust the audio signal according to the ED transfer function.
可以理解的，SP路径表示听戴式设备播放的音频信号与ERP的声压的关系，ED传递函数表示ERP的声压信号到DRP的声压信号的关系。听戴式设备根据SP路径调整 音频信号，可以改变ERP的声压信号，并根据ERP的声压信号和ED传递函数确定出DRP的声压信号。也就是说，当听戴式设备调整音频信号，则可以改变DRP的声压信号。因此，听戴式设备可以根据SP路径和ED传递函数调整音频信号，以实现优化听戴式设备功能的目的。It can be understood that the SP path represents the relationship between the audio signal played by the wearable device and the sound pressure of the ERP, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. The listening device adjusts the audio signal according to the SP path, which can change the sound pressure signal of the ERP, and determine the sound pressure signal of the DRP according to the sound pressure signal of the ERP and the ED transfer function. That is, when the hearable device adjusts the audio signal, it can change the sound pressure signal of the DRP. Therefore, the hearable device can adjust the audio signal according to the SP path and the ED transfer function for the purpose of optimizing the function of the hearable device.
需要说明的，上述的步骤可以重复执行，使得听戴式设备可以实时调整音频信号，这样，可以实现实时优化听戴式设备功能的目的。It should be noted that the above steps can be repeatedly performed, so that the hearable device can adjust the audio signal in real time, so that the purpose of optimizing the function of the hearable device in real time can be achieved.
其中，听戴式设备的功能可以是主动降噪功能，也可以是透传功能。当听戴式设备的主动降噪和/或透传功能处于开启状态，则听戴式设备可以根据SP路径和ED传递函数调整音频信号，以实现实时优化主动降噪和/或透传功能的目的。此处听戴式设备调整音频信号可以是调整听戴式设备播放的声音信号的音量，也可以是调整听戴式设备播放的声音信号的播放频率等。此处对于调整的音频信号中的物理量不作具体限定。Among them, the function of the hearable device may be an active noise reduction function or a transparent transmission function. When the active noise reduction and/or pass-through function of the hearable device is turned on, the hearable device can adjust the audio signal according to the SP path and the ED transfer function to achieve real-time optimization of the active noise reduction and/or pass-through function. Purpose. Here, adjusting the audio signal by the listenable device may be adjusting the volume of the sound signal played by the listenable device, or may be adjusting the playback frequency of the sound signal played by the listenable device, or the like. The physical quantity in the adjusted audio signal is not specifically limited here.
第一方面一种可能的设计中，第一设备中还可以包括多个预设SP路径，多个预设ED传递函数，以及预设SP路径和预设ED传递函数的预设映射关系。其中，预设SP路径是根据佩戴者的响应信息生成的，预设ED传递函数是根据佩戴者的响应信息和DRP的声压信号生成的。In a possible design of the first aspect, the first device may further include multiple preset SP paths, multiple preset ED transfer functions, and a preset mapping relationship between the preset SP paths and the preset ED transfer functions. The preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP.
需要说明的，预设SP路径是针对当前听戴式设备佩戴者的响应信息生成。如，听戴式设备多次测试得到的响应信息和音频信号，以生成多组预设SP路径，并获取多次测试得到的DRP处的声压信息，以生成多组预设ED传递函数。It should be noted that the preset SP path is generated according to the response information of the current wearer of the hearable device. For example, the response information and audio signals obtained from multiple tests of the wearable device are used to generate multiple sets of preset SP paths, and the sound pressure information at the DRP obtained from multiple tests is obtained to generate multiple sets of preset ED transfer functions.
上述第一设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP的到耳道参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系，包括：第一设备获取个性化数据，个性化数据用于创建ED传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。第一设备根据佩戴者的个性化数据和预设映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。第一设备通过第一映射关系和SP路径，生成ED传递函数。The above-mentioned first device generates an ED transfer function corresponding to the ear canal reference point DRP from the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. , including: the first device obtains personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearable device, and the type of the wearer's ear canal. One. The first device obtains the first mapping relationship according to the wearer's personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. The first device generates an ED transfer function by using the first mapping relationship and the SP path.
其中，第一设备中包括针对该佩戴者多组的预设SP路径和预设ED传递函数，以及预设SP路径和预设ED传递函数的映射关系。根据佩戴者的个性化数据可以修正SP路径和ED传递函数的映射关系，使得听戴式设备通过修正的映射关系得到准确的ED传递函数。The first device includes multiple sets of preset SP paths and preset ED transfer functions for the wearer, and a mapping relationship between the preset SP paths and the preset ED transfer functions. The mapping relationship between the SP path and the ED transfer function can be modified according to the wearer's personalized data, so that the hearable device can obtain an accurate ED transfer function through the modified mapping relationship.
第一方面另一种可能的设计中，第一设备还可以包括多个基础SP路径，多个基础ED传递函数，以及基础SP路径和基础ED传递函数的基础映射关系。其中，基础SP路径是根据响应信息生成的，基础ED传递函数是根据响应信息和DRP的声压信号生成的。In another possible design of the first aspect, the first device may further include multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions. Among them, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
需要说明的，基础SP路径和基础ED传递函数是通过多次测试，采集到多个佩戴者的数据生成的。采集得到的数据包括响应信息、音频信号和DRP处的声压信号等。并生成基础SP路径和基础ED传递函数的映射关系。It should be noted that the basic SP path and the basic ED transfer function are generated by collecting data from multiple wearers through multiple tests. The collected data includes response information, audio signals, and sound pressure signals at the DRP. And generate the mapping relationship between the basic SP path and the basic ED transfer function.
上述第一设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP的到耳道参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。具体可以包括：第一设备获取佩戴者的个性化数据，个性化数据用于创建ED 传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。第一设备根据个性化数据和基础映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。第一设备通过第一映射关系和SP路径，得到ED传递函数。The above-mentioned first device generates an ED transfer function corresponding to the ear canal reference point DRP from the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. . Specifically, it may include: the first device obtains the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearer's ear and the wearer's ear. One of the Tao types. The first device obtains the first mapping relationship according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. The first device obtains the ED transfer function through the first mapping relationship and the SP path.
在这种实现方式中，第一设备预设基础SP路径和基础ED传递函数。根据佩戴者个性化数据可以修正SP路径和ED传递函数的映射关系，使得听戴式设备根据修正的映射关系得到准确的ED传递函数。这样，听戴式设备根据SP路径和ED传递函数调整音频信号时，可以优化听戴式设备的功能。In this implementation, the first device presets the base SP path and the base ED transfer function. The mapping relationship between the SP path and the ED transfer function can be modified according to the wearer's personalized data, so that the hearable device can obtain an accurate ED transfer function according to the modified mapping relationship. In this way, the functionality of the hearable can be optimized as the hearable adjusts the audio signal according to the SP path and ED transfer function.
第一方面另一种可能的设计中，听戴式设备播放音频信号，并采集音频信号在佩戴者耳道的响应信息之前，该方法还可以包括：开启听戴式设备的主动降噪和/或透传功能。In another possible design of the first aspect, the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method may further include: enabling active noise reduction of the listenable device and/or or transparent transmission.
上述听戴式设备根据ED传递函数调整音频信号，包括：听戴式设备根据ED传递函数调整音频信号，以实现调整主动降噪的降噪深度和/或调整透传功能的声压信号的目的。The above-mentioned listening and wearing device adjusts the audio signal according to the ED transfer function, including: the listening and wearing device adjusts the audio signal according to the ED transfer function, so as to realize the purpose of adjusting the noise reduction depth of active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function. .
可以理解的，降噪深度越小，则听戴式设备主动降噪(也可以称为降噪)的效果越好。调整音频信号，以降低降噪深度，从而优化主动降噪的功能。透传的声压信号越接近佩戴者不佩戴听戴式设备时的声压信号，则听戴式设备透传的效果越好。通过音频信号，调整DRP的声压信号，可以优化透传功能。Understandably, the smaller the noise reduction depth, the better the active noise reduction (also referred to as noise reduction) effect of the hearable device. Adjusts the audio signal to reduce the depth of noise reduction to optimize the function of Active Noise Cancellation. The closer the transparently transmitted sound pressure signal is to the sound pressure signal when the wearer does not wear the hearable device, the better the transparent transmission effect of the hearable device is. By adjusting the sound pressure signal of the DRP through the audio signal, the transparent transmission function can be optimized.
第二方面，本申请提供一种优化听戴式设备功能的方法，该方法应用于听戴式设备，该方法可以包括：听戴式设备播放音频信号，并采集音频信号在佩戴者耳道的响应信息，其中，听戴式设备被佩戴者佩戴，音频信号在佩戴者耳道传播时产生响应信息。In a second aspect, the present application provides a method for optimizing the function of a hearable device. The method is applied to the hearable device. The method may include: the hearable device plays an audio signal, and collects the audio signal in the ear canal of the wearer. Response information, wherein the hearable device is worn by the wearer and the audio signal generates the response information when propagated in the wearer's ear canal.
听戴式设备根据响应信息和音频信号，生成SP路径，SP路径用于表示音频信号与耳道外部参考点ERP的声压信号的关系。The hearable device generates an SP path according to the response information and the audio signal, and the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal.
听戴式设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。The hearable device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer. The ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP.
听戴式设备根据ED传递函数调整音频信号。The hearable device adjusts the audio signal according to the ED transfer function.
第二方面一种可能的设计方式中，听戴式设备还可以包括多个预设SP路径，多个预设ED传递函数，以及预设SP路径和预设ED传递函数的映射关系；其中，预设SP路径是根据佩戴者的响应信息生成的，预设ED传递函数是根据佩戴者的响应信息和EDR的声压信号生成的。In a possible design manner of the second aspect, the hearable device may further include multiple preset SP paths, multiple preset ED transfer functions, and a mapping relationship between the preset SP paths and the preset ED transfer functions; wherein, The preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the EDR.
上述听戴式设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系，包括：听戴式设备获取佩戴者的个性化数据，个性化数据用于创建ED传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。听戴式设备根据个性化数据和预设映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。听戴式设备通过第一映射关系和SP路径，生成ED传递函数。The above-mentioned listening-worn device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the obtained personalized data of the wearer. The ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. Including: the wearer's personalized data obtained by the hearable device, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearable device and the wearer's ear canal one of the types. The hearable device obtains the first mapping relationship according to the personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. The hearable device generates an ED transfer function through the first mapping relationship and the SP path.
第二方面另一种可能的设计方式中，听戴式设备还可以包括多个基础SP路径，多 个基础ED传递函数，以及基础SP路径和基础ED传递函数的基本映射关系。其中，基础SP路径是根据响应信息生成的，基础ED传递函数是根据响应信息和DRP的声压信号生成的。In another possible design manner of the second aspect, the hearable device may further include multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions. Among them, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
上述听戴式设备获取佩戴者的个性化数据，个性化数据用于创建ED传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。听戴式设备根据个性化数据和基础映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。听戴式设备通过第一映射关系和SP路径，得到ED传递函数。The above-mentioned hearable device obtains the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the tightness of the wearable device and the type of the wearer's ear canal one of the. The hearable device obtains the first mapping relationship according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. The hearable device obtains the ED transfer function through the first mapping relationship and the SP path.
第二方面另一种可能的设计中，听戴式设备播放音频信号，并采集音频信号在佩戴者耳道的响应信息之前，该方法还可以包括：开启听戴式设备的主动降噪和/或透传功能。In another possible design of the second aspect, the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method may further include: enabling active noise reduction of the listenable device and/or or transparent transmission.
上述听戴式设备根据ED传递函数调整音频信号，包括：听戴式设备根据ED传递函数调整音频信号，以实现调整主动降噪的降噪深度和/或调整透传功能的声压信号的目的。The above-mentioned listening and wearing device adjusts the audio signal according to the ED transfer function, including: the listening and wearing device adjusts the audio signal according to the ED transfer function, so as to realize the purpose of adjusting the noise reduction depth of active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function. .
第三方面，本申请提供一种听戴式设备，包括：一个或多个处理器；存储器；以及一个或多个计算机程序。其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令。In a third aspect, the present application provides a hearable device comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions.
当指令被听戴式设备执行时，使得听戴式设备执行以下步骤：播放音频信号，并采集音频信号在佩戴者耳道的响应信息。其中，听戴式设备被佩戴者佩戴，音频信号在佩戴者耳道传播时产生响应信息。向第一设备发送响应信息和音频信号，使得第一设备根据响应信息生成耳道外部参考点ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。接收来自第一设备的ED传递函数；根据ED传递函数调整音频信号。When the instruction is executed by the listenable device, the listenable device is caused to perform the following steps: playing the audio signal, and collecting the response information of the audio signal in the ear canal of the wearer. The hearable device is worn by the wearer, and the audio signal generates response information when the audio signal propagates through the wearer's ear canal. Send the response information and the audio signal to the first device, so that the first device generates the ED transfer function corresponding to the external reference point ERP of the ear canal to the reference point DRP of the eardrum according to the response information, and the ED transfer function represents the sound pressure signal of the ERP and the sound pressure of the DRP. signal relationship. Receive the ED transfer function from the first device; adjust the audio signal according to the ED transfer function.
第三方面的一种可能的设计中，当指令被听戴式设备执行时，还使得听戴式设备执行以下步骤：开启听戴式设备的主动降噪和/或透传功能；当听戴式设备根据ED传递函数调整音频信号时，听戴式设备具体执行以下步骤：根据ED传递函数调整音频信号，以实现调整主动降噪的降噪深度和/或调整透传功能的声压信号的目的。In a possible design of the third aspect, when the instruction is executed by the hearable device, the hearable device is further caused to perform the following steps: enable the active noise reduction and/or transparent transmission function of the hearable device; When the audio signal is adjusted according to the ED transfer function, the hearable device specifically performs the following steps: adjusting the audio signal according to the ED transfer function, so as to adjust the noise reduction depth of the active noise reduction and/or adjust the sound pressure signal of the transparent transmission function. Purpose.
第四方面，本申请提供一种电子设备，包括：一个或多个处理器；存储器；以及一个或多个计算机程序。其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令。In a fourth aspect, the present application provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions.
当指令被听戴式设备执行时，使得听戴式设备执行以下步骤：接收来自听戴式设备的响应信息和音频信号。其中，听戴式设备被佩戴者佩戴，所示听戴式设备播放音频信号时，音频信号在佩戴者耳道传播时产生响应信息。根据响应信息和音频信号，生成SP路径，SP路径用于表示音频信号与耳道外部参考点ERP的声压信号的关系。根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。向听戴式设备发送ED传递函数，使得听戴式设备根据ED传递函数调整音频信号。When the instructions are executed by the hearable device, the hearable device is caused to perform the steps of: receiving response information and audio signals from the hearable device. The listenable device is worn by the wearer, and when the shown listenable device plays an audio signal, the audio signal generates response information when the audio signal propagates through the wearer's ear canal. Based on the response information and the audio signal, an SP path is generated, and the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal. According to the SP path and the acquired personalized data of the wearer, the ED transfer function corresponding to the ERP to the eardrum reference point DRP is generated. The ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP. The ED transfer function is sent to the hearable device so that the listenable device adjusts the audio signal according to the ED transfer function.
第四方面的一种可能的设计中，电子设备还可以包括：多个预设SP路径，多个预设ED传递函数，以及预设SP路径和预设ED传递函数的预设映射关系。其中，预设 SP路径是根据佩戴者的响应信息生成的，预设ED传递函数是根据佩戴者的响应信息和DRP的声压信号生成的。In a possible design of the fourth aspect, the electronic device may further include: multiple preset SP paths, multiple preset ED transfer functions, and a preset mapping relationship between the preset SP paths and the preset ED transfer functions. The preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP.
当指令被听戴式设备执行时，使得电子设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。电子设备具体执行以下步骤：获取个性化数据，个性化数据用于创建ED传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。根据佩戴者的个性化数据和预设映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。通过第一映射关系和SP路径，生成ED传递函数。When the instruction is executed by the hearable device, the electronic device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer. The ED transfer function represents the sound pressure signal of the ERP and the DRP sound pressure signal relationship. The electronic device specifically performs the following steps: acquiring personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the listening device, the tightness of the listening device, and the type of the wearer's ear canal. one of. The first mapping relationship is obtained according to the wearer's personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. Through the first mapping relationship and the SP path, an ED transfer function is generated.
第四方面另一种可能的设计中，电子设备还可以包括：多个基础SP路径，多个基础ED传递函数，以及基础SP路径和基础ED传递函数的基础映射关系。其中，基础SP路径是根据响应信息生成的，基础ED传递函数是根据响应信息和DRP的声压信号生成的。In another possible design of the fourth aspect, the electronic device may further include: multiple basic SP paths, multiple basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions. Among them, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP.
当指令被听戴式设备执行时，使得电子设备根据SP路径和获取到的佩戴者的个性化数据，生成ERP到耳膜参考点DRP对应的ED传递函数，ED传递函数表示ERP的声压信号与DRP的声压信号的关系。电子设备具体执行以下步骤：获取佩戴者的个性化数据，个性化数据用于创建ED传递函数，个性化数据至少包括：听戴式设备的类型、听戴式设备佩戴的松紧程度和佩戴者耳道类型中的一个。根据个性化数据和基础映射关系得到第一映射关系，第一映射关系用于表示SP路径和ED传递函数的对应关系。通过第一映射关系和SP路径，得到ED传递函数。When the instruction is executed by the hearable device, the electronic device generates the ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer. The ED transfer function represents the sound pressure signal of the ERP and the DRP sound pressure signal relationship. The electronic device specifically performs the following steps: acquiring personalized data of the wearer, and the personalized data is used to create the ED transfer function. One of the Tao types. The first mapping relationship is obtained according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function. Through the first mapping relationship and the SP path, the ED transfer function is obtained.
第五方面，本申请还提供一种听戴式设备，包括：一个或多个处理器；存储器；以及一个或多个计算机程序。其中，一个或多个计算机程序存储在存储器中，一个或多个计算机程序包括指令，当指令被听戴式设备执行时，使得听戴式设备执行第二方面及其任一种可能的设计方式中的优化听戴式设备功能的方法。In a fifth aspect, the present application further provides a hearable device, comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the hearable device, cause the hearable device to perform the second aspect and any possible design methods thereof Methods for optimizing the functionality of a hearable device in .
第六方面，本申请实施例提供了一种计算机可读存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行上述第一方面、第二方面及其任一种可能的设计中的优化听戴式设备功能的方法。In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device is made to perform the above-mentioned first aspect, the second aspect, and any possible possibility thereof Methods for optimizing the functionality of hearables in the design of .
第七方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行上述第一方面、第二方面及其任一种可能的设计中电子设备执行的优化听戴式设备功能的方法。In a seventh aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the electronic device in the first aspect, the second aspect, and any possible design thereof. Ways to optimize the functionality of a hearable device.
第八方面，本申请实施例提供了一种芯片***，该芯片***应用于电子设备。该芯片***包括一个或多个接口电路和一个或多个处理器；接口电路和处理器通过线路互联；接口电路用于从电子设备的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行计算机指令时，使得电子设备执行上述第一方面、第二方面及其任一种可能的设计中的优化听戴式设备功能的方法。In an eighth aspect, an embodiment of the present application provides a chip system, where the chip system is applied to an electronic device. The chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the interface circuit is used for receiving signals from the memory of the electronic device and sending signals to the processor, and the signals are included in the memory Stored computer instructions; when the processor executes the computer instructions, it causes the electronic device to perform the method for optimizing the function of the hearable device in the first aspect, the second aspect, and any possible designs thereof.
可以理解的是，上述本申请提供的第二方面的方法，第三方面的听戴式设备，第四方面的电子设备，第五方面的听戴式设备，第六方面的计算机可读存储介质，第七方面的计算机程序产品和第八面的芯片***所能达到的有益效果，可参考如第一方面及其任一种可能的设计方式中的有益效果，此处不再赘述。It can be understood that the above-mentioned method of the second aspect, the hearable device of the third aspect, the electronic device of the fourth aspect, the hearable device of the fifth aspect, and the computer-readable storage medium of the sixth aspect For the beneficial effects that can be achieved by the computer program product of the seventh aspect and the chip system of the eighth aspect, reference may be made to the beneficial effects of the first aspect and any possible design methods thereof, which will not be repeated here.
附图说明Description of drawings
图1A为本申请实施例提供的一种人耳佩戴不同类型的耳机示意图；1A is a schematic diagram of different types of earphones worn by human ears according to an embodiment of the present application;
图1B为本申请实施例提供的一种人耳耳道结构示意图；1B is a schematic structural diagram of a human ear canal provided by an embodiment of the present application;
图2为本申请实施例提供的一种人耳耳道等效电路结构示意图；2 is a schematic structural diagram of an equivalent circuit of a human ear canal provided by an embodiment of the present application;
图3为本申请实施例提供的一种听戴式设备的结构示意图；FIG. 3 is a schematic structural diagram of a hearable device according to an embodiment of the present application;
图4为本申请实施例提供的一种听戴式设备应用场景示意图；FIG. 4 is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application;
图5为本申请实施例提供的一种优化听戴式设备功能的方法的流程图；5 is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application;
图6为本申请实施例提供的另一优化听戴式设备功能的方法的流程图；6 is a flowchart of another method for optimizing the function of a hearable device provided by an embodiment of the present application;
图7为本申请实施例提供的一种优化听戴式设备的***结构示意图；FIG. 7 is a schematic diagram of a system structure of an optimized listen-worn device provided by an embodiment of the present application;
图8为本申请实施例提供的一种测试的人耳耳道SP路径和ED传递函数的曲线；8 is a curve of the human ear canal SP path and ED transfer function of a test provided by the embodiment of the present application;
图9A为本申请实施例提供的一种听戴式设备应用场景示意图；9A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application;
图9B为本申请实施例提供的一种算法程序框图示意图；9B is a schematic block diagram of an algorithm provided by an embodiment of the present application;
图10A为本申请实施例提供的一种听戴式设备应用场景示意图；10A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application;
图10B为本申请实施例提供的一种算法程序框图示意图；10B is a schematic block diagram of an algorithm provided by an embodiment of the present application;
图11为本申请实施例提供的一种ANC功能对应的降噪深度曲线图；11 is a noise reduction depth curve diagram corresponding to an ANC function provided by an embodiment of the application;
图12A为本申请实施例提供的一种听戴式设备应用场景示意图；12A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application;
图12B为本申请实施例提供的一种算法程序框图示意图；12B is a schematic block diagram of an algorithm provided by an embodiment of the present application;
图13A为本申请实施例提供的一种听戴式设备应用场景示意图；13A is a schematic diagram of an application scenario of a hearable device provided by an embodiment of the present application;
图13B为本申请实施例提供的一种算法程序框图示意图；13B is a schematic block diagram of an algorithm provided by an embodiment of the present application;
图14为本申请实施例提供的一种HT功能对应的降噪深度曲线图；14 is a graph of a noise reduction depth corresponding to an HT function provided by an embodiment of the present application;
图15为本申请实施例提供的另一优化听戴式设备功能的方法的流程图。FIG. 15 is a flowchart of another method for optimizing the function of a hearable device provided by an embodiment of the present application.
具体实施方式Detailed ways
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
为了方便说明本申请实施例，此处以耳机代表的听戴式设备为例，说明本申请。For the convenience of describing the embodiments of the present application, the present application is described here by taking a hearable device represented by an earphone as an example.
在使用耳机时，环境中存在的噪声对耳机播放的声音产生干扰。例如，耳机被佩戴者佩戴，耳机播放音乐的过程中，佩戴者在听到耳机播放的声音的同时还可以听到环境中的噪声。为了提供良好的声音服务，耳机一般具备主动降噪(Active noise cancelation，ANC)的功能。When using headphones, the noise in the environment interferes with the sound played by the headphones. For example, when the earphone is worn by the wearer, when the earphone is playing music, the wearer can hear the noise in the environment while listening to the sound played by the earphone. In order to provide good sound services, headphones generally have an Active Noise Cancellation (ANC) function.
具体地说，主动降噪的原理是，耳机中的麦克风采集耳机所在环境中的噪声信号，耳机将采集到的噪声信号传输至控制电路。控制电路可以根据噪声信号，生成与噪声信号相位相反、振幅近似的声波信号。控制电路将生成的声波信号传输至耳机中的喇叭，通过喇叭播放声波信号。由于声波信号的相位、振幅与噪声信号的相位、振幅相反，则喇叭播放的声波信号可以减弱噪声信号，从而减弱通过耳机传播至人耳的噪声信号，以实现耳机主动降噪的功能。混合式主动降噪范围大致在50Hz-3kHz，反馈式主动降噪的范围大致在50Hz-1kHz。Specifically, the principle of active noise reduction is that the microphone in the earphone collects the noise signal in the environment where the earphone is located, and the earphone transmits the collected noise signal to the control circuit. According to the noise signal, the control circuit can generate a sound wave signal with an opposite phase and similar amplitude to the noise signal. The control circuit transmits the generated sound wave signal to the speaker in the earphone, and the sound wave signal is played through the speaker. Since the phase and amplitude of the sound wave signal are opposite to those of the noise signal, the sound wave signal played by the speaker can weaken the noise signal, thereby weakening the noise signal transmitted to the human ear through the earphone, so as to realize the function of active noise reduction of the earphone. The range of hybrid active noise reduction is roughly 50Hz-3kHz, and the range of feedback active noise reduction is roughly 50Hz-1kHz.
需要说明的，在噪声环境中，佩戴具有ANC功能的耳机能降低噪声对佩戴者的干 扰。但是，人们还是需要对环境中的声音保持一定的敏感度，以监听周围环境的实时变化。例如，在语音通话的过程中，人们使用耳机接听语音，为了保证良好的通话质量，耳机通过主动降噪降低环境中的噪声对耳机佩戴者听见的声音的干扰。同时，耳机佩戴者需要了解到周围环境中的警报声等，以便可以根据环境中的声音做出应对。因此，耳机需要具备透传(hear through，HT)功能，以便耳机佩戴者能够听到环境中的部分声音。It should be noted that in a noisy environment, wearing headphones with ANC function can reduce the interference of noise to the wearer. However, people still need to maintain a certain sensitivity to the sound in the environment to monitor real-time changes in the surrounding environment. For example, during a voice call, people use headphones to answer voices. In order to ensure good call quality, the headphones use active noise reduction to reduce the interference of noise in the environment on the sound heard by the wearer of the headphones. At the same time, the wearer of the headset needs to be aware of the alarm sound in the surrounding environment, etc., so that it can respond according to the sound in the environment. Therefore, the earphone needs to have a hear through (HT) function so that the earphone wearer can hear part of the sound in the environment.
具体地说，耳机透传的原理是，耳机中的麦克风采集环境中的声音信号，并将该声音信号传输至信号处理电路。信号处理电路可以对环境中的声音信号进行滤波处理，得到模拟声音信号，向扬声器传输模拟声音信号，通过扬声器播放模拟声音信号。这样，耳机佩戴者就可以听到环境中的部分声音。例如，耳机采集到环境中的声音信号，并检测到声音信号中包括警报声，信号处理电路可以通过滤波电路去除声音信号中的杂音，保留警报声。依次对警报声信号模拟处理和放大处理，向扬声器传输放大处理后的警报声信号。这样，扬声器可以播放该警报声信号，使得耳机佩戴者听到环境中的警报声，且降低了环境中噪声对耳机佩戴者听力的干扰。Specifically, the principle of transparent transmission of the earphone is that the microphone in the earphone collects the sound signal in the environment and transmits the sound signal to the signal processing circuit. The signal processing circuit can filter and process the sound signal in the environment to obtain the analog sound signal, transmit the analog sound signal to the speaker, and play the analog sound signal through the speaker. This way, the earphone wearer can hear part of the sound in the environment. For example, the earphone collects the sound signal in the environment, and detects that the sound signal includes an alarm sound, and the signal processing circuit can remove the noise in the sound signal through the filter circuit and retain the alarm sound. The alarm sound signal is simulated and amplified in sequence, and the amplified alarm sound signal is transmitted to the speaker. In this way, the speaker can play the alarm sound signal, so that the earphone wearer can hear the alarm sound in the environment, and the interference of the noise in the environment to the earphone wearer's hearing is reduced.
需要说明的，耳机被佩戴者佩戴，则耳机发出的声音传播至耳道入口处外部参考点(external reference point，ERP)，进而声音通过耳道传播至人耳耳膜参考点(drum reference point，DRP)。声音信号引起人耳耳膜处的声压改变，在声压的作用下人耳耳膜产生振动，使得耳机佩戴者听到耳机播放的声音。It should be noted that when the earphone is worn by the wearer, the sound emitted by the earphone propagates to the external reference point (ERP) at the entrance of the ear canal, and then the sound propagates to the eardrum reference point (Drum Reference Point, DRP) through the ear canal ). The sound signal causes the sound pressure at the eardrum of the human ear to change, and the eardrum of the human ear vibrates under the action of the sound pressure, so that the earphone wearer hears the sound played by the earphone.
不同的耳机结构，耳机中的扬声器发出的声音到ERP的距离不同。请参考图1A，为不同类型的耳机被佩戴者佩戴后，耳机中的扬声器到ERP示意图。如图1A中(a)，为挂耳式耳机被佩戴者佩戴后，挂耳式耳机中的扬声器与ERP位置关系示意图。如图1A中(b)，为头戴式耳机被佩戴者佩戴后，头戴式耳机中的扬声器与ERP位置关系示意图。如图1A中(c)，为半入耳式耳机被佩戴者佩戴后，半入耳式耳机中的扬声器与ERP位置关系示意图，如图1A中(d)，为入耳式耳机被佩戴者佩戴后，入耳式耳机中扬声器与ERP位置关系示意图。Different earphone structures have different distances from the sound from the speakers in the earphones to the ERP. Please refer to FIG. 1A , which is a schematic diagram of the speaker in the earphone and the ERP after different types of earphones are worn by the wearer. Figure 1A (a) is a schematic diagram of the positional relationship between the speaker in the ear-mounted earphone and the ERP after the ear-mounted earphone is worn by the wearer. Figure 1A (b) is a schematic diagram of the positional relationship between the speaker in the headset and the ERP after the headset is worn by the wearer. Figure 1A (c) is a schematic diagram of the positional relationship between the speaker in the semi-in-ear headphones and the ERP after the semi-in-ear headphones are worn by the wearer, as shown in Figure 1A (d), after the in-ear headphones are worn by the wearer, Schematic diagram of the positional relationship between the speaker and the ERP in the in-ear headphones.
其中，声波的传播方向与空气粒子的振动方向相同，即声波是一种纵波。因此，声波在空气中传播时，空气粒子的疏密程度随着声波的传播而改变，则该处的压强也会改变。这种由于声波传播引起的压强的改变成为声压。声波(也可以理解为声音)从ERP传播至DRP，使得DRP处的声压改变，声压引起人耳耳膜振动，则人可以听到声音。Among them, the propagation direction of the sound wave is the same as the vibration direction of the air particles, that is, the sound wave is a longitudinal wave. Therefore, when the sound wave propagates in the air, the density of the air particles changes with the propagation of the sound wave, and the pressure there also changes. This change in pressure due to the propagation of sound waves is called sound pressure. Sound waves (which can also be understood as sound) propagate from the ERP to the DRP, so that the sound pressure at the DRP changes, the sound pressure causes the eardrum of the human ear to vibrate, and the human can hear the sound.
理论上，获取到DRP处的声压信号，EPR处的声压信号，则可以得到EPR处的声压信号和DRP处的声压信号的传递函数。传递函数表示EPR的声压信号和DRP的声压信号的数学表示。因此，耳机播放音频的过程中可以采集的ERP处的声压信号，并根据传递函数确定出DRP处的声压信号。耳机可以根据该传递函数调整扬声器播放的音频信号，则ERP处的声压信号也会发生调整，这样，就可以实现通过传递函数实现对DRP处声压信号的调整。也就是说，在耳机工作的过程中，可以根据传递函数调整扬声器播放的音频信号，以使得耳机提供良好的主动降噪或透传功能，提高耳机播放的声音的音效。Theoretically, by obtaining the sound pressure signal at the DRP and the sound pressure signal at the EPR, the transfer function of the sound pressure signal at the EPR and the sound pressure signal at the DRP can be obtained. The transfer function represents the mathematical representation of the sound pressure signal of the EPR and the sound pressure signal of the DRP. Therefore, the sound pressure signal at the ERP can be collected during the audio playback process of the headset, and the sound pressure signal at the DRP can be determined according to the transfer function. The earphone can adjust the audio signal played by the speaker according to the transfer function, and the sound pressure signal at the ERP will also be adjusted. In this way, the sound pressure signal at the DRP can be adjusted through the transfer function. That is to say, during the working process of the earphone, the audio signal played by the speaker can be adjusted according to the transfer function, so that the earphone can provide a good active noise reduction or transparent transmission function and improve the sound effect of the sound played by the earphone.
一般而言，可以通过直接测量的方式获取DRP处的声压信号，或者，通过人耳建 模方式推断出DRP处的声压信号。In general, the sound pressure signal at the DRP can be obtained by direct measurement, or the sound pressure signal at the DRP can be deduced by modeling the human ear.
在第一种实现中，可以采用多普勒激光测振仪测量人耳耳膜的振动，通过信号转换可以将人耳耳膜的振动转换为DRP处的声压信号。具体地说，对耳道建模的过程为，测量耳道的几何形状，将外耳道口到耳膜参考点之间的耳道做分段。如图1B所示，外耳道口到耳膜处的耳道分为i段。其中，外耳道入口DRP到ERP之间的通路包括D1段、D2段……和Di段，每段耳道都可以等效为一个电路模型。基于耳道中的各段等效电路模型，可以对耳朵进行建模。In the first implementation, a Doppler laser vibrometer can be used to measure the vibration of the human eardrum, and the vibration of the human eardrum can be converted into a sound pressure signal at the DRP through signal conversion. Specifically, the process of modeling the ear canal is to measure the geometric shape of the ear canal and segment the ear canal between the external auditory canal orifice and the eardrum reference point. As shown in Figure 1B, the ear canal from the external auditory canal orifice to the eardrum is divided into i segments. Among them, the path between DRP and ERP at the entrance of the external auditory canal includes the D1 segment, the D2 segment...and the Di segment, and each segment of the ear canal can be equivalent to a circuit model. Based on the equivalent circuit model of each segment in the ear canal, the ear can be modeled.
示例性的，请参考图2，为人耳结构的等效电路示意。图1B所示的D1段、D2段……和Di段都可以等效为声阻抗、声容抗和声感抗形成的电路模型。如图2所示，P1表示ERP处的声压信号，D1段耳道等效的电路模型包括声阻抗R1、声容抗C1和声感抗L1。其中，声容抗C1和声感抗L1并联连接、并与声阻抗R1串联。Di段耳道的电路模型包括声阻抗Ri、声容抗Ci和声感抗Li，D作为负载表示DRP处的声压信号。如图2所示，每段耳道的电路模型是相同的，因此，对于每段耳道的模型不予赘述。多段的电路模型以级联的方式连接，耳膜以声学负载的形式设置在建模电路中。Illustratively, please refer to FIG. 2 , which is a schematic diagram of an equivalent circuit of a human ear structure. The D1 segment, D2 segment... and Di segment shown in Fig. 1B can all be equivalent to circuit models formed by acoustic impedance, acoustic capacitive reactance and acoustic inductive reactance. As shown in Figure 2, P1 represents the sound pressure signal at the ERP, and the equivalent circuit model of the ear canal of the D1 segment includes acoustic impedance R1, acoustic capacitive reactance C1 and acoustic inductive reactance L1. Among them, the acoustic capacitive reactance C1 and the acoustic inductive reactance L1 are connected in parallel, and are connected in series with the acoustic impedance R1. The circuit model of the ear canal of the Di segment includes the acoustic impedance Ri, the acoustic capacitive reactance Ci and the acoustic inductive reactance Li, and D as the load represents the sound pressure signal at the DRP. As shown in FIG. 2 , the circuit model of each segment of the ear canal is the same, so the model of each segment of the ear canal will not be described in detail. The multi-segment circuit model is connected in a cascaded manner, and the eardrum is placed in the modeled circuit in the form of an acoustic load.
其中，声波在空气中传播实际是声波使得介质(即空气粒子)偏离平衡态的扰动，实现声音传播。声阻抗是声波使得介质产生位移所需克服的阻力，即声音在该段耳道中传播需要克服的阻力。声阻抗相当于电路中的电阻，声阻抗可以吸收部分的声音能量。声容抗和声感抗相当于电路中的电容和电感，声容抗和声感抗不会吸收声音的能量，可以改变声音传播的方向或形式。Among them, the propagation of sound waves in the air is actually the perturbation of the sound waves that make the medium (ie, air particles) deviated from the equilibrium state, so as to realize sound propagation. Acoustic impedance is the resistance that the sound wave needs to overcome to cause the displacement of the medium, that is, the resistance that the sound needs to overcome to propagate in the ear canal. The acoustic impedance is equivalent to the resistance in the circuit, and the acoustic impedance can absorb part of the sound energy. Acoustic capacitive reactance and acoustic inductive reactance are equivalent to capacitance and inductance in a circuit. Acoustic capacitive reactance and acoustic inductive reactance do not absorb the energy of sound and can change the direction or form of sound propagation.
基于对如图2所示的电路模型的分析、电路关系推导，以及仿真分析。可以采集到不同模型下(即不同的人耳)，耳道入口处的截面积不同，耳道的等效长度也不同，根据如图2所示的电路模型，可以得到外耳道截面积S和耳道长度L的数学关系。可以采用外耳道截面积S和耳道长度L等个体化的耳道信息，对ERP和DRP之间的传递函数进行修正。Based on the analysis of the circuit model shown in Figure 2, the derivation of the circuit relationship, and the simulation analysis. It can be collected under different models (ie different human ears), the cross-sectional area at the entrance of the ear canal is different, and the equivalent length of the ear canal is also different. According to the circuit model shown in Figure 2, the cross-sectional area S of the external auditory canal and the Mathematical relationship of track length L. The transfer function between the ERP and the DRP can be corrected by using individualized ear canal information such as the external auditory canal cross-sectional area S and the ear canal length L.
需要注意的是，在对耳道的模型进行分析、建模的过程中，需要对真实人耳道形状进行测量。其中，测量耳道形状结构的方法可以是将泡沫注入人耳，待泡沫快速成型之后取出人耳的耳道模型。通过三维(3 dimensions，3D)扫描建模，以获得人耳耳道的模型数据。以便于对人耳耳道分段，以及人耳模型创建。另外，采用该方法创建的人耳模型是光滑的声道，与实际的耳道存在差异，不能完全替代真实人耳。因此，在对人耳建模之后，还需要在实际的声管中测试，以便对传递函数进行修正。It should be noted that in the process of analyzing and modeling the ear canal model, it is necessary to measure the shape of the real human ear canal. The method for measuring the shape and structure of the ear canal may be to inject foam into the human ear, and take out the ear canal model of the human ear after the foam is rapidly formed. Through three-dimensional (3 dimensions, 3D) scanning modeling, the model data of the human ear canal is obtained. In order to facilitate the segmentation of the human ear canal, and the creation of the human ear model. In addition, the human ear model created by this method is a smooth channel, which is different from the actual ear canal and cannot completely replace the real human ear. Therefore, after modeling the human ear, it also needs to be tested in the actual sound tube in order to correct the transfer function.
值得一提的，采用物理建模的方法可以针对特定的耳朵建模，得到建模精度高的人耳模型。但是，这种建模方法包括对耳道模型获取、建模、测量和修正模型结果等步骤，操作过程繁琐，对实施环境的要求较高，实施复杂度高。而且，对建模结果的分析是针对一个特定的耳道形状的，如果将该方法直接应用在耳机上，耳机难以获取到耳道的等效截面面积，以及等效的人耳耳道长度等参数，难以实现针对当前耳机佩戴者进行耳道建模。还需要注意的是，不同的佩戴姿势，耳机上耳套的大小(针对入耳式耳机)，耳机的佩戴松紧度等都会影响测量结果。则在耳机产品的实际使用中，该方法的应用性较差。It is worth mentioning that the physical modeling method can be used to model a specific ear, and a human ear model with high modeling accuracy can be obtained. However, this modeling method includes steps such as acquiring, modeling, measuring, and revising the model results of the ear canal model. The operation process is cumbersome, the requirements for the implementation environment are relatively high, and the implementation complexity is high. Moreover, the analysis of the modeling results is for a specific ear canal shape. If the method is directly applied to the earphone, it is difficult for the earphone to obtain the equivalent cross-sectional area of the ear canal and the equivalent human ear canal length, etc. parameters, it is difficult to model the ear canal for the current earphone wearer. It should also be noted that different wearing postures, the size of the earmuffs on the headphones (for in-ear headphones), and the tightness of the headphones will affect the measurement results. Then, in the actual use of the earphone product, the applicability of this method is poor.
在第二种实现中，基于ERP处的声音信号以及估计的ERP到DRP传递函数ED，确 定出DRP处的声压信号。对耳道进行建模，是通过扬声器播放某种激励声信号，ERP处麦克风采集得到耳道的响应。耳机根据ERP处麦克风采集的响应，推测佩戴者的耳道结构的特征，以便耳机可以根据历史数据库中与当前响应最接近的ED传递函数，通过对该ED传递函数求解，耳机得到DRP处的信号估计。耳机可以根据DRP处的信号估计调整耳机播放的声音信号，使得耳机可以满足更好的主动降噪或透传功能，同时也能为佩戴者提供更好的声效。In a second implementation, the acoustic pressure signal at the DRP is determined based on the acoustic signal at the ERP and the estimated ERP to DRP transfer function ED. To model the ear canal, a certain excitation sound signal is played through the speaker, and the response of the ear canal is collected by the microphone at the ERP. According to the response collected by the microphone at the ERP, the headset infers the characteristics of the wearer's ear canal structure, so that the headset can obtain the signal at the DRP by solving the ED transfer function according to the ED transfer function closest to the current response in the historical database. estimate. The earphone can adjust the sound signal played by the earphone according to the signal estimation at the DRP, so that the earphone can meet the better active noise reduction or transparent transmission function, and can also provide the wearer with a better sound effect.
本申请实施例提供一种优化听戴式设备功能的方法，该方法可以应用于听戴式设备。听戴式设备预设有基于大数据得到的第二路径(Secondary Path，SP)(或称为SP路径)，ERP到DRP(ED)传递函数，以及SP路径和ED函数域的映射关系H。听戴式设备在使用的过程中，听戴式设备被佩戴者佩戴，可以播放预设测试音频信号，以得到针对该佩戴者的耳道ED inv传递函数建模。听戴式设备播放测试声音，可以采集ERP处的声压信号，以及耳道反馈的声音信息，听戴式设备可以根据得到的ERP处的声压信号、以及耳道反馈的声音信息推算得到SP inv路径。进一步的，听戴式设备可以根据SP inv路径确定出ED inv传递函数。也就是说，本申请实施例得到的ED inv传递函数是针对该听戴式设备的佩戴者相关的。此外，听戴式设备还可以获取与佩戴者相关的个性化数据，例如，该个性化数据可以是，听戴式设备使用的耳套的尺寸、听戴式设备佩戴的松紧程度、耳道类型等。听戴式设备可以根据佩戴者输入的这些个性化数据修正SP inv路径和ED inv函数域的映射关系H inv。由此一来，听戴式设备性可以采集到针对听戴式设备佩戴者的SP inv路径与ED inv传递函数分布域的映射关系H inv，实现听戴式设备在使用过程中实时调整降噪功能和透传功能的目的，实现为听戴式设备的佩戴者提供良好的主动降噪功能、透传功能，以及提供更好的音效。 The embodiment of the present application provides a method for optimizing the function of a hearable device, and the method can be applied to a hearable device. The listenable device is preset with a second path (Secondary Path, SP) (or referred to as the SP path) obtained based on big data, the ERP to DRP (ED) transfer function, and the mapping relationship H between the SP path and the ED function domain. During the use of the hearable device, the hearable device is worn by the wearer, and a preset test audio signal can be played to obtain the ED inv transfer function modeling for the wearer's ear canal. The listening device plays the test sound, which can collect the sound pressure signal at the ERP and the sound information fed back by the ear canal. The listening device can calculate the SP according to the sound pressure signal at the ERP and the sound information fed back by the ear canal. inv path. Further, the hearable device can determine the ED inv transfer function according to the SP inv path. That is to say, the ED inv transfer function obtained in the embodiment of the present application is related to the wearer of the hearable device. In addition, the hearable device can also obtain personalized data related to the wearer, for example, the personalized data can be the size of the earmuffs used by the hearable device, the tightness of the hearing device, the type of ear canal Wait. The hearable device can correct the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data input by the wearer. As a result, the hearable device can collect the mapping relationship H inv between the SP inv path and the ED inv transfer function distribution domain for the wearer of the hearable device, so that the hearable device can adjust noise reduction in real time during use. The purpose of the function and the transparent transmission function is to provide the wearer of the hearable device with a good active noise reduction function, a transparent transmission function, and a better sound effect.
以听戴式设备是耳机为例，其中，第二路径是环境中的噪声为声源，噪声通过耳机传播至人耳DER处的路径。耳机被佩戴者佩戴，耳机可以播放预设提示音，耳机中的麦克风采集ERP处的声压信号，以及获取耦合有佩戴者耳道信息的信号。这样，耳机可以针对该佩戴者建立SP inv路径和ED inv传递函数。 Taking the listening device as an earphone as an example, the second path is a path in which noise in the environment is a sound source, and the noise propagates through the earphone to the DER of the human ear. The earphone is worn by the wearer, the earphone can play a preset prompt tone, and the microphone in the earphone collects the sound pressure signal at the ERP, and acquires the signal coupled with the information of the wearer's ear canal. In this way, the headset can establish the SP inv path and ED inv transfer function for the wearer.
在一些应用场景中，耳机可以和电子设备配合使用。示例性的，耳机被佩戴者佩戴，耳机与电子设备建立通信连接。耳机可以为佩戴者提供与电子设备语音交互的功能，或者，耳机仅为佩戴者提供播放语音的功能。例如，耳机与电子设备建立通信连接，耳机被佩戴，当电子设备播放音频文件，电子设备解码音频文件生成语音信息，电子设备向耳机传输语音信息，耳机播放语音信息，则耳机佩戴者听到手机播放的音频文件。当电子设备播放视频，电子设备的显示屏显示视频画面，耳机为佩戴者提供其视频中的音频信息。佩戴者使用电子设备打电话，电子设备与另一电子设备通信连接，耳机可以用于采集佩戴者发出的语音信号，并传输至电子设备，电子设备可以将采集到的语音信号传输至另一电子设备。电子设备接收到另一电子设备传输的语音信号，电子设备可以通过耳机播放该语音信号。In some application scenarios, headphones can be used in conjunction with electronic devices. Exemplarily, the earphone is worn by the wearer, and the earphone establishes a communication connection with the electronic device. The headset may provide the wearer with the function of interacting with the electronic device voice, or the headset may only provide the wearer with the function of playing the voice. For example, the headset establishes a communication connection with the electronic device, the headset is worn, when the electronic device plays an audio file, the electronic device decodes the audio file to generate voice information, the electronic device transmits the voice information to the headset, and the headset plays the voice information, the headset wearer hears the mobile phone Played audio file. When the electronic device plays a video, the display screen of the electronic device displays the video image, and the headset provides the wearer with audio information in the video. The wearer uses an electronic device to make a call, and the electronic device communicates with another electronic device. The headset can be used to collect the voice signal sent by the wearer and transmit it to the electronic device. The electronic device can transmit the collected voice signal to another electronic device. equipment. The electronic device receives a voice signal transmitted by another electronic device, and the electronic device can play the voice signal through the earphone.
可以理解的，本申请实施例提供的方法可以针对听戴式设备的佩戴者创建个性化的SP路径和ED传递函数，根据采集的个性化参数修正SP路径和ED传递函数的映射关系H inv。这样一来，听戴式设备被佩戴者使用的过程中，始终可以为佩戴者提供实时的主动降噪和透传功能，为佩戴者提供良好的听觉体验，提高听戴式设备播放的声音 的音效。 It can be understood that the method provided by the embodiments of the present application can create a personalized SP path and ED transfer function for the wearer of the hearable device, and correct the mapping relationship H inv between the SP path and the ED transfer function according to the collected personalized parameters. In this way, the wearer can always provide the wearer with real-time active noise reduction and pass-through functions when the hearable device is used by the wearer, provide the wearer with a good listening experience, and improve the sound quality played by the hearable device. sound effects.
请参考图3，为本申请实施例提供的听戴式设备300的硬件结构示意图。如图3所示，该听戴式设备300可以包括处理器310、内部存储器320，充电接口330，充电管理模块340，电源管理模块341，电池342，天线1，天线2，射频模块350，通信模块360，音频模块370，扬声器370A，通话麦克风370B，前馈(Feed-Forward，FF)麦克风370C，反馈(Feed-Back，FB)麦克风370D，语音处理单元(Voice Process Unit，VPU)传感器380，按键390等。Please refer to FIG. 3 , which is a schematic diagram of a hardware structure of a hearable device 300 according to an embodiment of the present application. As shown in FIG. 3 , the hearable device 300 may include a processor 310, an internal memory 320, a charging interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a radio frequency module 350, a communication module 360, audio module 370, speaker 370A, call microphone 370B, feed-forward (Feed-Forward, FF) microphone 370C, feedback (Feed-Back, FB) microphone 370D, voice processing unit (Voice Process Unit, VPU) sensor 380, Button 390, etc.
其中，图3所示的听戴式设备300仅仅是听戴式设备的一个范例。图3示意的结构并不构成对听戴式设备300的限定。可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。例如，听戴式设备300是助听器，则听戴式设备300不包括通信模块350，射频模块360和受话器370B等。The hearable device 300 shown in FIG. 3 is only an example of the hearable device. The structure illustrated in FIG. 3 does not constitute a limitation on the hearable device 300 . More or fewer components than shown may be included, or some components may be combined, or some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, if the hearable device 300 is a hearing aid, the hearable device 300 does not include the communication module 350, the radio frequency module 360, the receiver 370B, and the like.
处理器310可以包括一个或多个处理单元，例如：处理器310可以包括应用处理器(application processor，AP)，调制解调处理器，控制器，存储器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (application processor, AP), a modem processor, a controller, a memory, a digital signal processor (digital signal processor, DSP) ), baseband processor, and/or neural-network processing unit (NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
控制器可以是指挥听戴式设备300的各个部件按照指令协调工作的决策者。是听戴式设备300的神经中枢和指挥中心。控制器根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。The controller may be the decision maker that directs the various components of the hearable device 300 to work in harmony as instructed. It is the nerve center and command center of the hearable device 300 . The controller generates an operation control signal according to the instruction operation code and timing signal, and completes the control of fetching and executing instructions.
处理器310中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器中的存储器为高速缓冲存储器。可以保存处理器刚用过或循环使用的指令或数据。如果处理器需要再次使用该指令或数据，可从存储器中直接调用。避免了重复存取，减少了处理器的等待时间，因而提高了***的效率。A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in the processor is a cache memory. Instructions or data that have just been used or recycled by the processor can be saved. If the processor needs to use the instruction or data again, it can be called directly from memory. Repeated access is avoided, and the waiting time of the processor is reduced, thereby improving the efficiency of the system.
本申请实施例中，处理器310可以存储基于大数据总结得到的SP db路径和ED db的传递函数，以及SP db路径与ED db函数分布域的映射关系H db。当听戴式设备300被佩戴者佩戴，听戴式设备300可以直接调用处理器310存储的数据，以针对该佩戴者创建对应的SP inv路径和ED inv的传递函数。 In this embodiment of the present application, the processor 310 may store the transfer function of the SP db path and the ED db obtained by summarizing the big data, and the mapping relationship H db between the SP db path and the ED db function distribution domain. When the hearable device 300 is worn by the wearer, the hearable device 300 may directly call the data stored in the processor 310 to create the corresponding SP inv path and ED inv transfer function for the wearer.
在一些实施例中，处理器310可以包括接口。其中接口可以包括集成电路(Inter-Integrated Circuit，I2C)接口，集成电路内置音频(Inter-Integrated Circuit Sound，I2S)接口，脉冲编码调制(Pulse Code Modulation，PCM)接口，通用异步收发传输器(Universal Asynchronous Receiver/Transmitter，UART)接口，和/或通用串行总线(Universal Serial Bus，USB)接口等。In some embodiments, the processor 310 may include an interface. The interface may include an integrated circuit (Inter-Integrated Circuit, I2C) interface, an integrated circuit built-in audio (Inter-Integrated Circuit Sound, I2S) interface, a pulse code modulation (Pulse Code Modulation, PCM) interface, Universal Asynchronous Receiver Transmitter (Universal) Asynchronous Receiver/Transmitter, UART) interface, and/or Universal Serial Bus (Universal Serial Bus, USB) interface, etc.
I2C接口是一种双向同步串行总线，包括一根串行数据线(Serial Data Line，SDA)和一根串行时钟线(Derail Clock Line，SCL)。在一些实施例中，处理器可以包含多组I2C总线。处理器可以通过不同的I2C总线接口分别耦合触摸传感器，充电器等。The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (Serial Data Line, SDA) and a serial clock line (Derail Clock Line, SCL). In some embodiments, the processor may contain multiple sets of I2C buses. The processor can separately couple touch sensors, chargers, etc. through different I2C bus interfaces.
I2S接口可以用于音频通信。在一些实施例中，处理器可以包含多组I2S总线。处理器可以通过I2S总线与音频模块耦合，实现处理器与音频模块之间的通信。在一 些实施例中，音频模块可以通过I2S接口向通信模块传递音频信号，实现通过蓝牙耳机接听电话的功能。The I2S interface can be used for audio communication. In some embodiments, the processor may contain multiple sets of I2S buses. The processor can be coupled with the audio module through the I2S bus to realize the communication between the processor and the audio module. In some embodiments, the audio module can transmit audio signals to the communication module through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块与通信模块可以通过PCM总线接口耦合。在一些实施例中，音频模块也可以通过PCM接口向通信模块传递音频信号，实现通过蓝牙耳机接听电话的功能。I2S接口和PCM接口都可以用于音频通信，两种接口的采样速率不同。The PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals. In some embodiments, the audio module and the communication module may be coupled through a PCM bus interface. In some embodiments, the audio module can also transmit audio signals to the communication module through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication, and the sampling rates of the two interfaces are different.
本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对听戴式设备300的结构限定。听戴式设备300可以使用本申请实施例中不同的接口连接方式，或多种接口连接方式的组合。The interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the hearable device 300 . The hearable device 300 may use different interface connection manners in the embodiments of the present application, or a combination of multiple interface connection manners.
充电管理模块340用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。The charging management module 340 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger.
电源管理模块341用于连接电池342，充电管理模块340与处理器310。电源管理模块接收所述电池和/或充电管理模块的输入，为处理器，内部存储器和通信模块等供电。电源管理模块还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。The power management module 341 is used to connect the battery 342 , the charging management module 340 and the processor 310 . The power management module receives input from the battery and/or charging management module, and supplies power to the processor, internal memory, and communication module. The power management module can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance).
听戴式设备300的无线通信功能可以通过天线1，天线2，射频模块350，通信模块360，调制解调器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。听戴式设备300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。The wireless communication function of the hearable device 300 may be implemented by the antenna 1, the antenna 2, the radio frequency module 350, the communication module 360, the modem, the baseband processor, and the like. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in hearable device 300 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
射频模块350可以提供应用在听戴式设备300上的包括2G/3G/4G/5G等无线通信的解决方案的通信处理模块。射频模块由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调器进行解调。射频模块还可以对经调制解调器调制后的信号放大，经天线1转为电磁波辐射出去。The radio frequency module 350 may provide a communication processing module applied on the hearable device 300 including 2G/3G/4G/5G wireless communication solutions. The radio frequency module receives electromagnetic waves from the antenna 1, filters and amplifies the received electromagnetic waves, and transmits them to the modem for demodulation. The radio frequency module can also amplify the signal modulated by the modem, and then turn it into electromagnetic waves and radiate it out through the antenna 1 .
调制解调器可以包括调制器和解调器。调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器，受话器等)输出音频信号。A modem may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs audio signals through audio devices (not limited to speakers, receivers, etc.).
本申请实施例提供的听戴式设备可以与远程的服务器(或云设备)交互，听戴式设备可以将获取到的个性化参数传输至远程的服务器，远程的服务器根据个性化数据对听戴式设备的SP inv路径和ED inv的传递函数的映射关系H db修正，以提高耳机的音效。 The listen-worn device provided by the embodiment of the present application can interact with a remote server (or cloud device), and the listen-worn device can transmit the acquired personalized parameters to the remote server, and the remote server can update the listen-worn device according to the personalized data. The mapping relationship H db of the SP inv path of the type device and the transfer function of the ED inv is corrected to improve the sound effect of the headphones.
通信模块360可以提供应用在听戴式设备300上的包括无线局域网(Wireless Local Area Networks，WLAN)，(如无线保真(Wireless Fidelity，Wi-Fi)网络)，蓝牙(Blue Tooth，BT)，调频(Frequency Modulation，FM)，近距离无线通信技术(Near Field Communication，NFC)，红外技术(Infrared，IR)等无线通信的解决方案的通信处理模块。通信模块360可以是集成至少一个通信处理模块的一个或多个器件。通信模块经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器。通信模块360还可以从处理器接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。The communication module 360 can provide wireless local area network (Wireless Local Area Networks, WLAN), (such as Wireless Fidelity (Wireless Fidelity, Wi-Fi) network), Bluetooth (Blue Tooth, BT), A communication processing module for wireless communication solutions such as Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The communication module 360 may be one or more devices integrating at least one communication processing module. The communication module receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor. The communication module 360 can also receive the signal to be sent from the processor, perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
示例性的，如果听戴式设备是蓝牙耳机，则蓝牙耳机可以通过天线2与电子设备建立通信连接，以实现通过蓝牙耳机播放电子设备的声音的目的。Exemplarily, if the listening device is a Bluetooth headset, the Bluetooth headset can establish a communication connection with the electronic device through the antenna 2, so as to achieve the purpose of playing the sound of the electronic device through the Bluetooth headset.
内部存储器321可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令，从而执行听戴式设备300的各种功能应用以及数据处理。存储器321可以包括存储程序区和存储数据区。其中，存储程序区可存储操作***，至少一个功能所需的应用程序(比如声音播放功能、降噪功能和透传功能等)等。存储数据区可存储听戴式设备300使用过程中所创建的数据(比如音频数据、基于大数据的SP db路径和ED db的传递函数，以及SP db路径和ED db的函数分布域的映射关系H db等)等。 Internal memory 321 may be used to store computer executable program code, which includes instructions. The processor 310 executes various functional applications and data processing of the hearable device 300 by executing the instructions stored in the internal memory 321 . The memory 321 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, a noise reduction function, a transparent transmission function, etc.), and the like. The storage data area can store data created during the use of the hearable device 300 (such as audio data, the transfer function of the SP db path and the ED db based on big data, and the mapping relationship between the SP db path and the function distribution domain of the ED db ) H db etc.) etc.
其中，上述内部存储器321包括本申请实施例中所述的数据分区(如，数据分区)。该数据分区中保存有操作***启动时所需要读写的文件或数据，以及听戴式设备使用过程中所创建的佩戴者数据(如，听戴式设备使用过程中获取到的佩戴者个性化参数等)。数据分区可以是上述内部存储器321中预先设定的存储区域。例如，数据分区可以包含于内部存储器321中的RAM中。The above-mentioned internal memory 321 includes the data partition (eg, data partition) described in the embodiments of the present application. The data partition stores files or data that need to be read and written when the operating system starts, as well as wearer data created during the use of the hearable device (for example, the wearer's personalization obtained during the use of the hearable device). parameters, etc.). The data partition may be a predetermined storage area in the above-mentioned internal memory 321 . For example, the data partition may be contained in RAM in the internal memory 321 .
本申请实施例中的虚拟数据分区可以为内部存储器321中的RAM的一个存储区域。或者，虚拟数据分区可以为内部存储器321中的ROM的一个存储区域。The virtual data partition in this embodiment of the present application may be a storage area of the RAM in the internal memory 321 . Alternatively, the virtual data partition may be a storage area of the ROM in the internal memory 321 .
听戴式设备300可以通过音频模块370，扬声器370A，通话麦克风370B，FF麦克风370C，FB麦克风370D，VPU传感器380，以及应用处理器等实现音频功能。例如音乐播放，语音通话，录音等。The hearable device 300 can implement audio functions through the audio module 370, the speaker 370A, the call microphone 370B, the FF microphone 370C, the FB microphone 370D, the VPU sensor 380, and the application processor. Such as music playback, voice calls, recording, etc.
音频模块用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块还可以用于对音频信号编码和解码。在一些实施例中，音频模块可以设置于处理器310中，或将音频模块的部分功能模块设置于处理器310中。The audio module is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input to digital audio signal. The audio module can also be used to encode and decode audio signals. In some embodiments, the audio module may be provided in the processor 310 , or some functional modules of the audio module may be provided in the processor 310 .
扬声器370A，也称“喇叭”，用于将音频电信号转换为音频信号。听戴式设备可以通过扬声器370A播放音频信号。 Speaker 370A, also referred to as "speaker", is used to convert audio electrical signals into audio signals. The hearable device may play audio signals through speaker 370A.
通话麦克风370B，也称“话筒”，“传声器”，用于将音频信号转换为电信号。当拨打电话或发送语音信息时，佩戴者可以通过人嘴靠近通话麦克风370B发声，将音频信号输入到通话麦克风370B。The call microphone 370B, also called "microphone" or "microphone", is used to convert audio signals into electrical signals. When making a call or sending a voice message, the wearer can make a sound by approaching the call microphone 370B through the human mouth, and input an audio signal into the call microphone 370B.
FF麦克风370C，可以设置在听戴式设备300的外侧，采集听戴式设备所在环境中的噪声。FB麦克风370D设置在听戴式设备靠近人耳一侧，用于采集耦合人耳声道信息的音频信号，以便实现听戴式设备300主动降噪的功能。The FF microphone 370C can be disposed outside the hearable device 300 to collect noise in the environment where the hearable device is located. The FB microphone 370D is disposed on the side of the hearable device close to the human ear, and is used to collect audio signals coupled with channel information of the human ear, so as to realize the function of active noise reduction of the hearable device 300 .
听戴式设备300可以设置至少一个麦克风。示例性的，如果听戴式设备是耳机，则耳机的听筒部分也可以设置麦克风，用于采集环境中的声音，以便耳机实现降噪和透传等功能。在一些实施例中，听戴式设备300还可以设置三个，四个或更多麦克风，实现采集音频信号，降噪，还可以识别声音来源，实现定向录音功能等。The hearable device 300 may be provided with at least one microphone. Exemplarily, if the hearable device is an earphone, a microphone may also be provided in the earpiece part of the earphone to collect sound in the environment, so that the earphone can realize functions such as noise reduction and transparent transmission. In some embodiments, the hearable device 300 may further be provided with three, four or more microphones to collect audio signals, reduce noise, identify sound sources, and implement directional recording functions.
VPU传感器380是一种骨传导传感器。是采用压电材料的单轴加速度传感器，可以用于感应测量声带运动。VPU传感器380的功耗较低，能够在听戴式设备300处于高噪声环境时提取语音信息。VPU sensor 380 is a bone conduction sensor. It is a single-axis accelerometer using piezoelectric materials, which can be used to sense and measure the movement of the vocal cords. The VPU sensor 380 has low power consumption and can extract speech information when the hearable device 300 is in a high noise environment.
按键390包括开机键，音量键等。按键可以是机械按键。也可以是触摸式按键。 听戴式设备300接收按键输入，产生与听戴式设备300的佩戴者设置以及功能控制有关的键信号输入。The keys 390 include a power-on key, a volume key, and the like. The keys may be mechanical keys. It can also be a touch key. The hearable device 300 receives key inputs and generates key signal inputs related to wearer settings and functional control of the hearable device 300 .
需要说明的，本申请实施例提供的听戴式设备可以是助听器，人工耳蜗，入耳式、半入耳式、贴耳式、头戴式耳机等，穿戴在耳部的电子设备。本申请实施例对听戴式设备的具体形态不作特殊限制。It should be noted that the hearing-worn device provided by the embodiment of the present application may be a hearing aid, a cochlear implant, an in-ear type, a semi-in-ear type, an on-ear type, a headphone, etc., an electronic device worn on the ear. The embodiment of the present application does not limit the specific form of the hearable device.
以下实施例提供的方法均可以在具备上述硬件结构的听戴式设备实现。The methods provided in the following embodiments can all be implemented in a hearable device having the above-mentioned hardware structure.
本申请实施例提供一种优化听戴式设备功能的方法，该方法可以应用于听戴式设备。可以理解的，该方法可以应用于多种听戴式设备中，本申请实施例以听戴式设备是耳机为例，说明本申请实施例提供的方法。The embodiment of the present application provides a method for optimizing the function of a hearable device, and the method can be applied to a hearable device. It can be understood that the method can be applied to a variety of hearable devices. In this embodiment of the present application, the hearable device is an earphone as an example to describe the method provided by the embodiment of the present application.
第一种实现中，耳机中可以预设基于大数据得到的通用的SP db路径(即上述基础SP路径)和ED db传递函数(即上述基础ED传递函数)，以及SP db路径和ED db函数域的映射关系H db。以便耳机根据获取到的当前佩戴者的数据，以创建出针对该佩戴者的SP inv路径和ED inv传递函数。 In the first implementation, a general SP db path (that is, the above-mentioned basic SP path) and an ED db transfer function (that is, the above-mentioned basic ED transfer function) obtained based on big data can be preset in the headset, as well as the SP db path and the ED db function. Domain mapping relationship H db . So that the headset can create the SP inv path and the ED inv transfer function for the wearer according to the acquired data of the current wearer.
第二种实现中，耳机可以和第一设备(如，电子设备，远程服务器，云设备等)(或称为主控设备)交互，通过第一设备创建出针对该佩戴者的SP inv路径(即上述预设SP路径)和ED inv传递函数(即上述预设ED传递函数)。其中，第一设备可以预设基于大数据得到的通用的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。 In the second implementation, the headset can interact with a first device (such as an electronic device, a remote server, a cloud device, etc.) (or called a master device), and create an SP inv path for the wearer through the first device ( That is, the above-mentioned preset SP path) and the ED inv transfer function (that is, the above-mentioned preset ED transfer function). The first device may preset a general SP db path and ED db transfer function obtained based on big data, and a mapping relationship H db between the SP db path and the ED db function domain.
可以理解的，本申请实施例提供的方法中，当耳机被佩戴者佩戴，并被使用的过程中。耳机可以基于大数据生成针对当前佩戴者的，SP inv路径和ED inv传递函数，以及SP inv路径和ED inv函数域的对应关系H inv。也就是说，听戴式设备中预设有大数据的相关信息，该相关信息为SP db路径和ED db传递函数，以及SP db和ED db函数域的映射关系。 It can be understood that, in the method provided by the embodiment of the present application, when the earphone is worn by the wearer and is used. Based on big data, the earphone can generate, for the current wearer, the SP inv path and the ED inv transfer function, and the corresponding relationship H inv between the SP inv path and the ED inv function domain. That is to say, the related information of the big data is preset in the hearable device, and the related information is the SP db path and the ED db transfer function, and the mapping relationship between the SP db and the ED db function domain.
需要说明的，基于大数据得到的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H，是在耳机售出之前已经通过测量和实验得到的。 It should be noted that the SP db path and the ED db transfer function obtained based on the big data, as well as the mapping relationship H between the SP db path and the ED db function domain, have been obtained through measurement and experiments before the headphones are sold.
以下将说明基于大数据得到SP db路径和ED db传递函数的过程。 The following will describe the process of obtaining the SP db path and the ED db transfer function based on big data.
示例性的，实验时使用的测试设备的结构可以与市场销售的耳机结构不同。如，为了得到准确的DRP的声压信号，测量使用的测试设备中包括探针麦克风。其中，探针麦克风可以得到准确的DRP处的声压信号。Exemplarily, the structure of the test equipment used in the experiment may be different from the structure of the earphones sold in the market. For example, in order to obtain an accurate DRP sound pressure signal, the test equipment used in the measurement includes a probe microphone. Among them, the probe microphone can obtain the accurate sound pressure signal at the DRP.
具体实验的原理为：针对不同人(即不同的耳道形状)，使用测试设备在各种耳套尺寸下(针对入耳式耳机)，佩戴测试设备的松紧程度不同，佩戴测试设备测量设备发声的扬声器与ERP不同距离的情况下，采集用于创建SP db路径和ED db传递函数的相关数据。以便测试人员处理采集得到的数据，以确定大数据下SP db和ED db传递函数。 The principle of the specific experiment is: for different people (ie different ear canal shapes), using the test equipment under various earmuff sizes (for in-ear headphones), wearing the test equipment with different degrees of tightness, wearing the test equipment to measure the sound of the equipment The relevant data used to create the SP db path and the ED db transfer function were collected at different distances from the loudspeaker to the ERP. So that testers can process the collected data to determine the SP db and ED db transfer functions under big data.
具体的测量过程可以为：确定测试场景并记录测试场景数据，如，测试对象，测试对象的耳道形状，测试对象佩戴的测试设备类型(如，是否有耳套等)，测试设备的佩戴松紧程度，测试设备的扬声器与ERP的距离等。测试设备播放预设的测试音乐，测试设备采集生成SP db路径和ED db传递函数的相关数据。 The specific measurement process can be: determine the test scene and record the test scene data, such as the test object, the shape of the ear canal of the test object, the type of test equipment worn by the test object (for example, whether there are earmuffs, etc.), the wearing tightness of the test equipment degree, the distance between the speaker of the test equipment and the ERP, etc. The test equipment plays the preset test music, and the test equipment collects and generates the related data of the SP db path and the ED db transfer function.
其中，生成SP db路径和ED db传递函数的相关数据可以包括：ERP处的声压信号，DRP处的声压信号，扬声器采集的响应信号，初级路径(primary path，PP)响应信号，声反馈路径(feedback path，FP)响应信号等。具体实施时，通过反复实验，多次测 量得到多组实验数据。可以将多组实验数据输入计算机，通过计算机处理和仿真计算以得到大数据下的SP db和ED db传递函数，并且，得到SP db和ED db函数域的映射关系H db。 Wherein, the relevant data for generating the SP db path and the ED db transfer function may include: the sound pressure signal at the ERP, the sound pressure signal at the DRP, the response signal collected by the speaker, the primary path (PP) response signal, and the acoustic feedback Path (feedback path, FP) response signal and so on. During specific implementation, multiple sets of experimental data are obtained through repeated experiments and multiple measurements. Multiple sets of experimental data can be input into the computer, and the SP db and ED db transfer functions under big data can be obtained through computer processing and simulation calculation, and the mapping relationship H db of the SP db and ED db function domains can be obtained.
可以理解的，上述得到上述生成SP db路径和ED db传递函数的相关数据是在离线状态下采集得到的，也就是说，测试设备测量之后得到测试数据即可。 It can be understood that the above-mentioned related data for generating the SP db path and the ED db transfer function are collected in an offline state, that is, the test data can be obtained after measurement by the test equipment.
请参考图4，为本申请实施例提供的听戴式设备与主控设备交互，获取测试数据的场景示意图。如图4中(a)所示，佩戴者100可以与电子设备200交互，使得电子设备200通过通信连接听戴式设备300。如图4中(b)所示，电子设备200可以是手机，电子设备200接收到佩戴者100的与电子设备200建立通信连接的操作指令(即电子设备200与佩戴者100交互)，响应于佩戴者100的操作指令，与听戴式设备300蓝牙连接。Please refer to FIG. 4 , which is a schematic diagram of a scenario in which a hearable device interacts with a main control device to acquire test data according to an embodiment of the present application. As shown in (a) of FIG. 4 , the wearer 100 can interact with the electronic device 200 so that the electronic device 200 is connected to the hearable device 300 through communication. As shown in (b) of FIG. 4 , the electronic device 200 may be a mobile phone. The electronic device 200 receives an operation instruction from the wearer 100 to establish a communication connection with the electronic device 200 (ie, the electronic device 200 interacts with the wearer 100 ), and responds to The operation command of the wearer 100 is connected with the listenable device 300 via Bluetooth.
其中，请参考图5，为本申请实施例提供的***示意图。如图5所示，501表示线下训练时的***示意，线下训练的***结构用于获取创建SP db路径和ED db传递函数的相关数据。502表示数据库，数据库用于存储线下训练得到的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。503表示当前使用者的个性化数据库，用于存储根据耳机佩戴者个性化数据得到的SP inv路径和ED inv传递函数，以及SP inv路径和ED inv传递函数的映射关系H inv。504表示听戴式设备的产品(如，耳机)对应的***示意图，听戴式设备用于获取佩戴者个性化数据，如，用于创建SP inv路径和ED inv传递函数的相关参数。 Wherein, please refer to FIG. 5 , which is a schematic diagram of a system provided by an embodiment of the present application. As shown in Figure 5, 501 represents a schematic diagram of the system during offline training, and the system structure of offline training is used to obtain relevant data for creating SP db paths and ED db transfer functions. 502 represents a database, and the database is used to store the SP db path and the ED db transfer function obtained by offline training, and the mapping relationship H db between the SP db path and the ED db function domain. 503 represents the personalization database of the current user, which is used to store the SP inv path and the ED inv transfer function obtained according to the personalized data of the earphone wearer, and the mapping relationship H inv between the SP inv path and the ED inv transfer function. 504 represents a schematic diagram of a system corresponding to a product of a hearable device (eg, earphones), and the hearable device is used to obtain the wearer's personalized data, such as for creating the SP inv path and the related parameters of the ED inv transfer function.
可以理解的，501的***可以采集到创建到SP db路径和ED db传递函数的相关数据，则501可以将采集得到的数据传输至502，使得502生成SP db路径和ED db传递函数。502可以生成多组测试数据的SP db路径和ED db传递函数，以得到SP db路径和ED db函数域的映射关系H db。501还可以将采集得到的数据传输至503，503还可以获取听戴式设备的佩戴者个性化数据，以使得503可以根据501传输的数据和个性化数据得到佩戴者的SP inv路径和ED inv传递函数。503数据库中的佩戴者个性化数据可以用于修正SP inv路径和ED inv传递函数，以得到修正后的SP db路径和ED db函数域的映射关系H db。 It can be understood that the system of 501 can collect the relevant data created to the SP db path and the ED db transfer function, then 501 can transmit the collected data to 502 so that 502 can generate the SP db path and the ED db transfer function. 502 may generate SP db paths and ED db transfer functions of multiple sets of test data, so as to obtain the mapping relationship H db between the SP db paths and the ED db function domains. 501 can also transmit the collected data to 503, and 503 can also obtain the wearer's personalized data of the hearable device, so that 503 can obtain the wearer's SP inv path and ED inv according to the data and personalized data transmitted by 501. Transfer Function. The wearer's personalized data in the 503 database can be used to modify the SP inv path and the ED inv transfer function, so as to obtain the mapping relationship H db between the modified SP db path and the ED db function domain.
需要说明的，501线下训练***中包括探针麦克风，使得线下训练***可以采集到人耳DRP处的声压信号。504为听戴式设备的***中不包括探针麦克风，则504不能采集得到佩戴者DRP处的声压信号。504可以获取503数据库中的修正后的SP db路径和ED db函数域的映射关系H db，以根据H db对听戴式设备的佩戴者进行ED建模。 It should be noted that the 501 offline training system includes a probe microphone, so that the offline training system can collect the sound pressure signal at the DRP of the human ear. 504 is that the system of the hearable device does not include a probe microphone, then 504 cannot collect the sound pressure signal at the wearer's DRP. 504 may obtain 503 the mapping relationship H db between the revised SP db path and the ED db function domain in the database, so as to perform ED modeling for the wearer of the hearable device according to H db .
示例性的，测试设备包括探针麦克风，测试设备播放预设测试音频信号(例如，测试音乐)，并采集ERP处的声压信号，DRP处的声压信号，扬声器采集的响应信号，初级路径(primary path，PP)响应信号，声反馈路径(feedback path，FP)响应信号等。基于采集得到的数据SP建模，建模可以采用如下公式1生成SP模型：Exemplarily, the test equipment includes a probe microphone, the test equipment plays a preset test audio signal (eg, test music), and collects the sound pressure signal at the ERP, the sound pressure signal at the DRP, the response signal collected by the speaker, and the primary path. (primary path, PP) response signal, acoustic feedback path (feedback path, FP) response signal, etc. Based on the collected data SP modeling, the modeling can use the following formula 1 to generate the SP model:
SP(z)＝[ERP(z)–Ref(z)*PP(z)]/Spk(z)+FP(z)*PP(z)     公式1SP(z)=[ERP(z)–Ref(z)*PP(z)]/Spk(z)+FP(z)*PP(z) Equation 1
其中，ERP(z)表示反馈(Feed-back，FB)麦克风采集到的ERP处的响应；Ref(z)表示听戴式设备中前馈麦克风(Feed-Forward，FF)麦克风采集到的响应；Spk(z)表示扬声器的响应；SP(z)表示扬声器到FB麦克风的传递函数响应；PP(z)表示FF麦克风到FB麦克风的传递函数响应；FP(z)表示扬声器到FF麦克风的传递函数响应。Among them, ERP(z) represents the response at the ERP collected by the feedback (Feed-back, FB) microphone; Ref(z) represents the response collected by the feed-forward microphone (Feed-Forward, FF) microphone in the hearable device; Spk(z) represents the response of the speaker; SP(z) represents the transfer function response from the speaker to the FB microphone; PP(z) represents the transfer function response from the FF microphone to the FB microphone; FP(z) represents the transfer function from the speaker to the FF microphone response.
基于采集到的数据ED建模，建模可以采用如下公式2生成ED模型：Based on the collected data ED modeling, the modeling can use the following formula 2 to generate the ED model:
ED(z)＝DRP(z)/ERP(z)    公式2ED(z)=DRP(z)/ERP(z) Formula 2
其中，DRP(z)表示探针麦克风采集到DRP处的响应，ERP(z)表示麦克风采集到的ERP处的响应。Among them, DRP(z) represents the response at the DRP collected by the probe microphone, and ERP(z) represents the response at the ERP collected by the microphone.
根据SP db(z)和ED db(z)的对应关系，可以得到传递函数映射对<SP db(z)，ED db(z)>。 According to the correspondence between SP db (z) and ED db (z), the transfer function mapping pair <SP db (z), ED db (z)> can be obtained.
重复上述的数据采集过程，在不同类型的耳道结构、耳套尺寸，以及听戴式设备的不同佩戴姿势时，采集得到对应的数据，通过多次测量采集到多组数据。根据多组数据建立数据库(Datebase)，数据库中包括多组数据的映射关系，数据库可以用如下公式3表示：Repeat the above data collection process to collect corresponding data under different types of ear canal structures, earmuff sizes, and different wearing postures of the hearable device, and collect multiple sets of data through multiple measurements. A database (Datebase) is established according to multiple sets of data. The database includes the mapping relationship of multiple sets of data. The database can be represented by the following formula 3:
Database{<EC,ES,WP>|<SP db(z),ED db(z)>}    公式3 Database{<EC,ES,WP>|<SP db (z),ED db (z)>} Equation 3
其中，EC表示不同测试者的不同耳道(ear canal，EC)，ES表示耳机佩戴者使用的耳套尺寸(earmuff size，ES)，WP表示耳机佩戴者佩戴耳机的佩戴姿势(wear posture，WP)。Among them, EC represents different ear canals (EC) of different testers, ES represents the earmuff size (ES) used by the earphone wearer, and WP represents the wearing posture (wear posture, WP) of the earphone wearer. ).
采用预设算法训练Datebase中的映射关系，以得到SP db(z)，ED db(z)的非线性映射关系H db，以得到目标函数最小化，可以用公式4表示目标函数最小化： Use the preset algorithm to train the mapping relationship in Datebase to obtain the nonlinear mapping relationship H db of SP db (z) and ED db (z), so as to obtain the objective function minimization, which can be expressed by formula 4 to minimize the objective function:
Figure PCTCN2021134629-appb-000001
Figure PCTCN2021134629-appb-000001
可以理解的，基于多次重复实验测量可以得到大数据下的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。 It can be understood that the SP db path and the ED db transfer function under big data, as well as the mapping relationship H db between the SP db path and the ED db function domain, can be obtained based on repeated experimental measurements.
上述第一种实现中，将实验得到的相关数据预设在听戴式设备中，该相关数据包括：通用的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。如果听戴式设备可以独立使用，即不需要配合第一设备实现其功能，如人工耳蜗、助听器等类型的听戴式设备产品。为了提供更适合听戴式设备的佩戴者听觉体验，听戴式设备的佩戴者可以根据自身的听力状况以及耳道形状等，训练听戴式设备的ED inv传递函数，使得听戴式设备更适合佩戴者的听力状况。 In the above-mentioned first implementation, the relevant data obtained by the experiment is preset in the hearable device, and the relevant data includes: the general SP db path and the ED db transfer function, and the mapping relationship between the SP db path and the ED db function domain Hdb . If the hearable device can be used independently, that is, it does not need to cooperate with the first device to realize its function, such as a cochlear implant, a hearing aid and other types of hearable device products. In order to provide a more suitable hearing experience for the wearer of the hearable device, the wearer of the hearable device can train the ED inv transfer function of the hearable device according to their own hearing conditions and the shape of the ear canal, so that the hearable device is more Suitable for the hearing condition of the wearer.
可以理解的，针对听戴式设备的佩戴者训练听戴式设备的ED inv传递函数时，采集SP inv建模和ED inv建模的相关数据，以生成该佩戴者的SP inv和ED inv传递函数。进一步的，在佩戴者使用不同耳套，或者佩戴的松紧程度不同，佩戴者的运动状态(非运动、运动)不同的多种情况下，听戴式设备采集SP inv建模和ED inv建模的相关数据，以生成该佩戴者个性化的数据库。 It can be understood that when training the ED inv transfer function of the hearable device for the wearer of the hearable device, the relevant data of SP inv modeling and ED inv modeling are collected to generate SP inv and ED inv transfer of the wearer. function. Further, in many cases where the wearer uses different earmuffs, or wears different tightness, and the wearer's movement state (non-movement, movement) is different, the listening device collects SP inv modeling and ED inv modeling. relevant data to generate a personalised database for that wearer.
其中，听戴式设备在采集佩戴者个性化数据的过程中，不可能得到所有可能的使用场景下，佩戴者的个性化数据。因此，可以使用大数据库中SP db路径和ED db函数域的映射关系H db修正佩戴者的个性化数据，以使得听戴式设备在多种场景中都可以较好的为佩戴者提供良好的听觉体验。 Among them, in the process of collecting the wearer's personalized data, the wearable device cannot obtain the wearer's personalized data in all possible usage scenarios. Therefore, the mapping relationship H db between the SP db path and the ED db function domain in the large database can be used to correct the wearer's personalized data, so that the hearable device can better provide the wearer with good performance in various scenarios. auditory experience.
值得一提的，佩戴者个性化数据包括，佩戴者是否使用耳套，佩戴者佩戴听戴式设备的松紧程度，佩戴者的运动状态等信息。示例性的，听戴式设备可以通过与佩戴者语音交互的方式采集到相关的个性化数据。例如，听戴式设备在开始测试后，通过语音交互的方式针对每个个性化数据提问，并采集佩戴者的语音信息，以确定佩戴者的个性化数据。如，听戴式设备发出提问，“请确认是否使用耳套”，如果听戴式设备采集到佩戴者的语音信息是“没有使用耳套”或“无”或“否”等回答。听戴式设 备可以确定佩戴者当前使用的听戴式设备没有耳套。在这种情况下，听戴式设备将不再询问佩戴者耳套尺寸等相关个性化数据。It is worth mentioning that the wearer's personalized data includes information such as whether the wearer uses earmuffs, the tightness of the wearer wearing the hearable device, and the movement state of the wearer. Exemplarily, the hearable device may collect relevant personalized data by interacting with the wearer's voice. For example, after the hearing-worn device starts the test, it asks questions for each personalized data through voice interaction, and collects the wearer's voice information to determine the wearer's personalized data. For example, if the listening device sends a question, "Please confirm whether to use earmuffs", if the listening device collects the wearer's voice information, the answer is "no earmuffs" or "no" or "no". The hearable can determine that the wearer is currently using a hearable that does not have eartips. In this case, the hearable device will no longer ask the wearer for personalization data such as the size of the earmuffs.
上述第二种实现中，听戴式设备可以与主控设备(或称为第一设备)连接，在主控设备的控制下工作，则可以通过主控设备采集佩戴者个性化数据。例如，主控设备是手机、电脑等电子设备，主控设备包括显示屏。听戴式设备与主控设备建立通信连接，主控设备的显示屏显示个性化数据的输入界面，该输入界面可以获取佩戴者输入的信息。佩戴者与主控设备交互，通过该输入界面输入个性化数据，使得听戴式设备采集得到佩戴者的个性化数据，以便建立佩戴者的个性化数据库。In the above-mentioned second implementation, the hearable device can be connected to the main control device (or called the first device), and works under the control of the main control device, then the wearer's personalized data can be collected through the main control device. For example, the main control device is an electronic device such as a mobile phone and a computer, and the main control device includes a display screen. The listening device establishes a communication connection with the main control device, and the display screen of the main control device displays an input interface for personalized data, and the input interface can obtain the information input by the wearer. The wearer interacts with the main control device, and inputs personalized data through the input interface, so that the wearable device collects the wearer's personalized data, so as to establish the wearer's personalized database.
示例性的，以听戴式设备是耳机，第一设备是手机，耳机和手机配合实现对耳机中传递函数的训练。其过程为：佩戴者佩戴好耳机，手机接收到佩戴者的操作信息，手机通过蓝牙与耳机连接。其中，佩戴者佩戴耳机时，确定使用的耳套(针对入耳式耳机)，调整佩戴姿势，以及佩戴的耳机的松紧程度。手机接收到采集佩戴者个性化数据的操作，手机可以接收佩戴者的输入信息，以采集到相关的个性化数据。如，手机接收佩戴者输入的耳机耳套尺寸、耳机的佩戴姿势，耳机佩戴的松紧程度等。手机向耳机发送预设测试音频信号，同时耳机采集相关的数据，耳机可以对采集到的数据传输至手机。手机可以采用耳机传输的数据，创建出针对该佩戴者的SP inv路径和ED inv传递函数，手机端可以利用其运算能力，结合手机采集到的佩戴者个性化数据得到个性化非线性映射关系H inv。手机还可以获取大数据得到H db，这样，手机可以根据个性化数据，以及H db得到个性化非线性映射关系H inv，手机可以向耳机传输映射关系H inv，并以初始数据或原始数据的形式设置在耳机中。这样，当耳机再次被该佩戴者使用时，可以根据该佩戴者个性化的数据为佩戴者提供良好的主动降噪或透传功能。 Exemplarily, the listening device is an earphone, the first device is a mobile phone, and the earphone and the mobile phone cooperate to implement the training of the transfer function in the earphone. The process is as follows: the wearer wears the earphone, the mobile phone receives the operation information of the wearer, and the mobile phone is connected with the earphone through Bluetooth. Wherein, when the wearer wears the earphones, the earmuffs to be used (for in-ear earphones) are determined, the wearing posture is adjusted, and the tightness of the earphones worn is adjusted. The mobile phone receives the operation of collecting the wearer's personalized data, and the mobile phone can receive the wearer's input information to collect the relevant personalized data. For example, the mobile phone receives the size of the earphone and earmuff input by the wearer, the wearing posture of the earphone, and the tightness of the earphone wearing. The mobile phone sends a preset test audio signal to the headset, and the headset collects relevant data, and the headset can transmit the collected data to the mobile phone. The mobile phone can use the data transmitted by the headset to create the SP inv path and ED inv transfer function for the wearer. The mobile phone can use its computing power to combine the wearer’s personalized data collected by the mobile phone to obtain a personalized nonlinear mapping relationship H. inv . The mobile phone can also obtain the big data to obtain H db , in this way, the mobile phone can obtain the personalized nonlinear mapping relationship H inv according to the personalized data and H db , the mobile phone can transmit the mapping relationship H inv to the headset, and use the initial data or the original data as the original data. The form is set in the headset. In this way, when the headset is used by the wearer again, the wearer can be provided with a good active noise reduction or transparent transmission function according to the wearer's personalized data.
以下将以听戴式设备不与其他设备交互，听戴式设备可以单独工作的情况说明本申请实施例提供的方法。如，听戴式设备是耳机，耳机中预设基于大数据得到的通用的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。 The method provided by the embodiments of the present application will be described below in the case that the hearable device does not interact with other devices, and the hearable device can work alone. For example, the listening device is an earphone, and the general SP db path and ED db transfer function obtained based on big data are preset in the earphone, as well as the mapping relationship H db between the SP db path and the ED db function domain.
请参考图6，为本申请实施例提供的优化听戴式设备功能的方法的流程图。如图6所示，该方法可以包括步骤601-步骤606。Please refer to FIG. 6 , which is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application. As shown in FIG. 6 , the method may include steps 601 to 606 .
步骤601：耳机被佩戴者佩戴，耳机的主动降噪和/或透传处于开启状态。Step 601 : the earphone is worn by the wearer, and the active noise reduction and/or transparent transmission of the earphone is turned on.
其中，耳机被佩戴者佩戴，开启耳机的ANC和/或HT功能，以使得耳机在工作的过程中，提供良好的声音播放效果。The earphone is worn by the wearer, and the ANC and/or HT function of the earphone is turned on, so that the earphone can provide a good sound playback effect during the working process.
示例性的，耳机上可以包括按键，耳机上的按键可以用于触发耳机ANC和/或HT功能。又示例性的，耳机可以获取当前所处的环境中的噪声信息，并根据噪声信息启动ANC和/或HT功能，以便耳机可以为佩戴者提供良好的听觉体验。Exemplarily, the earphone may include buttons, and the buttons on the earphone may be used to trigger the ANC and/or HT function of the earphone. In another example, the earphone can acquire noise information in the current environment, and activate the ANC and/or HT function according to the noise information, so that the earphone can provide the wearer with a good listening experience.
步骤602：播放预设音频信号，采集佩戴者耳道的响应信息，该响应信息用于创建SP inv路径。 Step 602: Play a preset audio signal, and collect response information from the wearer's ear canal, where the response information is used to create an SP inv path.
可以理解的，耳机播放音频信号之后，音频信号的声波在耳道中传输的过程中，耳机可以采集到耦合有耳道信息的响应信息。It can be understood that after the earphone plays the audio signal, the earphone can collect the response information coupled with the ear canal information during the process of transmitting the sound wave of the audio signal in the ear canal.
其中，听戴式设备采集的响应信息可以包括：ERP处的响应；扬声器的响应；初级路径上的响应；反馈路径上的响应等。耳机采集的响应信息与耳机的硬件结构相关，例如，耳机包括FF麦克风、FB麦克风、扬声器等。当耳机播放预设音频信号之后， 扬声器可以采集到扬声器响应，FF麦克风可以采集到反馈路径上的响应，FB麦克风可以采集到初级路径上的响应等。The response information collected by the hearable device may include: the response at the ERP; the response of the speaker; the response on the primary path; the response on the feedback path, and the like. The response information collected by the headset is related to the hardware structure of the headset. For example, the headset includes an FF microphone, a FB microphone, a speaker, and the like. After the earphone plays the preset audio signal, the speaker can collect the speaker response, the FF microphone can collect the response on the feedback path, the FB microphone can collect the response on the primary path, and so on.
步骤603：根据响应信息创建耳道的SP inv路径。 Step 603: Create an SP inv path of the ear canal according to the response information.
需要说明的，由于耳机的结构与测试设备的结构不同，耳机不包括探针麦克风，则耳机不能直接获取到DRP处的声压信号。基于耳机的结构，当耳机播放预设音频信号之后，耳机可以基于采集的响应信号，进行SP inv路径建模，以得到实时的SP cur(z)。 It should be noted that, because the structure of the earphone is different from that of the test equipment, the earphone does not include a probe microphone, so the earphone cannot directly obtain the sound pressure signal at the DRP. Based on the structure of the earphone, after the earphone plays the preset audio signal, the earphone can model the SP inv path based on the collected response signal to obtain the real-time SP cur (z).
步骤604：基于获取到的个性化数据得到耳道建模ED inv传递函数，以及SP inv路径和ED inv传递函数的映射关系H inv。 Step 604: Obtain the ear canal modeling ED inv transfer function and the mapping relationship H inv between the SP inv path and the ED inv transfer function based on the obtained personalized data.
示例性的，耳机的开关被触发，则耳机处于工作状态，耳机可以采集佩戴者的个性化数据。例如，耳机可以通过语音交互的方式获取佩戴者的个性化数据。又如，耳机可以包括按键，基于佩戴者对按键的操作采集到佩戴者的个性化数据。又如，耳机可以借助其他的输入设备(如，显示器、触摸键盘等)，耳机与输入设备连接，耳机可以通过输入设备获取到佩戴者的个性化数据，或者，输入设备获取到佩戴者的个性化数据，并向耳机发送个性化数据。本申请实施例对于耳机采集佩戴者个性化数据的方式不作具体限定。Exemplarily, when the switch of the earphone is triggered, the earphone is in a working state, and the earphone can collect personalized data of the wearer. For example, the headset can obtain personalized data of the wearer through voice interaction. For another example, the headset may include buttons, and the wearer's personalized data is collected based on the wearer's operation of the buttons. For another example, the headset can use other input devices (such as a display, a touch keyboard, etc.), the headset is connected to the input device, and the headset can obtain the wearer's personalized data through the input device, or the input device can obtain the wearer's personality. data and send personalized data to the headset. The embodiments of the present application do not specifically limit the manner in which the earphone collects the wearer's personalized data.
在一些实现中，个性化数据中的耳机佩戴状态可以由耳机确定。例如，耳机中可以包括方向传感器和陀螺仪传感器，使得耳机可以根据方向传感器和陀螺仪传感器的数据确定耳机的位姿信息，耳机可以确定耳机佩戴的松紧状态，以及耳机的佩戴姿势是否有发生变化。耳机中还可以包括加速度传感器，耳机可以根据加速度传感器的数据可以反映耳机是否被佩戴者携带，处于运动状态，则耳机可以确定耳机佩戴者是否处于运动状态。也就是说，佩戴者个性化数据中可以是耳机根据自身传感器的数据确定，也可以是耳机与佩戴者交互得到个性化数据。In some implementations, the headset wearing status in the personalization data may be determined by the headset. For example, the headset may include a direction sensor and a gyroscope sensor, so that the headset can determine the posture information of the headset according to the data of the direction sensor and the gyroscope sensor, and the headset can determine the tightness of the headset and whether the wearing posture of the headset has changed. . The headset may also include an acceleration sensor, and the headset may reflect whether the headset is carried by the wearer according to the data of the acceleration sensor and is in a motion state, and the headset can determine whether the headset wearer is in a motion state. That is to say, the personalization data of the wearer may be determined by the earphone according to the data of its own sensor, or the personalized data may be obtained by the interaction between the earphone and the wearer.
其中，耳机采集得到佩戴者个性化数据，根据个性化数据修正SP inv路径与ED inv函数域的映射关系H inv。耳机播放的预设音频信号与佩戴者的耳道耦合，耳机可以得到当前佩戴者在耦合佩戴者耳道信息的响应信息，以便耳机建模实时传递函数ED cur(z)。 The earphone collects the wearer's personalized data, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data. The preset audio signal played by the earphone is coupled with the wearer's ear canal, and the earphone can obtain the response information of the current wearer coupling the wearer's ear canal information, so that the earphone can model the real-time transfer function ED cur (z).
也就是说，耳机播放预设音频信号，耳机获取到耳机佩戴者的个性化数据，耳机可以生成针对该佩戴者的实时SP cur(z)路径和ED cur(z)传递函数。实时ED cur(z)传递函数可以反映ERP和DRP处的声压信号的关系，由于耳机中的前馈麦克风可以采集ERP处的音频信号，则耳机可以根据ERP处的音频信号确定耳道ERP处的声压信号。这样，耳机在使用的过程中，耳机播放音频信号，耳机可以根据ED cur(z)传递函数和ERP处的声压信号，调整DRP处的声压信号。实现优化耳机的ANC和/或HT功能的目的，并提高耳机播放音频信号的音效，为佩戴者提供良好的听觉体验。 That is, the earphone plays a preset audio signal, the earphone obtains the personalized data of the earphone wearer, and the earphone can generate the real-time SP cur (z) path and ED cur (z) transfer function for the wearer. The real-time ED cur (z) transfer function can reflect the relationship between the sound pressure signal at the ERP and the DRP. Since the feedforward microphone in the headset can collect the audio signal at the ERP, the headset can determine the location of the ear canal at the ERP according to the audio signal at the ERP. sound pressure signal. In this way, when the earphone is in use, the earphone plays an audio signal, and the earphone can adjust the sound pressure signal at the DRP according to the ED cur (z) transfer function and the sound pressure signal at the ERP. The purpose of optimizing the ANC and/or HT function of the headset is achieved, and the sound effect of the audio signal played by the headset is improved, so as to provide the wearer with a good listening experience.
步骤605：播放音频信息，采集佩戴者耳道的响应信息，实时更新SP cur路径和ED cur传递函数。 Step 605: Play the audio information, collect the response information of the wearer's ear canal, and update the SP cur path and the ED cur transfer function in real time.
可以理解的，耳机在播放音频文件的过程中，耳机的ANC和/或HT功能处于开启状态。耳机可以基于得到的针对当前佩戴者的ED cur(z)传递函数，耳机实时采集ERP处的声压信号，根据ED cur(z)传递函数实时调整耳机播放的音频信号，以提供良好的降噪或透传效果。 It can be understood that during the process of playing the audio file in the earphone, the ANC and/or HT function of the earphone is turned on. Based on the obtained ED cur (z) transfer function for the current wearer, the headphones can collect the sound pressure signal at the ERP in real time, and adjust the audio signal played by the headphones in real time according to the ED cur (z) transfer function to provide good noise reduction. or pass-through effect.
步骤606：基于实时更新的SP cur路径和ED cur传递函数调整耳机播放的音频信息， 以使耳机实现实时主动降噪和/或实时透传。 Step 606: Adjust the audio information played by the earphone based on the SP cur path and the ED cur transfer function updated in real time, so that the earphone realizes real-time active noise reduction and/or real-time transparent transmission.
其中，耳机在使用的过程中还可以实时采集个性化数据，以更新SP cur路径和ED cur传递函数。这些个性化数据是耳机根据自身的传感器数据可以确定的，如，耳机佩戴松紧程度，佩戴者是否处于运动状态等。例如，耳机被佩戴者佩戴，佩戴者处于运动状态(如，走路、跑步等运动)，则随着佩戴者的步伐变化，耳机中的加速度传感器可以检测到耳机的运动状态，则耳机可以根据加速度传感器的数据实时确定佩戴者的状态。特别的，佩戴者的运动可能会影响耳机的佩戴松紧程度，耳机中的传感器可以检测耳机佩戴的松紧程度。佩戴者走路的时候，耳机可以实时检测耳机的佩戴松紧程度。在一些实现中，耳机可以通过采集ERP处的声压信号，判断耳机佩戴的松紧程度是否有较大变化。如果耳机佩戴的松紧程度发生变化，则耳机可以根据耳机佩戴松紧程度的变化(即个性化数据的变化)实时调整ED cur传递函数，以使得耳机可以实时优化ANC和/或HT等功能。 Among them, the headset can also collect personalized data in real time in the process of use to update the SP cur path and the ED cur transfer function. These personalized data can be determined by the headset according to its own sensor data, such as the tightness of the headset, whether the wearer is in motion, etc. For example, if the headset is worn by the wearer, and the wearer is in a state of motion (such as walking, running, etc.), then as the wearer's pace changes, the acceleration sensor in the headset can detect the motion state of the headset, and the headset can detect the motion state of the headset according to the acceleration Data from the sensors determines the state of the wearer in real time. In particular, the movement of the wearer may affect the tightness of the earphone, and the sensor in the earphone can detect the tightness of the earphone. When the wearer walks, the headset can detect the tightness of the headset in real time. In some implementations, the earphone can determine whether the tightness of the earphone has changed greatly by collecting the sound pressure signal at the ERP. If the tightness of the earphone is changed, the earphone can adjust the ED cur transfer function in real time according to the change of the tightness of the earphone (ie, the change of the personalized data), so that the earphone can optimize the functions such as ANC and/or HT in real time.
以下将以听戴式设备与第一设备交互，听戴式设备与第一设备配合，使得听戴式设备处于工作状态，说明本申请实施例提供的方法。The method provided by the embodiments of the present application will be described below by using the hearable device to interact with the first device, and the listenable device to cooperate with the first device so that the hearable device is in a working state.
其中，耳机可以与第一设备交互，第一设备可以获取基于大数据得到的通用的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。第一设备可以和耳机佩戴者交互，获取佩戴者的个性化数据，则第一设备创建出针对耳机佩戴者SP inv路径和ED inv传递函数。使得耳机可以利用手机的运算和数据处理能力，创建出针对耳机佩戴者的SP inv路径和ED inv传递函数。如果第一设备是远程服务器或云设备，则耳机可以通过通信模块与第一设备通信。使得耳机可以利用远程设备的运算和数据处理能力，创建出针对耳机佩戴者SP inv路径和ED inv传递函数。 The headset can interact with the first device, and the first device can obtain the general SP db path and ED db transfer function obtained based on big data, and the mapping relationship H db between the SP db path and the ED db function domain. The first device can interact with the earphone wearer to obtain personalized data of the wearer, and the first device creates an SP inv path and an ED inv transfer function for the earphone wearer. The earphone can utilize the computing and data processing capabilities of the mobile phone to create the SP inv path and the ED inv transfer function for the earphone wearer. If the first device is a remote server or a cloud device, the headset can communicate with the first device through the communication module. The headset can utilize the computing and data processing capabilities of the remote device to create the SP inv path and the ED inv transfer function for the headset wearer.
示例性的，听戴式设备是耳机，第一设备可以是手机，耳机通过蓝牙或WLAN等通信方式建立连接，耳机可以接收来自手机的音频信号，并播放该音频信号。耳机中可以包括通信模块，使得耳机可以与手机、电脑等建立通信连接。如，耳机通过近距离通信(如，蓝牙，WLAN，窄带物联网NB-IoT等)的方式与手机建立通信连接。这样，耳机可以与手机交互，手机可以采集佩戴者个性化数据。进一步的，耳机可以播放测试音频信号，采集得到耦合有佩戴者耳道信息的响应信息，耳机可以将响应信息发送至手机。手机可以根据响应信息得到SP inv路径，并根据个性化数据修正SP inv路径和ED inv函数域的映射关系H inv，得到ED inv传递函数。手机可以向耳机传输针对当前佩戴者的SP inv路径和ED inv传递函数，以使得耳机可以针对当前佩戴者调整播放音频信号，优化耳机的ANC和/或HT功能。 Exemplarily, the listening device is an earphone, the first device may be a mobile phone, the earphone establishes a connection through a communication method such as Bluetooth or WLAN, and the earphone can receive an audio signal from the mobile phone and play the audio signal. The headset may include a communication module, so that the headset can establish a communication connection with a mobile phone, a computer, and the like. For example, the headset establishes a communication connection with the mobile phone by means of short-range communication (eg, Bluetooth, WLAN, NB-IoT, etc.). In this way, the headset can interact with the mobile phone, and the mobile phone can collect the wearer's personalized data. Further, the earphone can play the test audio signal, collect the response information coupled with the wearer's ear canal information, and the earphone can send the response information to the mobile phone. The mobile phone can obtain the SP inv path according to the response information, and correct the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data, and obtain the ED inv transfer function. The mobile phone can transmit the SP inv path and ED inv transfer function for the current wearer to the headset, so that the headset can adjust the playback audio signal for the current wearer, optimizing the ANC and/or HT functions of the headset.
需要说明的，耳机中可以预设基于大数据得到的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。耳机与手机建立通信连接之后，耳机向手机发送基于大数据得到的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。或者，耳机与手机建立通信连接，则耳机向手机发送下载地址，手机可以访问下载地址，下载得到基于大数据得到的SP db路径和ED db传递函数，以及SP db路径和ED db函数域的映射关系H db。 It should be noted that the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain can be preset in the headset. After the headset establishes a communication connection with the mobile phone, the headset sends the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain to the mobile phone. Or, if the headset establishes a communication connection with the mobile phone, the headset sends the download address to the mobile phone, and the mobile phone can access the download address, and download the SP db path and ED db transfer function based on big data, as well as the mapping of the SP db path and the ED db function domain. relation H db .
又示例性的，耳机中可以包括射频模块，使得耳机可以与远程服务器或云设备交互。在这种情况下，可以在远程服务器或云设备设置基于大数据得到的SP db路径和ED db 传递函数，以及SP db路径和ED db函数域的映射关系H db。耳机可以用于与佩戴者交互，采集佩戴者的个性化数据，并将采集到的佩戴者个性化数据通过射频模块传输至手机。手机可以基于耳机的佩戴者创建该佩戴者的SP inv路径和ED inv传递函数。远程服务器可以将得到的该佩戴者的SP inv路径和ED inv传递函数发送至耳机，以使得耳机在播放音频的过程中，可以针对当前佩戴者调整播放音频信号，提供良好的主动降噪和透传功能。 In another example, a radio frequency module may be included in the headset, so that the headset can interact with a remote server or cloud device. In this case, the SP db path and the ED db transfer function obtained based on the big data, and the mapping relationship H db between the SP db path and the ED db function domain can be set on the remote server or cloud device. The headset can be used to interact with the wearer, collect the wearer's personalized data, and transmit the collected wearer's personalized data to the mobile phone through the radio frequency module. The cell phone can create the wearer's SP inv path and ED inv transfer function based on the wearer of the headset. The remote server can send the obtained SP inv path and ED inv transfer function of the wearer to the headset, so that the headset can adjust the playing audio signal for the current wearer during the process of playing audio, providing good active noise reduction and transparency. transfer function.
在一些实现中，以听戴式设备是耳机，第一设备是手机为例，说明本申请实施例提供的方法。请参考图7，为本申请实施例提供的优化听戴式设备功能的方法的流程图。如图7所示，该方法包括步骤701-步骤709。In some implementations, the method provided by the embodiments of the present application is described by taking the listening device as an earphone and the first device as a mobile phone as an example. Please refer to FIG. 7 , which is a flowchart of a method for optimizing a function of a hearable device provided by an embodiment of the present application. As shown in FIG. 7 , the method includes steps 701 to 709 .
需要说明的，该方法与上述实施例中区别之处在于，上述实施例中，耳机可以根据个性化数据创建得到针对佩戴者的SP inv路径和ED inv传递函数。本实施例中手机创建得到针对佩戴者的SP inv路径和ED inv传递函数。其中，本申请实施例中的步骤702、步骤703和步骤708与上述实施例中的步骤601、步骤602和步骤605相同。因此，上述相关步骤中的相关实现方式也可以应用于本申请实施例中，同理，本申请实施例中的相关步骤中的实施细节也可以应用于上述实施例中，此处不予赘述。 It should be noted that the difference between this method and the above-mentioned embodiment is that in the above-mentioned embodiment, the earphone can create and obtain the SP inv path and the ED inv transfer function for the wearer according to the personalized data. In this embodiment, the mobile phone creates the SP inv path and the ED inv transfer function for the wearer. Wherein, step 702, step 703, and step 708 in the embodiment of the present application are the same as step 601, step 602, and step 605 in the foregoing embodiment. Therefore, the relevant implementation manners in the above-mentioned relevant steps can also be applied to the embodiments of the present application, and similarly, the implementation details of the relevant steps in the embodiments of the present application can also be applied to the above-mentioned embodiments, which will not be repeated here.
步骤701：耳机与手机建立通信连接。Step 701: Establish a communication connection between the headset and the mobile phone.
需要说明的，此处以耳机采用蓝牙连接的方式与手机建立通信连接。手机和耳机的蓝牙功能均处于开启状态，耳机与手机蓝牙连接成功，则耳机可以通过蓝牙与手机数据交互。It should be noted that the communication connection between the headset and the mobile phone is established by using a Bluetooth connection. The Bluetooth function of the mobile phone and the headset are both turned on, and the headset and the mobile phone are successfully connected via Bluetooth, then the headset can interact with the mobile phone data through Bluetooth.
步骤702：耳机被佩戴者佩戴，耳机的主动降噪和/或透传功能处于开启状态。Step 702: The earphone is worn by the wearer, and the active noise reduction and/or transparent transmission function of the earphone is turned on.
在一些实现方式中，耳机通过蓝牙与手机连接，手机可以向耳机发送控制信息，控制信息用于控制耳机提供的功能的状态。示例性的，耳机与手机建立蓝牙连接，手机可以显示耳机的控制界面，控制界面上包括耳机中功能的开关控件。如，主动降噪的开关控件和透传的开关控件。手机接收到佩戴者对主动降噪开关控件的触发操作，手机向耳机发送开启主动降噪功能的控制信息。In some implementations, the earphone is connected to the mobile phone through Bluetooth, and the mobile phone can send control information to the earphone, and the control information is used to control the state of the function provided by the earphone. Exemplarily, a Bluetooth connection is established between the headset and the mobile phone, and the mobile phone can display a control interface of the headset, and the control interface includes switch controls for functions in the headset. For example, switch controls for active noise reduction and switch controls for transparent transmission. The mobile phone receives the trigger operation of the active noise reduction switch control by the wearer, and the mobile phone sends the control information to enable the active noise reduction function to the headset.
另一些实现方式中，耳机被佩戴者佩戴，耳机上包括按键，耳机上的按键可以用于开启耳机的功能。耳机上包括主动降噪功能的按键和透传功能的按键，耳机上主动降噪功能的按键被触发，耳机启动主动降噪的功能。In other implementation manners, the earphone is worn by the wearer, the earphone includes buttons, and the buttons on the earphone can be used to enable the function of the earphone. The headset includes a button for the active noise reduction function and a button for the transparent transmission function. The button for the active noise reduction function on the headset is triggered, and the headset activates the active noise reduction function.
步骤703：耳机播放预设音频信号，采集佩戴者耳道的响应信息，该响应信息用于创建SP inv路径。 Step 703: The earphone plays the preset audio signal, and collects the response information of the wearer's ear canal, and the response information is used to create the SP inv path.
可以理解的，耳机播放的预设音频信号可以是耳机中预存储的音频信号。或者，该音频信号是手机向耳机发送的音频信号。其中，耳机与手机建立连接，则手机可以向耳机发送预设音频信号，耳机播放预设音频信号。It can be understood that the preset audio signal played by the earphone may be an audio signal pre-stored in the earphone. Alternatively, the audio signal is an audio signal sent by the mobile phone to the headset. Wherein, when the headset is connected to the mobile phone, the mobile phone can send a preset audio signal to the headset, and the headset plays the preset audio signal.
其中，耳机播放预设音频信号，用于耳机可以采集到耳道的反馈的响应信息，以便可以根据响应信息创建SP inv路径。 The earphone plays a preset audio signal for the earphone to collect the feedback response information of the ear canal, so that the SP inv path can be created according to the response information.
步骤704：耳机将采集到的响应信息传输至手机。Step 704: The headset transmits the collected response information to the mobile phone.
其中，耳机将采集到的响应信息传输至手机，以便手机可以处理响应信息，根据响应信息生成SP inv路径。 The headset transmits the collected response information to the mobile phone, so that the mobile phone can process the response information, and generate the SP inv path according to the response information.
步骤705：手机并接收到耳机传输的响应信息，并采集佩戴者个性化数据，个性化数据用于ED inv建模。 Step 705: The mobile phone receives the response information transmitted by the headset, and collects the wearer's personalized data, and the personalized data is used for ED inv modeling.
示例性的，手机可以显示个性化数据采集的界面，手机可以获取佩戴者在个性化数据采集的界面输入的信息，使得手机获取到佩戴者的个性化的信息。如，个性化数据可以包括佩戴者佩戴的耳机是否包括耳套，耳套的尺寸，耳机的松紧程度等。Exemplarily, the mobile phone may display a personalized data collection interface, and the mobile phone may acquire information input by the wearer on the personalized data collection interface, so that the mobile phone may acquire the wearer's personalized information. For example, the personalized data may include whether the earphones worn by the wearer include earmuffs, the size of the earmuffs, the tightness of the earphones, and the like.
步骤706：手机根据得到的响应信息创建佩戴者耳道的SP inv路径，并根据个性化数据修正SP inv路径和ED inv函数域的映射关系H inv，以得到ED inv传递函数。 Step 706: The mobile phone creates the SP inv path of the wearer's ear canal according to the obtained response information, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data to obtain the ED inv transfer function.
需要说明的，手机根据大数据得到的SP db路径和ED db传递函数，SP db路径和ED db函数域的映射关系H db，得到针对佩戴者个性化的SP inv路径和ED inv传递函数。其中，步骤605-步骤605与上述步骤503和步骤504的具体实现相同，具体实现可以参考上述步骤503和步骤504，此处不予赘述。 It should be noted that the mobile phone obtains the SP db path and ED db transfer function according to the big data, and the mapping relationship H db between the SP db path and the ED db function domain, and obtains the SP inv path and ED inv transfer function personalized for the wearer. The specific implementations of steps 605 to 605 are the same as the above-mentioned steps 503 and 504, and the specific implementation may refer to the above-mentioned steps 503 and 504, which will not be repeated here.
步骤707：手机将生成的针对该佩戴者的ED inv传递函数传输至耳机，并向耳机发送音频数据。 Step 707: The mobile phone transmits the generated ED inv transfer function for the wearer to the earphone, and sends audio data to the earphone.
可以理解的，耳机接收到该ED inv传递函数，可以根据ED inv传递函数调整播放的音频信号，以满足主动降噪或透传的功能。 It can be understood that, after receiving the ED inv transfer function, the earphone can adjust the played audio signal according to the ED inv transfer function, so as to satisfy the function of active noise reduction or transparent transmission.
步骤708：耳机根据ED inv传递函数调整播放的音频信号，采集佩戴者耳道的响应信息，并向手机发送响应信息。 Step 708: The earphone adjusts the played audio signal according to the ED inv transfer function, collects the response information of the wearer's ear canal, and sends the response information to the mobile phone.
步骤709：手机采用响应信息更新SP inv路径和ED inv传递函数，并将更新的ED传递函数传输至耳机，以便耳机可以实时主动降噪和/或实时透传。 Step 709: The mobile phone uses the response information to update the SP inv path and the ED inv transfer function, and transmits the updated ED transfer function to the headset, so that the headset can perform active noise reduction and/or transparent transmission in real time.
一般而言，手机根据个性化数据以及响应信息得到SP inv路径和ED inv传递函数，如图8所示，为耳机使用的过程中，手机根据实时数据得到的耳机佩戴者SP inv路径曲线示意，以及ED inv传递函数曲线示意图。其中，图8所示的SP曲线为当前耳机在播放的音频文件在不同频段上，耳机采集到的SP路径上的功率增益。ED曲线为当前耳机在播放音频文件时，ERP和DRP处声压的功率增益变化。 Generally speaking, the mobile phone obtains the SP inv path and the ED inv transfer function according to the personalized data and response information. As shown in Figure 8, in the process of using the headset, the mobile phone obtains the SP inv path curve of the headset wearer according to the real-time data. And the schematic diagram of the ED inv transfer function curve. The SP curve shown in FIG. 8 is the power gain on the SP path collected by the headset in different frequency bands of the audio file currently being played by the headset. The ED curve is the power gain change of the sound pressure at ERP and DRP when the current headset is playing an audio file.
在一些实施例中，耳机在使用过程中ED inv传递函数的建模开关可以由佩戴者控制，佩戴者可以触发建模开关，则耳机获取佩戴者个性化数据创建ED inv传递函数。佩戴者也可以不触发建模开关，则耳机不会获取佩戴者个性化数据，也不会创建ED inv传递函数。 In some embodiments, the modeling switch of the ED inv transfer function can be controlled by the wearer during use of the earphone, the wearer can trigger the modeling switch, and the earphone obtains the wearer's personalized data to create the ED inv transfer function. The wearer can also not trigger the modeling switch, and the headset will not obtain the wearer's personalized data, nor will the ED inv transfer function be created.
示例性的，请参考图9A，为手机和耳机配合使用的应用场景示意图。如图9A所示，801表示人耳，802表示耳机，803表示手机。耳机803被佩戴在人耳801，手机803可以通过蓝牙与耳机802连接。如图9A所示，手机803的显示界面上显示ANC功能处于开启状态，创建ED传递函数的开关处于关闭状态。请参考图9B，为手机或耳机中设置的ANC算法架构示意图。如图9B所示，耳机可以采集得到参考麦克风的响应信号，ERP处的响应信号，DL表示基于大数据得到的ED传递函数和SP路径。Ref表示前馈麦克风采集到的响应信息，W ff(Z)表示根据Ref采集的响应信息得到，反馈路径上的响应信息。W fb(Z)表示耳机采集的初级路径上的响应信息。SPK表示耳机的扬声器播放的音频信号。 Exemplarily, please refer to FIG. 9A , which is a schematic diagram of an application scenario in which a mobile phone and a headset are used together. As shown in FIG. 9A, 801 denotes a human ear, 802 denotes an earphone, and 803 denotes a mobile phone. The earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth. As shown in FIG. 9A , the display interface of the mobile phone 803 shows that the ANC function is on, and the switch for creating the ED transfer function is off. Please refer to FIG. 9B , which is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset. As shown in Figure 9B, the headset can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED transfer function and SP path obtained based on big data. Ref represents the response information collected by the feedforward microphone, and W ff (Z) represents the response information on the feedback path obtained according to the response information collected by Ref. W fb (Z) represents the response information on the primary path collected by the earphone. SPK represents the audio signal played by the speaker of the headset.
其中，耳机在使用的过程中，ED(z)＝1。耳机在播放音频信号的过程中，前馈麦克风采集到响应信息Ref，以得到W ff(Z)。同时，耳机可以采集到ERP处的声压信号传输至运算器，SP(z)将DL得到的ED传递函数和SP路径传输至运算器，以得到当前佩戴者的SP inv路径和ED inv传递函数。ED(z)＝1表示设置ED传递函数为1，根据ED(z)＝1 得到耳机的初级路径上的响应信息。耳机根据得到的W ff(Z)、W fb(Z)以及DL调节耳机中扬声器的音频信号。在这种情况下，在主动降噪的过程中，并未考虑针对该佩戴者的ED传递函数，只在耳道入口处实现降噪，则ERP处的降噪程度要优于DRP处的降噪深度。 Wherein, in the process of using the earphone, ED(z)=1. In the process of playing the audio signal in the earphone, the feedforward microphone collects the response information Ref to obtain W ff (Z). At the same time, the earphone can collect the sound pressure signal at ERP and transmit it to the calculator. SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer. . ED(z)=1 means that the ED transfer function is set to 1, and the response information on the primary path of the earphone is obtained according to ED(z)=1. The earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL. In this case, in the process of active noise reduction, the ED transfer function for the wearer is not considered, and noise reduction is only achieved at the entrance of the ear canal, then the noise reduction degree at the ERP is better than that at the DRP. noise depth.
又示例性的，请参考图10A，为手机和耳机配合使用的应用场景示意图。如图10A所示，801表示人耳，802表示耳机，803表示手机。耳机803被佩戴在人耳801，手机803可以通过蓝牙与耳机802连接。如图10A所示，手机803的显示界面上显示ANC功能处于开启状态，创建ED传递函数的开关处于开启状态。请参考图10B，为手机或耳机中设置的ANC算法架构示意图。如图10B所示，耳机可以采集得到参考麦克风的响应信号，ERP处的响应信号，DL表示基于大数据得到的ED传递函数和SP路径。W ff(Z)表示耳机采集的反馈路径上的响应信息，W fb(Z)表示耳机采集的初级路径上的响应信息。 For another example, please refer to FIG. 10A , which is a schematic diagram of an application scenario in which a mobile phone and a headset are used together. As shown in FIG. 10A, 801 denotes a human ear, 802 denotes an earphone, and 803 denotes a mobile phone. The earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth. As shown in FIG. 10A , the display interface of the mobile phone 803 shows that the ANC function is turned on, and the switch for creating the ED transfer function is turned on. Please refer to FIG. 10B , which is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset. As shown in Figure 10B, the headset can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED transfer function and SP path obtained based on big data. W ff (Z) represents the response information on the feedback path collected by the earphone, and W fb (Z) represents the response information on the primary path collected by the earphone.
其中，耳机的使用过程中，耳机播放音频信号，SP(z)检测模块和ED(z)估计模块同步工作，采集用于创建SP路径的相关参数，并实时更新SP路径的相关参数。SP(z)检测模块用于检测SP路径的相关数据，SP(z)更新模块用于将更新的SP路径的相关数据。这样，SP(z)可以根据SP(z)更新模块的数据实时更新SP路径。SP(z)可以得到实时的SP cur(z)，并将SP cur(z)传输至运算器。运算器还可以获取ERP的响应信息，以得到生成ED传递函数的参数。同时，ED(z)估计模块用于根据估计当前的DRP处的声压信号，ED(z)更新模块根据DRP处的声压信号估计ED db传递函数。ED(z)模块根据ED(z)更新模块和来自运算器的数据，生成实时的ED传递函数。ED(z)更新模块用于更新ED cur(z)传递函数中的参数，以得到W fb(Z)。由此一来，耳机可以根据W ff(Z)、W fb(Z)以及DL调节耳机中扬声器的音频信号。在这种情况下，主动降噪的过程中，考虑针对该佩戴者的ED传递函数，实现在DRP处的降噪，因此，DRP处的降噪程度要优于ERP处的降噪程度。 Among them, during the use of the headset, the headset plays an audio signal, and the SP(z) detection module and the ED(z) estimation module work synchronously to collect relevant parameters for creating the SP path, and update the relevant parameters of the SP path in real time. The SP(z) detection module is used to detect the related data of the SP path, and the SP(z) update module is used to update the related data of the SP path. In this way, SP(z) can update the SP path in real time according to the data of the SP(z) update module. SP(z) can get the real-time SP cur (z) and transmit SP cur (z) to the operator. The calculator can also obtain the response information of the ERP to obtain parameters for generating the ED transfer function. Meanwhile, the ED(z) estimation module is used to estimate the current sound pressure signal at the DRP, and the ED(z) update module estimates the ED db transfer function according to the sound pressure signal at the DRP. The ED(z) module generates a real-time ED transfer function based on the ED(z) update module and data from the operator. The ED(z) update module is used to update the parameters in the ED cur (z) transfer function to obtain W fb (Z). As a result, the earphone can adjust the audio signal of the speaker in the earphone according to W ff (Z), W fb (Z) and DL. In this case, in the process of active noise reduction, the ED transfer function for the wearer is considered to achieve noise reduction at the DRP. Therefore, the noise reduction degree at the DRP is better than that at the ERP.
基于上述示例，请参考图11，为主动降噪的过程中，创建ED inv传递函数的降噪效果与关闭创建ED inv传递函数的降噪效果对比示意图。降噪深度越小，则降噪效果越好。如图11所示，在100Hz-10000Hz频率之间，ED开启后的ANC曲线对应的降噪深度的数值更小，则ED开启后的降噪效果更好。因此，相比于在ERP处的降噪，如果采用ED传递函数对EDP处降噪的效果更好。本申请实施例提供的方法降噪的程度更优，带宽更宽，相比于在ERP处的主动降噪，启动ED传递函数的降噪效果更好。 Based on the above example, please refer to FIG. 11 , which is a schematic diagram of the comparison between the noise reduction effect of creating the ED inv transfer function and the noise reduction effect of closing the creation of the ED inv transfer function in the process of active noise reduction. The smaller the noise reduction depth, the better the noise reduction effect. As shown in Figure 11, between the frequencies of 100Hz-10000Hz, the value of the noise reduction depth corresponding to the ANC curve after the ED is turned on is smaller, and the noise reduction effect after the ED is turned on is better. Therefore, compared with the noise reduction at the ERP, the effect of noise reduction at the EDP is better if the ED transfer function is used. The method provided by the embodiment of the present application has better noise reduction degree and wider bandwidth, and has better noise reduction effect when the ED transfer function is activated, compared with the active noise reduction at the ERP.
另外，对于耳机的透传功能，通过ED传递函数建模能够带来更好的透传效果。In addition, for the transparent transmission function of the headset, modeling through the ED transfer function can bring a better transparent transmission effect.
示例性的，请参考图12A，为手机和耳机配合使用的应用场景示意图。如图12A所示，801表示人耳，802表示耳机，803表示手机。耳机803被佩戴在人耳801，手机803可以通过蓝牙与耳机802连接。如图9A所示，手机803的显示界面上显示HT功能处于开启状态，创建ED传递函数的开关处于关闭状态。Exemplarily, please refer to FIG. 12A , which is a schematic diagram of an application scenario in which a mobile phone and a headset are used together. As shown in FIG. 12A, 801 denotes a human ear, 802 denotes an earphone, and 803 denotes a mobile phone. The earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth. As shown in FIG. 9A , the display interface of the mobile phone 803 shows that the HT function is on, and the switch for creating the ED transfer function is off.
请参考图12B，为手机或耳机中设置的ANC算法架构示意图。如图12B所示，耳机可以采集得到参考麦克风的响应信号，ERP处的响应信号，DL表示基于大数据得到的ED db传递函数和SP db路径。W ff(Z)表示耳机采集的反馈路径上的响应信息，W fb(Z)表示耳机采集的初级路径上的响应信息。 Please refer to FIG. 12B , which is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset. As shown in Figure 12B, the earphone can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED db transfer function and SP db path obtained based on big data. W ff (Z) represents the response information on the feedback path collected by the earphone, and W fb (Z) represents the response information on the primary path collected by the earphone.
其中，耳机播放预设音频信号，ED(z)＝1。耳机在播放音频信号的过程中，前馈麦克风采集到响应信息Ref。ED(z)＝1表示设置ED传递函数为1，ED传递函数不变。根据ED(z)＝1得到耳机的初级路径上的响应信息W ff(Z)。同时，耳机可以采集到ERP处的声压信号传输至运算器，SP(z)将DL得到的ED传递函数和SP路径传输至运算器，以得到当前佩戴者的SP inv路径和ED inv传递函数。耳机可以根据SP inv路径和ED inv传递函数，得到初级路径上的响应信息W fb(Z)。耳机根据得到的W ff(Z)、W fb(Z)以及DL调节耳机中扬声器的音频信号，使得耳机实现透传功能。在这种情况下，ED(z)＝1，则耳机采集的反馈路径上的响应信息中，不能反映出实时的传递函数的变化。在透传声音的过程中，并未考虑针对该佩戴者的ED传递函数，只能保证在ERP处的透传效果，则可以确定ERP处的透传带宽优于DRP处的透传带宽。 The earphone plays a preset audio signal, ED(z)=1. During the process of playing the audio signal in the earphone, the feedforward microphone collects the response information Ref. ED(z)=1 means that the ED transfer function is set to 1, and the ED transfer function remains unchanged. According to ED(z)=1, the response information W ff (Z) on the primary path of the earphone is obtained. At the same time, the earphone can collect the sound pressure signal at ERP and transmit it to the calculator. SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer. . The earphone can obtain the response information W fb (Z) on the primary path according to the SP inv path and the ED inv transfer function. The earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL, so that the earphone realizes the transparent transmission function. In this case, ED(z)=1, the response information on the feedback path collected by the earphone cannot reflect the real-time change of the transfer function. In the process of transparent transmission of sound, the ED transfer function for the wearer is not considered, and only the transparent transmission effect at the ERP can be guaranteed, so it can be determined that the transparent transmission bandwidth at the ERP is better than that at the DRP.
又示例性的，请参考图13A，为手机和耳机配合使用的应用场景示意图。如图13A所示，801表示人耳，802表示耳机，803表示手机。耳机803被佩戴在人耳801，手机803可以通过蓝牙与耳机802连接。如图9A所示，手机803的显示界面上显示HT功能处于开启状态，创建ED传递函数的开关处于开启状态。For another example, please refer to FIG. 13A , which is a schematic diagram of an application scenario in which a mobile phone and a headset are used together. As shown in FIG. 13A, 801 denotes a human ear, 802 denotes an earphone, and 803 denotes a mobile phone. The earphone 803 is worn on the human ear 801, and the mobile phone 803 can be connected to the earphone 802 through Bluetooth. As shown in FIG. 9A , the display interface of the mobile phone 803 shows that the HT function is in an on state, and the switch for creating the ED transfer function is in an on state.
请参考图13B，为手机或耳机中设置的ANC算法架构示意图。如图13B所示，耳机可以采集得到参考麦克风的响应信号，ERP处的响应信号，DL表示基于大数据得到的ED db传递函数和SP db路径。W ff(Z)表示耳机采集的反馈路径上的响应信息，W fb(Z)表示耳机采集的初级路径上的响应信息。 Please refer to FIG. 13B , which is a schematic diagram of an ANC algorithm architecture set in a mobile phone or a headset. As shown in Figure 13B, the earphone can collect the response signal of the reference microphone, the response signal at the ERP, and DL represents the ED db transfer function and SP db path obtained based on big data. W ff (Z) represents the response information on the feedback path collected by the earphone, and W fb (Z) represents the response information on the primary path collected by the earphone.
其中，耳机播放预设音频信号，耳机的HT功能处于开启状态。耳机可以采集到ERP处的声压信号传输至运算器，SP(z)将DL得到的ED传递函数和SP路径传输至运算器，以得到当前佩戴者的SP inv路径和ED inv传递函数。耳机可以根据SP inv路径和ED inv传递函数，得到初级路径上的响应信息W fb(Z)。同时，耳机通过前馈麦克风采集得到Ref，ED(z)模块根据实时采集的Ref以及创建ED函数的相关参数，得到ED(z)。以便根据ED传递函数得到反馈路径上的响应信息W ff(Z)。耳机根据得到的W ff(Z)、W fb(Z)以及DL调节耳机中扬声器的音频信号。其中，SP(z)检测模块处于工作状态，采集响应数据，用于创建SP路径。使得在耳机的使用过程中，SP(z)检测模块可以根据当前采集的数据实时更新SP cur(z)。ED(z)估计模块根据离线训练得到的个性化非线性映射函数H inv和SP cur(z)得到ED cur(z)的估计，然后ED(z)更新模块对***中的ED cur(z)参数进行更新。在这种情况下，在透传声音的过程中，使得耳机可以实现DRP处的音频信号的目的，则可以提高DRP处的透传效果，因此，DRP点处的透传带宽要强于ERP点透传带宽。 The earphone plays a preset audio signal, and the HT function of the earphone is turned on. The earphone can collect the sound pressure signal at ERP and transmit it to the calculator. SP(z) transmits the ED transfer function and SP path obtained by DL to the calculator to obtain the SP inv path and ED inv transfer function of the current wearer. The earphone can obtain the response information W fb (Z) on the primary path according to the SP inv path and the ED inv transfer function. At the same time, the earphone obtains Ref through feed-forward microphone acquisition, and the ED(z) module obtains ED(z) according to the Ref collected in real time and the relevant parameters for creating the ED function. In order to obtain the response information W ff (Z) on the feedback path according to the ED transfer function. The earphone adjusts the audio signal of the speaker in the earphone according to the obtained W ff (Z), W fb (Z) and DL. Among them, the SP(z) detection module is in a working state, and the response data is collected to create the SP path. In the process of using the headset, the SP(z) detection module can update SP cur (z) in real time according to the currently collected data. The ED(z) estimation module obtains the estimation of ED cur (z) according to the personalized nonlinear mapping function H inv and SP cur (z) obtained by offline training, and then the ED (z) update module estimates the ED cur (z) in the system parameters are updated. In this case, in the process of transparently transmitting the sound, the earphone can achieve the purpose of the audio signal at the DRP, which can improve the transparent transmission effect at the DRP. Therefore, the transparent transmission bandwidth at the DRP point is stronger than that at the ERP point. transmission bandwidth.
基于上述示例，请参考图14，耳机开启透传功能，创建ED传递函数模块开启与关闭状态下的实时透传的数值变化示意图。如图14所示，以不佩戴耳机时人耳听到的音频信号波形示意为参考标准，ED传递函数模块处于开启状态人耳听到的声信号更接近，不佩戴耳机时人耳接收的音频信号。DRP的声压信号越接近不佩戴耳机时的声压，则透传效果越好。如图14所示，ED打开时，耳机透传的声压更接近不佩戴耳机时人耳DRP的声压信号。因此，创建ED传递函数模块处于开启状态，耳机的透传效果更好，耳机透传的带宽更宽，DRP点处的透传带宽要强于ERP点透传带宽。Based on the above example, please refer to FIG. 14 , the headset enables the transparent transmission function to create a schematic diagram of the value change of the real-time transparent transmission when the ED transfer function module is turned on and off. As shown in Figure 14, taking the waveform of the audio signal heard by the human ear when the earphone is not worn as the reference standard, the sound signal heard by the human ear is closer when the ED transfer function module is turned on, and the audio signal received by the human ear when the earphone is not worn. Signal. The closer the sound pressure signal of the DRP is to the sound pressure when no headphones are worn, the better the transparent transmission effect will be. As shown in Figure 14, when the ED is turned on, the sound pressure transparently transmitted by the earphone is closer to the sound pressure signal of the human ear DRP when the earphone is not worn. Therefore, when the ED transfer function creation module is enabled, the transparent transmission effect of the headset is better, the bandwidth of the transparent transmission of the headset is wider, and the transparent transmission bandwidth at the DRP point is stronger than the transparent transmission bandwidth at the ERP point.
另一些实现中，听戴式设备是耳机，以第一设备是云设备为例，说明本申请实施 例提供的方法啊。如图15所示，该方法包括步骤901-步骤909。In other implementations, the listenable device is an earphone, and the first device is a cloud device as an example to describe the method provided by the embodiments of the present application. As shown in FIG. 15 , the method includes steps 901 to 909 .
步骤901：耳机与云设备建立连接。Step 901: The headset establishes a connection with the cloud device.
其中，耳机包括射频模块，耳机可以通过射频模块与云设备建立通信连接，实现得耳机与云设备数据传输的目的。云设备中设置有大数据得到SP db路径和ED db传递函数，SP db和ED db函数域的映射关系H db。 The headset includes a radio frequency module, and the headset can establish a communication connection with the cloud device through the radio frequency module, so as to achieve the purpose of data transmission between the headset and the cloud device. The cloud device is provided with big data to obtain the SP db path and the ED db transfer function, and the mapping relationship H db between the SP db and the ED db function domain.
示例性的，耳机与云设备建立通信，耳机向云设备发送的报文中包括耳机的标志，以使得云设备可以针对耳机建模，以得到该耳机的佩戴者的SP inv路径和ED inv传递函数。 Exemplarily, the headset establishes communication with the cloud device, and the message sent by the headset to the cloud device includes the logo of the headset, so that the cloud device can model the headset to obtain the SP inv path and ED inv transmission of the wearer of the headset. function.
步骤902：耳机被佩戴者佩戴，耳机的主动降噪和/或透传处于开启状态。Step 902: The earphone is worn by the wearer, and the active noise reduction and/or transparent transmission of the earphone is turned on.
步骤903：耳机播放预设音频信号，采集佩戴者耳道的响应信息，该响应信息用于创建SP路径。Step 903: The earphone plays a preset audio signal, and collects the response information of the wearer's ear canal, and the response information is used to create the SP path.
步骤904：耳机将采集到的响应信息传输至云设备，耳机获取佩戴者个性化数据，并向云设备发送个性化数据。Step 904: The headset transmits the collected response information to the cloud device, the headset acquires the wearer's personalized data, and sends the personalized data to the cloud device.
步骤905：云设备并接收到耳机传输的响应信息以及个性化数据，个性化数据用于ED inv建模。 Step 905: The cloud device receives the response information and personalized data transmitted by the headset, and the personalized data is used for ED inv modeling.
步骤906：云设备根据得到的响应信息创建佩戴者耳道的SP inv路径，并根据个性化数据修正SP inv路径和ED inv函数域的映射关系H inv，以得到ED inv传递函数。 Step 906: The cloud device creates the SP inv path of the wearer's ear canal according to the obtained response information, and corrects the mapping relationship H inv between the SP inv path and the ED inv function domain according to the personalized data to obtain the ED inv transfer function.
步骤907：云设备将生成的针对该佩戴者的ED inv传递函数传输至耳机。 Step 907: The cloud device transmits the generated ED inv transfer function for the wearer to the headset.
步骤908：耳机根据ED inv传递函数调整播放的音频信号，采集佩戴者耳道的响应信息，并将响应信息传输至云设备。 Step 908: The headset adjusts the played audio signal according to the ED inv transfer function, collects the response information of the wearer's ear canal, and transmits the response information to the cloud device.
步骤909：云设备采用响应信息更新SP inv路径和ED inv传递函数，并将更新的ED inv传递函数传输至耳机，以便耳机可以实现实时降噪和/或实时透传的功能。 Step 909: The cloud device uses the response information to update the SP inv path and the ED inv transfer function, and transmits the updated ED inv transfer function to the headset, so that the headset can implement real-time noise reduction and/or real-time transparent transmission.
可以理解的，上述手机上实施的相关步骤可以应用于云设备中，因此，对于云设备的具体实施不予赘述。It can be understood that the above-mentioned relevant steps implemented on the mobile phone can be applied to the cloud device, so the specific implementation of the cloud device will not be repeated.
以上是以听戴式设备是耳机为例进行说明的，当听戴式设备为其他设备，也可以采用上述的方法。此处不予赘述。The above description is given by taking an example that the hearable device is an earphone. When the hearable device is another device, the above method can also be used. It will not be repeated here.
可以理解的是，上述听戴式设备为了实现上述功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请实施例的范围。It can be understood that, in order to realize the above-mentioned functions, the above-mentioned listen-worn device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that, in conjunction with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Experts may use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the embodiments of the present application.
本申请实施例可以根据上述方法示例对上述电子设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。In this embodiment of the present application, the electronic device may be divided into functional modules according to the foregoing method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
本申请实施例还提供一种电子设备，包括：一个或多个处理器以及一个或多个存储器。一个或多个存储器与一个或多个处理器耦合，一个或多个存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当一个或多个处理器执行计算机指令 时，使得电子设备可以执行上述相关方法步骤，以实现上述实施例中的优化听戴式设备功能的方法。Embodiments of the present application further provide an electronic device, including: one or more processors and one or more memories. One or more memories coupled to one or more processors for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to execute The above related method steps are to implement the method for optimizing the function of the hearable device in the above embodiment.
本申请实施例还提供一种芯片***，该芯片***包括至少一个处理器和至少一个接口电路。处理器和接口电路可通过线路互联。例如，接口电路可用于从其它装置(例如电子设备的存储器)接收信号。又例如，接口电路可用于向其它装置(例如处理器)发送信号。示例性的，接口电路可读取存储器中存储的指令，并将该指令发送给处理器。当所述指令被处理器执行时，可使得电子设备执行上述实施例中的各个步骤。当然，该芯片***还可以包含其他分立器件，本申请实施例对此不作具体限定。Embodiments of the present application further provide a chip system, where the chip system includes at least one processor and at least one interface circuit. The processor and interface circuits may be interconnected by wires. For example, an interface circuit may be used to receive signals from other devices, such as the memory of an electronic device. As another example, an interface circuit may be used to send signals to other devices, such as a processor. Exemplarily, the interface circuit may read the instructions stored in the memory and send the instructions to the processor. When executed by the processor, the instructions can cause the electronic device to perform each step in the above-described embodiments. Certainly, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.
本申请实施例还提供一种计算机存储介质，该计算机存储介质包括计算机指令，当所述计算机指令在上述电子设备上运行时，使得该电子设备执行上述方法实施例中手机执行的各个功能或者步骤。Embodiments of the present application further provide a computer storage medium, where the computer storage medium includes computer instructions, when the computer instructions are executed on the above-mentioned electronic device, the electronic device is made to perform various functions or steps performed by the mobile phone in the above-mentioned method embodiments .
本申请实施例还提供一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行上述方法实施例中手机执行的各个功能或者步骤。Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, enables the computer to perform various functions or steps performed by the mobile phone in the above method embodiments.
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。From the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated as required. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以使用硬件的形式实现，也可以使用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因 此，本申请的保护范围应以所述权利要求的保护范围为准。The above contents are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims (15)

  1. 一种优化听戴式设备功能的方法，其特征在于，所述方法包括：A method for optimizing the function of a hearable device, characterized in that the method comprises:
    所述听戴式设备播放音频信号，并采集所述音频信号在佩戴者耳道的响应信息，其中，所述听戴式设备被所述佩戴者佩戴，所述音频信号在所述佩戴者耳道传播时产生所述响应信息；The listen-worn device plays an audio signal, and collects response information of the audio signal in the ear canal of the wearer, wherein the listen-worn device is worn by the wearer, and the audio signal is in the wearer's ear The response information is generated when the channel is propagated;
    所述听戴式设备向第一设备发送所述响应信息和所述音频信号；The hearable device sends the response information and the audio signal to the first device;
    所述第一设备根据所述响应信息和所述音频信号，生成SP路径，所述SP路径用于表示所述音频信号与耳道外部参考点ERP的声压信号的关系；The first device generates an SP path according to the response information and the audio signal, where the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal;
    所述第一设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；The first device generates an ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer, where the ED transfer function represents the sound pressure of the ERP the relationship between the signal and the sound pressure signal of the DRP;
    所述第一设备向所述听戴式设备发送所述ED传递函数和所述SP路径；The first device sends the ED transfer function and the SP path to the hearable device;
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号。The hearable device adjusts the audio signal according to the ED transfer function and the SP path.
  2. 根据权利要求1所述的方法，其特征在于，所述第一设备包括多个预设SP路径，多个预设ED传递函数，以及所述预设SP路径和所述预设ED传递函数的预设映射关系；其中，所述预设SP路径是根据所述佩戴者的响应信息生成的，所述预设ED传递函数是根据所述佩戴者的响应信息和DRP的声压信号生成的；The method of claim 1, wherein the first device comprises a plurality of preset SP paths, a plurality of preset ED transfer functions, and a combination of the preset SP paths and the preset ED transfer functions A preset mapping relationship; wherein, the preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP;
    所述第一设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP的到耳道参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系，包括：The first device generates an ED transfer function corresponding to the ear canal reference point DRP of the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the ED transfer function of the ERP. The relationship between the sound pressure signal and the sound pressure signal of the DRP, including:
    所述第一设备获取所述佩戴者的个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；The first device acquires personalized data of the wearer, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the one of the tightness of the wearable device and the type of the wearer's ear canal;
    所述第一设备根据所述个性化数据和所述预设映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；The first device obtains a first mapping relationship according to the personalized data and the preset mapping relationship, where the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    所述第一设备通过所述第一映射关系和所述SP路径，生成所述ED传递函数。The first device generates the ED transfer function by using the first mapping relationship and the SP path.
  3. 根据权利要求1所述的方法，其特征在于，所述第一设备包括多个基础SP路径，多个基础ED传递函数，以及所述基础SP路径和所述基础ED传递函数的基础映射关系；其中，所述基础SP路径是根据响应信息生成的，所述基础ED传递函数是根据响应信息和DRP的声压信号生成的；The method according to claim 1, wherein the first device comprises a plurality of basic SP paths, a plurality of basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions; Wherein, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP;
    所述第一设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP的到耳道参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系，包括：The first device generates an ED transfer function corresponding to the ear canal reference point DRP of the ERP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the ED transfer function of the ERP. The relationship between the sound pressure signal and the sound pressure signal of the DRP, including:
    所述第一设备获取所述佩戴者的个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；The first device acquires personalized data of the wearer, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the one of the tightness of the wearable device and the type of the wearer's ear canal;
    所述第一设备根据所述个性化数据和所述基础映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；The first device obtains a first mapping relationship according to the personalized data and the basic mapping relationship, where the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    所述第一设备通过所述第一映射关系和所述SP路径，得到所述ED传递函数。The first device obtains the ED transfer function through the first mapping relationship and the SP path.
  4. 根据权利要求1-3任一项所述的方法，其特征在于，所述听戴式设备播放音频信号，并采集所述音频信号在佩戴者耳道的响应信息之前，所述方法还包括：The method according to any one of claims 1-3, wherein the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method further comprises:
    开启所述听戴式设备的主动降噪和/或透传功能；Turn on the active noise reduction and/or pass-through function of the hearable device;
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号，包括：The hearable device adjusts the audio signal according to the ED transfer function and the SP path, including:
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号，以实现调整所述主动降噪的降噪深度和/或调整所述透传功能的声压信号的目的。The hearable device adjusts the audio signal according to the ED transfer function and the SP path, so as to achieve the purpose of adjusting the noise reduction depth of the active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function .
  5. 一种优化听戴式设备功能的方法，其特征在于，应用于听戴式设备，所述方法包括：A method for optimizing the function of a hearable device, wherein the method is applied to the hearable device, and the method includes:
    所述听戴式设备播放音频信号，并采集所述音频信号在佩戴者耳道的响应信息，其中，所述听戴式设备被所述佩戴者佩戴，所述音频信号在所述佩戴者耳道传播时产生所述响应信息；The listen-worn device plays an audio signal, and collects response information of the audio signal in the ear canal of the wearer, wherein the listen-worn device is worn by the wearer, and the audio signal is in the wearer's ear The response information is generated when the channel is propagated;
    所述听戴式设备根据所述响应信息和所述音频信号，生成SP路径，所述SP路径用于表示所述音频信号与耳道外部参考点ERP的声压信号的关系；The hearable device generates an SP path according to the response information and the audio signal, where the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal;
    所述听戴式设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；The hearable device generates an ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the sound of the ERP. the relationship between the pressure signal and the sound pressure signal of the DRP;
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号。The hearable device adjusts the audio signal according to the ED transfer function and the SP path.
  6. 根据权利要求5所述的方法，其特征在于，所述听戴式设备包括多个预设SP路径，多个预设ED传递函数，以及所述预设SP路径和所述预设ED传递函数的映射关系；其中，所述预设SP路径是根据所述佩戴者的响应信息生成的，所述预设ED传递函数是根据所述佩戴者的响应信息和EDR的声压信号生成的；The method of claim 5, wherein the hearable device comprises a plurality of preset SP paths, a plurality of preset ED transfer functions, and the preset SP paths and the preset ED transfer functions The mapping relationship; wherein, the preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the EDR;
    所述听戴式设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系，包括：The hearable device generates an ED transfer function corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer, and the ED transfer function represents the sound of the ERP. The relationship between the pressure signal and the sound pressure signal of the DRP, including:
    所述听戴式设备获取所述佩戴者的个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；The hearable device acquires the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the one of the tightness of the wearable device and the type of the wearer's ear canal;
    所述听戴式设备根据所述个性化数据和所述预设映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；The hearable device obtains a first mapping relationship according to the personalized data and the preset mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    所述听戴式设备通过所述第一映射关系和所述SP路径，生成所述ED传递函数。The hearable device generates the ED transfer function through the first mapping relationship and the SP path.
  7. 根据权利要求5所述的方法，其特征在于，所述听戴式设备包括多个基础SP路径，多个基础ED传递函数，以及所述基础SP路径和所述基础ED传递函数的基本映射关系；其中，所述基础SP路径是根据响应信息生成的，所述基础ED传递函数是根据响应信息和DRP的声压信号生成的；The method according to claim 5, wherein the hearable device comprises a plurality of basic SP paths, a plurality of basic ED transfer functions, and a basic mapping relationship between the basic SP paths and the basic ED transfer functions ; wherein, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP;
    所述听戴式设备获取所述佩戴者的个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；The hearable device acquires the wearer's personalized data, the personalized data is used to create the ED transfer function, and the personalized data at least includes: the type of the hearable device, the one of the tightness of the wearable device and the type of the wearer's ear canal;
    所述听戴式设备根据所述个性化数据和所述基础映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；The hearable device obtains a first mapping relationship according to the personalized data and the basic mapping relationship, and the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    所述听戴式设备通过所述第一映射关系和所述SP路径，得到所述ED传递函数。The hearable device obtains the ED transfer function through the first mapping relationship and the SP path.
  8. 根据权利要求5-7任一项所述的方法，其特征在于，所述听戴式设备播放音频信号，并采集所述音频信号在佩戴者耳道的响应信息之前，所述方法还包括：The method according to any one of claims 5-7, wherein the listenable device plays an audio signal, and before collecting the response information of the audio signal in the ear canal of the wearer, the method further comprises:
    开启所述听戴式设备的主动降噪和/或透传功能；Turn on the active noise reduction and/or pass-through function of the hearable device;
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号，包括：The hearable device adjusts the audio signal according to the ED transfer function and the SP path, including:
    所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号，以实现调整所述主动降噪的降噪深度和/或调整所述透传功能的声压信号的目的。The hearable device adjusts the audio signal according to the ED transfer function and the SP path, so as to achieve the purpose of adjusting the noise reduction depth of the active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function .
  9. 一种听戴式设备，其特征在于，包括：一个或多个处理器；存储器；A hearable device, comprising: one or more processors; a memory;
    以及一个或多个计算机程序，其中，所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述听戴式设备执行时，使得所述听戴式设备执行以下步骤：and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by the hearable device , causing the hearable device to perform the following steps:
    播放音频信号，并采集所述音频信号在佩戴者耳道的响应信息，其中，所述听戴式设备被所述佩戴者佩戴，所述音频信号在所述佩戴者耳道传播时产生所述响应信息；Playing an audio signal, and collecting response information of the audio signal in the wearer's ear canal, wherein the hearable device is worn by the wearer, and the audio signal generates the said audio signal when it propagates in the wearer's ear canal response information;
    向第一设备发送所述响应信息和所述音频信号，使得所述第一设备根据所述响应信息生成耳道外部参考点ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；Send the response information and the audio signal to the first device, so that the first device generates an ED transfer function corresponding to the external reference point ERP of the ear canal to the reference point DRP of the eardrum according to the response information, and the ED transfer function represents The relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP;
    接收来自所述第一设备的所述ED传递函数和SP路径；receiving the ED transfer function and SP path from the first device;
    根据所述ED传递函数和所述SP路径调整所述音频信号。The audio signal is adjusted according to the ED transfer function and the SP path.
  10. 根据权利要求9所述的听戴式设备，其特征在于，当所述指令被所述听戴式设备执行时，还使得所述听戴式设备执行以下步骤：The listen-worn device according to claim 9, wherein when the instruction is executed by the listen-worn device, the listen-worn device is further caused to perform the following steps:
    开启所述听戴式设备的主动降噪和/或透传功能；Turn on the active noise reduction and/or pass-through function of the hearable device;
    当所述听戴式设备根据所述ED传递函数和所述SP路径调整所述音频信号时，所述听戴式设备具体执行以下步骤：根据所述ED传递函数和所述SP路径调整所述音频信号，以实现调整所述主动降噪的降噪深度和/或调整所述透传功能的声压信号的目的。When the hearable device adjusts the audio signal according to the ED transfer function and the SP path, the hearable device specifically performs the following steps: adjusting the audio signal according to the ED transfer function and the SP path. The audio signal is used to achieve the purpose of adjusting the noise reduction depth of the active noise reduction and/or adjusting the sound pressure signal of the transparent transmission function.
  11. 一种电子设备，其特征在于，包括：一个或多个处理器；存储器；An electronic device, comprising: one or more processors; a memory;
    以及一个或多个计算机程序，其中，所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被听戴式设备执行时，使得所述听戴式设备执行以下步骤：and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by a hearable device, cause The hearable device performs the following steps:
    接收来自听戴式设备的响应信息和音频信号，其中，所述听戴式设备被佩戴者佩戴，所示听戴式设备播放所述音频信号时，所述音频信号在所述佩戴者耳道传播时产生所述响应信息；receiving response information and an audio signal from a listen-worn device, wherein the listen-worn device is worn by a wearer, and when the listen-worn device plays the audio signal, the audio signal is in the wearer's ear canal generating the response message upon dissemination;
    根据所述响应信息和所述音频信号，生成SP路径，所述SP路径用于表示所述音频信号与耳道外部参考点ERP的声压信号的关系；generating an SP path according to the response information and the audio signal, where the SP path is used to represent the relationship between the audio signal and the sound pressure signal of the external reference point ERP of the ear canal;
    根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；According to the SP path and the acquired personalized data of the wearer, an ED transfer function corresponding to the ERP to the eardrum reference point DRP is generated, where the ED transfer function represents the sound pressure signal of the ERP and the DRP The relationship of the sound pressure signal;
    向所述听戴式设备发送所述ED传递函数和所述SP路径，使得所述听戴式设备根据所述ED传递函数调整和所述SP路径所述音频信号。The ED transfer function and the SP path are sent to the hearable device such that the hearable device adjusts the audio signal and the SP path according to the ED transfer function.
  12. 根据权利要求11所述的电子设备，其特征在于，所述电子设备还包括：多个 预设SP路径，多个预设ED传递函数，以及所述预设SP路径和所述预设ED传递函数的预设映射关系；其中，所述预设SP路径是根据所述佩戴者的响应信息生成的，所述预设ED传递函数是根据所述佩戴者的响应信息和DRP的声压信号生成的；The electronic device according to claim 11, wherein the electronic device further comprises: a plurality of preset SP paths, a plurality of preset ED transfer functions, and the preset SP paths and the preset ED transfer functions The preset mapping relationship of the function; wherein, the preset SP path is generated according to the wearer's response information, and the preset ED transfer function is generated according to the wearer's response information and the sound pressure signal of the DRP of;
    当所述指令被所述听戴式设备执行时，使得所述电子设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；所述电子设备具体执行以下步骤：When the instruction is executed by the hearable device, the electronic device generates an ED transfer corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer function, the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP; the electronic device specifically performs the following steps:
    获取所述个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；Obtain the personalized data, the personalized data is used to create the ED transfer function, and the personalized data includes at least: the type of the hearable device, the tightness of the hearable device and the degree of wear of the hearable device. one of the types of the wearer's ear canal;
    根据所述佩戴者的个性化数据和所述预设映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；A first mapping relationship is obtained according to the wearer's personalized data and the preset mapping relationship, where the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    通过所述第一映射关系和所述SP路径，生成所述ED传递函数。The ED transfer function is generated through the first mapping relationship and the SP path.
  13. 根据权利要求11所述的电子设备，其特征在于，所述电子设备还包括：多个基础SP路径，多个基础ED传递函数，以及所述基础SP路径和所述基础ED传递函数的基础映射关系；其中，所述基础SP路径是根据响应信息生成的，所述基础ED传递函数是根据响应信息和DRP的声压信号生成的；The electronic device according to claim 11, wherein the electronic device further comprises: a plurality of basic SP paths, a plurality of basic ED transfer functions, and a basic mapping of the basic SP paths and the basic ED transfer functions relationship; wherein, the basic SP path is generated according to the response information, and the basic ED transfer function is generated according to the response information and the sound pressure signal of the DRP;
    当所述指令被所述听戴式设备执行时，使得所述电子设备根据所述SP路径和获取到的所述佩戴者的个性化数据，生成所述ERP到耳膜参考点DRP对应的ED传递函数，所述ED传递函数表示所述ERP的声压信号与所述DRP的声压信号的关系；所述电子设备具体执行以下步骤：When the instruction is executed by the hearable device, the electronic device generates an ED transfer corresponding to the ERP to the eardrum reference point DRP according to the SP path and the acquired personalized data of the wearer function, the ED transfer function represents the relationship between the sound pressure signal of the ERP and the sound pressure signal of the DRP; the electronic device specifically performs the following steps:
    获取所述佩戴者的个性化数据，所述个性化数据用于创建所述ED传递函数，所述个性化数据至少包括：所述听戴式设备的类型、所述听戴式设备佩戴的松紧程度和所述佩戴者耳道类型中的一个；Acquire personalized data of the wearer, the personalized data is used to create the ED transfer function, the personalized data at least include: the type of the hearable device, the tightness of the wearable device one of the extent and the type of the wearer's ear canal;
    根据所述个性化数据和所述基础映射关系得到第一映射关系，所述第一映射关系用于表示所述SP路径和所述ED传递函数的对应关系；Obtain a first mapping relationship according to the personalized data and the basic mapping relationship, where the first mapping relationship is used to represent the corresponding relationship between the SP path and the ED transfer function;
    通过所述第一映射关系和所述SP路径，得到所述ED传递函数。The ED transfer function is obtained through the first mapping relationship and the SP path.
  14. 一种听戴式设备，其特征在于，包括：一个或多个处理器；存储器；A hearable device, comprising: one or more processors; a memory;
    以及一个或多个计算机程序，其中，所述一个或多个计算机程序存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述听戴式设备执行时，使得所述听戴式设备执行如权利要求5-8任一项所述的优化听戴式设备功能的方法。and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by the hearable device, The hearable device is caused to perform the method of optimizing the function of a hearable device as claimed in any one of claims 5-8.
  15. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在计算机上运行时，使得所述计算机执行如权利要求1-8任一项所述的优化听戴式设备功能的方法。A computer-readable storage medium, characterized by comprising computer instructions that, when executed on a computer, cause the computer to perform the optimized listen-worn device function according to any one of claims 1-8 Methods.
PCT/CN2021/134629 2020-12-10 2021-11-30 Method for optimizing functions of hearables and hearables WO2022121743A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011435355.5 2020-12-10
CN202011435355.5A CN114630223B (en) 2020-12-10 2020-12-10 Method for optimizing functions of hearing-wearing device and hearing-wearing device

Publications (1)

Publication Number Publication Date
WO2022121743A1 true WO2022121743A1 (en) 2022-06-16

Family

ID=81896232

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/134629 WO2022121743A1 (en) 2020-12-10 2021-11-30 Method for optimizing functions of hearables and hearables

Country Status (2)

Country Link
CN (1) CN114630223B (en)
WO (1) WO2022121743A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130208909A1 (en) * 2010-09-14 2013-08-15 Phonak Ag Dynamic hearing protection method and device
CN107426660A (en) * 2016-04-08 2017-12-01 奥迪康有限公司 Audiphone including directional microphone system
CN109996165A (en) * 2017-12-29 2019-07-09 奥迪康有限公司 Hearing devices including being suitable for being located at the microphone at user ear canal or in ear canal
US20200252734A1 (en) * 2017-01-31 2020-08-06 Widex A/S Method of operating a hearing aid system and a hearing aid system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE435572T1 (en) * 2006-12-01 2009-07-15 Siemens Audiologische Technik HEARING AID WITH NOISE CANCELLATION AND CORRESPONDING METHOD
US9648410B1 (en) * 2014-03-12 2017-05-09 Cirrus Logic, Inc. Control of audio output of headphone earbuds based on the environment around the headphone earbuds
US10511915B2 (en) * 2018-02-08 2019-12-17 Facebook Technologies, Llc Listening device for mitigating variations between environmental sounds and internal sounds caused by the listening device blocking an ear canal of a user
EP3660835B1 (en) * 2018-11-29 2024-04-24 AMS Sensors UK Limited Method for tuning a noise cancellation enabled audio system and noise cancellation enabled audio system
CN111935589B (en) * 2020-09-28 2021-02-12 深圳市汇顶科技股份有限公司 Active noise reduction method and device, electronic equipment and chip

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130208909A1 (en) * 2010-09-14 2013-08-15 Phonak Ag Dynamic hearing protection method and device
CN107426660A (en) * 2016-04-08 2017-12-01 奥迪康有限公司 Audiphone including directional microphone system
US20200252734A1 (en) * 2017-01-31 2020-08-06 Widex A/S Method of operating a hearing aid system and a hearing aid system
CN109996165A (en) * 2017-12-29 2019-07-09 奥迪康有限公司 Hearing devices including being suitable for being located at the microphone at user ear canal or in ear canal

Also Published As

Publication number Publication date
CN114630223A (en) 2022-06-14
CN114630223B (en) 2023-04-28

Similar Documents

Publication Publication Date Title
CN107690119B (en) Binaural hearing system configured to localize sound source
CN111095944B (en) Ear bud earphone device, ear bud earphone device and method
EP3016410B1 (en) Measurement device and measurement system
CN103988485A (en) Measurement device, measurement system, and measurement method
CN111034217A (en) Audio processing apparatus and audio processing method
Shimokura et al. Simulating cartilage conduction sound to estimate the sound pressure level in the external auditory canal
US11991499B2 (en) Hearing aid system comprising a database of acoustic transfer functions
US10092223B2 (en) Measurement system
WO2022121743A1 (en) Method for optimizing functions of hearables and hearables
EP4325885A1 (en) Acoustic apparatus and transfer function determination method therefor
CN116033312B (en) Earphone control method and earphone
CN115086851A (en) Human ear bone conduction transfer function measuring method, device, terminal equipment and medium
CN207518802U (en) Neck wears formula interactive voice earphone
CN218772357U (en) Earphone set
CN116744169B (en) Earphone device, sound signal processing method and wearing fit testing method
WO2023093412A1 (en) Active noise cancellation method and electronic device
CN109729471A (en) The ANC denoising device of formula interactive voice earphone is worn for neck
WO2023160286A1 (en) Noise reduction parameter adaptation method and apparatus
US20230054213A1 (en) Hearing system comprising a database of acoustic transfer functions
US20240114296A1 (en) Hearing aid comprising a speaker unit
CN111213390B (en) Sound converter
JP6234081B2 (en) measuring device
CN115942173A (en) Method for determining HRTF and hearing device
CN109729470A (en) The sound wheat harvest sound processor of formula interactive voice earphone is worn for neck

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21902450

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21902450

Country of ref document: EP

Kind code of ref document: A1