CN108694956A - Hearing device and correlation technique with adaptive sub-band beam forming - Google Patents

Hearing device and correlation technique with adaptive sub-band beam forming Download PDF

Info

Publication number
CN108694956A
CN108694956A CN201810245866.7A CN201810245866A CN108694956A CN 108694956 A CN108694956 A CN 108694956A CN 201810245866 A CN201810245866 A CN 201810245866A CN 108694956 A CN108694956 A CN 108694956A
Authority
CN
China
Prior art keywords
band logical
signal
offside
formed signal
hearing device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810245866.7A
Other languages
Chinese (zh)
Other versions
CN108694956B (en
Inventor
R·德弗里斯
马长学
A·迪特贝尔纳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Hearing AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Hearing AS filed Critical GN Hearing AS
Publication of CN108694956A publication Critical patent/CN108694956A/en
Application granted granted Critical
Publication of CN108694956B publication Critical patent/CN108694956B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L2021/02087Noise filtering the noise being separate speech, e.g. cocktail party
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The hearing device that the invention discloses a kind of for including the binaural hearing system of hearing device and offside hearing device.Hearing device includes:Transceiver module;Microphone, for providing the first and second microphone input signals;First beamforming block, for providing the first beam-formed signal based on the first microphone input signal and second microphone input signal;Filter bank, for the first beam-formed signal to be filtered into multiple first sub-band beam-formed signals including the first band logical beam-formed signal, and for offside beam-formed signal to be filtered into offside band logical beam-formed signal;Second beamforming block includes the adaptive band logical beam-shaper for providing the second band logical beam-formed signal;Adder, the input signal for providing beam forming;Processor provides electrical output signal for the input signal based on beam forming;And receiver, for electrical output signal to be converted to audio output signal.

Description

Hearing device and correlation technique with adaptive sub-band beam forming
Technical field
This disclosure relates to a kind of hearing device with the guiding of adaptive binaural and a kind of operation binaural hearing system In hearing device method.
Background technology
In acoustic enviroment, it is naturally that normal audience is absorbed in a talker while monitoring other sound sources. One of example is other talkers in cocktail party or other complicated acoustic enviroments.In this respect, due to Head shadow effect With the interaction of ears nerves caused by acoustic filtering for enhancing concern while inhibiting other interference talker Voice plays an important role.In addition, brain also forms another audiovideo from two ears for monitoring other sound sources, these sound sources Inhibited by ears beam forming effect.
US2015/0289065A1 is related to a kind of ears hearing assistance system including ears noise reduction.User can input target sound The position in source, for example, using remote controler or cellular phone, and position of the noise reduction system based on input is operated.
When people's wear hearing aid, the signal from sound source carries out space filtering by additional stage (that is, hearing aid), Especially when the beam forming technique of hearing aid application higher order is come when enhancing directionality.
Invention content
Therefore, it is necessary to the device and method for enhancing voice in noisy environment and cocktail party scene.
Disclose a kind of hearing device for including the binaural hearing system of hearing device and offside hearing device.Hearing Equipment includes:Transceiver module, for being communicated with the offside hearing device of binaural hearing system, transceiver module is configured to provide for The offside beam-formed signal received from offside hearing device;Microphone group, including be used to provide the first microphone input signal The first microphone and second microphone for providing second microphone input signal;First beamforming block, is connected to Microphone group, for providing the first beam-formed signal based on the first microphone input signal and second microphone input signal; Filter bank is connected to the first beamforming block and is optionally connected to transceiver module, is used for the first beam forming Signal is filtered into multiple first sub-band beam-formed signals including the first band logical beam-formed signal, and optionally for Offside beam-formed signal is filtered into offside band logical beam-formed signal;Second beamforming block, is connected to filter bank, Second beamforming block includes for being carried based on the first band logical beam-formed signal and/or offside band logical beam-formed signal For the band logical beam-shaper of the second band logical beam-formed signal;Adder is connected to band logical beam-shaper, for based on the Two band logical beam-formed signals provide the input signal of beam forming;Processor, for handling the input signal of beam forming simultaneously Input signal based on beam forming provides electrical output signal;And receiver, it is defeated for electrical output signal to be converted to audio Go out signal.The band logical beam-shaper of second beamforming block is optionally adaptive beamforming device.
Also disclose a kind of binaural hearing system including hearing device and offside hearing device, wherein hearing device is Hearing device as disclosed herein.Offside hearing device can be hearing device as disclosed herein.
Disclose a kind of hearing device operated in the binaural hearing system for including hearing device and offside hearing device Method, this method include:Offside beam-formed signal is obtained from offside hearing device;Obtain the first microphone input signal and Two microphone input signals;The first beam forming letter is provided based on the first microphone input signal and second microphone input signal Number;First beam-formed signal is filtered and optionally offside beam-formed signal is filtered, to provide first Band logical beam-formed signal and offside band logical beam-formed signal;Based on the first band logical beam-formed signal and/or offside band logical Beam-formed signal provides the second band logical beam-formed signal;The defeated of beam forming is provided based on the second band logical beam-formed signal Enter signal;Hearing compensation is carried out to the input signal of beam forming to handle to provide electrical output signal;And by electrical output signal Be converted to audio output signal.In the method, the second band logical beam-formed signal is provided to optionally include adaptive beam Forming is applied to the first band logical beam-formed signal and offside band logical beam-formed signal.
This device and method provides improved binaural boot policy (BASS), for Integrated Acoustic, auditory processing and Selectivity listens to mechanism.This device and method forms the absorbed shotgun microphone wave beam of height for the talker of concern, and The reception pattern similar with omnidirectional microphone characteristic is formed for other talkers of side simultaneously.
Rank is listened to provide improved hearing device solution party in the filtering of disclosure Integrated Acoustic, peripheral processes and center Case.
The disclosure provides the beam forming of optimization and both is listened to situation awareness with adapting to selectivity/specific aim.
A kind of hearing device for including the binaural hearing system of hearing device and offside hearing device, the hearing device Including:Transceiver module, for being communicated with the offside hearing device of binaural hearing system, transceiver module is configured to eavesdropping Power equipment obtains offside beam-formed signal;Microphone group includes the first Mike for providing the first microphone input signal Wind and second microphone for providing second microphone input signal;First beamforming block is connected to microphone group, uses In based on the first microphone input signal and second microphone input signal the first beam-formed signal of offer;Filter bank, even It is connected to the first beamforming block and transceiver module, for being filtered into the first beam-formed signal including the first band logical wave beam Multiple first sub-band beam-formed signals of shaped signal, and for offside beam-formed signal to be filtered into offside band logical Beam-formed signal;Second beamforming block, is connected to filter bank, which includes for based on the One band logical beam-formed signal and offside band logical beam-formed signal provide the band logical wave beam of the second band logical beam-formed signal at Shape device;Adder is connected to band logical beam-shaper, for providing the defeated of beam forming based on the second band logical beam-formed signal Enter signal;Processor, the input signal for handling beam forming and the input signal based on beam forming provide electricity output letter Number;And receiver, for electrical output signal to be converted to audio output signal, wherein the band logical of the second beamforming block Beam-shaper is adaptive beamforming device.As non-limiting example, the second band logical beam-formed signal can be low pass Beam-formed signal and/or high pass beam-formed signal.
Optionally, band logical beam-shaper includes band logical beam forming controller and the first multiplier, wherein band logical wave beam Former is configured to the first band logical beam-formed signal and offside band logical beam-formed signal to determine the first band logical wave beam First band logical coefficient of shaped signal, and the first band logical coefficient is applied in the first multiplier.
Optionally, band logical beam-shaper is configured to be based on the first band logical beam-formed signal and offside band logical by solution The minimization problem of the expectation performance number of beam-formed signal determines the first band logical coefficient of the first band logical beam-formed signal.
Optionally, band logical beam-shaper is configured to be based on the first band logical beam-formed signal and offside band logical by solution The minimization problem of the expected mean square value of the linear combination of beam-formed signal determines the of the first band logical beam-formed signal One band logical coefficient.
Optionally, band logical beam-shaper includes offside multiplier, and wherein, and band logical beam forming controller is configured to Pair of offside band logical beam-formed signal is determined based on the first band logical beam-formed signal and offside band logical beam-formed signal Side band logical coefficient, and offside band logical coefficient is applied in offside multiplier.
Optionally, band logical beam forming controller is configured to be based on the first band logical beam-formed signal and offside by solution The minimization problem of the expectation performance number of band logical beam-formed signal determines the offside band logical of offside band logical beam-formed signal Coefficient.
Optionally, band logical beam forming controller is configured to be based on the first band logical beam-formed signal and offside by solution The minimization problem of the expected mean square value of the linear combination of band logical beam-formed signal determines offside band logical beam-formed signal Offside band logical coefficient.
Optionally, band logical beam-shaper includes band logical balanced device, which is to be inputted based on balanced device To provide the second band logical beam-formed signal, wherein balanced device input is based on the first band logical beam-formed signal and/or offside band Logical beam-formed signal.
Optionally, the second beamforming block includes for based on the first low pass beam-formed signal and also based on offside Low pass beam-formed signal provides the low pass beam-shaper of the second low pass beam-formed signal, and wherein, and adder connects It is connected to low pass beam-shaper, the input signal for providing beam forming based on the second low pass beam-formed signal.
Optionally, the second beamforming block includes for based on the first high pass beam-formed signal and also based on offside High pass beam-formed signal provides the high pass beam-shaper of the second high pass beam-formed signal, and wherein, and adder connects It is connected to high pass beam-shaper, the input signal for providing beam forming based on the second high pass beam-formed signal.
Optionally, hearing device includes the beam forming controller for being connected to the second beamforming block, for controlling the Two beamforming blocks, wherein beam forming controller is configured to the main behaviour in hearing device in the second beamforming block The second main beam forming arrangements are applied under operation mode, and in the auxiliary operation mode of hearing device in the second beamforming block The second auxiliary beam forming solutions of lower application.
Optionally, beam forming controller is connected to the first beamforming block, for controlling the first beamforming block, Wherein, beam forming controller is configured in the first beamforming block apply first under the principal mode of hearing device Main beam forming arrangements, and the first auxiliary beam forming solutions are applied under the auxiliary operation mode of hearing device.
Optionally, the first beamforming block is connected to transceiver module, and wherein, and transceiver module is configured to At least part of one beam-formed signal is sent to offside hearing device.
Binaural hearing system includes any hearing device and offside hearing device described herein.
A method of operation includes the hearing device in the binaural hearing system of hearing device and offside hearing device, should Method includes:Offside beam-formed signal is obtained from offside hearing device;Obtain the first microphone input signal and the second Mike Wind input signal;The first beam-formed signal is provided based on the first microphone input signal and second microphone input signal;It is right First beam-formed signal and offside beam-formed signal are filtered, to provide the first band logical beam-formed signal and offside band Logical beam-formed signal;The second band logical wave beam is provided based on the first band logical beam-formed signal and offside band logical beam-formed signal Shaped signal;The input signal of beam forming is provided based on the second band logical beam-formed signal;To the input signal of beam forming Hearing compensation processing is carried out to provide electrical output signal;And electrical output signal is converted into audio output signal;Wherein, it provides The step of second band logical beam-formed signal includes answering the first band logical beam-formed signal and offside band logical beam-formed signal Use adaptive beamforming.
Description of the drawings
By reference to attached drawing to the described in detail below of exemplary embodiment of the present invention, above and other feature and advantage Those skilled in the art will be apparent, wherein:
Fig. 1 schematically shows exemplary hearing device,
Fig. 2 schematically shows exemplary hearing device,
Fig. 3 schematically shows exemplary hearing device,
Fig. 4 shows the exemplary band logical beam-shaper of the second beamforming block, and
Fig. 5 is the flow chart of illustrative methods.
Reference numerals list
2 hearing devices
4 transceiver modules
4A antennas
4B transceivers/radio unit
5 offside beam-formed signals
6 first microphones
The first microphone input signals of 6A
8 second microphones
8A second microphone input signals
10 first beamforming blocks
The first beam-formed signals of 10A
12 filter banks
12A the first band logical beam-formed signals
12B the first low pass beam-formed signals
12C the first high pass beam-formed signals
14A offside band logical beam-formed signals
14B offside low pass beam-formed signals
14C offside high pass beam-formed signals
16 second beamforming blocks
17A band logical beam-shapers
17B low pass beam-shapers
17C high pass beam-shapers
18A the second band logical beam-formed signals
18B the second low pass beam-formed signals
18C the second high pass beam-formed signals
20 adders
The input signal of 22 beam formings
24 processors
26 electrical output signals
28 receivers
52 band logical beam forming controllers
54 first multipliers
56 offside multipliers
58 band logical balanced devices
60 adders
The method of 100 operation hearing devices
102 obtain offside beam-formed signal
104 obtain the first microphone input signal and second microphone input signal
106 obtain the first beam-formed signal
108 pair of first beam-formed signal and offside beam-formed signal are filtered
110 provide the second band logical beam-formed signal
112 provide the input signal of beam forming
114 execute hearing compensation processing
Electrical output signal is converted to audio output signal by 116
Specific implementation mode
Various exemplary embodiments and details are described below with reference to relevant drawings.It should be noted that attached drawing may or may not It is drawn to scale, and throughout the drawings, the element of similar structures or function is indicated by like reference numerals.It should also manage Solution, attached drawing are intended merely to facilitate the description of embodiment.They are not intended as the detailed description to the present invention or as to the present invention Range limitation.In addition, illustrated embodiment need not show all aspects or advantage.The aspect described in conjunction with specific embodiment Or advantage is not necessarily limited to the embodiment, and even if being not shown or being not explicitly described, it can also be in any other embodiment Practice.
Disclosed hearing device and method for the ears of user provide improved space go shelter and improve it is off-axis It listens to.Further it is provided that better context aware is to provide multiple streams for selectively listening to.The disclosure is by using the mankind The binaural listening mechanism of auditory system provides asymmetric listening experience.Therefore, in two hearing devices of binaural hearing system The middle polar mode using asymmetric and different polar mode, that is, being absorbed in and monitoring polar mode.Absorbed polar mode can Selection of land is designed as handling diffusion noise, and is monitored polar mode and optionally be designed as using together with absorbed polar mode In the context aware and better speech intelligibility that provide optimization, for example, utilizing the Selective Attention Mechanism of auditory system.Institute is public The hearing device and method opened are related to designing absorbed ear and monitor ear spatial filtering system to meet the needs of mankind's listener.
Hearing device can be (BTE) formula after hearing aid, such as ear, (ITE) formula, pleasant (ITC) formula, duct are inscribed in ear Receive receiver (RIE) formula in device (RIC) formula or ear.Hearing aid can be binaural hearing aid.
Hearing device includes the transmitting-receiving for communicating for the offside hearing device with binaural hearing system and (receiving and/or emit) Device module.Transceiver module is optionally configured to provide the offside beam-formed signal received from offside hearing device.Transceiver Module may include for one or more wireless input signals from offside hearing device to be converted to antenna output signal Antenna.Transceiver module optionally includes the radio transceiver for being coupled to antenna, for being converted to antenna output signal Transceiver input signal.Transceiver module may include that mutiple antennas and/or antenna are configurable to one or more antennas Pattern operates.
Offside beam-formed signal can be the combination of multiple microphone input signals of offside hearing device, so as to Effectively use limited transceiver resources (bandwidth and battery).In one or more exemplary hearing devices or method, offside Beam-formed signal can monitor beam-formed signal.In one or more exemplary hearing devices or method, to side wave Beam shaping signal can be the microphone input signal from offside hearing device.
Hearing device includes microphone group.Microphone group may include one or more microphones.Microphone group includes using In the first microphone and/or the second Mike for providing second microphone input signal that provide the first microphone input signal Wind.Microphone group may include N number of microphone for providing N number of microphone signal, wherein N is that range is whole from 1 to 10 Number.In one or more exemplary hearing devices, the quantity N of microphone is 2,3,4,5 or more.Microphone group may include Third microphone for providing third microphone input signal.
Hearing device includes for providing first based on the first microphone input signal and/or second microphone input signal First beamforming block of beam-formed signal.First beamforming block is connected to microphone group for receiving microphone Input signal.First beam-formed signal can be based on third microphone input signal (if present).First beam forming mould Block can operate in the time domain.
Hearing device includes filter bank, which optionally includes multiple filters, for by the first wave beam at Shape signal is filtered into multiple first sub-band beam-formed signals including the first band logical beam-formed signal.Filter bank connects To the first beamforming block, for receiving the first beam-formed signal.Multiple first sub-band beam-formed signals can wrap Include the first low pass beam-formed signal and/or the first high pass beam-formed signal.Multiple first sub-band beam-formed signals can To include multiple first band logical beam-formed signals.Filter bank can operate in the time domain.
Filter bank is optionally included for the first beam-formed signal to be filtered into the first band logical beam-formed signal First bandpass filter.First bandpass filter can have relatively low cutoff frequency in the range of from 300Hz to 2.0kHz. First bandpass filter can have higher cut off frequency in the range of from 4.0kHz to 8.0kHz.Show in one or more In example property hearing device, the first bandpass filter have relatively low cutoff frequency in the range of from 1.0kHz to 1.8kHz and Higher cut off frequency in the range of from 5.0kHz to 7.0kHz.
Filter bank is optionally included for offside beam-formed signal to be filtered into offside band logical beam-formed signal Offside bandpass filter.Offside bandpass filter can have relatively low cutoff frequency in the range of from 300Hz to 2.0kHz. Offside bandpass filter can have higher cut off frequency in the range of from 4.0kHz to 8.0kHz.Show in one or more In example property hearing device, offside bandpass filter have relatively low cutoff frequency in the range of from 1.0kHz to 1.8kHz and Higher cut off frequency in the range of from 5.0kHz to 7.0kHz.
Filter bank is optionally included for the first beam-formed signal to be filtered into the first low pass beam-formed signal First low-pass filter.First low-pass filter can have cutoff frequency in the range of from 300Hz to 2.0kHz.One In a or multiple exemplary hearing devices, the first low-pass filter has cutoff frequency in the range of from 1.0kHz to 1.8kHz Rate.First low-pass filter may be embodied as bandpass filter, relatively low cutoff frequency in the range of from 0Hz to 300Hz, and And higher cut off frequency is in the range of from 1.0kHz to 1.8kHz.
Filter bank is optionally included for the first beam-formed signal to be filtered into the first high pass beam-formed signal First high-pass filter.First high-pass filter can have more than 4.0kHz cutoff frequency, such as from 5.0kHz to In the range of 7.0kHz.In one or more exemplary hearing devices, the first high-pass filter may be embodied as having from Relatively low cutoff frequency in the range of 5.0kHz to 7.0kHz and it is more than 8kHz (such as in the range of from 8.0kHz to 12kHz) Higher cut off frequency bandpass filter.
Filter bank is optionally connected to transceiver module, for receive offside beam-formed signal and/or by it at least It is filtered into offside band logical beam-formed signal.Filter bank be configurable to for by offside beam-formed signal be filtered into including Multiple offside sub-band beam-formed signals of offside band logical beam-formed signal.Multiple offside sub-band beam-formed signals can To include offside low pass beam-formed signal and/or offside high pass beam-formed signal.
Filter bank is optionally included for offside beam-formed signal to be filtered into offside low pass beam-formed signal Offside low-pass filter.Offside low-pass filter can have cutoff frequency in the range of from 300Hz to 2.0kHz.One In a or multiple exemplary hearing devices, offside low-pass filter has cutoff frequency in the range of from 1.0kHz to 1.8kHz Rate.Offside low-pass filter may be embodied as bandpass filter, relatively low cutoff frequency in the range of from 0Hz to 300Hz, and And higher cut off frequency is in the range of from 1.0kHz to 1.8kHz.
Filter bank is optionally included for offside beam-formed signal to be filtered into offside high pass beam-formed signal Offside high-pass filter.Offside high-pass filter can have more than 4.0kHz cutoff frequency, such as from 5.0kHz to In the range of 7.0kHz.In one or more exemplary hearing devices, offside high-pass filter may be embodied as having from Relatively low cutoff frequency in the range of 5.0kHz to 7.0kHz and it is more than 8kHz (such as in the range of from 8.0kHz to 12kHz) Higher cut off frequency bandpass filter.
The important advantage of the disclosure is, can execute noise suppressed in the sub-band of selection, while from sense of hearing angle From the point of view of, it is desirable to input signal is changed as few as possible to help auditory scene analysis.In addition, some frequency fields be easier by Noise jamming, and disclosure permission selectively improves SNR in that region.
Hearing device includes for being carried based on the first band logical beam-formed signal and/or offside band logical beam-formed signal For the second beam forming mould of one or more second beam-formed signals (e.g., including the second band logical beam-formed signal) Block.Second beamforming block is connected to filter bank, for receiving the first sub-band beam-formed signal and/or offside frequency Band beam-formed signal.Second beamforming block can operate in the time domain.
Second beamforming block includes one or more beam-shapers comprising band logical beam-shaper.Band logical wave Beam shaper can be adaptive beamforming device.Adaptive beamforming device be wherein according to one of beam-shaper or Multiple input signal adjusts the beam-shaper of beam forming.
Second beamforming block can be directly connected to transceiver module, for receiving offside beam-formed signal.Cause This, for example, due in transceiver module coding/decoding and/or be filtered before the transmission from offside hearing device, So offside beam-formed signal can be offside band logical beam-formed signal.
Hearing device includes adder.The one or more that adder is optionally connected to the second beamforming block is defeated Go out, for example, band logical beam-shaper is connected to, for for example based on the one or more second from the second beamforming block Beam-formed signal provides the input signal of beam forming.The input signal of beam forming can be based on the second band logical wave beam at Shape signal.
Hearing device includes processor, the input signal for handling beam forming and the input signal based on beam forming Electrical output signal is provided.Processor is configurable to the hearing loss of compensation user, for example, by filtering and/or compressing wave beam The input signal of forming.
The beam-shaper of second beamforming block may include beam forming controller and/or one or more multiplication Device, such as multiple multipliers.The beam-shaper of second beamforming block optionally includes the adder for being connected to multiplier, For being provided multiplier the output phase to corresponding second beam-formed signal.Beam forming controller be configured at one or It is determined in multiple multipliers and/or using corresponding coefficient (also being indicated as A_1, B_1, A_2, B_2, A_3, B_3, A_4, B_4 etc.).
Band logical beam-shaper may include band logical beam forming controller and the first multiplier, wherein band logical wave beam at Shape device (for example, band logical beam forming controller) is optionally configured to be based on the first band logical beam-formed signal and/or offside band Logical beam-formed signal determines the first band logical coefficient of the first band logical beam-formed signal.Band logical beam-shaper is (for example, band logical Beam forming controller) it is optionally configured to apply the first band logical coefficient in the first multiplier.In second beamforming block Adaptive band logical beam-shaper allow to carry out beam forming in the selected frequency band frequency band of voice (for example, covering), simultaneously Allow above and/or under for example frequency by without or the beam forming that substantially reduces.This is very favorable, because sound is defeated The ILD (Interaural Level Difference) and ITD (Interaural Time Difference) for entering signal are usual It resides in frequency band and lower frequency band.
This hearing device is based on the temporal sub-band signal from ears.From the perspective of improving SNR, using from double The benefit that the temporal sub-band signal of ear carries out bilateral beam forming is apparent.In addition, the disclosure maintains space line by allowing Rope and discourse context clue listen stress effect to provide reduced tunnel.
The important advantage of the disclosure is, can improve signal-to-noise ratio (SNR) in selected frequency band, while keeping other frequency bands It is unaffected or in different frequency bands enable different beams forming arrangements, for example, to optimize spatial cues (ILD and ITD).
Hearing device (for example, band logical beam forming controller) is configurable to determine the first band logical beam-formed signal First band logical coefficient (also being indicated as A_1).For example, determining that the first band logical coefficient of the first band logical beam-formed signal may include Solve minimization problem.Minimization problem can be based on the first band logical beam-formed signal and/or offside band logical beam forming is believed Number expectation performance number.
Minimization problem can be provided optionally under one or more constraintss by cost function.
In one or more exemplary hearing devices, determine that the first band logical coefficient of the first band logical beam-formed signal can To include:Solve the expectation of the linear combination for example based on the first band logical beam-formed signal and offside band logical beam-formed signal The minimization problem of mean-square value.
The beam-shaper of second beamforming block may include offside multiplier.The beam forming control of beam-shaper Device processed is configurable to determine the offside coefficient of offside multiplier, for example, based on the first beam-formed signal and to lateral beam at Shape signal, and offside coefficient is applied in offside multiplier, such as applied to offside sub-band beam-formed signal.
In one or more exemplary hearing devices, band logical beam-shaper includes offside multiplier.Band logical wave beam at Shape controller is configurable to determine offside based on the first band logical beam-formed signal and/or offside band logical beam-formed signal The offside band logical coefficient (also being indicated as B_1) of band logical beam-formed signal.Band logical beam forming controller is configurable to right Offside band logical coefficient is applied in the multiplier of side, for example, being applied to offside band logical beam-formed signal.
In one or more exemplary hearing devices, determine that the offside band logical coefficient of offside band logical beam-formed signal can To include:Solve such as expectation performance number based on the first band logical beam-formed signal and/or offside band logical beam-formed signal Minimization problem.
In one or more exemplary hearing devices, determine that the offside band logical coefficient of offside band logical beam-formed signal can To include:Solve the linear combination for example based on the first band logical beam-formed signal and/or offside band logical beam-formed signal The minimization problem of expected mean square value.
In one or more exemplary hearing devices, coefficient A_1, B_1, A_2, B_2, A_3, B_3 etc. are from 0 to 1 In range.
For example, determining the first band logical coefficient (also being indicated as α or A_1) and/or offside of the first band logical beam-formed signal (it may include solving minimization problem, such as provide also to be indicated as β or B_1 to the offside band logical coefficient of band logical beam-formed signal For:
si=argmax (SNR (li), SNR (ri), SNR (α li+(1-α)r1),
Here, liFor the first band logical beam-formed signal, riFor offside band logical beam-formed signal, and a is the first band logical Coefficient.Hearing device is designed, it is assumed that target sound source is located at zero direction axis.Above formula can be reduced to:
si=argmin (rms (li), rms (ri), rms (α li+(1-α)ri),
Here, rms indicates the root-mean-square value of signal.The target that therefore, it is necessary to obtain optimum a-value to realize us.Its phase As the α and β in the following cost function C (α, β) of solution:
argmin{E[(αli+βri)·(αli+βri)]}
And under the constraints of alpha+beta=1, E is statistical expectation, and here, α is the first band logical coefficient, and β is offside band Logical coefficient.
In one or more exemplary hearing devices, it may include declining to calculate using random steepest to solve minimization problem Method.
In one or more exemplary hearing devices, solve minimization problem may include using least mean square algorithm or Normalization minimum mean-square calculation.
Minimization problem can be obtained adaptively, for example, passing through:
C (α, β)={ E { (α li+βri)·(αli+βri)}+λ(α+β-1)。
Minimization problem can be solved by using random steepest descent algorithm, including:
Take gradient
Solve Lagrange λ=- E { vl }-E { vr } and v=al+ β r
·
Xie Wei
μ is step-length
Minimization problem can be solved by using LMS algorithm (lowest mean square):
Minimization problem can be solved by using NLMS algorithms (normalization minimum mean-square):
Or
For all three algorithms, in vv>Update is completed when 0.
The solution of realization is as follows:
Here, it exports as v=αnlinri, and step size mu=0.001, αnFor the first band logical coefficient, βnFor band logical wave beam The opposite side band logical coefficient used in former.
The size of beam-formed signal vector l and r can be under the sampling rates of (for example, 16kHz) from 8kHz to 33kHz For from 20 to 60 (for example, 48) a samples.In the calculation, beam-formed signal vector can be accumulated in two frames.
In one or more exemplary hearing devices, better ear strategy (minimization problem) can be with for example, for one A or multiple sub-bands, can be expressed as:
si=argmin (rms (li), rms (ri), rms (v)),
For example, band logical beam forming controller is configurable to determine the first band logical system by solving the minimization problem Number and offside band logical coefficient.When adaptive process restrains, solve as beam forming result (the first band logical coefficient and offside band logical system Number).(the α when adaptive process is since equal weight00=0.5), better ear is listened to strategy and can be believed according to three Number minimum RMS selection signals.
In one or more exemplary hearing devices, band logical beam-shaper includes band logical balanced device, and the band logical is balanced Device is configured to balanced device input to provide the second band logical beam-formed signal, wherein balanced device input is based on the first band logical Beam-formed signal and/or offside band logical beam-formed signal.The multichannel selectivity sub-band directional filtering scheme of the disclosure The noise jamming that can be effectively reduced in selected frequency band.However, due to reducing noise, so total loudness of these sub-bands It may be softer relative to other bands or with more basses.Band logical balanced device can compensate this loudness loss.In addition, Reduce or avoid substantially the extension of the masking from high low frequency sub-band.According to acoustic environment and/or specific it can listen to field Scape activates band logical balanced device.
In one or more exemplary hearing devices, optionally, when not detecting target voice, band logical balanced device Be configured to determine also be indicated as G_1 penalty coefficient and by penalty coefficient be applied to the first band logical beam-formed signal and/or The linear combination of offside band logical beam-formed signal.In one or more exemplary hearing devices, penalty coefficient is as ratio Factor G1It provides/is calculated as:
Here, l is that the first band logical beam-formed signal, v=A_1*l+B_1*r, and r believe for offside band logical beam forming Number, that is, intensity before and after beam forming than square root.Therefore, the frequency band of beam forming can be enlarged into its original The RMS level of beginning.
In one or more exemplary hearing devices, untreated frequency band can be based on scale smaller.
Second beamforming block may include for for example based on the first low pass beam-formed signal and offside low pass wave Beam shaping signal provides the low pass beam-shaper of the second low pass beam-formed signal.Low pass beam-shaper can be adaptive Answer beam-shaper.Adder can be connected to low pass beam-shaper, for being provided based on the second low pass beam-formed signal The input signal of beam forming.
Low pass beam-shaper may include low pass beam forming controller and the first multiplier, wherein low pass wave beam at Shape device (for example, low pass beam forming controller) is optionally configured to low based on the first low pass beam-formed signal and/or offside Logical beam-formed signal determines the first low-pass coefficients of the first low pass beam-formed signal.Low pass beam-shaper is (for example, low pass Beam forming controller) it is optionally configured to apply the first low-pass coefficients in the first multiplier.
Hearing device (for example, low pass beam forming controller) is configurable to determine the first low pass beam-formed signal First low-pass coefficients (also are indicated as A_2).For example, determining that the first low-pass coefficients of the first low pass beam-formed signal may include Solve minimization problem.Minimization problem can be based on the first low pass beam-formed signal and/or offside low pass beam forming is believed Number expectation performance number.
In one or more exemplary hearing devices, low pass beam-shaper includes offside multiplier.Low pass wave beam at Shape controller is configurable to determine offside based on the first low pass beam-formed signal and/or offside low pass beam-formed signal The offside low-pass coefficients (also being indicated as B_2) of low pass beam-formed signal.Low pass beam forming controller is configurable to right Offside low-pass coefficients are applied in the multiplier of side, for example, being applied to offside low pass beam-formed signal.
Second beamforming block may include for for example based on the first high pass beam-formed signal and offside high pass wave Beam shaping signal provides the high pass beam-shaper of the second high pass beam-formed signal.High pass beam-shaper can be adaptive Answer beam-shaper.Adder can be connected to high pass beam-shaper, for being provided based on the second high pass beam-formed signal The input signal of beam forming.
High pass beam-shaper may include high pass beam forming controller and the first multiplier, wherein high pass wave beam at Shape device (for example, high pass beam forming controller) is optionally configured to high based on the first high pass beam-formed signal and/or offside Logical beam-formed signal determines the first high-pass coefficient of the first high pass beam-formed signal.High pass beam-shaper is (for example, high pass Beam forming controller) it is optionally configured to apply the first high-pass coefficient in the first multiplier.
Hearing device (for example, high pass beam forming controller) is configurable to determine the first high pass beam-formed signal First high-pass coefficient (also is indicated as A_3).For example, determining that the first high-pass coefficient of the first high pass beam-formed signal may include Solve minimization problem.Minimization problem can be based on the first high pass beam-formed signal and/or offside low pass beam forming is believed Number expectation performance number.
In one or more exemplary hearing devices, high pass beam-shaper includes offside multiplier.High pass wave beam at Shape controller is configurable to determine offside based on the first high pass beam-formed signal and/or offside high pass beam-formed signal The offside high-pass coefficient (also being indicated as B_3) of high pass beam-formed signal.High pass beam forming controller is configurable to right Offside high-pass coefficient is applied in the multiplier of side, for example, being applied to offside high pass beam-formed signal.
Second beamforming block may include multiple band logical waves for providing multiple second band logical beam-formed signals Beam shaper.Therefore, the SNR further improved can be obtained in different frequency bands.
Second beamforming block may include for for example based on the first auxiliary band logical beam-formed signal and the auxiliary band of offside Logical beam-formed signal provides the auxiliary band logical beam-shaper of the second auxiliary band logical beam-formed signal.Auxiliary band logical beam-shaper It can be adaptive beamforming device.Adder can be connected to auxiliary band logical beam-shaper, for being based on the second auxiliary band logical wave Beam shaping signal provides the input signal of beam forming.
Auxiliary band logical beam-shaper may include auxiliary band logical beam forming controller and the first multiplier, wherein auxiliary band logical Beam-shaper (for example, auxiliary band logical beam forming controller) is optionally configured to be based on the first auxiliary band logical beam-formed signal And/or the auxiliary band logical beam-formed signal of offside determines the first auxiliary band logical coefficient of the first auxiliary band logical beam-formed signal.Auxiliary band logical Beam-shaper (for example, auxiliary band logical beam forming controller) is optionally configured to apply the first auxiliary band logical in the first multiplier Coefficient.
Hearing device (for example, auxiliary band logical beam forming controller) is configurable to determine the first auxiliary band logical beam forming letter Number the first auxiliary band logical coefficient (also being indicated as A_4).For example, determining the first auxiliary band logical system of the first auxiliary band logical beam-formed signal Number may include solving minimization problem.Minimization problem can be based on the first auxiliary band logical beam-formed signal and/or offside is auxiliary The expectation performance number of band logical beam-formed signal.
In one or more exemplary hearing devices, auxiliary band logical beam-shaper includes offside multiplier.Auxiliary band logical wave Beam shaping controller be configurable to based on the first auxiliary band logical beam-formed signal and/or the auxiliary band logical beam-formed signal of offside come Determine the auxiliary band logical coefficient (also being indicated as B_4) of the offside of the auxiliary band logical beam-formed signal of offside.Auxiliary band logical beam forming controller It is configurable to apply the auxiliary band logical coefficient of offside in offside multiplier, for example, being applied to the auxiliary band logical beam-formed signal of offside.
In one or more hearing devices with auxiliary band logical beam-shaper, filter bank is optionally included for dividing Indescribably supply the auxiliary bandpass filter of first and offside of the first auxiliary band logical beam-formed signal and the auxiliary band logical beam-formed signal of offside. First and the relatively low cutoff frequency of the auxiliary bandpass filter of offside can correspond to the higher cut-off of first and offside bandpass filter Frequency, for example, in the range of from 2kHz to 4kHz, and first and the higher cut off frequency of the auxiliary bandpass filter of offside can be with Corresponding to first and the cutoff frequency of offside high-pass filter, for example, in the range of from 5.0kHz to 7.0kHz.
Hearing device may include the beam forming controller for being connected to the second beamforming block, for controlling the second wave Beam shaping module, wherein beam forming controller is configured to the main operation mould in hearing device in the second beamforming block The second main beam forming arrangements are applied under formula, and optionally in the second beamforming block in the auxiliary operation mould of hearing device The second auxiliary beam forming solutions are applied under formula.
Beam forming controller can be connected to the first beamforming block, for controlling the first beamforming block.Wave Beam shaping controller is configurable in the first beamforming block under the principal mode of hearing device using the first master Beam forming solutions, and the first auxiliary beam forming solutions are optionally applied under the auxiliary operation mode of hearing device.
First beamforming block can be connected to transceiver module, for example, for feeding the first beam-formed signal To transceiver module.Transceiver module is configurable at least part of the first beam-formed signal to be sent to offside Hearing device.First microphone and/or second microphone can be connected to transceiver module, for example, being used for the first microphone Input signal and/or second microphone input signal are fed to transceiver module.Transceiver module is configurable to for by At least part of one microphone input signal and/or second microphone input signal is sent to offside hearing device.
This method includes that the transceiver module for example using hearing device obtains offside beam forming from offside hearing device Signal.
This method includes corresponding first microphone for example using hearing device and second microphone to obtain the first Mike Wind input signal and second microphone input signal.This method include the first beamforming block for example using hearing device come The first beam-formed signal is provided based on the first microphone input signal and second microphone input signal.This method includes for example The first beam-formed signal and/or offside beam-formed signal are filtered using the filter of hearing device to provide One band logical beam-formed signal and offside band logical beam-formed signal.This method includes the second wave beam for example using hearing device Shaping module provides the second band logical beam forming to be based on the first band logical beam-formed signal and offside band logical beam-formed signal Signal.Second band logical beam-formed signal is provided and is optionally included, adaptive beamforming is applied to the first band logical beam forming Signal and offside band logical beam-formed signal.This method includes the adder for example using hearing device to be based on the second band logical wave Beam shaping signal provides the input signal of beam forming.This method include the processor for example using hearing device come to wave beam at The input signal of shape executes hearing compensation and handles to provide electrical output signal.This method includes the reception for example using hearing device Electrical output signal is converted to audio output signal by device.
This hearing device and method help hearing device designer to integrate sound using binaural boot policy (BASS) It learns filtering, peripheral processes and center and listens to rank.The disclosure is intended to retain the spatial cues in two audio streams to obtain space Go masking benefit.
Fig. 1 shows exemplary hearing device.Hearing device 2 is configured for including hearing device and offside hearing device Binaural hearing system.The hearing device 2 (left/right hearing device) of binaural hearing system includes for the offside with binaural system (right/left) hearing device (not shown in figure 1) carries out the transceiver module 4 of (wireless) communication.Transceiver module 4 includes antenna 4A With transceiver 4B, and it is configured to provide for the offside beam-formed signal 5 received from distal end hearing device.Hearing device 2 includes Microphone group comprising be respectively configured to provide the first wheat of the first microphone input signal 6A and second microphone input signal 8A Gram wind 6 and second microphone 8.Hearing device 2 includes the first beam forming for being connected to the first microphone 6 and second microphone 8 Module 10, for receiving and handling the first microphone input signal 6A and second microphone input signal 8A.First beam forming Module 10 provides or exports the first beam forming based on the first microphone input signal 6A and second microphone input signal 8A Signal 10A.
Hearing device 2 includes the filter bank 12 for being connected to the first beamforming block 10.Filter bank is configured for By the first beam-formed signal 10A be filtered into multiple first sub-band wave beams including the first band logical beam-formed signal 12A at Shape signal.Filter bank 12 is optionally connected to transceiver module 5 and is configured for filtering offside beam-formed signal At offside band logical beam-formed signal 14A.
Hearing device 2 includes the second beamforming block 16 for being connected to filter bank 12, the second beamforming block 16 Including adaptive band logical beam-shaper 17A, for being based on the first band logical beam-formed signal 12A and offside band logical beam forming Device 14A provides the second band logical beam-formed signal 18A.Hearing device 2 includes being connected to band logical beam-shaper 17A and matching It is set to the adder 20 of the input signal 22 for providing beam forming based on the second band logical beam-formed signal 18A.In addition, plus Musical instruments used in a Buddhist or Taoist mass 20 is connected to filter bank 12, for being believed based on the first low pass beam-formed signal 12B and/or the first high pass beam forming Number 12C provides the input signal 22 of beam forming.Therefore, the second beam forming is not executed under low frequency and high frequency, so as to The ITD and ILD of the first beam-formed signal are maintained in binaural hearing system.
Hearing device 2 includes the input signal 22 for handling beam forming and the input signal 22 based on beam forming carries The processor 24 of electrical output signal 26 and receiver 28 for electrical output signal 26 to be converted to audio output signal.
Fig. 2 shows be configured for include the binaural hearing system of hearing device and offside hearing device exemplary hearing Equipment 2A.The hearing device 2A (left/right hearing device) of binaural hearing system includes for the offside (right/left) with binaural system Hearing device (being not shown in Fig. 2) carries out the transceiver module 4 of (wireless) communication.Transceiver module 4 is configured to provide for from distal end The offside beam-formed signal 5 that hearing device receives.Hearing device 2A includes microphone group comprising is respectively configured to provide first The first microphone 6 and second microphone 8 of microphone input signal 6A and second microphone input signal 8A.Hearing device 2A packets The first beamforming block 10 for being connected to the first microphone 6 and second microphone 8 is included, for receiving and handling the first microphone Input signal 6A and second microphone input signal 8A.First beamforming block 10 be based on the first microphone input signal 6A and Second microphone input signal 8A provides or exports the first beam-formed signal 10A.
Hearing device 2A includes the filter bank 12 for being connected to the first beamforming block 10.Filter bank is configured for First beam-formed signal 10A is filtered into including the first band logical beam-formed signal 12A and the first low pass beam-formed signal Multiple first sub-band beam-formed signals of 12B.Filter bank 12 is optionally connected to transceiver module 5 and is configured to use In offside beam-formed signal is filtered into offside band logical beam-formed signal 14A and offside low pass beam-formed signal 14B.
Hearing device 2A includes the second beamforming block 16 for being connected to filter bank 12, the second beamforming block 16 Including adaptive band logical beam-shaper 17A, for being based on the first band logical beam-formed signal 12A and offside band logical beam forming Device 14A provides the second band logical beam-formed signal 18A.Second beamforming block 16 includes for being based on the first low pass wave beam Shaped signal 12B and offside low pass beam-formed signal 14B provides the adaptive low pass of the second low pass beam-formed signal 18B Beam-shaper 17B.Hearing device 2A includes the addition for being connected to band logical beam-shaper 17A and low pass beam-shaper 17B Device 20.Adder 20 is configured for carrying based on the second band logical beam-formed signal 18A and the second low pass beam-formed signal For the input signal 22 of beam forming.In addition, adder 20 is connected to filter bank 12, for being based on the first high pass beam forming Signal 12C provides the input signal 22 of beam forming.Therefore, the second beam forming is not executed in high frequency, so as in ears The ILD of the first beam-formed signal is maintained in hearing system.
Hearing device 2A includes the input signal 22 for handling beam forming and the input signal 22 based on beam forming The processor 24 of electrical output signal 26 and the receiver 28 for electrical output signal 26 to be converted to audio output signal are provided.
Fig. 3 show to be configured for include the binaural hearing system of hearing device and offside hearing device exemplary hearing Equipment 2B.The hearing device 2B (left/right hearing device) of binaural hearing system includes for the offside (right/left) with binaural system Hearing device (being not shown in Fig. 3) carries out the transceiver module 4 of (wireless) communication.Transceiver module 4 is configured to provide for from distal end The offside beam-formed signal 5 that hearing device receives.Hearing device 2B includes microphone group comprising is respectively configured to provide first The first microphone 6 and second microphone 8 of microphone input signal 6A and second microphone input signal 8A.Hearing device 2B packets The first beamforming block 10 for being connected to the first microphone 6 and second microphone 8 is included, for receiving and handling the first microphone Input signal 6A and second microphone input signal 8A.First beamforming block 10 be based on the first microphone input signal 6A and Second microphone input signal 8A provides or exports the first beam-formed signal 10A.
Hearing device 2B includes the filter bank 12 for being connected to the first beamforming block 10.Filter bank is configured for First beam-formed signal 10A is filtered into multiple first sub-band beam-formed signals comprising the first band logical beam forming Signal 12A, the first low pass beam-formed signal 12B and the first high pass beam-formed signal 12C.Filter bank 12 optionally connects It is connected to transceiver module 5 and is configurable for offside beam-formed signal being filtered into offside band logical beam-formed signal 14A, offside low pass beam-formed signal 14B and offside high pass beam-formed signal 14C.Offside beam-formed signal is filtered into Offside sub-band beam-formed signal 14A, 14B, 14C enables sub-band wave beam by being based on offside sub-band beam-formed signal It shapes to improve design flexibility.
Hearing device 2B includes the second beamforming block 16 for being connected to filter bank 12, the second beamforming block 16 Including adaptive band logical beam-shaper 17A, for being based on the first band logical beam-formed signal 12A and offside band logical beam forming Device 14A provides the second band logical beam-formed signal 18A.Second beamforming block 16 includes for being based on the first low pass wave beam Shaped signal 12B and offside low pass beam-formed signal 14B provides the adaptive low pass of the second low pass beam-formed signal 18B Beam-shaper 17B.Second beamforming block 16 includes adaptive high pass beam-shaper 17C, for being based on the first high pass Beam-formed signal 12C and offside high pass beam-formed signal 14C provides the second high pass beam-formed signal 18C.Hearing is set Standby 2B includes being connected to band logical beam-shaper 17A, high pass beam-shaper 17C and low pass beam-shaper 17B (if deposited ) adder 20.Adder 20 is configured to the second band logical beam-formed signal 18A, the second high pass beam-formed signal 18C and the second low pass beam-formed signal 18B provides the input signal 22 of beam forming.In showing similar to hearing device 2B In example property hearing device, it is convenient to omit low pass beam-shaper 17B, and can be straight by the first low pass beam-formed signal 12B It connects and is fed to adder 20.Hearing device 2 includes the input signal 22 for handling beam forming and based on the defeated of beam forming Enter signal 22 and provides the processor 24 of electrical output signal 26 and for electrical output signal 26 to be converted to audio output signal Receiver 28.
Fig. 4 shows the exemplary band logical beam-shaper 17A of the second beamforming block 16.Band logical beam-shaper includes Band logical beam forming controller 52 and the first multiplier 54, wherein band logical beam-shaper is configured to the first band logical wave beam Shaped signal 12A and offside band logical beam-formed signal 14A determines the first band logical system of the first band logical beam-formed signal 12A Number A_1.Band logical beam forming controller 52 is configured in the first multiplier 54 first band logical coefficient A_1 being applied to first band Logical beam-formed signal 12A, for example, by sending the first band logical coefficient to the first multiplier 54 or indicating the first band logical coefficient First control signal.Band logical beam-shaper 17A includes offside multiplier 56, and band logical beam forming controller 52 is configured to Determine that offside band logical beam forming is believed based on the first band logical beam-formed signal 12A and offside band logical beam-formed signal 14A Offside band logical coefficient B _ 1 of number 14A.Band logical beam forming controller 52 is configured to apply offside band logical in offside multiplier 56 Coefficient B _ 1, for example, by sending offside band logical coefficient B _ 1 to offside multiplier 56 or indicating the offside of offside band logical coefficient B _ 1 Control signal.Band logical beam-shaper 17A includes the adder 60 for being connected to multiplier 54,56, for by corresponding multiplier 54, 56 output signal is added.Band logical beam-shaper 17A includes being connected to adder 60 and being configured to as adder The balanced device of 60 output signal inputs to provide the band logical balanced device 58 of the second band logical beam-formed signal 18A.Therefore, balanced Device input is based on the first band logical beam-formed signal and/or offside band logical beam-formed signal, this depends on coefficient A_1 and B_1 Current value.Band logical balanced device 58 is configured to determine penalty coefficient (also being indicated as G_1) and penalty coefficient is applied to conduct The adder of the linear combination of first band logical beam-formed signal 12A and/or offside band logical beam-formed signal 14A exports.It mends Coefficient is repaid optionally to be determined as:
Here, l be the first band logical beam-formed signal 12A, v=A_1*l+B_1*r, and r be offside band logical wave beam at Shape signal 14A.Therefore, penalty coefficient be intensity before and after beam forming than square root, and band logical sub-band is enlarged into Its original RMS level.
Band logical beam forming controller 52 is configured to for example ask by using random steepest descent algorithm using determiner 52A The minimization problem given by cost function C as described above and constraints is solved, to determine the first band logical coefficient A_1 and offside Band logical coefficient B _ 1.
Therefore, in band logical beam-shaper 17A, the second band logical beam-formed signal 18A (also being indicated as X_1) is provided For:
X1=G1*(A_1*l+B_1*r);
Here, l is the first band logical beam-formed signal 12A, and r is offside band logical beam-formed signal 14A.
Fig. 5 be operation include hearing device and offside hearing device binaural hearing system in hearing device it is exemplary The flow chart of method 100.Method 100 includes obtaining (102) offside beam-formed signal from offside hearing device and obtaining (104) first microphone input signals and second microphone input signal.In addition, method 100 includes defeated based on the first microphone Enter signal and second microphone input signal and provides (106) first beam-formed signals and to the first beam-formed signal and right Lateral beam shaped signal is filtered (108) to provide the first band logical beam-formed signal and offside band logical beam-formed signal. This method carries out providing (110) second band logical waves to based on the first band logical beam-formed signal and offside band logical beam-formed signal Beam shaping signal, wherein it includes that adaptive beamforming is applied to first band to provide (110) second band logical beam-formed signals Logical beam-formed signal and offside band logical beam-formed signal.Method 100 includes being provided based on the second band logical beam-formed signal (112) input signal of beam forming executes (114) hearing compensation to the input signal of beam forming and handles to provide electricity output Signal, and electrical output signal is converted into (116) as audio output signal.
Also disclose the hearing device and method according to following any project.
A kind of hearing device for binaural hearing system of project 1., the binaural hearing system include the hearing device With offside hearing device, the hearing device includes:
Transceiver module is communicated for the offside hearing device with the binaural hearing system, the transceiver mould Block is configured for providing the offside beam-formed signal received from the offside hearing device;
Microphone group includes the first microphone for providing the first microphone input signal and for providing the second Mike The second microphone of wind input signal;
First beamforming block is connected to the microphone group, for based on first microphone input signal and The second microphone input signal provides the first beam-formed signal;
Filter bank is connected to first beamforming block and the transceiver module, is used for the first wave Beam shaping signal is filtered into multiple first sub-band beam-formed signals including the first band logical beam-formed signal, and is used for The offside beam-formed signal is filtered into offside band logical beam-formed signal;
Second beamforming block is connected to the filter bank, and second beamforming block includes for being based on The first band logical beam-formed signal and the offside band logical beam-formed signal provide the second band logical beam-formed signal Band logical beam-shaper;
Adder is connected to the band logical beam-shaper, for being provided based on the second band logical beam-formed signal The input signal of beam forming;
Processor, input signal for handling the beam forming are simultaneously provided based on the input signal of the beam forming Electrical output signal;And
Receiver, for the electrical output signal to be converted to audio output signal,
Wherein, the band logical beam-shaper of second beamforming block is adaptive beamforming device.
Hearing device of the project 2. according to project 1, wherein the band logical beam-shaper includes band logical beam forming Controller and the first multiplier, wherein the band logical beam-shaper is configured to the first band logical beam-formed signal The first band logical coefficient of the first band logical beam-formed signal is determined with the offside band logical beam-formed signal, and will The first band logical coefficient is applied in first multiplier.
Hearing device of the project 3. according to project 2, wherein determine the first of the first band logical beam-formed signal Band logical coefficient includes:Solve the expectation based on the first band logical beam-formed signal and the offside band logical beam-formed signal The minimization problem of performance number.
Hearing device of the project 4. according to any one of project 2-3, wherein determine the first band logical beam forming First band logical coefficient of signal includes:It solves and is based on the first band logical beam-formed signal and the offside band logical beam forming The minimization problem of the expected mean square value of the linear combination of signal.
Hearing device of the project 5. according to any one of project 1-4, wherein the band logical beam-shaper includes pair Side multiplier, and wherein, the band logical beam forming controller be configured to the first band logical beam-formed signal and The offside band logical beam-formed signal determines the offside band logical coefficient of the offside band logical beam-formed signal, and by institute Offside band logical coefficient is stated applied in the offside multiplier.
Hearing device of the project 6. according to project 5, wherein determine the offside of the offside band logical beam-formed signal Band logical coefficient includes:Solve the expectation based on the first band logical beam-formed signal and the offside band logical beam-formed signal The minimization problem of performance number.
Hearing device of the project 7. according to any one of project 5-6, wherein determine the offside band logical beam forming The offside band logical coefficient of signal includes:It solves and is based on the first band logical beam-formed signal and the offside band logical beam forming The minimization problem of the expected mean square value of the linear combination of signal.
Hearing device of the project 8. according to any one of project 1-7, wherein the band logical beam-shaper includes band Logical balanced device, the band logical equalizer configuration are to provide the second band logical beam-formed signal based on balanced device input, In, the balanced device input is based on the first band logical beam-formed signal and/or the offside band logical beam-formed signal.
Hearing device of the project 9. according to any one of project 1-8, wherein second beamforming block includes For providing the second low pass beam-formed signal based on the first low pass beam-formed signal and offside low pass beam-formed signal Low pass beam-shaper, and wherein, the adder is connected to the low pass beam-shaper, for being based on described second Low pass beam-formed signal provides the input signal of beam forming.
Hearing device of the project 10. according to any one of project 1-9, wherein the second beamforming block packet It includes for providing the second high pass wave based on the first high pass beam-formed signal and the offside high pass beam-formed signal The high pass beam-shaper of beam shaping signal, and wherein, the adder is connected to the high pass beam-shaper, is used for base The input signal of beam forming is provided in the second high pass beam-formed signal.
Hearing device of the project 11. according to any one of project 1-10, wherein the hearing device includes being connected to The beam forming controller of second beamforming block, for controlling second beamforming block, wherein the wave Beam shaping controller is configured in second beamforming block under the principal mode of the hearing device using the Two main beam forming arrangements, and applied under the auxiliary operation mode of the hearing device in second beamforming block Second auxiliary beam forming solutions.
Hearing device of the project 12. according to any one of project 1-11, wherein the beam forming controller connection To first beamforming block, for controlling first beamforming block, wherein the beam forming controller is matched It is set in first beamforming block under the principal mode of the hearing device and applies the first main beam forming side Case, and the first auxiliary beam forming solutions are applied under the auxiliary operation mode of the hearing device.
Hearing device of the project 13. according to any one of project 1-12, wherein first beamforming block connects It is connected to the transceiver module, and wherein, the transceiver module is configured to first beam-formed signal at least A part is sent to the offside hearing device.
A kind of binaural hearing system including hearing device and offside hearing device of project 14., wherein the hearing device It is the hearing device according to any one of project 1-13.
The method of hearing device in a kind of operation binaural hearing system of project 15., the binaural hearing system includes institute Hearing device and offside hearing device are stated, the method includes:
Offside beam-formed signal is obtained from the offside hearing device;
Obtain the first microphone input signal and second microphone input signal;
The first beam forming is provided based on first microphone input signal and the second microphone input signal Signal;
First beam-formed signal and the offside beam-formed signal are filtered to provide the first band logical wave Beam shaping signal and offside band logical beam-formed signal;
The second band logical is provided based on the first band logical beam-formed signal and the offside band logical beam-formed signal Beam-formed signal;
The input signal of beam forming is provided based on the second band logical beam-formed signal;
Compensation of hearing is executed to the input signal of the beam forming to handle to provide electrical output signal;And
The electrical output signal is converted into audio output signal,
Wherein, it includes that adaptive beamforming is applied to the first band logical wave to provide the second band logical beam-formed signal Beam shaping signal and the offside band logical beam-formed signal.
Although specific features have been shown and described, but it is to be understood that they are not intended to limit claimed Invention, and it will be apparent to one skilled in the art that can be in the spirit for not departing from invention claimed It is made various changes and modifications in the case of range.Therefore, the description and the appended drawings are considered illustrative instead of limiting Property.Invention claimed is intended to cover all alternative solutions, modification and equivalent.

Claims (15)

1. a kind of hearing device for binaural hearing system, the binaural hearing system includes the hearing device and to eavesdropping Power equipment, the hearing device include:
Transceiver module is communicated for the offside hearing device with the binaural hearing system, and the transceiver module is matched It is set to from the offside hearing device and obtains offside beam-formed signal;
Microphone group includes the first microphone for providing the first microphone input signal and defeated for providing second microphone Enter the second microphone of signal;
First beamforming block is connected to the microphone group, for based on first microphone input signal and described Second microphone input signal provides the first beam-formed signal;
Filter bank is connected to first beamforming block and the transceiver module, for by first wave beam at Shape signal is filtered into multiple first sub-band beam-formed signals including the first band logical beam-formed signal, and is used for institute It states offside beam-formed signal and is filtered into offside band logical beam-formed signal;
Second beamforming block, is connected to the filter bank, and second beamforming block includes for based on described First band logical beam-formed signal and the offside band logical beam-formed signal provide the band logical of the second band logical beam-formed signal Beam-shaper;
Adder is connected to the band logical beam-shaper, for providing wave beam based on the second band logical beam-formed signal The input signal of forming;
Processor, input signal for handling the beam forming and to provide electricity based on the input signal of the beam forming defeated Go out signal;And
Receiver, for the electrical output signal to be converted to audio output signal,
Wherein, the band logical beam-shaper of second beamforming block is adaptive beamforming device.
2. hearing device according to claim 1, wherein the band logical beam-shaper includes the control of band logical beam forming Device and the first multiplier, wherein the band logical beam-shaper is configured to the first band logical beam-formed signal and institute Offside band logical beam-formed signal is stated to determine the first band logical coefficient of the first band logical beam-formed signal, and will be described First band logical coefficient is applied in first multiplier.
3. hearing device according to claim 2, wherein the band logical beam-shaper is configured to be based on institute by solution The minimization problem for stating the expectation performance number of the first band logical beam-formed signal and the offside band logical beam-formed signal is come really First band logical coefficient of the fixed first band logical beam-formed signal.
4. according to the hearing device described in any one of claim 2-3, wherein the band logical beam-shaper is configured to pass through The expectation for solving the linear combination based on the first band logical beam-formed signal and the offside band logical beam-formed signal is equal The minimization problem being just worth determines the first band logical coefficient of the first band logical beam-formed signal.
5. according to the hearing device described in any one of claim 1-4, wherein the band logical beam-shaper includes that offside multiplies Musical instruments used in a Buddhist or Taoist mass, and wherein, the band logical beam forming controller are configured to the first band logical beam-formed signal and described Offside band logical beam-formed signal determines the offside band logical coefficient of the offside band logical beam-formed signal, and will be described right Side band logical coefficient is applied in the offside multiplier.
6. hearing device according to claim 5, wherein the band logical beam forming controller is configured to by solving base In the minimization problem of the expectation performance number of the first band logical beam-formed signal and the offside band logical beam-formed signal To determine the offside band logical coefficient of the offside band logical beam-formed signal.
7. according to the hearing device described in any one of claim 5-6, wherein the band logical beam forming controller is configured to By the phase for solving the linear combination based on the first band logical beam-formed signal and the offside band logical beam-formed signal The minimization problem of mean-square value is hoped to determine the offside band logical coefficient of the offside band logical beam-formed signal.
8. according to the hearing device described in any one of claim 1-7, wherein the band logical beam-shaper includes that band logical is equal Weighing apparatus, the band logical equalizer configuration are to provide the second band logical beam-formed signal based on balanced device input, wherein institute It states balanced device input and is based on the first band logical beam-formed signal and/or the offside band logical beam-formed signal.
9. according to the hearing device described in any one of claim 1-8, wherein second beamforming block includes being used for Based on the first low pass beam-formed signal and also the second low pass beam forming is provided based on offside low pass beam-formed signal The low pass beam-shaper of signal, and wherein, the adder is connected to the low pass beam-shaper, for based on described The second low pass beam-formed signal provides the input signal of the beam forming.
10. according to the hearing device described in any one of claim 1-9, wherein second beamforming block includes using In based on the first high pass beam-formed signal and also based on offside high pass beam-formed signal come provide the second high pass wave beam at The high pass beam-shaper of shape signal, and wherein, the adder is connected to the high pass beam-shaper, for being based on institute The second high pass beam-formed signal is stated to provide the input signal of the beam forming.
11. according to the hearing device described in any one of claim 1-10, wherein the hearing device is described including being connected to The beam forming controller of second beamforming block, for controlling second beamforming block, wherein the wave beam at Shape controller is configured in second beamforming block under the principal mode of the hearing device using the second master Beam forming solutions, and second is applied under the auxiliary operation mode of the hearing device in second beamforming block Auxiliary beam forming solutions.
12. hearing device according to claim 11, wherein the beam forming controller is connected to first wave beam Shaping module, for controlling first beamforming block, wherein the beam forming controller is configured to described first The first main beam forming arrangements are applied in beamforming block under the principal mode of the hearing device, and are listened described The first auxiliary beam forming solutions are applied under the auxiliary operation mode of power equipment.
13. according to the hearing device described in any one of claim 1-12, wherein first beamforming block is connected to The transceiver module, and wherein, the transceiver module is configured at least one of first beam-formed signal Divide and is sent to the offside hearing device.
14. a kind of binaural hearing system includes hearing device and offside hearing according to any one of claim 1-13 Equipment.
15. a kind of method of the hearing device in operation binaural hearing system, the binaural hearing system includes that the hearing is set Standby and offside hearing device, the method includes:
Offside beam-formed signal is obtained from the offside hearing device;
Obtain the first microphone input signal and second microphone input signal;
The first beam-formed signal is provided based on first microphone input signal and the second microphone input signal;
To first beam-formed signal and the offside beam-formed signal be filtered with provide the first band logical wave beam at Shape signal and offside band logical beam-formed signal;
The second band logical wave beam is provided based on the first band logical beam-formed signal and the offside band logical beam-formed signal Shaped signal;
The input signal of beam forming is provided based on the second band logical beam-formed signal;
Compensation of hearing is executed to the input signal of the beam forming to handle to provide electrical output signal;And
The electrical output signal is converted into audio output signal;
Wherein, the step of providing the second band logical beam-formed signal includes that adaptive beamforming is applied to described first Band logical beam-formed signal and the offside band logical beam-formed signal.
CN201810245866.7A 2017-03-29 2018-03-23 Hearing device with adaptive sub-band beamforming and related methods Active CN108694956B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762478445P 2017-03-29 2017-03-29
US62/478,445 2017-03-29

Publications (2)

Publication Number Publication Date
CN108694956A true CN108694956A (en) 2018-10-23
CN108694956B CN108694956B (en) 2023-08-22

Family

ID=63844546

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810245866.7A Active CN108694956B (en) 2017-03-29 2018-03-23 Hearing device with adaptive sub-band beamforming and related methods

Country Status (2)

Country Link
JP (1) JP2018186494A (en)
CN (1) CN108694956B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111356068A (en) * 2018-12-20 2020-06-30 大北欧听力公司 Hearing device with acceleration-based beamforming
CN111565347A (en) * 2019-02-13 2020-08-21 西万拓私人有限公司 Method for operating a hearing system and hearing system

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3672283B1 (en) * 2018-12-21 2022-01-26 Sivantos Pte. Ltd. Method for improving the spatial hearing perception of a binaural hearing aid
DK3672282T3 (en) * 2018-12-21 2022-07-04 Sivantos Pte Ltd Method of beamforming in a binaural hearing aid
JP2022528579A (en) * 2019-06-04 2022-06-14 ジーエヌ ヒアリング エー/エス Bilateral hearing aid system with temporally uncorrelated beamformer

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455473A (en) * 2002-04-30 2003-11-12 Lg电子株式会社 Self-adaptive beam-formation apparatus and method
CN101263734A (en) * 2005-09-02 2008-09-10 丰田自动车株式会社 Post-filter for microphone array
WO2009034524A1 (en) * 2007-09-13 2009-03-19 Koninklijke Philips Electronics N.V. Apparatus and method for audio beam forming
US20130259239A1 (en) * 2012-03-27 2013-10-03 Siemens Medical Instruments Pte. Ltd. Hearing apparatus for binaural supply and method for providing a binaural supply
CN104980865A (en) * 2014-04-03 2015-10-14 奥迪康有限公司 Binaural hearing assistance system comprising binaural noise reduction
CN105144674A (en) * 2013-05-03 2015-12-09 高通股份有限公司 Multi-channel echo cancellation and noise suppression
JP2016015722A (en) * 2014-06-23 2016-01-28 ジーエヌ リザウンド エー/エスGn Resound A/S Omni-directional sensing in binaural hearing aid system
CN105392096A (en) * 2014-09-02 2016-03-09 奥迪康有限公司 binaural hearing system and method
US20160360326A1 (en) * 2015-06-02 2016-12-08 Oticon A/S Peer to peer hearing system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0609248D0 (en) * 2006-05-10 2006-06-21 Leuven K U Res & Dev Binaural noise reduction preserving interaural transfer functions
WO2009072040A1 (en) * 2007-12-07 2009-06-11 Koninklijke Philips Electronics N.V. Hearing aid controlled by binaural acoustic source localizer

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455473A (en) * 2002-04-30 2003-11-12 Lg电子株式会社 Self-adaptive beam-formation apparatus and method
CN101263734A (en) * 2005-09-02 2008-09-10 丰田自动车株式会社 Post-filter for microphone array
WO2009034524A1 (en) * 2007-09-13 2009-03-19 Koninklijke Philips Electronics N.V. Apparatus and method for audio beam forming
US20130259239A1 (en) * 2012-03-27 2013-10-03 Siemens Medical Instruments Pte. Ltd. Hearing apparatus for binaural supply and method for providing a binaural supply
CN105144674A (en) * 2013-05-03 2015-12-09 高通股份有限公司 Multi-channel echo cancellation and noise suppression
CN104980865A (en) * 2014-04-03 2015-10-14 奥迪康有限公司 Binaural hearing assistance system comprising binaural noise reduction
JP2016015722A (en) * 2014-06-23 2016-01-28 ジーエヌ リザウンド エー/エスGn Resound A/S Omni-directional sensing in binaural hearing aid system
CN105491494A (en) * 2014-06-23 2016-04-13 Gn瑞声达A/S Omni-directional perception in a binaural hearing aid system
CN105392096A (en) * 2014-09-02 2016-03-09 奥迪康有限公司 binaural hearing system and method
US20160360326A1 (en) * 2015-06-02 2016-12-08 Oticon A/S Peer to peer hearing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高杰;胡广书;张辉;: "基于GSC结构的多麦克风数字助听器的自适应波束形成算法", 北京生物医学工程, no. 03, pages 269 - 273 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111356068A (en) * 2018-12-20 2020-06-30 大北欧听力公司 Hearing device with acceleration-based beamforming
CN111565347A (en) * 2019-02-13 2020-08-21 西万拓私人有限公司 Method for operating a hearing system and hearing system
US11153692B2 (en) 2019-02-13 2021-10-19 Sivantos Pte. Ltd. Method for operating a hearing system and hearing system
CN111565347B (en) * 2019-02-13 2021-12-21 西万拓私人有限公司 Method for operating a hearing system and hearing system

Also Published As

Publication number Publication date
CN108694956B (en) 2023-08-22
JP2018186494A (en) 2018-11-22

Similar Documents

Publication Publication Date Title
US11917370B2 (en) Hearing device and a hearing system comprising a multitude of adaptive two channel beamformers
CN108694956A (en) Hearing device and correlation technique with adaptive sub-band beam forming
CN105872923B (en) Hearing system comprising a binaural speech intelligibility predictor
AU2008207437B2 (en) Method of estimating weighting function of audio signals in a hearing aid
CN109660928B (en) Hearing device comprising a speech intelligibility estimator for influencing a processing algorithm
EP2433437B1 (en) Signal enhancement using wireless streaming
US20100002886A1 (en) Hearing system and method implementing binaural noise reduction preserving interaural transfer functions
US10848880B2 (en) Hearing device with adaptive sub-band beamforming and related method
CN107968981B (en) Hearing device
CN111757233A (en) Hearing device or system for evaluating and selecting external audio sources
CN112492434A (en) Hearing device comprising a noise reduction system
CN108243381B (en) Hearing device with adaptive binaural auditory guidance and related method
US11153695B2 (en) Hearing devices and related methods
EP4250765A1 (en) A hearing system comprising a hearing aid and an external processing device
Sunohara et al. Low-latency real-time blind source separation with binaural directional hearing aids
EP4277300A1 (en) Hearing device with adaptive sub-band beamforming and related method
EP3886463A1 (en) Method at a hearing device
CN109922416B (en) Hearing device and method with flexible control of beamforming

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant