WO2010084769A1 - 補聴装置 - Google Patents
補聴装置 Download PDFInfo
- Publication number
- WO2010084769A1 WO2010084769A1 PCT/JP2010/000381 JP2010000381W WO2010084769A1 WO 2010084769 A1 WO2010084769 A1 WO 2010084769A1 JP 2010000381 W JP2010000381 W JP 2010000381W WO 2010084769 A1 WO2010084769 A1 WO 2010084769A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sound source
- hearing aid
- sound
- unit
- binaural
- Prior art date
Links
- 210000005069 ears Anatomy 0.000 claims abstract description 17
- 238000012546 transfer Methods 0.000 claims description 55
- 238000000926 separation method Methods 0.000 claims description 46
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 37
- 238000004364 calculation method Methods 0.000 claims description 33
- 238000013507 mapping Methods 0.000 abstract description 15
- 230000005236 sound signal Effects 0.000 description 27
- 230000006870 function Effects 0.000 description 22
- 238000012545 processing Methods 0.000 description 22
- 238000010586 diagram Methods 0.000 description 19
- 238000005259 measurement Methods 0.000 description 15
- 238000001514 detection method Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000003111 delayed effect Effects 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 230000004807 localization Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000001934 delay Effects 0.000 description 1
- 238000012880 independent component analysis Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0272—Voice signal separating
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
- G10L2021/065—Aids for the handicapped in understanding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/558—Remote control, e.g. of amplification, frequency
Definitions
- the present invention relates to a hearing aid device.
- Patent Document 1 discloses a hearing aid device that directs the direction of a microphone array in the direction of a speaker to clarify the sound collected by the microphone.
- Patent Document 2 and Patent Document 3 the rotation angle of the head of the headphone wearer is detected by a sensor such as a digital vibration gyroscope or a camera, and a virtual sound image is generated even if the head of the headphone wearer rotates.
- Patent Document 4 also discloses a method for detecting the rotation angle of the head using a head tracker.
- FIG. 10 is a block diagram showing a configuration of a conventional hearing aid device.
- the conventional hearing aid apparatus shown in FIG. 10 includes an external microphone array 900 and a hearing aid 800.
- the hearing aid 800 includes a binaural speaker 801, a virtual sound image rotation unit 803, an inverse mapping rule storage unit 805, a direction reference setting unit 809, a head rotation angle sensor 811, and a direction estimation unit 813.
- the head rotation angle sensor 811 is composed of, for example, a digital vibration gyro and detects the rotation angle of the head of the person wearing the hearing aid.
- the direction reference setting unit 809 includes a direction reference setting switch.
- the direction reference setting unit 809 may set a reference direction that determines the direction of the virtual sound source or reset the head rotation angle sensor 811 by operating a direction reference setting switch by a person wearing the hearing aid 800. it can.
- the head rotation angle sensor 811 detects the rotation of the head of the wearer of the hearing aid 800.
- the direction estimation unit 813 integrates the rotation angle detected by the head rotation angle sensor 811 in the reverse direction, and determines the direction of the virtual sound source to be localized as the angle from the reference direction set by the direction reference setting switch.
- the inverse mapping rule storage unit 805 stores an inverse mapping rule for converting the angle determined by the direction estimation unit 813 into a directional component.
- the virtual sound image rotation unit 803 refers to the inverse mapping rule and rotates the sound image of the voice of the speaker separated by the sound source separation unit 902 described later in the direction determined by the direction estimation unit 813.
- the binaural speaker 801 expresses the sound image of the voice of the speaker rotated by the virtual sound image rotating unit 803 and the virtual sound image rotating unit 803 as an acoustic signal for the left ear and an acoustic signal for the right ear, and outputs them.
- the external microphone array 900 includes a sound source input unit 901 and a sound source separation unit 902.
- the sound source input unit 901 is composed of a plurality of microphones arranged in a predetermined arrangement, and takes in sound from the outside in multiple channels.
- the sound source separation unit 902 separates the voice of the speaker by directing the directivity of the external microphone array 900 toward the speaker. The separated voice of the speaker is transferred to the virtual sound image rotating unit 803 described above.
- a reverse mapping rule for converting the angle determined by the direction estimation unit 813 into a directional component is stored in advance, and the wearer is referred to by referring to the reverse mapping rule.
- the direction of the sound image of the speaker's voice can be determined.
- An object of the present invention is to provide a hearing aid device that can improve the clarity of the voice uttered by the speaker while reproducing the direction in which the voice uttered by the speaker arrives without using the reverse mapping rule. It is.
- a sound source input unit that inputs sound coming from a sound source and converts the sound into a first sound signal
- the first sound signal converted by the sound source input unit is separated into sound source signals corresponding to each sound source.
- a sound source separation unit a binaural microphone that is arranged at the left and right ears, inputs the sound coming from the sound source and converts it into a second acoustic signal, and the left and right second acoustic signals converted by the binaural microphone
- a directional component calculating unit that calculates a directional component representing a directional sense of the sound source with the binaural microphone as a base point, and generating left and right output acoustic signals based on the sound source signal and the directional component.
- a hearing aid device comprising: an output signal generation unit; and a binaural speaker that outputs the left and right output acoustic signals generated by the output signal generation unit.
- the hearing aid device of the present invention it is possible to improve the clarity of the speech uttered by the speaker while reproducing the direction in which the speech uttered by the speaker arrives without using the reverse mapping rule.
- the directional component calculation unit calculates, for each sound source, at least one of the interaural time difference and the interaural volume difference from the left and right second acoustic signals, and the interaural time difference and both At least one of the interaural volume differences is defined as the directional component.
- the hearing aid device of the present invention it is possible to improve the clarity of the speech uttered by the speaker while reproducing the direction in which the speech uttered by the speaker arrives without using the reverse mapping rule.
- the directional component calculation unit may calculate, for each sound source, a transfer characteristic between the sound source signal from the sound source separation unit and the left and right second acoustic signals from the binaural microphone. Calculated as a directional component.
- the directional component calculation unit detects an utterance interval for each sound source from the sound source signal acquired from the sound source separation unit, and the directional component calculation unit simultaneously determines the utterance intervals of a plurality of sound sources. When detected, the previous value is used as the transfer characteristic.
- the directional component calculation unit estimates a position of each sound source based on the transfer characteristics, and the directional component calculation unit estimates that the wearer of the binaural microphone is the position of the sound source.
- the output signal generator outputs the second acoustic signal to the binaural speaker.
- the sound signal from the binaural microphone closer to the sound source is output, so that the voice of the hearing aid wearer's confidence can be heard clearly.
- the hearing aid device of the present invention it is possible to improve the clarity of the speech uttered by the speaker while reproducing the direction in which the speech uttered by the speaker arrives without using the reverse mapping rule.
- FIG. 3 is a block diagram showing a configuration of the hearing aid device according to the first embodiment.
- the block diagram which shows the structure of the hearing aid apparatus of Embodiment 1 in detail
- FIG. The figure which shows the usage example 2 of the hearing aid apparatus of Embodiment 1.
- the block diagram which shows the structure of the hearing aid apparatus of Embodiment 2 in detail
- FIG. 1 is a block diagram illustrating a configuration of the hearing aid device according to the first embodiment.
- the hearing aid device of the first embodiment includes a hearing aid 100 and an external microphone array 300.
- FIG. 3 is a diagram illustrating a usage example 1 of the hearing aid device according to the first embodiment
- FIG. 4 is a diagram illustrating a usage example 2 of the hearing aid device according to the first embodiment.
- FIG. 2 is a block diagram showing in detail the configuration of the hearing aid apparatus shown in FIG. 2, the same reference numerals as those in FIG. 1 are given the same functions as those in FIG.
- the hearing aid 100 which comprises a part of hearing aid apparatus of Embodiment 1 is demonstrated.
- the hearing aid 100 includes a right unit worn on the right ear and a left unit worn on the left ear.
- Each of the left and right units includes a microphone for each ear of the binaural microphone 101, a direction sense component calculation unit 103, an output signal generation unit 105, and a speaker for each ear of the binaural speaker 107.
- the left and right units of the hearing aid 100 communicate wirelessly. Note that the left and right units of the hearing aid 100 may be configured to communicate with each other by wire.
- the binaural microphone 101 includes a right ear microphone 101A that constitutes a part of the right unit and a left ear microphone 101B that constitutes a part of the left unit.
- the binaural microphone 101 inputs sound coming from the sound source to the wearer of the hearing aid 100 at the left and right ears of the wearer of the hearing aid 100 and converts it into an acoustic signal.
- the directional component calculation unit 103 calculates the interaural time difference and the interaural volume difference from the acoustic signal converted by the binaural microphone 101, and the arrival direction of the sound coming from the sound source to the wearer of the binaural microphone. This is calculated as a directional component felt by the wearer of the hearing aid 100. That is, the direction sense component represents the direction sense of the sound source based on the wearer of the binaural microphone 101.
- the direction component calculation unit 103 calculates the time of the right acoustic signal converted by the right ear microphone 101A and the time of the left acoustic signal converted by the left ear microphone 101B. The cross-correlation value is calculated while shifting. Then, the time at which the cross-correlation value is maximized is defined as the interaural time difference.
- the directional component calculation unit 103 uses the time of the right acoustic signal converted by the right ear microphone 101A and the left ear microphone 101B by the amount of the interaural time difference. The power ratio of the left and right acoustic signals is obtained by shifting the converted left acoustic signal. Then, the directional component calculation unit 103 sets the power ratio of the left and right acoustic signals as a binaural volume difference.
- the directional component calculation unit 103 calculates the directional component of the sound arriving from the sound source directly from the sound reaching the binaural microphone 101 from the sound source. Therefore, the hearing aid device of Embodiment 1 can faithfully reproduce the direction of the sound coming from the sound source.
- the directional component calculation unit 103 may calculate either the interaural time difference or the interaural volume difference as the directional component, or both the interaural time difference and the interaural volume difference as directions. It may be calculated as a sensitive component.
- the output signal generation unit 105 generates left and right acoustic signals to be output from the left and right speakers from the direction sense component calculated by the direction sense component calculation unit 103 and the sound source signal received from the external microphone array 300 described later. Generate. The output signal generation unit 105 determines which unit of the left unit and the right unit is away from the sound source from the interaural time difference that is one of the directional components.
- the output signal generation unit 105 delays the sound source signal received from the sound source separation unit 303 of the external microphone array 300, which will be described later, by the time difference between both ears for units that are further away from the sound source. Furthermore, the output signal generation unit 105 controls the unit farther away from the sound source so as to reduce the volume of the binaural speaker 107 of the unit by the amount of the binaural volume difference.
- the output signal generation unit 105 outputs the sound source signal received from the sound source separation unit 303 to the binaural speaker 107 as it is for a unit close to the sound source among the left and right units.
- the binaural speaker 107 includes a right ear speaker 107A that constitutes a part of the right unit and a left ear speaker 107B that constitutes a part of the left unit.
- the binaural speaker 107 outputs the sound source signal generated by the output signal generation unit 105 as the left and right acoustic signals at the left and right ears of the wearer of the hearing aid 100.
- the external microphone array 300 includes a sound source input unit 301 and a sound source separation unit 303.
- the external microphone array 300 is installed in a place closer to the binaural microphone 101 of the hearing aid 100.
- the external microphone array 300 communicates wirelessly with the left and right units of the hearing aid 100.
- the external microphone array 300 may be configured to communicate with the left and right units of the hearing aid 100 by wire.
- the sound source input unit 301 inputs sound coming from the sound source to the external microphone array 300 and converts it into an acoustic signal.
- the sound source input unit 301 includes a plurality of microphones. The sound signal of each microphone converted by the sound source input unit 301 is transferred to the sound source separation unit 303.
- the sound source separation unit 303 detects the direction of the sound source with the external microphone array 300 as a base point by using the difference in arrival time of the sound coming from the sound source to each microphone.
- the sound source separation unit 303 takes into account the delay time of the sound for each microphone based on the spatial arrangement of each microphone and adds the sound signals of each microphone, so that the sound source separation unit 303 uses the external microphone array 300 as a base point.
- a sound source signal that has undergone directivity processing in the direction of the sound source is generated and transmitted to the output signal generation unit 105 of the hearing aid 100 wirelessly.
- the sound source signal generated by the sound source separation unit 303 has the sound coming from the target sound source emphasized (directivity processing) with the external microphone array 300 as a base point. Therefore, in the sound source signal generated by the sound source separation unit 303, sounds other than the sound of the target sound source are suppressed, and the sound of the target sound source is clear. Note that when the position of the external microphone array 300 is closer to the position of the sound source than the position of the binaural microphone 101, the sound source signal generated by the sound source separation unit 303 further makes the sound of the target sound source clear.
- the sound uttered by the person B is input from two microphone systems and converted into an acoustic signal.
- the first microphone system is a plurality of microphones constituting the sound source input unit 301 of the external microphone array 300
- the second microphone system is the binaural microphone 101 of the hearing aid 100.
- a sound (arrow 1) arriving at the external microphone array 300 from the person B who speaks is input and converted into an acoustic signal.
- Each of the plurality of microphones constituting the sound source input unit 301 of the external microphone array 300 collects the sound of the utterance of the person B coming from the person B as the sound source.
- the acoustic signal converted by the sound source input unit 301 is transferred to the sound source separation unit 303.
- the sound source separation unit 303 detects the sound source direction indicating the direction of the sound source with the external microphone array 300 as a base point using the difference in arrival time of the sound of the speech of the person B arriving at each microphone.
- the acoustic signals of the microphones are added in consideration of the sound delay time for each microphone based on the spatial arrangement of each microphone, and directivity processing is performed in the direction of the sound source with the external microphone array 300 as the base point. Is done.
- the directivity-processed acoustic signal is wirelessly transmitted to the output signal generation unit 105 of the hearing aid 100 as a sound source signal subjected to directivity processing in the direction of the sound source with the external microphone array 300 as a base point.
- the left and right acoustic signals respectively converted by the right ear microphone 101A and the left ear microphone 101B are transferred to the direction sense component calculation unit 103.
- the directional component calculation unit 103 At least one of the interaural time difference and the interaural volume difference is based on the wearer of the binaural microphone 101 from the left and right acoustic signals converted by the binaural microphone 101. It is calculated as a directional component indicating the direction of the sound source.
- the binaural time difference based on the right ear microphone 101A is a positive value and the binaural volume difference (power ratio). Becomes a value of 1 or less (arrow 2B is longer than arrow 2A).
- the direction sense component calculated by the direction sense component calculation unit 103 is transferred to the output signal generation unit 105.
- the output signal generation unit 105 outputs from the binaural speaker 107 from the direction sense component calculated by the direction sense component calculation unit 103 and the sound source signal subjected to directivity processing in the direction of the sound source based on the external microphone array 300. Left and right acoustic signals are generated.
- the left ear of the person A is farther from the person B than the right ear of the person A. Therefore, in the output signal generation unit 105, the left acoustic signal output from the left ear speaker 107B of the person A is delayed by the time difference between both ears which is a direction sense component.
- the left ear speaker 107B is controlled so that the volume of the left ear speaker 107B for outputting the left acoustic signal is reduced by the volume difference between both ears.
- the sound source signal received from the sound source separation unit 303 is transferred to the right ear speaker 107A for output from the right ear speaker 107A as a right acoustic signal.
- the directional component calculation unit 103 calculates the direction in which the sound of the person B, who is the sound source, and (2) directivity processing in the direction of the sound source with the external microphone array 300 as a base point.
- the clarity of the speech of the person B who is the sound source is enhanced by the sound source signal thus generated.
- the first microphone system is a plurality of microphones constituting the sound source input unit of the external microphone array 300
- the second microphone system is the binaural microphone 101 of the hearing aid 100.
- a sound arriving at the external microphone array 300 from the uttered person C (arrow 3) is input and converted into an acoustic signal.
- Each of the plurality of microphones constituting the sound source input unit 301 of the external microphone array 300 collects the sound of the utterance of the person C coming from the person C as a sound source.
- the sound source separation unit 303 detects the sound source direction indicating the direction of the sound source with the external microphone array 300 as a base point using the difference in arrival time of the sounds of the utterance of the person C arriving at each microphone.
- the sound signals of the respective microphones are added in consideration of the delay time of the sound for each microphone based on the spatial arrangement of each microphone, and directivity in the direction of the sound source with the external microphone array 300 as a base point is added. It is processed. Then, the directivity-processed acoustic signal is wirelessly transmitted to the output signal generation unit 105 of the hearing aid 100 as a sound source signal that has been directivity-processed in the direction of the sound source with the external microphone array 300 as a base point.
- the sound (arrow 4A and arrow 4B) arriving at the binaural microphone 101 from the uttering person C is input and is input to the acoustic signal. Converted.
- the left and right acoustic signals respectively converted by the right ear microphone 101 ⁇ / b> A and the left ear microphone 101 ⁇ / b> B are transferred to the direction sense component calculation unit 103.
- the directional component calculation unit 103 At least one of the interaural time difference and the interaural volume difference is based on the wearer of the binaural microphone 101 from the left and right acoustic signals converted by the binaural microphone 101. It is calculated as a directional component representing the sense of direction of the sound source.
- the person A turns from the direction in which the person C is viewed to the left to the direction in which the person C is viewed in the front, so that the binaural time difference is positive when the left ear microphone 101B is used as a reference.
- the binaural volume difference (power ratio) is changed from a value smaller than 1 to 1 (values of arrows 4A and 4B are equal).
- the direction sense component calculated by the direction sense component calculation unit 103 is transferred to the output signal generation unit 105.
- the output signal generation unit 105 outputs from the binaural speaker 107 from the direction sense component calculated by the direction sense component calculation unit 103 and the sound source signal subjected to directivity processing in the direction of the sound source based on the external microphone array 300. Left and right acoustic signals are generated.
- the left and right acoustic signals synthesized by the output signal generation unit 105 are output from the left ear speaker 107B and the right ear speaker 107A of the binaural speaker 107.
- the output signal generation unit 105 performs the interaural time difference that is a directional component. Changes from the value calculated from the measured value to zero. Further, the output signal generation unit 105 controls the right ear speaker 107A so that the volume of the right ear speaker 107A is reduced by the volume difference between both ears, and gradually makes it equal to the left. Therefore, when the person A is looking at the external microphone array 300 in front, the right ear speaker 107A outputs a small sound with a delayed utterance of the person C compared to the left ear speaker 107B of the left ear. .
- the utterance of the person C is not delayed not only from the left ear speaker 107B but also from the right ear speaker 107A. It changes so that the sound of the same magnitude is output.
- the person A views the person C from the front, the person A can hear the utterance of the person C from the front.
- the sound image of the utterance of the person C with respect to the person A does not move according to the movement of the person A who is wearing the hearing aid 100.
- the sound image of the person C speaking to the person A does not move according to the movement of the person A wearing the hearing aid 100.
- the direction sense component calculation unit 103 calculates the sound source based on the wearer of the binaural microphone 101.
- the direction sense component indicating the direction faithfully reproduces the direction in which the voice of the person C, who is the sound source, arrives, and (2) the sound source signal subjected to directivity processing in the direction of the sound source with the external microphone array 300 as a base point
- the hearing aid device of the first embodiment can improve the clarity of the voice uttered by the speaker while reproducing the direction in which the voice uttered by the speaker arrives.
- FIG. 5 shows a configuration diagram of the hearing aid device of the first embodiment and a configuration diagram of a conference system using the hearing aid device.
- the hearing aid device includes a hearing aid 100 and an external microphone array 300.
- the hearing aid 100 includes a hearing aid main body 110, a right ear microphone 101A and a right ear speaker 107A, and a left ear microphone 101B and a left ear speaker 107B, which are connected to each other by wire.
- the external microphone array 300 includes a speakerphone main body 310 and two external microphones 320, and the two external microphones 320 and the speakerphone main body 310 are connected by a wire L1.
- the speakerphone main body 310 includes four built-in microphones 330.
- the hearing aid main body 110 included in the hearing aid 100 and the speakerphone main body 310 included in the external microphone array 300 are connected by a wire L2.
- the hearing aid main body 110 and the speakerphone main body 310 each include a power source, a DSP (Digital Signal Processor), a communication unit, a storage unit, and a control unit.
- DSP Digital Signal Processor
- the conference system using the hearing aid device includes a hearing aid device, a desk 710, and a plurality of chairs 720.
- the plurality of chairs 720 are installed around the desk 710.
- the voice of the speaker sitting on the chair 720 is input to the external microphone array 300, the right ear microphone 101A, and the left ear microphone 101B.
- the voice of the speaker is output to the binaural speaker 107 as a highly clear voice component via the external microphone array 300.
- the voice of the speaker is output to the binaural speaker 107 as a direction sense component via the right ear microphone 101A and the left ear microphone 101B.
- the user of the hearing aid device can hear the speaker's voice clearly and perceiving the direction of arrival based on the voice component and direction sense component with high clarity.
- each unit is connected by the wires L1 and L2, but each unit may be connected wirelessly.
- an external microphone array 300 are connected to a power source, a DSP, It may include a communication unit, a storage unit, a control unit, etc., and communicate with each other wirelessly.
- a remote control unit 130 may be added to the hearing aid 100 in the conference system using the hearing aid device shown in FIG.
- the portion that communicates wirelessly is indicated by a broken line.
- the remote control unit 130 is basically controlled by the user, such as changing the output volume of the hearing aid 100, but can be used as an external microphone array 300 by mounting a microphone array composed of four microphones 131. become.
- the remote control unit 130 can be mounted on the mobile phone 150, for example.
- the information processing in the hearing aid device takes into account the processing delay due to communication, power consumption, etc. It is desirable that the plurality of units included in the hearing aid 100 and the external microphone array 300 are appropriately distributed.
- the DSP built in the speakerphone main body 310 may perform sound source input processing and sound source separation processing, and the DSP built in the hearing aid main body 110 may perform other processing.
- the communication signal between the external microphone array 300 and the hearing aid 100 only needs to include the separated audio signal, and the communication capacity can be reduced.
- the speakerphone main body 310 that can use an AC adapter there is an effect that the power consumption of the hearing aid main body 110 can be suppressed.
- the processing delay associated with wireless communication becomes more prominent than with wired communication, so it is better to consider the amount of communication.
- the volume of the left and right output signals can be determined using the difference between the left and right volume and a predetermined reference volume. As a result, there is no processing delay due to the transmission of signals from the left and right units of the hearing aid main body 110 to the remote control unit 130, so that the directional component is kept natural. Furthermore, since a direct comparison of the left and right volume is not necessary, a right output signal is generated in the right unit of the hearing aid main body 110, a left output signal is generated in the left unit of the hearing aid main body 110, and the left and right are processed independently. Therefore, there is an effect that the processing delay associated with the left and right communication does not occur.
- the shape of the hearing aid 100 of the hearing aid device according to the first embodiment is not particularly limited. However, for example, if the shape of the hearing aid 100 of the hearing aid device according to the first embodiment is made a canal type, the hearing aid device according to the first embodiment is not limited to the direction of the head of the wearer of the binaural microphone 101 but also the hearing aid It is possible to generate a directional component that reflects the influence of reflection depending on the size and shape of each part (auricle, shoulder, trunk) of 100 wearers.
- the external microphone array 300 is installed near the center of the round table 700, but the present invention is not limited to this.
- Each speaker may wear a headset type external microphone array 300.
- the external microphone array includes the sound source input unit 301 and the sound source separation unit 303 is not necessary.
- the binaural speaker 107 may be incorporated in, for example, headphones.
- the binaural microphone 101 may be incorporated in, for example, headphones.
- the sound source input unit 301 of the external microphone array 300 may be configured by a single microphone, and the external microphone array 300 may be disposed closer to the sound source than the binaural microphone 101. .
- FIG. 7 is a block diagram illustrating a configuration of the hearing aid device according to the second embodiment.
- FIG. 8 is a block diagram showing in detail the configuration of the hearing aid device of the second embodiment.
- the hearing aid device of the second embodiment includes a hearing aid 200 and an external microphone array 400.
- FIG. 9 is a diagram illustrating a usage example of the hearing aid device according to the second embodiment.
- FIG. 7 a configuration of a hearing aid 200 that constitutes a part of the hearing aid device of the second embodiment will be described.
- the binaural microphone and the binaural speaker of the hearing aid of Embodiment 2 have the same configuration as the binaural microphone 101 and binaural speaker 107 of Embodiment 1. Therefore, the same reference numbers as those in FIG.
- the hearing aid 200 includes a right unit worn on the right ear and a left unit worn on the left ear.
- Each of the left and right units includes a binaural microphone 101, an output signal generation unit 205, a binaural transfer characteristic measurement unit 207, a sound source position estimation unit 209, a binaural speaker 107, and a sound detection unit 211.
- the left and right units of the hearing aid 200 communicate wirelessly. Note that the left and right units of the hearing aid 100 may be configured to communicate with each other by wire.
- the binaural microphone 101 includes a right ear microphone 101A that constitutes a part of the right unit and a left ear microphone 101B that constitutes a part of the left unit.
- the binaural microphone 101 inputs sound coming from the sound source to the wearer of the hearing aid 200 at the left and right ears of the wearer of the hearing aid 200 and converts it into an acoustic signal. Then, the converted acoustic signal is transferred to the binaural transfer characteristic measurement unit 207 in order to obtain transfer functions of the left and right ears of the hearing aid 200 wearer.
- the voice detection unit 211 receives each sound source signal separated by the sound source separation unit 403 of the external microphone array 400 and detects the voice of the person who is speaking from the sound source signal.
- the sound detection unit 211 obtains power in a predetermined time interval for each sound source signal separated for each sound source. Then, a sound source whose power in a predetermined time interval is equal to or greater than a threshold is detected as the voice of the person who is speaking.
- the voice detection unit 211 uses a parameter representing a harmonic structure as an element of a sound source signal used when detecting the voice of a speaking person (for example, power by a comb filter assuming a pitch). And the ratio of broadband power) may be used.
- the binaural transfer characteristic measuring unit 207 is a space between a sound source signal (hereinafter referred to as an audio signal) detected by the audio detecting unit 211 as the voice of the person who is speaking and a right acoustic signal obtained from the right ear microphone 101A.
- the transfer function (hereinafter referred to as transfer characteristic on the right) is obtained.
- the binaural transfer characteristic measurement unit 207 obtains a transfer function (hereinafter referred to as the left transfer characteristic) between the audio signal and the left acoustic signal obtained from the left ear microphone 101B.
- the binaural transfer characteristic measuring unit 207 associates the transfer characteristic of each ear with a direction (hereinafter referred to as a sound source direction) indicating the direction of the sound source with the external microphone array 400 as a base point. Therefore, even when there are a plurality of audio signals detected as sound, the binaural transfer characteristic measuring unit 207 can express the sound source direction of each sound source.
- a sound source direction a direction indicating the direction of the sound source with the external microphone array 400 as a base point. Therefore, even when there are a plurality of audio signals detected as sound, the binaural transfer characteristic measuring unit 207 can express the sound source direction of each sound source.
- the direction sense component in the first embodiment corresponds to the transmission characteristics of each ear obtained by the binaural transmission characteristics measuring unit 207.
- the binaural transfer characteristic measurement unit 207 Stop measuring the ear transfer function. In that case, the sense of sound source direction of each person can be maintained by using the transfer function immediately before stopping the measurement of the transfer function of each ear.
- the sound source position estimation unit 209 can estimate the position of each sound source based on the transfer functions of the left and right ears associated with the sound source direction obtained by the binaural transfer characteristic measurement unit 207.
- the sound source position estimation unit 209 determines the sound arrival time from the external microphone array 400 to the binaural microphone 101 from the time having the first peak on the impulse response of the transfer function of each ear associated with the sound source direction. Ask for. From this arrival time, the perspective of each sound source from the wearer of the hearing aid 200 can be estimated. Further, the sound source position estimation unit 209 calculates the cross-correlation value while shifting the time from the impulse response of the transfer function of the left and right ears, and obtains the time when the cross-correlation value is maximum as the interaural time difference.
- the sound source position estimation unit 209 sets a sound source having a minimum arrival time and a time difference between both ears close to 0 among a plurality of sound sources as an utterance of the hearing aid 200 itself. Therefore, the sound source position estimation unit 209 can estimate the position of each sound source based on the transfer functions of the left and right ears associated with the sound source direction obtained by the binaural transfer characteristic measurement unit 207. Then, the output signal generation unit 205 refers to the estimation result of the sound source position estimation unit 209. As described above, in the hearing aid device according to the second embodiment, the sound detection unit 211, the binaural transfer characteristic measurement unit 207, and the sound source position estimation unit 209 have the same functions as the directional component calculation unit according to the first embodiment. It has.
- the output signal generation unit 205 outputs the right and left transfer characteristics measured by the binaural transfer characteristic measurement unit 207 and the left and right audio signals from the right ear speaker 107A and the left ear speaker 107B of the binaural speaker 107, respectively. Left and right acoustic signals are generated.
- the output signal generation unit 205 convolves the sound signal of the first microphone system with the impulse response of the transfer function representing the left and right transfer characteristics to generate the left and right acoustic signals.
- the output signal generation unit 205 refers to the estimation result of the sound source position estimation unit 209 as necessary, and determines whether the sound source of the left and right audio signals is the wearer himself / herself.
- the output signal generation unit 205 does not output the audio signal of the first microphone system to the binaural speaker 107, but the second microphone system. Are output to the binaural speaker 107. As a result, the voice of the wearer can be heard clearly and with little time delay.
- the binaural speaker 107 includes a right ear speaker 107A that constitutes a part of the right unit and a left ear speaker 107B that constitutes a part of the left unit.
- the binaural speaker 107 outputs the sound source signal generated by the output signal generation unit 205 as the left and right acoustic signals at the left and right ears of the wearer of the hearing aid 200.
- the configuration of the external microphone array 400 that constitutes a part of the hearing aid device of Embodiment 2 will be described with reference to FIGS.
- the sound source input unit 301 of the external microphone array has the same configuration as the sound source input unit of the external microphone array of the first embodiment. Therefore, the same reference numbers as those in FIG.
- the external microphone array 400 includes a sound source input 301 and a sound source separation unit 403.
- the external microphone array 400 is installed at a place closer to the speakers B and C than the binaural microphone 101 of the hearing aid 200.
- the external microphone array 400 communicates wirelessly with the left and right units of the hearing aid 200.
- the external microphone array 400 may be configured to communicate with the left and right units of the hearing aid 200 by wire.
- the sound source input unit 301 inputs sound coming from the sound source to the external microphone array 400 and converts it into a sound signal.
- the sound source input unit 301 includes a plurality of microphones. The sound signal of each microphone converted by the sound source input unit 301 is transferred to the sound source separation unit 303.
- the sound source separation unit 303 detects the direction of the sound source with the external microphone array 400 as a base point, using the difference in arrival time of the sound coming from the sound source to each microphone.
- the sound source separation unit 303 adds the sound signal of each microphone, taking into account the delay time of the sound for each microphone, based on the spatial arrangement of each microphone. Then, the sound source separation unit 303 generates a sound source signal that has been subjected to directivity processing in the direction of the sound source with the external microphone array 400 as a base point, and transmits the sound source signal to the sound detection unit 211 of the hearing aid 200 wirelessly.
- the sound source signal generated by the sound source separation unit 303 has the sound coming from the target sound source as emphasized (directivity processing) with the external microphone array 400 as a base point. Therefore, in the sound source signal generated by the sound source separation unit 303, sounds other than the sound of the target sound source are suppressed, and the sound of the target sound source is clear.
- the sound source signal generated by the sound source separation unit 303 further makes the sound of the target sound source clear.
- the sound source separation unit 303 may perform sound source separation by independent component analysis. At this time, in order to use power in the voice detection unit 211, power information is restored by multiplying each independent component by a diagonal element of an inverse matrix of the separation matrix.
- FIG. 9 As shown in FIG. 9, it is assumed that a person A, a person B, and a person C wearing the hearing aid 200 are having a meeting surrounding a round table 700 in which an external microphone array 400 is installed near the center. In FIG. 9, while the person B and the person C are speaking, the person A looks at the person B in front and listens to the person B.
- Speech sounds of person B, person C, and person A are input from the two microphone systems and converted into left and right acoustic signals.
- the first microphone system is a plurality of microphones constituting the sound source input unit of the external microphone array 400
- the second microphone system is the binaural microphone 101 of the hearing aid 200.
- the sound (arrow 5) arriving at the external microphone array 400 from the person B is input and converted into an acoustic signal.
- the sound (arrow 7) that arrives at the external microphone array 400 from the person C is converted into an acoustic signal.
- the sound (arrow 9) that reaches the external microphone array 400 from the person A is also converted into an acoustic signal.
- Each of the plurality of microphones constituting the sound source input unit 301 of the external microphone array 400 collects utterance sounds coming from the person B, person C, and person A, which are sound sources.
- the sound signal converted into the sound signal by the sound source input unit 301 is transferred to the sound source separation unit 303.
- the sound source separation unit 403 detects the sound source direction indicating the direction of the sound source with the external microphone array 400 as a base point using, for example, the difference in arrival time of the utterance sound of the person B arriving at each microphone.
- the sound signals of the respective microphones are added in consideration of the sound delay time for each microphone based on the spatial arrangement of each microphone, and directivity processing is performed in the direction of the sound source with the external microphone array 400 as a base point. Is done.
- the sound signal subjected to directivity processing is wirelessly transmitted to the sound detection unit 211 of the hearing aid 200 as a sound source signal subjected to directivity processing in the direction of the sound source with the external microphone array 400 as a base point.
- the utterance sound (arrow 6A, arrow 8A, arrow 10A, arrow 6B) of each person (person B, person C or person A) arriving from each sound source, Arrows 8B and 10B) are input and converted into acoustic signals, respectively.
- the converted acoustic signals of the sound sources are transferred from the microphones 101A and 101B to the binaural transfer characteristic measuring unit 207.
- the voice detection unit 211 detects the voices of the persons B, C, and A from the sound source signals received from the sound source separation unit 403 of the external microphone array 400.
- the voice detection unit 211 obtains power in a predetermined time interval for each sound source signal separated for each sound source. Then, a sound source whose power in a predetermined time interval is equal to or greater than a threshold is detected as the voice of the person who is speaking. Since the detected voice of the talking person is detected from the sound source signal subjected to the directivity processing by the sound source separation unit 403, it is very clear.
- Each sound source signal (hereinafter referred to as an audio signal) in which the voice of the person who is speaking is detected is transferred to the binaural transfer characteristic measuring unit 207.
- the binaural transfer characteristic measuring unit 207 transmission between each audio signal of each sound source (person B, person C, or person A) transferred from the sound detection unit 211 and the acoustic signal transferred from the right ear microphone 101A. A function is required. Similarly, in the binaural transfer characteristic measurement unit 207, transmission between each of the sound signals of each sound source (person B or person C) transferred from the sound detection unit 211 and the acoustic signal transferred from the left ear microphone 101B. A function is required.
- the binaural transfer characteristic measuring unit 207 associates the transfer characteristics of each ear (person B, person C, person A) of each sound source with the sound source direction indicating the direction of the sound source based on the external microphone array 400. It has been.
- the binaural transfer characteristic measurement unit 207 stops measuring the transfer function of each ear. In that case, the transfer function immediately before stopping the measurement of the transfer function of each ear is used.
- the transfer characteristics of each ear of each sound source associated with the sound source direction are transferred to the output signal generation unit 205 and the sound source position estimation unit 209.
- each sound source is determined based on the transfer functions of the left and right ears associated with the sound source direction indicating the direction of the sound source with the external microphone array 400 as a base point, which is obtained by the binaural transfer characteristic measurement unit 207. Can be estimated.
- the utterance of the person A who is wearing the hearing aid 200 has a minimum arrival time among a plurality of sound sources (the difference between the lengths of the arrows 10B and 9 is indicated by the arrows 6B and 9). 5 and smaller than the lengths of the arrows 8B and 7), and the interaural time difference is close to 0 (the lengths of the arrows 10A and 10B are substantially equal).
- the output signal generation unit 205 convolves the left and right audio signals of each sound source with the impulse response of the transfer function representing the transfer characteristic of each ear of each sound source associated with the sound source direction, and The left and right acoustic signals are synthesized for output from the right ear speaker 107A and the left ear speaker 107B.
- the output signal generation unit 205 outputs the audio signal of the second microphone system to the binaural speaker 107. To do.
- the left and right acoustic signals synthesized by the output signal generation unit 205 are output from the right ear speaker 107A and the left ear speaker 107B, respectively.
- the hearing aid device of the second embodiment the left and right audio signals in which the sound of each sound source processed by the external microphone array 400 is clear and the binaural transfer characteristic measurement unit 207 of the hearing aid 200 are obtained.
- the left and right acoustic signals generated from the left and right transfer functions associated with the sound source directions are output from the binaural speaker 107. Therefore, the hearing aid device of the second embodiment can improve the clarity of the voice uttered by the speaker while reproducing the direction in which the voice uttered by the speaker arrives.
- the shape of the hearing aid 200 is not particularly limited.
- the left and right acoustic signals synthesized by the output signal generation unit 205 are speaking.
- the left and right transfer characteristics include the effect of reflection from the size and shape of each part (auricle, shoulder, torso) of the person speaking, as well as the direction of the head on which the person wears the hearing aid 200. Therefore, in the hearing aid device of the second embodiment, the wearer of the hearing aid 200 can feel the sense of direction of the sound output from the binaural speaker 107 in real time.
- the hearing aid according to the present invention has an effect of improving the clarity of the speech uttered by the speaker while reproducing the direction in which the speech uttered by the speaker arrives without using the inverse mapping rule. It is useful as a hearing aid.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
- Circuit For Audible Band Transducer (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
Description
方向基準設定部809は、方向基準設定スイッチを備える。方向基準設定部809は、補聴器800を装着する者が方向基準設定スイッチを操作することで、仮想音源の方向を定める基準方向を設定したり、頭部回転角度センサ811をリセットしたりすることができる。
方向推定部813は、頭部回転角度センサ811が検知する回転角度を逆方向に積分し、定位させたい仮想音源の方向を、方向基準設定スイッチで設定された基準方向からの角度として決定する。
逆写像ルール記憶部805は、方向推定部813で決定された角度を方向感成分に変換するための逆写像ルールが記憶されている。
両耳スピーカー801は、仮想音像回転部803と、仮想音像回転部803で回転した発話者の音声の音像を、左耳用の音響信号と右耳用の音響信号として表現しそれぞれ出力する。
音源入力部901は、所定の配置に並べられた複数のマイクから構成され、外部からの音を多チャンネルで取り込む。
音源分離部902は、発話者の方向に外部マイクアレー900の指向性を向けて発話者の音声を分離する。分離された発話者の音声は、上述した仮想音像回転部803へ転送される。
図1は、実施の形態1の補聴装置の構成を示すブロック図である。図1に示すように、第1の実施の形態の補聴装置は、補聴器100と、外部マイクアレー300と、を備える。図3は、実施の形態1の補聴装置の使用例1を示す図であり、図4は、実施の形態1の補聴装置の使用例2を示す図である。
音源入力部301で変換された各マイクの音響信号は、音源分離部303へ転送される。
図3に示すように、補聴器100を装着する人物Aと、人物Bと、人物Cとが、中央付近に外部マイクアレー300が設置されている円卓700を囲んで会議をしている。図3では、人物Bが発話をしている間、人物Aは人物Bを斜め右方向に見て人物Bの話を聞いている。
外部マイクアレー300の音源入力部301では、発話する人物Bから外部マイクアレー300に到来する音(矢印1)が入力され、音響信号に変換される。外部マイクアレー300の音源入力部301を構成する複数のマイクのそれぞれが、音源である人物Bから到来する人物Bの発話の音を収音する。
音源入力部301で変換された音響信号は、音源分離部303へ転送される。
音源分離部303では、各マイクの音響信号が、各マイクの空間配置に基づいて、各マイクに対する音の遅延時間を加味し加算され、外部マイクアレー300を基点とした音源の方向に指向性処理される。そして、指向性処理された音響信号は、外部マイクアレー300を基点とした音源の方向に指向性処理された音源信号として、補聴器100の出力信号生成部105へ無線で送信される。
補聴器100の両耳マイク101を構成する右耳マイク101A及び左耳マイク101Bではそれぞれ、発話する人物Bから両耳マイク101に到来する音(矢印2A及び矢印2B)が、音響信号に変換される。
図4に示すように、補聴器100を装着する人物Aと、人物Bと、人物Cとが、中央付近に外部マイクアレー300が設置されている円卓700を囲んで会議をしているとする。図4では、図3に示す状態から、人物Bが発話をやめ、人物Aが外部マイクアレー300を正面に見ていたのを、発話を開始した人物Cを正面に見る方に向きなおし、人物Cの発話を聞いている。
外部マイクアレー300の音源入力部301では、発話する人物Cから外部マイクアレー300に到来する音が(矢印3)入力され、音響信号に変換される。
外部マイクアレー300の音源入力部301を構成する複数のマイクのそれぞれが、音源である人物Cから到来する人物Cの発話の音を収音する。
補聴器100の両耳マイク101を構成する右耳マイク101A及び左耳マイク101Bではそれぞれ、発話する人物Cから両耳マイク101に到来する音(矢印4A及び矢印4B)が、入力され、音響信号に変換される。
右耳マイク101A及び左耳マイク101Bで、それぞれ変換された左右の音響信号は、方向感成分算出部103へ転送される。
図7は、実施の形態2の補聴装置の構成を示すブロック図である。また、図8は、実施の形態2の補聴装置の構成を、詳細に示すブロック図である。図7に示すように、第2の実施の形態の補聴装置は、補聴器200と、外部マイクアレー400と、を備える。図9は、実施の形態2の補聴装置の使用例を示す図である。
上述のように、実施の形態2の補聴装置では、音声検出部211と、両耳伝達特性計測部207と、音源位置推定部209とが、実施の形態1の方向感成分算出部と同じ機能を備えている。
音源入力部301で変換された各マイクの音響信号は、音源分離部303へ転送される。
図9に示すように、補聴器200を装着する人物Aと、人物Bと、人物Cとが、中央付近に外部マイクアレー400が設置されている円卓700を囲んで会議をしているとする。図9では、人物B、人物Cが発話をしている間、人物Aは人物Bを正面に見て人物Bの話を聞いている。
外部マイクアレー400の音源入力部301では、人物Bから外部マイクアレー400に到来する音(矢印5)が入力され、音響信号に変換される。同様に、外部マイクアレー400の音源入力部301では、人物Cから外部マイクアレー400に到来する音(矢印7)が、音響信号に変換される。また、外部アレー400の音源入力部301では、人物Aから外部マイクアレー400に到達する音(矢印9)についても、音響信号に変換される。外部マイクアレー400の音源入力部301を構成する複数のマイクのそれぞれが、音源である人物B及び人物C及び人物Aからそれぞれ到来する発話の音を収音する。音源入力部301で音響信号に変換された音響信号は、音源分離部303へ転送される。
補聴器200の両耳マイク101の左右のマイク101A、101Bでは、各音源から到来する各人物(人物B又は人物C又は人物A)の発話の音(矢印6A、矢印8A、矢印10A、矢印6B、矢印8B、矢印10B)が入力され、それぞれ音響信号に変換される。
変換された各音源の音響信号は、各マイク101A、101Bから、両耳伝達特性計測部207へ転送される。
101 両耳マイク
101A 右耳マイク
101B 左耳マイク
103、203 方向感成分算出部
105、205 出力信号生成部
107、801 両耳スピーカー
107A 右耳スピーカー
107B 左耳スピーカー
110 補聴器本体
130 リモコンユニット
207 両耳伝達特性計測部
209 音源位置推定部
211 音声検出部
300、400、900 外部マイクアレー
301、901 音源入力部
303、403、902 音源分離部
310 スピーカーホン本体
320 外部マイク
700 円卓
710 机
720 複数の椅子
803 仮想音像回転部
805 逆写像ルール記憶部
807 頭部角度センサ
809 方向基準設定部
813 方向推定部
Claims (5)
- 音源から到来する音を入力して第1音響信号に変換する音源入力部と、
前記音源入力部で変換された前記第1音響信号を、各音源に対応した音源信号に分離する音源分離部と、
左右の耳元に配置され、前記音源から到来する前記音を入力して第2音響信号に変換する両耳マイクと、
前記両耳マイクで変換された左右の前記第2音響信号から、前記両耳マイクを基点とした前記音源の方向感を表す方向感成分を算出する方向感成分算出部と、
前記音源信号及び前記方向感成分に基づいて、左右の出力音響信号を生成する出力信号生成部と、
前記出力信号生成部で生成された前記左右の出力音響信号を出力する両耳スピーカーと、
を備える補聴装置。 - 請求項1に記載の補聴装置であって、
前記方向感成分算出部は、前記音源毎に、左右の前記第2音響信号から両耳間時間差及び両耳間音量差の少なくとも一方を算出し、
当該両耳間時間差及び両耳間音量差の少なくとも一方を、前記方向感成分とする補聴装置。 - 請求項1に記載の補聴装置であって、
前記方向感成分算出部は、前記音源毎に、前記音源分離部からの前記音源信号と前記両耳マイクからの左右の前記第2音響信号との間の伝達特性を、前記方向感成分として算出する補聴装置。 - 請求項3に記載の補聴装置であって、更に、
前記方向感成分算出部は、
前記音源分離部から取得した音源信号から、音源毎に発話区間を検出し、
前記方向感成分算出部が、複数の音源の前記発話区間を同時に検出すると、前記伝達特性として直前の値を利用する補聴装置。 - 請求項3に記載の補聴装置であって、
前記方向感成分算出部は、前記伝達特性に基づいて各音源の位置を推定し、
前記出力信号生成部は、前記方向感成分算出部により前記両耳マイクの装着者自身が前記音源の位置と推定された場合、前記第2の音響信号を前記両耳スピーカーへ出力する補聴装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010547444A JP5409656B2 (ja) | 2009-01-22 | 2010-01-22 | 補聴装置 |
US13/145,415 US8670583B2 (en) | 2009-01-22 | 2010-01-22 | Hearing aid system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009012292 | 2009-01-22 | ||
JP2009-012292 | 2009-01-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010084769A1 true WO2010084769A1 (ja) | 2010-07-29 |
Family
ID=42355824
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/000381 WO2010084769A1 (ja) | 2009-01-22 | 2010-01-22 | 補聴装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US8670583B2 (ja) |
JP (2) | JP5409656B2 (ja) |
WO (1) | WO2010084769A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012074950A (ja) * | 2010-09-29 | 2012-04-12 | Brother Ind Ltd | 遠隔会議装置 |
JP2012175580A (ja) * | 2011-02-23 | 2012-09-10 | Kyocera Corp | 携帯電子機器及び音出力システム |
JP2015019353A (ja) * | 2013-05-29 | 2015-01-29 | ジーエヌ リザウンド エー/エスGn Resound A/S | 補聴器の外部入力装置 |
Families Citing this family (90)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US20120309363A1 (en) | 2011-06-03 | 2012-12-06 | Apple Inc. | Triggering notifications associated with tasks items that represent tasks to perform |
CN109039391B (zh) | 2010-12-27 | 2021-08-10 | 株式会社精好 | 移动电话 |
KR101973346B1 (ko) | 2012-01-20 | 2019-04-26 | 파인웰 씨오., 엘티디 | 연골 전도부를 갖는 휴대 전화 |
US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
DE102012214081A1 (de) | 2012-06-06 | 2013-12-12 | Siemens Medical Instruments Pte. Ltd. | Verfahren zum Fokussieren eines Hörinstruments-Beamformers |
KR101644261B1 (ko) | 2012-06-29 | 2016-07-29 | 로무 가부시키가이샤 | 스테레오 이어폰 |
CN104969289B (zh) | 2013-02-07 | 2021-05-28 | 苹果公司 | 数字助理的语音触发器 |
US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
KR102127640B1 (ko) | 2013-03-28 | 2020-06-30 | 삼성전자주식회사 | 휴대 단말 및 보청기와 휴대 단말에서 음원의 위치를 제공하는 방법 |
DE102013207149A1 (de) * | 2013-04-19 | 2014-11-06 | Siemens Medical Instruments Pte. Ltd. | Steuerung der Effektstärke eines binauralen direktionalen Mikrofons |
US10425747B2 (en) | 2013-05-23 | 2019-09-24 | Gn Hearing A/S | Hearing aid with spatial signal enhancement |
DK2806661T3 (en) * | 2013-05-23 | 2017-12-11 | Gn Resound As | A hearing aid with spatial signal enhancement |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US9124990B2 (en) * | 2013-07-10 | 2015-09-01 | Starkey Laboratories, Inc. | Method and apparatus for hearing assistance in multiple-talker settings |
WO2015020942A1 (en) | 2013-08-06 | 2015-02-12 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
EP2840807A1 (en) * | 2013-08-19 | 2015-02-25 | Oticon A/s | External microphone array and hearing aid using it |
JP6296646B2 (ja) * | 2014-01-22 | 2018-03-20 | 日東電工株式会社 | 聴覚補完システム、聴覚補完装置及び聴覚補完方法 |
US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
WO2015184186A1 (en) | 2014-05-30 | 2015-12-03 | Apple Inc. | Multi-command single utterance input method |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10068586B2 (en) * | 2014-08-14 | 2018-09-04 | Rensselaer Polytechnic Institute | Binaurally integrated cross-correlation auto-correlation mechanism |
KR101973486B1 (ko) | 2014-12-18 | 2019-04-29 | 파인웰 씨오., 엘티디 | 전자형 진동 유닛을 사용한 연골 전도 청취 장치 및 전자형 진동 유닛 |
JP6676837B2 (ja) * | 2015-04-14 | 2020-04-08 | 株式会社ファインウェル | 受話装置 |
US9774960B2 (en) * | 2014-12-22 | 2017-09-26 | Gn Hearing A/S | Diffuse noise listening |
EP3038381B1 (en) * | 2014-12-22 | 2017-08-09 | GN Resound A/S | Diffuse noise listening |
JP6762091B2 (ja) * | 2014-12-30 | 2020-09-30 | ジーエヌ ヒアリング エー/エスGN Hearing A/S | 外部からピックアップされたマイクロホン信号の上に空間聴覚キューを重ね合わせる方法 |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
EP3278575B1 (en) | 2015-04-02 | 2021-06-02 | Sivantos Pte. Ltd. | Hearing apparatus |
US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
US10200824B2 (en) | 2015-05-27 | 2019-02-05 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device |
US20160378747A1 (en) | 2015-06-29 | 2016-12-29 | Apple Inc. | Virtual assistant for media playback |
KR102056550B1 (ko) | 2015-07-15 | 2019-12-16 | 파인웰 씨오., 엘티디 | 로봇 및 로봇 시스템 |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US10331312B2 (en) | 2015-09-08 | 2019-06-25 | Apple Inc. | Intelligent automated assistant in a media environment |
US10740384B2 (en) | 2015-09-08 | 2020-08-11 | Apple Inc. | Intelligent automated assistant for media search and playback |
JP6551929B2 (ja) | 2015-09-16 | 2019-07-31 | 株式会社ファインウェル | 受話機能を有する腕時計 |
US10368162B2 (en) * | 2015-10-30 | 2019-07-30 | Google Llc | Method and apparatus for recreating directional cues in beamformed audio |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10956666B2 (en) | 2015-11-09 | 2021-03-23 | Apple Inc. | Unconventional virtual assistant interactions |
JP6665379B2 (ja) * | 2015-11-11 | 2020-03-13 | 株式会社国際電気通信基礎技術研究所 | 聴覚支援システムおよび聴覚支援装置 |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
WO2017126406A1 (ja) | 2016-01-19 | 2017-07-27 | ローム株式会社 | ペン型送受話装置 |
US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
DK179415B1 (en) | 2016-06-11 | 2018-06-14 | Apple Inc | Intelligent device arbitration and control |
DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
GB2551521A (en) * | 2016-06-20 | 2017-12-27 | Nokia Technologies Oy | Distributed audio capture and mixing controlling |
US20180018300A1 (en) * | 2016-07-16 | 2018-01-18 | Ron Zass | System and method for visually presenting auditory information |
US11195542B2 (en) | 2019-10-31 | 2021-12-07 | Ron Zass | Detecting repetitions in audio data |
DE102016225207A1 (de) | 2016-12-15 | 2018-06-21 | Sivantos Pte. Ltd. | Verfahren zum Betrieb eines Hörgerätes |
US11204787B2 (en) | 2017-01-09 | 2021-12-21 | Apple Inc. | Application integration with a digital assistant |
US10841724B1 (en) | 2017-01-24 | 2020-11-17 | Ha Tran | Enhanced hearing system |
DK180048B1 (en) | 2017-05-11 | 2020-02-04 | Apple Inc. | MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION |
US10726832B2 (en) | 2017-05-11 | 2020-07-28 | Apple Inc. | Maintaining privacy of personal information |
DK179745B1 (en) | 2017-05-12 | 2019-05-01 | Apple Inc. | SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT |
DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
DK201770429A1 (en) | 2017-05-12 | 2018-12-14 | Apple Inc. | LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT |
DK201770411A1 (en) | 2017-05-15 | 2018-12-20 | Apple Inc. | MULTI-MODAL INTERFACES |
US20180336275A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Intelligent automated assistant for media exploration |
US20180336892A1 (en) * | 2017-05-16 | 2018-11-22 | Apple Inc. | Detecting a trigger of a digital assistant |
US9992585B1 (en) | 2017-05-24 | 2018-06-05 | Starkey Laboratories, Inc. | Hearing assistance system incorporating directional microphone customization |
JP6668306B2 (ja) * | 2017-10-18 | 2020-03-18 | ヤマハ株式会社 | サンプリング周波数推定装置 |
CN112237009B (zh) * | 2018-01-05 | 2022-04-01 | L·奥拉 | 助听器及其使用方法 |
US10818288B2 (en) | 2018-03-26 | 2020-10-27 | Apple Inc. | Natural assistant interaction |
US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
DK179822B1 (da) | 2018-06-01 | 2019-07-12 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
DK180639B1 (en) | 2018-06-01 | 2021-11-04 | Apple Inc | DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT |
US10892996B2 (en) | 2018-06-01 | 2021-01-12 | Apple Inc. | Variable latency device coordination |
JP2020053948A (ja) | 2018-09-28 | 2020-04-02 | 株式会社ファインウェル | 聴取装置 |
US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
DK180129B1 (en) | 2019-05-31 | 2020-06-02 | Apple Inc. | USER ACTIVITY SHORTCUT SUGGESTIONS |
DK201970510A1 (en) | 2019-05-31 | 2021-02-11 | Apple Inc | Voice identification in digital assistant systems |
US11227599B2 (en) | 2019-06-01 | 2022-01-18 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
US11488406B2 (en) | 2019-09-25 | 2022-11-01 | Apple Inc. | Text detection using global geometry estimators |
US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
US11183193B1 (en) | 2020-05-11 | 2021-11-23 | Apple Inc. | Digital assistant hardware abstraction |
US11755276B2 (en) | 2020-05-12 | 2023-09-12 | Apple Inc. | Reducing description length based on confidence |
US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
CN113556660B (zh) * | 2021-08-01 | 2022-07-19 | 武汉左点科技有限公司 | 一种基于虚拟环绕立体声技术的助听方法及装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09140000A (ja) * | 1995-11-15 | 1997-05-27 | Nippon Telegr & Teleph Corp <Ntt> | 会議用拡聴器 |
JP2002504794A (ja) * | 1998-02-18 | 2002-02-12 | トプホルム アンド ウエスターマン エイピーエス | バイノーラル・デジタル補聴システム |
JP2005268964A (ja) * | 2004-03-16 | 2005-09-29 | Intelligent Cosmos Research Institute | 音処理装置、音処理方法および音処理プログラム |
JP2007336460A (ja) * | 2006-06-19 | 2007-12-27 | Tohoku Univ | 聴音装置 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3385725B2 (ja) | 1994-06-21 | 2003-03-10 | ソニー株式会社 | 映像を伴うオーディオ再生装置 |
JPH11308699A (ja) * | 1998-04-21 | 1999-11-05 | Nippon Telegr & Teleph Corp <Ntt> | 空間音響再生装置、その両耳間差維持方法及び両耳間差補正方法 |
JP2001166025A (ja) * | 1999-12-14 | 2001-06-22 | Matsushita Electric Ind Co Ltd | 音源の方向推定方法および収音方法およびその装置 |
JP3952870B2 (ja) | 2002-06-12 | 2007-08-01 | 株式会社東芝 | 音声伝送装置、音声伝送方法及びプログラム |
DE10228632B3 (de) * | 2002-06-26 | 2004-01-15 | Siemens Audiologische Technik Gmbh | Richtungshören bei binauraler Hörgeräteversorgung |
US20080056517A1 (en) | 2002-10-18 | 2008-03-06 | The Regents Of The University Of California | Dynamic binaural sound capture and reproduction in focued or frontal applications |
US20070009120A1 (en) | 2002-10-18 | 2007-01-11 | Algazi V R | Dynamic binaural sound capture and reproduction in focused or frontal applications |
US7333622B2 (en) | 2002-10-18 | 2008-02-19 | The Regents Of The University Of California | Dynamic binaural sound capture and reproduction |
US20050100182A1 (en) * | 2003-11-12 | 2005-05-12 | Gennum Corporation | Hearing instrument having a wireless base unit |
US7564980B2 (en) * | 2005-04-21 | 2009-07-21 | Sensimetrics Corporation | System and method for immersive simulation of hearing loss and auditory prostheses |
US8565459B2 (en) * | 2006-11-24 | 2013-10-22 | Rasmussen Digital Aps | Signal processing using spatial filter |
-
2010
- 2010-01-22 US US13/145,415 patent/US8670583B2/en active Active
- 2010-01-22 JP JP2010547444A patent/JP5409656B2/ja active Active
- 2010-01-22 WO PCT/JP2010/000381 patent/WO2010084769A1/ja active Application Filing
-
2013
- 2013-07-23 JP JP2013152673A patent/JP5642851B2/ja active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09140000A (ja) * | 1995-11-15 | 1997-05-27 | Nippon Telegr & Teleph Corp <Ntt> | 会議用拡聴器 |
JP2002504794A (ja) * | 1998-02-18 | 2002-02-12 | トプホルム アンド ウエスターマン エイピーエス | バイノーラル・デジタル補聴システム |
JP2005268964A (ja) * | 2004-03-16 | 2005-09-29 | Intelligent Cosmos Research Institute | 音処理装置、音処理方法および音処理プログラム |
JP2007336460A (ja) * | 2006-06-19 | 2007-12-27 | Tohoku Univ | 聴音装置 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012074950A (ja) * | 2010-09-29 | 2012-04-12 | Brother Ind Ltd | 遠隔会議装置 |
JP2012175580A (ja) * | 2011-02-23 | 2012-09-10 | Kyocera Corp | 携帯電子機器及び音出力システム |
JP2015019353A (ja) * | 2013-05-29 | 2015-01-29 | ジーエヌ リザウンド エー/エスGn Resound A/S | 補聴器の外部入力装置 |
Also Published As
Publication number | Publication date |
---|---|
JP5642851B2 (ja) | 2014-12-17 |
JP5409656B2 (ja) | 2014-02-05 |
US20120020503A1 (en) | 2012-01-26 |
JPWO2010084769A1 (ja) | 2012-07-19 |
US8670583B2 (en) | 2014-03-11 |
JP2013236396A (ja) | 2013-11-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5642851B2 (ja) | 補聴装置 | |
US10431239B2 (en) | Hearing system | |
US11037544B2 (en) | Sound output device, sound output method, and sound output system | |
JP5894634B2 (ja) | 個人ごとのhrtfの決定 | |
CN104883636B (zh) | 仿生听力耳麦 | |
CN109640235B (zh) | 利用声源的定位的双耳听力*** | |
CN104185129B (zh) | 具有改善的定位的助听器 | |
Ranjan et al. | Natural listening over headphones in augmented reality using adaptive filtering techniques | |
WO2010043223A1 (en) | Method of rendering binaural stereo in a hearing aid system and a hearing aid system | |
JP2011512745A (ja) | 音響システム及びサウンドを提供する方法 | |
US11805364B2 (en) | Hearing device providing virtual sound | |
JP2019041382A (ja) | 音響デバイス | |
US8666080B2 (en) | Method for processing a multi-channel audio signal for a binaural hearing apparatus and a corresponding hearing apparatus | |
EP1796427A1 (en) | Hearing device with virtual sound source | |
DK2887695T3 (en) | A hearing aid system with selectable perceived spatial location of audio sources | |
US20070127750A1 (en) | Hearing device with virtual sound source | |
KR102613035B1 (ko) | 위치보정 기능의 이어폰 및 이를 이용하는 녹음방법 | |
JP2019066601A (ja) | 音響処理装置、プログラム及び方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10733376 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010547444 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13145415 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10733376 Country of ref document: EP Kind code of ref document: A1 |