WO2015044000A1 - Dispositif et procédé de superposition d'un signal acoustique - Google Patents

Dispositif et procédé de superposition d'un signal acoustique Download PDF

Info

Publication number
WO2015044000A1
WO2015044000A1 PCT/EP2014/069635 EP2014069635W WO2015044000A1 WO 2015044000 A1 WO2015044000 A1 WO 2015044000A1 EP 2014069635 W EP2014069635 W EP 2014069635W WO 2015044000 A1 WO2015044000 A1 WO 2015044000A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
sound
useful signal
environment
useful
Prior art date
Application number
PCT/EP2014/069635
Other languages
German (de)
English (en)
Inventor
Dirk OETTING
Jens E. APPELL
Thomas Sporer
Original Assignee
Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. filed Critical Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
Publication of WO2015044000A1 publication Critical patent/WO2015044000A1/fr

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/05—Noise reduction with a separate noise microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers

Definitions

  • Embodiments of the present invention relate to a device for superposing a sound signal with a Nutzsignai. Further exemplary embodiments relate to a method for superimposing a sound signal with a useful signal.
  • Hearing aids try to emphasize the speaker by using directional microphones, in which they dampen the background noise. Due to the small number of microphones (2 - 3) on the hearing aid and the small distance (2 - 3 cm), this directivity is often not sufficient. It must also be ensured that the current speaker position is correctly estimated so that the directional microphone can work effectively. With multiple interviewees in background noise environments, the speaker position can often be estimated very inaccurately.
  • the sound of the hearing aid is reproduced by a loudspeaker directly on or in the ear of the user. However, as the ambient signal is often already loud, further amplification often does not increase the Sens, etc.
  • the amplified signal for the speaker and the other participants in the conversation will be heard in addition, which can cause irritation, since one then perceives one's own voice when speaking.
  • a system which uses a mobile phone with an external directional microphone and earphones to gain additional useful sound for direct sound in difficult communication situations and thus an improvement in the signal-to-noise ratio between speech level and noise level.
  • the present invention is therefore based on the object to provide a concept that allows an increase in a signal-to-noise ratio between the sound level of a useful signal and sound level of a noise, thereby making the wearing of hearing aids for the user superfluous.
  • Embodiments of the present invention provide a device having a payload detector and a sound transmitter.
  • the useful signal detector is designed to generate a useful signal from a circuit signal from an environment of the device to extract and separate from an interfering signal in the sound signal.
  • the sound transmitter is designed to reproduce the useful signal directed and superimposed on the sound signal. Furthermore, a method is provided. The method comprises:
  • a computer program with a program code for execution according to the method described above is provided when the computer program runs on a computer or processor.
  • the present invention utilizes the effect that in a plurality of sound sources with technical means, a single sound source can be extracted and these can be separated from the other sound sources, which represent an interference signal.
  • a sound source of the useful signal can be positioned in a certain direction relative to the device, wherein an acoustic alignment of the Nutzsignalerankers can be done on this sound source.
  • the sound transmitter can give the useful signal in a limited range again.
  • the useful signal is only delivered to a person who is located in this area.
  • For the person in the area creates a greater signal-to-noise ratio between the useful signal and the interference signal, without having to carry a sound or the useful signal reproducing aids, such as a hearing aid or headphones.
  • Fig. 1 is a schematic representation of an embodiment of a device with a Nutzsignaleranker and a Schallwiedergeber; a further schematic representation of an exemplary embodiment of the device 10 with a sound recorder, a signal processor and the Schallwiedergeber; 3 shows a schematic representation of a communication situation for using the device 10;
  • Fig. 4 shows an embodiment of the device 10 with a housing.
  • Fig. 1 shows a schematic representation of an embodiment of a device 10 with a Nutzsignaleranker 12 and a Schallwiedergeber 14.
  • the Nutzsignaleranker 12 is designed to extract from a sound signal 16 in an environment 18 of the device 10, a useful signal 20 and the extracted useful signal 20a of a Interference signal 22 in the sound signal 16 to separate.
  • the sound transmitter 14 is designed to reproduce the useful signal 20 in the form of a directional useful signal 20b and to superimpose it on the sound signal 16.
  • the useful signal detector 12 includes, for example, a microphone with which the sound signal 16 is converted into an electrical signal.
  • the microphone may be a directional microphone which, by suitable geometry, increases the directivity of the microphone, i. the sound signal 16 is preferably detected from a certain spatial direction, while the microphone is less sensitive to other spatial directions. Increased directivity may increase the accuracy of the direction estimate with respect to a sound source 24.
  • the device 10 may comprise a number of portable microphones which are placed, for example, in the vicinity of a sound source 24 or infected by the persons, for example, on a garment or, for example, in the hand, around the neck or the head worn.
  • the device 10 may be configured to interpret the sound recorded by a first subset of one or more of the portable microphones as primarily useful signal 20 while it is being used classifies a second disjoint set of one or more of the microphones as a jamming signal 22.
  • the useful signal detector 12 may also have a microphone array.
  • a microphone array consists of several microphones in a specific relative position to each other. With a microphone array, runtime differences of the arrival of sound 26 at the respective microphones can be utilized in order to obtain a directional selectivity.
  • a sound source 24 can be located, or the recorded sound signals 16 of the individual microphones can be suitably combined into a detected sound signal 16a, to which sound 26 from a particular direction of the device environment 18 contributes more than sound 26 from other directions.
  • space selectivity for sound 26 could also be achieved from a particular two-dimensionally-limited region of environment 18 of device 10 in a near field of the array.
  • the payload signal 20 is, for example, a signal which comprises the information which is to be output to a user 36.
  • the useful signal 20 is referred to as extracted useful signal 20a and may be an electrical signal.
  • the useful signal 20 is referred to as a directional useful signal 20b and may be an acoustic signal, which is transmitted as a pressure difference in an elastic medium such as air.
  • the information content of the useful signal 20 is largely identical for the extracted useful signal 20a and the directional useful signal 20b.
  • the sound signal 6 is composed of the useful signal 20 and the noise signal 22 together.
  • the useful signal 20 and the interference signal 22 can already be separated during the detection of the sound signal 16, e.g. by a directional microphone or by an array of microphones with a suitable, directionally selective combination of the microphone signals. Further possibilities for separating the useful signal 20 from the interference signal 22 will be explained later with reference to FIG. 2.
  • the environment 18 of the device 10 includes the space surrounding the device 10.
  • the environment 18 may be limited by the part of the surrounding space, which allows a meaningful reception of a sound signal 16.
  • the environment 18 may designate an actual space, or a virtual space, and the Environment 18 may be defined relative to device 10, eg, not taking into account actual objects in environment 18.
  • the shawth transmitter 14 may comprise a loudspeaker with a directional sound reproduction characteristic.
  • the directional sound reproduction characteristic i. the fozussierende effect of the speaker, can be achieved by a suitable geometry of the speaker or the device 10. It may be sufficient to use a single speaker. It may be useful to remove low frequencies from the signal (sound signal 16), since the directivity for high frequencies is more pronounced. It is also possible to reproduce the directional useful signal 20a through an ultrasonic speaker or a loudspeaker array. The use of a loudspeaker array, on the loudspeaker of which the extracted useful signal to be superimposed on the sound signal is output by means of beamforming or beamforming processing, is also possible.
  • a loudspeaker In the sound reproduction by means of ultrasonic loudspeakers, a loudspeaker is set up from several ultrasonic radiators. By means of such ultrasonic emitters audio sound can be emitted in a frequency range in which the audio sound itself can no longer be perceived by the human ear. Non-linear effects in the air generate audible sound at high sound pressure and the superposition of two ultrasonic waves.
  • the high frequency of the ultrasound in comparison to conventional audio signals causes the radiation of the sound to be highly spatially directed because of its small wavelength and the comparatively large transducer dimensions of the ultrasound radiator.
  • the frequency dependence of the directional characteristic of conventional loudspeaker spherical radiators at low frequencies, directional radiators at high frequency occur in an ultrasonic speaker hardly on.
  • the ultrasonic loudspeakers have a suitable frequency response (approx. 0.8-8kHz) for the application.
  • the size of the speakers must be dimensioned so that the required sound pressure level can also be achieved.
  • the radiation behavior is isophoric in the vertical plane, ie all frequencies to be transmitted are directed in phase in one direction only. If several sound elements are grouped on top of each other, the result is a coherent wavefront in the vertical, which has almost no interference, since each point in the room is sonicated by only one loudspeaker per (stereo) side.
  • the environment of the device 10 may be divided into two areas.
  • the useful signal detector 12 can be designed such that portions of the sound signal 16 from a first region 28 of the environment 18 of the device 10 contribute more to the useful signal 20 than portions of the sound signal 16 from a second region 30 of the environment 18 of the device 10.
  • this is realized for example by a directional microphone or by an array of microphones with a suitable, directionally active combination of the microphone signals.
  • the detection is directional or room-selective and the distribution of the environment 18 of the device 10 is virtual, ie represents a type of specification according to which it can be determined where a sound source 24 contributes to the sound signal 16, so that its sound output can be attributed to the useful signal 20.
  • FIG. 2 shows the device 10 by way of example several sound sources 24 0 to 24 n which contribute to the sound signal 16 and which are located in the environment 18 of the device 10, n being a natural number greater than or equal to zero, n> 0.
  • the sound sources 24 0 to 24 n can each emit a sound 26 or not send out.
  • the sound sources 24 0 to 24 n can be designed differently.
  • the sound source 24 0 to 24 n may be a person speaking or singing in the vicinity of the device 10, ie a person who contributes an active acoustic contribution.
  • FIG. 2 could depict a typical communication situation with multiple participants 24.
  • Each of the sound sources 24 0 through 24 n could also be a speaker that reproduces sound 26 that was recorded and stored at a remote location and / or at an earlier time.
  • the sound sources 24 may deliver the sound 26 directed or undirected. At least a portion of the sound 26 may be detected by the Nutzsignaleranker 12 as a sound signal 16.
  • the environment 18 in regions 28 and 30 may be determined by a specific choice of the combination of the microphone signals of a microphone array of the useful signal detector 12 or by the directional characteristic of the microphone of the same.
  • the two regions 28 and 30 can also be virtually determined or predefined, and the useful signal 20 is detected by the useful signal detector 12 from an initially undirected sound signal 16, by first determining from the sound signal 16 that sound source 24 which belongs to the sound source 16 current time to the sound signal 16.
  • the NutzsignalerLKer 12 is set so that each sound source 24 is associated with a portable microphone and turn each sound source 24 either the Area 28 or area 30, quasi as a predetermined seating order in a communication,
  • the first region 28 of the environment 18 of the device 10 there are sound sources 24 whose sound 26 is to be output as a useful signal 20.
  • sound sources 24 whose sound 26 is to be output as a useful signal 20.
  • An acoustic contribution of a person who is located in the first region 28 of the environment 18 of the device 10 can be reproduced as a useful signal 20.
  • An acoustic contribution of a person who is located in the second area 30 of the environment 18 of the device 10 is preferably not output as a useful signal 20.
  • the user 36 of the device 10 itself may be located, which would only be disturbed by the amplification of his own speech.
  • the user 36 of the device 10 is a person who can use the useful signal 20 superimposed on the sound signal 16 in order to better understand the acoustic contribution.
  • the sound transducer 14 may be configured to reproduce the useful signal 20 in a preferred reproducing direction 38, and the sound reproducer 14 may be configured to reproduce the useful signal 20 directed in the preferred reproducing direction 38.
  • the device 10 may be configured so that the preferred reproduction direction 38 is user-adjustable. By the preferred reproduction direction 38, the useful signal 20 is reproduced in a predetermined direction.
  • the sounder 14 may include one or more speakers previously described.
  • the Nutzsigna! 20 may, for example, by a speaker, which has a directional sound reproduction characteristics are met again or only speakers are activated, which have in the preferred reproduction area 38.
  • a user 36 of the device 10 can direct the preferential reproduction direction 38 in order to hear the useful signal 20 superimposed on the sound signal 16.
  • loudspeakers are installed or if an adjustable loudspeaker is used, more than one person can be supplied with additional sound energy (useful signal 20). Thus, several rere users 36, which are in the preferred reproduction direction 38, are reproduced a directional useful signal 20.
  • the preferred reproduction direction may point into the second region 30 of the environment 18 of the device 10.
  • the first region 28 of the environment 18 of the device 10 and the second region 30 of the environment 18 of the device 10 may be disjoint solid angle regions, i. the two regions 28, 30 of the environment 18 of the device 10 are separated from each other and do not overlap.
  • the second region 30 of the surroundings 18 of the device 10 can be arranged where the preferred reproduction direction 38 points, and the first region 30 can be arranged beyond the preferred reproduction direction 38.
  • an acoustic contribution which the user 36 who is located in the second area 30 of the environment 18 of the device 10, is not output to the user 36. This prevents the user 36 from being irritated by hearing his own voice.
  • the apparatus 10 may include a plurality of preferred reproduction directions 38 in embodiments. This is indicated by the three arrows in FIG.
  • the useful signal detector 12 can be designed to extract a respective useful signal 20 from the sound signal 16 from the environment 18 of the device 10 for each preferred reproducing direction 38 and to separate it from a respective interference signal 22 in the sound signal 16.
  • the sound transmitter 14 can be designed to reproduce the respective extracted useful signal 20 directed into the respective preferred reproduction direction 38 for each preferred reproduction direction 38.
  • the device I O can thus be used by several users 36 at the same time. Where, for example, all users 36 hear all the acoustic contributions, except their own.
  • the useful signal detector 12 may have the following features: a sound detector 32 configured to detect the sound signal 16 in the environment 18 of the device 10, and a signal processor 34 configured to generate the useful signal 20 from the detected sound signal 16a to extract and from the interfering signal 22 in the sound signal 16 to separate.
  • the sound detector 32 may comprise a microphone array or a plurality of portable microphones as previously described for the useful signal detector 12. Further embodiments, such as, for example, directional microphones, desktop microphones or portable microphones, can be used both for the useful signal detector 12 and for the sound detector 32.
  • the sound signal 16 is an acoustic signal which is transmitted by small pressure differences in an elastic medium such as air.
  • the detected sound signal 16a may be an electrical signal.
  • the information content of the sound signal 16 and the detected sound signal 16a is largely identical.
  • the signal processor 34 can separate the useful signal 20 from the interference signal 22 by means of an analog or digital filter.
  • the filter may be a high-low or band-pass filter constructed with an operational amplifier and a capacitance or inductance.
  • the signal processor 34 can also have a computer or a processor on which a program code performs a separation of the useful signal 20 from the interference signal 22.
  • the signal processor 34 may be designed to detect certain frequencies or specific frequency patterns of the sound signal 16 and to assign the useful signal 20 or the interference signal 22.
  • the signal processor 34 can also be designed to allow special possibilities for individualization of the sound.
  • the device 10 can be replaced by a suitable fitting method, e.g. be adjusted to the individual hearing loss of the user 36 in order to optimize the useful signal 10 on the speech intelligibility for the user 36.
  • the signal processor 34 may be configured to determine location information of a sound source 24 contributing to the sound signal 16 and to use the location information to extract the useful signal 20 from the sound signal 16 and to separate it from the noise signal 22.
  • the location information can be obtained, for example, from the signal processor 34 by different signal levels and / or signal propagation times when using a plurality of microphones. In particular, through the use of directional microphones or a microphone array, a location information for a sound source 24 can be determined.
  • the signal processor 34 may be configured to determine based on the location information whether a sound source 24 contributing to the sound signal 16 lies in the first region 28 of the environment 18 of the device 10 or in the second region 30 of the environment 18 of the device 10.
  • the sound 26 of the sound source 24 can be added to the useful signal 20 and if the sound source 24 is in the second region 30, sound 26 of the sound source 24 can not be added to the useful signal 20.
  • the sound sources 24 in the first or second regions 28, 30 of the environment 18 of the device 10 it can be determined, for example, whether the sound 26 is a useful signal 20 or an interference signal 22. Among other things, it can be prevented that the user 36 hears himself speak and is thereby irritated.
  • the signal processor 34 may be configured to detect features of people's voices. In this case, for example, with a computer program a voice can be analyzed and assigned to a person. For example, an algorithm for feature extraction may recognize features of the user's voice 36 to better distinguish it from other conversation participants. By assigning the voice to a person, this person can be assigned to the first or second area 28, 30 of the environment 18 of the device 10. Thus, the device 10 can more precisely extract the useful signal 20a from a detected sound signal 16a, since it is known which sound source 24 contributes which sound 26 to the detected sound signal 16.
  • the signal processor 34 may also be designed to amplify or attenuate at least one frequency range from the useful signal.
  • the detected sound signal 16a is composed of several frequencies. In this case, individual frequency ranges can be classified as useful signal 20 or as interference signal 22. If the frequency range is classified as a useful signal 20, it is amplified by the signal processor 34. If a frequency range is classified as noise 22, it is attenuated.
  • the device 10 may be formed in embodiments in order to preserve a psychoacoustic localization capability for the sound signal 16.
  • the psychoacoustic localization ability describes the possibility of determining from which direction a sound 26 comes or where a sound source 24 lies.
  • the law of the first wavefront which states that two similar signals appear come different directions (eg direct sound and useful signal 20) are located from the direction of incidence, from which the first wavefront arrives.
  • the delay of the second signal (useful signal 20) must not exceed a certain threshold (echo threshold, approximately 50 ms), since in such a case the user perceives two individual signals (eg direct sound and echo).
  • the device should be designed to reproduce the useful signal 20 at the sound transmitter 14 with a delay relative to the sound signal 16, which is less than 50 ms.
  • the device 10 may be designed to output the useful signal 20 at a level that depends on a level of the interference signal 22.
  • An acoustic signal is characterized by the frequency and a signal level.
  • the signal level of an acoustic signal is referred to in the acoustics as volume.
  • the directional useful signal 20a has a higher level than the interference signal 22 at all times.
  • the level of the directional signal is Useful signal 20a depending on the level of the interfering signal 22 or the useful signal 20 is output.
  • the level of the directional useful signal 20a can also be increased and the level of the directional useful signal 20a can be reduced when the level of the interference signal 22 is reduced.
  • the device 10 may be configured to display a first region 28 of the environment 18 of the device 10 and a second region 30 of the environment 18 of the device 10 and / or a preferred reproduction direction 38.
  • the display can be done for example by printing on a housing of the device 10.
  • the device 10 may be designed to indicate from which direction a useful signal 20 or an interference signal 22 is detected or where the preferred reproduction direction 38 lies.
  • Previously mentioned signals 20, 22, regions 28, 30 or 38 directions may also be, for example, by light, preferably with LED's are displayed.
  • the device 10 may indicate by different colors of light where the first and second regions 28, 30 of the environment 18 of the device 10 are located.
  • the first area 28 can be indicated by a green LED or an LED band, and the second area 30 by one or more red LED 's .
  • the display can also be made mechanically, for example in the pointer-specific areas 28, 30 or directions 38 displayed or demarcated relative to the device 10. Further, a display may display the aforementioned signals 20, 22, areas 28, 30 or directions 38.
  • 3 shows a schematic representation of a communication situation for using the device 10. The exemplary situation shows how an embodiment of the device 10 can improve the communication situations.
  • the device 10 is, for example. As a portable device in the middle of the table.
  • the user 36 has set the device 10 so that the useful signal 20b is focused as additional sound on his seat.
  • the directional useful signal 20b reaches as additional presented sound 26 only the user 36th
  • the direction of the current speaker can be estimated (arrow). If the direction outside the second region 30 of the environment 18 of the device I 0 (ie outside the sound range of the user 36), the sound 26 is amplified, since it can be assumed that someone else speaks at the table. If the direction estimate in the first region 28 of the environment 18 of the device I 0, ie in a sound range of the user 36, the sound 26 is not amplified, since it can be assumed that the user 36 speaks himself and are irritated by the perception of his own voice would.
  • the amplified sound 26 is perceived by the directed sound reproduction (focusing) only for the user 36, the other persons (participants in the conversation) do not perceive the directional useful signal 20b (the sound) and are thus not disturbed.
  • the desired additional volume of the directional useful signal 20 b (sound signal) can be set by the user 36. In this case, the volume of the directional useful signal 20b can be adjusted so that it is constantly above the interfering signal 22 (background noise) and is thus clearly perceptible. Silent voices are amplified more than loud voices.
  • the user 36 can locate the speaker (sound source 24) without the additional sound of the directional useful signal 20b interfering. It is exploited that the human exploits the first wavefront for the localization of sound sources 24 (Haas effect, precedence effect) and additional sound energy can be added from another direction without influencing the direction perception.
  • an algorithm may be necessary which analyzes the situation accordingly and processes the payload signal 20 (the signals). The algorithm includes:
  • the recorded sound signal 16 is presented via the loudspeaker of the sound transmitter 14, since it is assumed that this is another interviewee.
  • a noise reduction is performed, so that the signal presented (useful signal 20) as possible only contains the desired speech components.
  • the volume of the directional payload signal 20b may be adjusted to be at the desired level above the background noise interfering signal 22 set by the user 36.
  • the user 36 Only the user 36 hears the amplified signals (the payload signal 20) of the other call participants (sound sources 24) and these are not disturbed by the device 10 in the situation.
  • the user 36 does not hear his own voice over the device because his position is detected and no signal (sound signal 16, useful signal 20) is amplified when he speaks himself.
  • a previously described communication situation may include a plurality of persons who are participants in the communication situation.
  • the participants of the communication situation can be active participants who actively make an acoustic contribution to the communication situation and thus represent a sound source 24, or the participants can be passive participants in the communication situation be soft hear the acoustic contributions.
  • Acoustic contributions may be, for example, speech or singing.
  • the participants can also be both active and passive participants, ie the participants make both an acoustic contribution and listen, with a time delay or simultaneously, an acoustic contribution by another participant.
  • Fig. 4 shows an embodiment of the device 10 with a housing.
  • the portable device 10 can be placed in the middle of a table 40 in such a way that the directional useful signal 20 b (sound beam) is aligned with the user 36.
  • the device 10 receives the sound signal 16 of all the participants sitting at the table 40 (sound sources 24) via several microphones and amplifies the respective voice as a useful signal 20 to the volume selected by the user 36.
  • the microphones capture the current speaker and the integrated algorithms filter the interference signal 22 (noise) of the environment 18 from the sound signal 16 (signal) out.
  • the volume of the useful signal 20 (the additional sound energy) can adaptively adapt to the environment 18, so that the user 26 always perceives a constant additional, but not too loud, sound presentation of the conversations at the table.
  • an algorithm for feature extraction recognizes features of the user 36's voice to better distinguish it from other participants in the conversation.
  • Embodiments of the device 10 have the advantage that the user 36 does not have to wear a device directly on the body, neither hearing aid nor a headset or a headset. Furthermore, other users (conversation participants) are not disturbed by the directional useful signal 20b (focused sound presentation).
  • Embodiments of the device 10 have the advantage over a hearing aid that the device 10 is only used when it is really needed. Further, the device 10 can be easily operated with a controller. There is no stigma taking place with correspondingly appealing design. Raceman can easily try out how the device 10 has a positive effect on the communication situation. Furthermore, the directional hearing is retained due to the law of the first wave fronts. Listening is comfortable without wearing a device in the ear. The large distance of the microphones and the better positioning of the device (small distance to the sound source 24) in the discussion circle provides a better signal-to-noise ratio for the useful signal 20 as your own ear receives.
  • the device 10 is also suitable for use in front of the television, in which the device 10 (device) is placed, for example.
  • the device 10 is also suitable for normal hearing in many situations.
  • An advantage of the device 10 is the improvement of the speech understanding of a user 36 in acoustically difficult spatial situations in a comfortable manner (no device in the ear), combined with the important effect that the other participants (conversation participants) are not disturbed (directional useful signal 20b, fo kussêt sound presentation), It is a significant advantage over the hearing aid, that you can try the device 10 (device) simply because no earmold is necessary.
  • the user 36 sets himself the proportion of the directional useful signal 20b (additional signal) as desired. Since the direct sound reaches the ear unhindered, the ability to localize the speaker (the sound source 24) remains (precedence effect).
  • Embodiments of the device 10 have the advantage over the use of simple microphones in the vicinity of the payload speaker (eg table microphone on the table in front of the speakers, clip-on microphones on the collar) that the microphones indeed improve the signal-to-noise ratio to the other (disturbing) speakers
  • the microphones indeed improve the signal-to-noise ratio to the other (disturbing) speakers
  • one does not have an acoustic orientation and can only recognize from the mouth movements and the sound of the voice which speaker is currently speaking. This additional task requires a very high concentration and should be avoided.
  • a device 10 (mobile device) using the described embodiments can be transported in a handbag and supports people with a hearing loss in communication, especially with many participants. With this technique, multiple devices 10 (devices) can be used on a table at the same time. At home, the device may e.g. placed on a charging station and, for example, a battery to be charged.
  • Embodiments of the device 10 may additionally include a user interface to set, for example, the desired additional volume on the device 10 (device).
  • the signal processing of the signal processor 34 adapts adaptively to the environment (interference signal 22), so that the user 36 always perceives a constant additional, but not too loud, sound presentation of the useful signal 20.
  • the sound transducer 14 is not fixed in the device 10, but can be individually aligned in the room.
  • the device 10 (system) is aligned with one or more users 36 and does not provide a particular space with the payload signal 20.
  • the exemplary embodiments include devices 10 (devices) which, in addition to the direct sound, present a conditioned signal (useful signal 20) to a specific user 36 without disturbing other conversation participants.
  • the sound presentation is achieved by directional loudspeakers (Schallwiedergeber 14), so that no device must be worn directly on or in the ear (hearing aid, headphones, etc.).
  • the use of the embodiments is intended for situations where the speech is quiet or does not stand out clearly from the background noise. Examples are pub visits with friends, big Christmas dinner with the whole family, big coffee party.
  • the device 10 comprises a plate detector 32 (also called a signal recording unit) a signal processor 34 (also called signal processing unit)) and a sound transducer 14 (also called signal reproduction unit) and is characterized in particular by the fact that in addition to the existing sound in the room , which includes both the useful signal 20 (also called useful sound) and the interference signal 22 (also known as interference sound), a directional useful signal 20b (also called conditioned signal) which is presented via a sound transducer 14 (also called focussing speaker) the audibility of the useful signal 20 or in communication situations to improve the speech signal of the relevant speaker.
  • a plate detector 32 also called a signal recording unit
  • a signal processor 34 also called signal processing unit
  • a sound transducer 14 also called signal reproduction unit
  • one or more ultrasonic speakers are used for sound reproduction.
  • the sound reproduction takes place via a loudspeaker array.
  • the sound reproduction is distributed over WFS (loudspeaker array permanently installed (eg wall) or as a portable array for example for mobile use).
  • WFS wirelessspeaker array permanently installed (eg wall) or as a portable array for example for mobile use.
  • the use of multiple microphones provides the opportunity to use a directivity to one or more positions.
  • the use of a plurality of microphones and corresponding signal processing algorithms automatically aligns the sound detector 32 (signal recording unit) with the relevant call partner (directional microphone, beamforming).
  • the sound detector 32 (signal receiving unit) is positioned closer to the mouth.
  • the microphones may be cordless or corded connected to the device 10 (device).
  • the device 10 recognizes when the user 36 speaks for himself and presents in this situation no additional useful signal 20 (useful sound).
  • the device 10 obtains the psychoacoustic localization capability by suitable signal processing. At the same time, the precedence effect / Haas effect is retained.
  • the device 10 offers the possibility of presenting the useful signal 20 at a constant level above the interference signal 22 (ambient noise).
  • the device 10 offers the possibility of presenting only a limited frequency range of the useful signal 20.
  • the device 10 allows for special possibilities for individualizing the sound.
  • the device 10 (device) is replaced by a suitable fitting method, e.g. adjusted to individual hearing loss to optimize speech intelligibility.
  • no microphone is used for sound detection (signal recording) but the audio signal is transmitted directly to the device 10 (wireless or wired).
  • the additionally required strength of the support is automatically adapted to the environment 18 (-> online determination of speech intelligibility and automated control of the support).
  • the direction of the currently recognized as payload speaker on a display can be continuously displayed on a display.
  • the device 10 is portable and can be powered by an integrated power supply.
  • the device 10 is extended to more than one user 36 (person) (multiple signal processors 34, same sounder 32 (microphone) / sounder 14 (speakers) and other hardware).
  • aspects have been described in the context of a device, it will be understood that these aspects also constitute a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step , Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block or detail or feature of a corresponding device.
  • Some or all of the method steps may be performed by a hardware device (or using a hardware device). Apparatus), such as a microprocessor, a programmable computer or an electronic circuit. In some embodiments, some or more of the most important method steps may be performed by such an apparatus.
  • embodiments of the invention may be implemented in hardware or in software.
  • the implementation may be performed using a digital storage medium, such as a floppy disk, a DVD, a Blu-ray Disc, a CD, a ROM, a PROM, an EPROM, an EEPROM or FLASH memory, a hard disk, or other magnetic disk or optical memory which stores electronically readable control signals which are compatible with a programmable computer system. act together or work together that the respective process is carried out. Therefore, the digital storage medium can be computer readable.
  • some embodiments according to the invention include a data carrier having electronically readable control signals capable of interacting with a programmable computer system such that one of the methods described herein is performed.
  • embodiments of the present invention may be implemented as a computer program product having a program code, wherein the program code is operable to perform one of the methods when the computer program product runs on a computer.
  • the program code can also be stored, for example, on a machine-readable carrier.
  • an embodiment of the method according to the invention is thus a computer program which has a program code for performing one of the methods described herein when the computer program runs on a computer.
  • a further embodiment of the method according to the invention is thus a data medium (or a digital storage medium or a computer-readable medium) on which the computer program is recorded for performing one of the methods described herein.
  • a further exemplary embodiment of the method according to the invention is thus a data stream or a sequence of signals which represents or represents the computer program for performing one of the methods described herein.
  • the data stream or the sequence of signals may be configured, for example, to be transferred via a data communication connection, for example via the Internet.
  • Another embodiment includes a processing device, such as a computer or a programmable logic device, that is configured or adapted to perform one of the methods described herein.
  • Another embodiment includes a computer on which the computer program is installed to perform one of the methods described herein.
  • Another embodiment according to the invention comprises a device or system adapted to transmit a computer program for performing at least one of the methods described herein to a receiver.
  • the transmission can be done for example electronically or optically.
  • the receiver may be, for example, a computer, a mobile device, a storage device or a similar device.
  • the device or system may include a file server for transmitting the computer program to the recipient.
  • a programmable logic device eg, a field programmable gate array, an FPGA
  • a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein.
  • the methods are performed by any hardware device. This may be a universal hardware such as a computer processor (CPU) or hardware specific to the process, such as an ASIC.

Landscapes

  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

L'invention concerne un dispositif (10) comprenant un détecteur de signal utile (12) et un reproducteur acoustique (14). Le détecteur de signal utile (12) est conçu pour extraire un signal utile (20a) d'un signal acoustique (16) dans un environnement (18) du dispositif (10) et pour le séparer d'un signal parasite (22) dans le signal acoustique (16). L'appareil de reproduction acoustique (14) est conçu pour reproduire le signal utile (20b) de façon dirigée et le superposer au signal acoustique (16).
PCT/EP2014/069635 2013-09-27 2014-09-15 Dispositif et procédé de superposition d'un signal acoustique WO2015044000A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013219636.9 2013-09-27
DE201310219636 DE102013219636A1 (de) 2013-09-27 2013-09-27 Vorrichtung und verfahren zur überlagerung eines schallsignals

Publications (1)

Publication Number Publication Date
WO2015044000A1 true WO2015044000A1 (fr) 2015-04-02

Family

ID=51564646

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/069635 WO2015044000A1 (fr) 2013-09-27 2014-09-15 Dispositif et procédé de superposition d'un signal acoustique

Country Status (2)

Country Link
DE (1) DE102013219636A1 (fr)
WO (1) WO2015044000A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110096963A (zh) * 2019-04-08 2019-08-06 清华大学深圳研究生院 一种有用信号提取电路、方法及装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3901740A1 (fr) * 2018-10-15 2021-10-27 Orcam Technologies Ltd. Systèmes et procédés d'aide auditive

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1413168A2 (fr) * 2001-07-20 2004-04-28 Koninklijke Philips Electronics N.V. Systeme amplificateur de son equipe d'un dispositif de suppression d'echo et d'un dispositif de formation de faisceaux de haut-parleurs
US20040208324A1 (en) * 2003-04-15 2004-10-21 Cheung Kwok Wai Method and apparatus for localized delivery of audio sound for enhanced privacy
EP2059064A1 (fr) * 2006-08-01 2009-05-13 Yamaha Corporation Systeme de conference vocale
US20100177178A1 (en) * 2009-01-14 2010-07-15 Alan Alexander Burns Participant audio enhancement system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2702918B1 (fr) * 1993-03-19 1995-05-12 Prescom Sarl Appareil de prise et de restitution de son, et son application à l'audio-conférence.
US6535609B1 (en) * 1997-06-03 2003-03-18 Lear Automotive Dearborn, Inc. Cabin communication system
WO2000019770A1 (fr) * 1998-09-29 2000-04-06 Siemens Audiologische Technik Gmbh Prothese auditive et procede de traitement de signaux de microphone dans une prothese auditive
DE602007007581D1 (de) * 2007-04-17 2010-08-19 Harman Becker Automotive Sys Akustische Lokalisierung eines Sprechers
US8965546B2 (en) * 2010-07-26 2015-02-24 Qualcomm Incorporated Systems, methods, and apparatus for enhanced acoustic imaging

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1413168A2 (fr) * 2001-07-20 2004-04-28 Koninklijke Philips Electronics N.V. Systeme amplificateur de son equipe d'un dispositif de suppression d'echo et d'un dispositif de formation de faisceaux de haut-parleurs
US20040208324A1 (en) * 2003-04-15 2004-10-21 Cheung Kwok Wai Method and apparatus for localized delivery of audio sound for enhanced privacy
EP2059064A1 (fr) * 2006-08-01 2009-05-13 Yamaha Corporation Systeme de conference vocale
US20100177178A1 (en) * 2009-01-14 2010-07-15 Alan Alexander Burns Participant audio enhancement system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110096963A (zh) * 2019-04-08 2019-08-06 清华大学深圳研究生院 一种有用信号提取电路、方法及装置
CN110096963B (zh) * 2019-04-08 2021-06-22 清华大学深圳研究生院 一种有用信号提取电路、方法及装置

Also Published As

Publication number Publication date
DE102013219636A1 (de) 2015-04-02

Similar Documents

Publication Publication Date Title
RU2647213C2 (ru) Направленное маскирование звука
Arweiler et al. The influence of spectral characteristics of early reflections on speech intelligibility
JP6964608B2 (ja) メディア補償されたパススルーおよびモード切り換え
EP3451705A1 (fr) Procédé et dispositif de reconnaissance rapide de voix propre
US20170374478A1 (en) Method and a hearing device for improved separability of target sounds
DE102014214052A1 (de) Virtuelle Verdeckungsmethoden
CN109218948B (zh) 助听***、***信号处理单元及用于产生增强的电音频信号的方法
CN107465984A (zh) 用于操作双耳听觉***的方法
Wolfe et al. Evaluation of a remote microphone system with tri-microphone beamformer
WO2015044000A1 (fr) Dispositif et procédé de superposition d'un signal acoustique
DE102019001966B4 (de) Vorrichtung, System und Verfahren zur Audiosignalverarbeitung
US20220191627A1 (en) Systems and methods for frequency-specific localization and speech comprehension enhancement
DE102019107173A1 (de) Verfahren und Vorrichtung zum Erzeugen und Ausgeben eines Audiosignals zum Erweitern des Höreindrucks bei Live-Veranstaltungen
EP3148217B1 (fr) Procédé de fonctionnement d'un système auditif binauriculaire
DE102017126432A1 (de) Hörer
DE19926552B4 (de) Kopfhörer mit Mikrofon
DE102020212964A1 (de) Verfahren zur Übertragung von Informationen bezüglich eines Hörgerätes an ein externes Gerät
Wühle et al. Evaluation of the frequency dependent influence of direct sound on the effect of sound projection
DE112019005697T5 (de) Verfahren zur Bereitstellung von Dienstleistungen unter Verwendung eines Ohrbügels
Korhonen et al. Low processing delay preserves natural cues and improves spatial perception in hearing aids
DE102023200412B3 (de) Verfahren zum Betrieb eines Hörgeräts
DE102022201706B3 (de) Verfahren zum Betrieb eines binauralen Hörvorrichtungssystems und binaurales Hörvorrichtungssystem
DE102023116204A1 (de) Verfahren und System zur akkustischen Durchleitung
EP0723381B2 (fr) Dispositif d'assistance auditive
DE102019106187A1 (de) Vorrichtung zur selektiven Geräuschunterdrückung

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14766702

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14766702

Country of ref document: EP

Kind code of ref document: A1