EP3679729A1 - Mehrzweck-hochleistungshörgerät mit einem mobilen endgerät, insbesondere smartphone - Google Patents
Mehrzweck-hochleistungshörgerät mit einem mobilen endgerät, insbesondere smartphoneInfo
- Publication number
- EP3679729A1 EP3679729A1 EP18769105.0A EP18769105A EP3679729A1 EP 3679729 A1 EP3679729 A1 EP 3679729A1 EP 18769105 A EP18769105 A EP 18769105A EP 3679729 A1 EP3679729 A1 EP 3679729A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- hearing
- hearing aid
- sound
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 claims abstract description 79
- 210000000613 ear canal Anatomy 0.000 claims abstract description 36
- 230000005236 sound signal Effects 0.000 claims abstract description 22
- 210000000883 ear external Anatomy 0.000 claims description 3
- 230000001225 therapeutic effect Effects 0.000 claims description 2
- 230000009467 reduction Effects 0.000 abstract description 9
- 230000007547 defect Effects 0.000 abstract description 3
- 208000032041 Hearing impaired Diseases 0.000 description 23
- 208000016354 hearing loss disease Diseases 0.000 description 16
- 206010011878 Deafness Diseases 0.000 description 15
- 230000010370 hearing loss Effects 0.000 description 15
- 231100000888 hearing loss Toxicity 0.000 description 15
- 230000008447 perception Effects 0.000 description 15
- 238000006243 chemical reaction Methods 0.000 description 10
- 238000013461 design Methods 0.000 description 10
- 210000005069 ears Anatomy 0.000 description 10
- 230000006978 adaptation Effects 0.000 description 8
- 210000004556 brain Anatomy 0.000 description 8
- HJVCHYDYCYBBQX-HLTLHRPFSA-N (2s,3s,4e,6e,8s,9s)-3-amino-9-methoxy-2,6,8-trimethyl-10-phenyldeca-4,6-dienoic acid Chemical compound OC(=O)[C@@H](C)[C@@H](N)/C=C/C(/C)=C/[C@H](C)[C@@H](OC)CC1=CC=CC=C1 HJVCHYDYCYBBQX-HLTLHRPFSA-N 0.000 description 6
- 230000003321 amplification Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 6
- 238000003199 nucleic acid amplification method Methods 0.000 description 6
- PBLZLIFKVPJDCO-UHFFFAOYSA-N omega-Aminododecanoic acid Natural products NCCCCCCCCCCCC(O)=O PBLZLIFKVPJDCO-UHFFFAOYSA-N 0.000 description 6
- 238000001228 spectrum Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 238000012076 audiometry Methods 0.000 description 4
- ZYXYTGQFPZEUFX-UHFFFAOYSA-N benzpyrimoxan Chemical compound O1C(OCCC1)C=1C(=NC=NC=1)OCC1=CC=C(C=C1)C(F)(F)F ZYXYTGQFPZEUFX-UHFFFAOYSA-N 0.000 description 4
- 230000003203 everyday effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006735 deficit Effects 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 238000002560 therapeutic procedure Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 210000003608 fece Anatomy 0.000 description 2
- 230000004886 head movement Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 210000003454 tympanic membrane Anatomy 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000282412 Homo Species 0.000 description 1
- 241001585676 Orthonama obstipata Species 0.000 description 1
- 229910000577 Silicon-germanium Inorganic materials 0.000 description 1
- 238000005299 abrasion Methods 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000005576 amination reaction Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000003776 cleavage reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 229920001971 elastomer Polymers 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000003455 independent Effects 0.000 description 1
- 238000009413 insulation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 210000003734 kidney Anatomy 0.000 description 1
- 239000004816 latex Substances 0.000 description 1
- 229920000126 latex Polymers 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000007830 nerve conduction Effects 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000007017 scission Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
- 238000009736 wetting Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/558—Remote control, e.g. of amplification, frequency
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/04—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception comprising pocket amplifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/556—External connectors, e.g. plugs or modules
Definitions
- the invention relates to a high performance hearing aid.
- a high performance hearing aid In addition to its main function as a therapeutic hearing aid for persons with limited hearing, it offers additional functions for other listening situations, in particular telephoning.
- a particular difficulty of hearing aids is that they are operated in sometimes considerably different acoustic environment conditions (listening situations).
- Such auditory situations include, for example, a (personal) conversation, a mass environment with many other people, a telephone call, listening to music in the private sector but also, for example, a concert visit with public music playback. All these situations have different Anforde ⁇ requirements. Fulfilling these is a challenge.
- the hearing aid is to be designed based on a smartphone (DE 20 2011 105 898 U1).
- a special program on the smartphone recreates the functionality of the hearing aid.
- the smartphone is combined with a special earphone, which also includes a microphone.
- a Schallbearbei ⁇ tion in particular to achieve a pulse limit and noise suppression, and further echo avoidance.
- this groove ⁇ wetting of the MP3 player is both beneficial as Res ⁇ resources be saved, but then also functionally be ⁇ fronting.
- MP3 players are intended for a compressed artificial signal; this objective bites with the aim of enabling listening to music at the highest possible level. This applies not only to the high level of listening to music, but at the other end also for the more down to earth level in the field of telephony itself.
- MP3 players are not designed.
- a certain latency problem in this case acts, since the La ⁇ tenzzeit is meaningless in itself in the music playback, when using (as a hearing aid be it for calls or to Telephony) but not. It is a typical compromise device, which does not satisfy especially because of the unresolved latency problem.
- the invention is based on the object starting from the last-mentioned prior art to provide an improved hearing aid ⁇ system, which increases the user-friendliness at the same or better functionality.
- a hearing aid system comprising a to be arranged at the ear of a user hearing unit and a remote cookedsein ⁇ integrated, wherein the remote processing unit is implemented as a mobi ⁇ les terminal, in particular smart phone, wherein a signal connection is provided, via which communicate with the hearing unit and the processing unit and the Ver ⁇ processing unit comprises a signal processing path for external sound signals to an amplifier with a
- Basic signal for the signal processing path is formed wel ⁇ ches corresponds to the incoming sound
- the hearing unit comprises an open earphone and a microphone
- the processing unit has a com ⁇ pensationspfad comprising a compensator and a splitter, wherein the compensator is designed to be from an applied fundamental signal based on an adjustable frequency band profile of the user compensation be ⁇ votes, in such a way that the compensation signals are a Emphase of the basic signal, and the splitter is thoroughlybil ⁇ det to split off the basic signal, so that an the OH ⁇ purity Transmitted output signal consists only or at least mainly from the compensation signal, the Compensation signals in the ear canal are synchronously superimposed on the external sound signal.
- the basic concept of the use of a smartphone for a hearing aid system is decisively improved in that the other hand resulting by signal propagation time on the one hand and processing time latency mi ⁇ is nimiert total, and that the compensation signal is added to the naturally carried out there external sound signal in the ear canal, so that the user hears the sum of the two.
- the invention has recognized that it is precisely this aspect which is the critical factor that hitherto stood in the way of a proliferation of smartphone-based hearing device systems.
- the core idea of the invention is to achieve a considerable Re ⁇ production of the required signal processing effort with the present invention designed Kompensationska ⁇ nal.
- a compensation signal is determined as Em ⁇ phase to the basic signal, and from a splitter, the basic signal is split off itself, a significant reduction of the data to be handled for further processing amount of data is achieved.
- the complex signal processing is not - as is usual - on the total signal angewen ⁇ det, but only on a subset of them (namely, the "rest" - portion remaining after cleavage of the fundamental signal), the data to be processed quantity is thus significantly reduced. This allows for significantly faster signal processing, so that the latency is significantly reduced.
- the compensation signal OF INVENTION ⁇ dung as produced is therefore comparatively ⁇ as quickly ready and can thus easily the
- Basic signal are mixed.
- the invention has recognized that this is particularly expedient for the use of a of ⁇ fenen headphones, in which the basic signal per se can pass through the ear canal and thus only the (according to erfindungsge ⁇ moderately generated with low latency) compensation signal hin- is added. According to the invention, this takes place quasi-synchronously, ie without a delay perceptible to the user (ie a latency below the perception threshold).
- the invention is thus based on the idea that in operation the base signal in the signal processing is not fully mitzu- process, but instead cleave in the compensation path, so as to process only a data-reduced Kompensationssig ⁇ nal.
- This allows a significantly faster processing and transfer rate back to the earphone, resulting in a practically relevant reduction in latency.
- a signal overlay at the ear with the (there anyway anyway) basic signal is thus problem-free.
- a) that the ear sends out a wave during the hearing b) that, as with all people, even in patients with residual hearing in the brain, object-related hearing experiences (so-called auditory representations) such.
- auditory representations As the sound of an instrument, the noise of a drill, the voice sound of family members, etc. are stored.
- a possible klangge ⁇ faithful recording is necessary as it provides the architecture of the ear, as well as a wide range of frequencies in order to edit the frequency range of human hearing. This is particularly useful when using open headphones. Because while further fitting in the ear canal natural external audio signal is routed to the drum fell ⁇ and it will only get the compensation signal according to the invention produced with low latencystandge ⁇ adds from the earphones. The processing of the fundamental signal and its transmission and delivery via the earphone is not only ver ⁇ avoided, but also, thanks to the elimination in the compensation path even a significantly faster signal processing thanks to data reduction. As a result, an effective prevention of unwanted sound abrasions is achieved.
- the natural architecture of the auricle is ge ⁇ uses for the position of microphone and speaker per ear so that the recording (microphone) takes place in the sound collection point of the auricle and the Playback (speakers) in the open ear canal.
- Microphone and speakers are preferably connected to a unit that carries the hearing impaired in each ear.
- the invention can be implemented with a commercially available per se as a processing unit and a smartphone Hörein ⁇ integrated, wherein the invention is implemented as a formality functiona ⁇ app on the smartphone. Since a large part of the population today already has a smartphone, the invention can be realized with a minimum of effort.
- the use of the smartphone also gives the user a familiar user interface, which is favorable for acceptance by the user himself. Because of the ubiquity of the smartphone, the acceptance by people is also high, so that the traditional stigma of hearing aid user effectively ver ⁇ avoided is.
- wel ⁇ ches corresponds to the sound arriving at the ear.
- the term describes, on the one hand, the acoustic signal itself, which is conducted from the external ear via the auditory canal [external auditory meatus] to the eardrum.
- the term also includes the corresponding electrical signal which is picked up by the microphone of the hearing unit which is acted upon by the acoustic signal and transmitted to the processing unit.
- a compensation signal is understood to be the signal which was determined by the (digital) signal processing of the processing unit in the compensation path as an additional signal for correcting the pathologically caused, distorted frequency response of the user.
- a mobile terminal is typically a smartphone or a tablet computer.
- the emphasis is a term of art in the field of processing and Signalverarbei ⁇ referred automatic increase (possibly also Absen ⁇ effect) of a signal in certain frequency ranges.
- the emphasis is chosen so that a (as far as possible) compensation of Hörde Stamms of the user he ⁇ reaches.
- ear peripheral sound recording
- nerve conduction electrical energy
- brain processing in the brain
- the diagram shows an ideal type of hearing loss compensation using one or more Equali ⁇ zer.
- the vertical represents the dynamics (volume), the horizontal represents the frequencies.
- Each sound signal consists of a frequency band in which the individual frequencies have different volumes.
- the audible range of the human ear is approximately 16 Hz to 16,000 Hz.
- the compensation equalizer takes over the amplification (emphasis) of certain frequencies in the new high-performance hearing aid in accordance with the audiometry curve of the hearing impaired, in order to compensate for the hearing loss (to compensate to sift); it is programmed in accordance with the by audiometry ermit ⁇ telten hearing loss per ear.
- EQ 2 adaptation equalizer
- a panoramic potentiometer compensates for the difference in volume perception between the left and right ear of the hearing impaired.
- the high-performance hearing aid offers Adjustment derarti ⁇ ge complex listening situations best options: apart from the three processing steps (EQ 1, EQ 2, Panorama) per ear, the user now has even the possibility of using the Adaptionsequa ⁇ targeted lizers (EQ 2) the frequency ranges the consonant ⁇ annul, to enhance the figure-ground perception.
- the signal path expediently comprises a mode selector for selecting between a hearing aid mode and an additional telephone mode, in which a voice signal output by a telephone module of the processing unit is applied as an input signal to the compensation path.
- the hearing aid can also be used directly for use with a mobile phone module, as is often provided in the processing unit anyway.
- the processing unit is a smart phone:
- the incoming speech signal can be fed directly into the processing unit during a call, so that a detection via a microphone is not necessary. Microphone related noise or signal propagation delay due to the use of the microphone is avoided in this way. This results in a considerable improvement of the voice quality for the user.
- a switch is provided for this purpose, which switches the input signal in a telephone mode, namely from a microphone on the ear unit to a voice signal emitted by the telephone module.
- the mode selector may switch to a play mode, to a player of the processing unit. This is preferably an integrated MP3 player and / or streaming client.
- the invention can thus use directly in the processing unit arranged signal sources, such as the telephone module or the Ab ⁇ game device, and use their output signal directly to the input of the signal path for further processing for the corresponding compensation of hearing deficiencies of the user.
- the user not only in the hearing aid mode, but also in phone mode and playback mode is one adapted to the hearing loss of the user ⁇ playback.
- the user Independent of the mode, the user thus receives a (for him) constant high signal quality across the different modes ("seamless integration" of the different modes).
- automatic switching between the modes is furthermore provided. It is particularly useful when the switch cooperates with a switch, wherein the switch is designed to bypass the inventively provided splitter in the phone mode and / or play mode.
- the splitting of the basic signal void - so but also eliminates the runtime improvement achieved by the Abspal ⁇ th.
- the term of improvement is not he ⁇ conducive for use as a player, since this did not depend on a Echtzeitfä ⁇ ability.
- the switch also acts as a switch for the latency ⁇ reduction.
- the hearing aid mode deviating configured ge ⁇ genüber phone mode and / or play mode so that in Hörge ⁇ etzmodus a latency in the compensation path is less than in the phone mode and / or playing mode.
- this is achieved by means of faster filters and / or reduced data rate.
- digital filters offer the advantage that they can be chosen differently depending on the mode.
- the latency time which is preferably considerably reduced, results in faster signal processing in the compensation path so that the compensation signal is available more quickly and can be transmitted to the earphone, from which it is emitted into the auditory canal of the user. It mixes there with the basic signal available there, so that a low latency is accompanied by an improved quality of the overall signal.
- the latency in Hör ⁇ device mode is at most 12 ms, preferably at most 10 ms and more preferably at most 8 ms.
- a lower limit is not mandatory, but in practice it will be the minimum value usually 1 ms.
- a practically proven range is between 2 to 8 ms.
- a programming interface is expediently provided for the compensator.
- the compensator can be programmed from the outside with a compensation characteristic suitable for the user.
- the programming ⁇ interface is connected over a mobile module of the processing unit to a server of a therapy station.
- the connection is here conveniently over the Internet, with the processing unit via the mobile radio module can be connected ver ⁇ anyway.
- the treatment station can (often this will involve be an ENT practice) un ⁇ indirectly accomplish programming of the processing unit, so as to achieve a better adaptation to the user. This is made particularly comfortable by the further provision of a user-operable interface in the form of a separate app which serves to administer this process.
- an equalizer is provided in the signal path, in which different listening situations are stored as a profile. It is designed separately from the compensator.
- the equalizer is connected downstream of the compensator.
- the hearing device system according to the invention can be adapted to different environmental conditions and the resulting different hearing situations.
- listening situations can be stored for quiet environment, entertainment in noisy environment, listening to music at home, listening to music in public space (concert), etc.
- Selecting a suitable profile can significantly improve the overall device's compensation performance. It is useful if the main equalizer with a selection unit cooperates, in such a way that the profiles are selectable by the user, and preferably also changeable. In this way, the user can customize the profiles according to his personal circumstances. Furthermore, he can choose her suitable. However, it should not be ruled out that, if necessary, an automatic switching of the profiles is provided.
- the signal connection between the processing unit and hearing unit at the ear is preferably carried out wirelessly.
- a Bluetooth connection in particular an ener ⁇ giequaintde variant of the Bluetooth connection is particularly useful. Thanks to such a wireless design of the signal connection disturbing cables can be avoided. The comfort of use increases be ⁇ considerable. However, it should not be ruled out that the hearing unit is connected to the processing unit via a cable connection.
- the signal path expediently comprises AD and DA converters.
- this original parts to the processing ⁇ processing unit are. It can be ⁇ already normally present anyway converter of the processing unit will ge ⁇ use in this way. This saves additional effort and simplifies signal routing.
- transducers arranged at the hearing unit can also be provided. The latter is particularly advantageous when using a digitally operating signal connection, in particular a Bluetooth connection.
- the signal propagation time in the compensation ⁇ path is smaller than the signal transit time between the microphone and the input of the processing unit and output to the processing ⁇ processing unit and speakers.
- the hearing aid system is embodied stereophonically with a left and a right channel and preferably comprises a mask. norama module.
- This design allows a clear realis ⁇ zierres listening experience for the user.
- the Panorama module it ⁇ it enables to compensate for dynamic differences between the ears.
- the compensation signal it is possible for the compensation signal to further adapt the original signal, as detected by the hearing unit, by means of the main equalizer and to mix it again steplessly into the compensation signal.
- the natural Klan ⁇ impression for the user can be further improved.
- the hearing unit is preferably embodied as a commercially available stereo headphones, additionally comprising microphones for receiving the original signal and is provided with a bidirectional Sig ⁇ nalfact to the processing unit.
- a commercially available stereo headphones as they are often worn today in public, the sound system can be hidden inconspicuously. The hitherto frequently occurring in hearing aids stigma for the user due to visible arrangement of the hearing aid is effectively reduced in this way.
- the hearing unit expediently comprises a sound pipe ⁇ pipe, at the beginning of an electro-acoustic transducer is arranged and whose end is designed as a final funnel, which is preferably to be arranged on a sound-transmitting material in Ge ⁇ listening of the user.
- a passing of the background signal is obtained (so-called open construction). It mixes in this way automatically in the ear with the compensation signal generated by the processing unit.
- the execution by means of the funnel preferably tapers and the Schalllei ⁇ ment tube from the connection of the transducer at the beginning and in turn opens like a funnel for radiating the sound in the open ear canal.
- the sound pipe is designed as a pressure wave hose and / or the final funnel shaped like a so-called falls of an orchestra horn.
- the sound-permeable material is approximately teardrop-shaped and has an opening for receiving the sound tube with the end funnel. It is shaped so that the end funnel is positioned away from the ear canal, preferably centrally in the ear canal.
- the hearing unit is preferably provided in the area of the Be ⁇ funnel with openings, to direct the sound better in the interior of the ear.
- the sound tube is preferably made flexible and thus allows easy adaptation to the individual circumstances at the user's ear.
- the hearing unit preferably comprises further a microphone wel ⁇ ches in the auricle located adjacent to the ear canal.
- a microphone wel ⁇ ches in the auricle located adjacent to the ear canal.
- mount the microphone on the hearing unit in such a way that the microphone is positioned in a sound focus point of the ear.
- the microphone is thus positioned outside the ear canal at a certain point in the pinna through the hearing of the invention.
- the microphone has been proven to provide the microphone with at least one sound guide.
- This is shaped to partially, but not completely surround a sound inlet of the microphone, and that preference ⁇ surrounds a circular arc. Conveniently, it extends over about a part of the circumference, preferably in the range of about one-fifth to one-third of the circumference.
- the sound guide vane is arranged so with its inner surface facing away from the end funnel. It has been proven to dimension them so that their height is smaller than the diameter of the sound inlet opening of the microphone, preferably less than half.
- FIG. 1 shows an overview representation of a hearing aid system according to an embodiment of the invention
- FIG. 2 shows a hearing unit arranged in the ear
- FIG. 3 is a block diagram of a hearing aid mode
- Fig. 4 is a functional diagram to Figure 3 with the Kompensati ⁇ onspfad.
- Fig. 5 is a block diagram of a telephone mode
- Fig. 6 is a functional diagram to Figure 5 with the Kompensati ⁇ onspfad.
- Fig. 7a, b show two views of the hearing unit
- FIG. 8 shows a detail of the microphone and the sound guide vane
- FIG. 9 Detail view for mounting in the ear canal
- Fig. 14a, b representations of the bell shape of orchestral horn and trumpet;
- Fig. 15 ideal typical representation of the compensation of a
- 16 is a functional diagram illustrating what the hearing-impaired user hears with the high performance hearing aid.
- Figure 1 shows an overview of the sinsbei ⁇ game for the hearing aid system. Thereafter, the Hörommesys ⁇ a system at the ear (9) of a user to be arranged hearing unit
- the processing unit (3) is designed as a smartphone or a tablet.
- This may preferably be a Bluetooth connection (21), but it should not be ruled out that, alternatively or additionally, a cable connection (20) may be provided.
- the cable connection may preferably be a Bluetooth connection (21), but it should not be ruled out that, alternatively or additionally, a cable connection (20) may be provided.
- the cable connection may preferably be a Bluetooth connection (21), but it should not be ruled out that, alternatively or additionally, a cable connection (20) may be provided.
- the smartphone acting as a processing unit (3) is conventionally designed. It has a housing with a large ⁇ Shen display for operation. Furthermore, it has a mobile radio module (32) via which data and / or voice telephony can be exchanged in a mobile radio network (87). For this purpose, the smartphone is provided with a visible or invisible angeord ⁇ Neten antenna (31).
- the hearing unit 1 comprises an earphone (11), which is designed in an open design.
- a sound tube (10) is provided, which via a final funnel (14) in the ear canal
- the sound tube (10) is connected in the region of the beginning of the ear canal (90) with a holding plate (15).
- This has a plurality of sound pipe holes (16) in order to achieve the most unhindered possible entry of the sound to the ear (9) in the ear canal (90).
- the holding plate (15) is so bronze ⁇ det that they are with a support arm within the pinna
- Al ⁇ ternativ can also be a star-shaped holder (18 ⁇ ) vorgese ⁇ hen, as shown in the illustration in Fig. 9. This supports the end of the sound conduction tube (1) with the end ⁇ funnel (bell) (14) from at a shroud (18 ").
- the free interspaces (18" ⁇ ) between the star-shaped holder (18 ⁇ ) and the jacket (18 ") are preferably open and thus allow an unhindered passage of the natural sound signal coming from the outside - this mixes with the sound signal generated by the hearing aid for compensation and emitted via the bell (14).
- the listening unit (1) is stereophonic, ie there is one earphone (11) and microphone (12) for the left ear and one earphone (11 ⁇ ) and microphone (12 ⁇ ) for the right ear. Subsequently, ⁇ reasons of simplification only treats a closer; for the other entspre ⁇ same applies, mutatis mutandis.
- Fig. 10a The design of the final judge as Schallleitbecher is de ⁇ waisted in Fig. 10a. There can be seen the end of the sound conduction tube (10) which widens at its end and there is a ⁇ Schallleitbecher (14) is formed. This is formed in the shape of the falls of an orchestra horn.
- the orchestra horn (see Fig. 14a, b from Wikipedia "Horn") has a narrow scale of the tube, the extension of the tube towards the
- a Smartphone Ver ⁇ processing unit (3) comprises a mobile ⁇ module (32) that communicates via an arranged on or in the housing at ⁇ antenna (31) to a mobile network (87). Furthermore, the mobile radio module (32) is preferably configured to dial into the Internet (88). Also connected to the Internet (88) is a therapy station (89). This may in particular be a practice of a doctor's ears act (ENT practice) that a server (not Darge ⁇ represents) has to provide adjustment data for the processing unit (3).
- ENT practice a practice of a doctor's ears act
- the processing unit (3) further comprises an analog / digital converter (41) and digital / analog converter (48). Further, it has input and output amplifiers (40) (49) for Ver ⁇ amplification of incoming voice signals - in particular from the microphone - as well as to be output for amplifying sound signals.
- a signal processing path (4) is formed, which among other things comprises an equalizer (42). Further, the invention provides a compensator (50), which is currentlybil ⁇ det to compensate for restrictions on the hearing of the user across the frequency spectrum by appropriate additional signals.
- a programming interface (52) is provided, via which the compensator (50) can be programmed. This is done in particular by setting parameters as determined individually by the therapy station (89) for the user has been. These may be transmitted wirelessly by means of the Mo ⁇ bilfunkmoduls (32) over the Internet (88) in the proces ⁇ processing unit (3) advantageously. Furthermore, a Bluetooth module (21) is provided which serves to establish a signal connection (2) to the hearing unit (1).
- a sound signal from the order ⁇ ssen is received, for example, the speech signal is an entertaining to the user person.
- This incoming sound signal is symbolized by the signal train (71).
- the microphone (12) receives this sound signal and converts it into electrical impulses.
- the amplifier (40) is provided at the input. Its output is converted to digital signals by an analog-to-digital converter (41).
- the processed signal is in the extent ⁇ now referred to as the base signal (72).
- the further signal processing in the signal path (4) as well as in a compensation path (5) is preferably di gital ⁇ . According to the invention, a compensation path for improving the intelligibility of the sound signal for the user
- the Kompensa ⁇ tion path (5) comprises a frequency compensator (50). This is designed to generate determined depending on the by the Therapiesta ⁇ tion (89) defects in the Hörfrequenzkurve the user corresponding additional signals, that add to the ⁇ special signal frequencies in the pathological frequency spectrum for compensation.
- the compensator includes, inter alia, digital filters (51). Depending on this, additional signals are determined (they are indicated in the illustration in FIG. 4 by black colorations on the signal train shown). They become the basic signal at the output of the compensator (50)
- composition signal (73) added to form a composition signal (73).
- the signal is now applied to a splitter (53).
- the ⁇ ser is adapted to separate the basic signal. What remains at the output is only the additional signal determined by the compensator (50). This is visualized by the signal train (74), in which the (now separated) basic signal is symbolized by dashed representation.
- the signal may optionally be processed by an equalizer (42) further ⁇ .
- the equalizer (42) can adapt to the respective listening situations.
- different profiles are provided, each of the profiles (43) stands for a different listening situations.
- One of the profiles (43) can be ⁇ selected by the user on the display means of the selection unit (44). May be further vorgese ⁇ hen a panoramic module (45). This is designed in a stereophonic design of the hearing aid system to compensate for dynamic differences between the left and right ear of the user.
- a panorama controller (46) is provided as an input to the panoramic module.
- the output signal thus formed is applied to a di gital ⁇ / analog converter (48) for conversion back into an analog signal.
- the signal is then performed after amplification by an output amplifier (49) to the earpiece (11) of the hearing unit (1) to ⁇ .
- a superimposition signal (70) It is irrelevant for the dung OF INVENTION ⁇ where the digital / analog rescission is made as to whether in the processing unit (3) or - in case of digital signal connection (2), such as Bluetooth, preferable - only in the auditory unit (1). In the latter case, the digital / analog Conversion may be conveniently integrated be embodied in the transition from ⁇ amplifier (49) and as so-called. Class D amplifier. This offers considerable advantages for compactness and efficiency, which in turn has a favorable effect on the Energyver ⁇ consumption and thus reduced size of batteries to supply energy.
- the additional signal (74) may be reduced in resolution compared to the basic signal (72).
- the additional signal can be processed with a resolution of 8 bits, while the basic signal is provided with a higher resolution of 10 bits, 12 bits or more. So there is a significant data reduction by the restriction to the additional signal (74). In this way, a much faster verar ⁇ processing, so that the latency in the compensation path (5) and signal processing path (4) is significantly reduced as a whole.
- the aim is a latency in the range of 2 to 8 ms, preferably up to a maximum of 12 ms.
- the functionality described is preferably realized by means of ei ⁇ ner special app in the smartphone.
- the additional app in the smartphone is integrated into the audio path of the smartphone ("looped in.") It works stereo (2 x mono)
- the compensation equalizer (50) (equalizer 1), which is set to the audiometrically determined hearing loss of the hearing impaired, including storage of his attitude,
- the app (software) provides three modes of operation:
- Mode 1 everyday listening with hearing (focus on speech intelligibility ⁇ ) 2.
- Mode 2 Making Calls with the Smartphone (Playback Adapted to Hearing Loss)
- Mode 3 listening to music with your smartphone (playback adapted to hearing loss).
- Standard operating mode is operating mode 1, ie the Hörgerä ⁇ te mode.
- the switchover to the corresponding operating mode 2 or 3 takes place automatically.
- the app uses the smartphone's ADDA conversion (41, 48) for modes 1, 2, and 3:
- mode 1 the performance (latency) of the smartphone during ADDA conversion (41, 48) and wireless transmission is still challenging
- the design of the high performance hearing aid is modified so that the AD and DA conversion takes place in a separate, wirelessly connected to the smartphone unit (eg behind the ear).
- the ADDA conversion (41, 48) ggfls.
- On a data-reduced basis (possibly with only 8 bits) work in the app itself to achieve a lower latency, so that the radiated by the playback unit, edited signal as synchronously as possible, of course hearing over ⁇ can store.
- the Compensation Equalizer (50) (EQ 1) of the app adopts the amplification or amplification of certain frequencies according to the audiometric curve of the hearing impaired person in order to compensate for the hearing loss (see Fig. 15 dashed curve) (see Fig. 15) Curve); He is programmable via your phone or via the Internet from the ENT practice and is fixed at ⁇ hand audiometry curve.
- the adaptation equalizer (42) (EQ 2) the app used to adjust the hearing aid to specific listening situations: here the hearing impaired can call up presets or even program and save your own SET ⁇ settings on the display of the smartphone.
- FIGS. 5 and 6 show a variant of the exemplary embodiment. Same components are designated with identical reference ⁇ number.
- the illustrated in Figure 5, 6 ⁇ execution example differs from that illustrated in figure 3 essentially in that the processing unit (3) has ei ⁇ NEN additional play mode.
- the play mode serves to present music, radio plays or other sound material to the user by means of a playback device (34), such as an MP3 player and / or streaming client.
- the proces ⁇ processing unit in addition to a mode selector (56) with a switch (58). It is configured to switch from normal hearing aid operation to a play mode or a telephone mode.
- Basic signal (72) is no longer split off, but it is instead the total signal (75) consisting of basic signal (72) and additional signal (74) further processed. While this has the disadvantage that now is not the budget for the United ⁇ processing speed data reduction by ab ⁇ split of the basic signal (72) can be drawn. However, the invention has recognized that it no longer matters critical in this case on the latency, because in any case the Ge ⁇ yaksignal by the earphone (11) shall be given. Thus, by means of the switching module (56), an optimal adaptation of the processing unit to the respective operating mode can be achieved.
- Fig. 12 shows the telephone mode. It is provided (by means of the app):
- the telephone signal is a mono signal.
- the compensation equalizer (EQ 1), permanently integrated with the audio path, corrects or compensates for the hearing loss of the hearing impaired person so that the interlocutor's speech is more easily understood.
- Fig. 13 shows the playback mode. This signal flow is used for listening to music, listening to the radio, music streaming, games, etc. using a smartphone. It is provided that (using the app):
- the music signal is a stereo signal.
- FIG 7 two views of the hearing unit (1) are Darge ⁇ represents, with figure 7a in a sectional view and Figure 7b as part ⁇ view in plan view.
- the holder which acts as a base plate. It is made transparent, preferably before ⁇ from dimensionally stable soft latex material.
- At her be ⁇ consolidates a sound pipe (10), at the beginning of an electro-acoustic transducer (13) is arranged. This is secured via an anechoic rubber ring (10) on the sound conduction tube (10) and acts as a speaker Hö ⁇ purity (1).
- a final funnel (14) is provided at the end of the sound pipe (10).
- Ummante- (18) made of sound-conducting material in the ear canal (90) of the User positioned.
- a fastening ⁇ supply ring (16) In the region of the passage of the sound ⁇ line pipe (10) through the holder (15) is a fastening ⁇ supply ring (16) with a plurality of sound pipe openings (16 ⁇ ) arranged.
- the fastening ring (16) positions the sound tube (10) in the holder (15) and is formed with its openings (16 ⁇ ) to direct the incident on the outside of the ear (9) sound into the ear canal (90).
- the microphone (12) has a substantially round sound inlet opening (17).
- an outwardly projecting element (19) is arranged as a sound ⁇ guide surface, which is formed like a blade, in ⁇ particular arcuate. It preferably extends over approximately 1/4 to 1/3 of the circumference of the sound inlet opening (17).
- it promotes favorable reflection behavior, and on the one hand increases the sensitivity of the microphone (12) and, on the other hand, prevents unwanted feedback with the sound entering the auditory canal (90).
- it has at its free end on an overhanging attachment (19 ⁇ ), which further favors the focusing of the sound.
- microphone (12) and speakers (sound transducer 13) are connected to form a unit, the user in the ear, inserted in the ear canal (90) wears.
- the hearing aid works in two-channel stereo (2 x mono).
- the microphone and speaker per ear, the architecture or natural function of the auricle and the ear canal are positioned so that the recording (microphone) takes place in the sound collection point of the auricle and As the ⁇ dergabe (speakers) in the open ear canal.
- the positioning of the microphones in the sound collecting point of the ear ⁇ shells and the thus generated A / B level stereo signal (2 x mono) allow the hearing impaired to continue a natural directional hearing.
- the sound is heard in full frequency band in front of the head, sound ( "dimmed") from behind in formerlyredu ⁇ ed frequency band can sound from the side by the time differences between the ears, which determine the Ge ⁇ brain and evaluate.
- the distance between The ears and the architecture of the earcups are the cause of this mechanical-acoustic phenomenon.
- the invention can be summarized as follows:
- the core idea of the invention lies in the novel design of a multipurpose high-performance hearing device, the
- c) provides a novel special microphone & speaker unit for optimum utilization of the acoustic conditions of the auricle and the auditory canal
- this microphone & speaker unit uses a novel microphone with a sound guide in the sound collection point of the auricle
- e ensures open listening because of the outgoing from the ear canal shaft, characterized in that the playback by means of a pressure wave tube (alternatively at the same Posi ⁇ tion speaker) with attached bell in the form of the falls of an orchestral horn is positioned centrally in the open ear canal
- k) of the ENT practice is directly programmable via the Internet and enables the user to own, savable adjustments to indi ⁇ vidual listening situations,
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Headphones And Earphones (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP17189224 | 2017-09-04 | ||
PCT/EP2018/073718 WO2019043246A1 (de) | 2017-09-04 | 2018-09-04 | Mehrzweck-hochleistungshörgerät mit einem mobilen endgerät, insbesondere smartphone |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3679729A1 true EP3679729A1 (de) | 2020-07-15 |
EP3679729B1 EP3679729B1 (de) | 2022-06-22 |
Family
ID=59772514
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18769105.0A Active EP3679729B1 (de) | 2017-09-04 | 2018-09-04 | Mehrzweck-hochleistungshörgerät mit einem mobilen endgerät, insbesondere smartphone |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP3679729B1 (de) |
WO (1) | WO2019043246A1 (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102021103769B4 (de) | 2021-02-17 | 2022-10-27 | Clir Technologies Gmbh | Verfahren zur Signalverarbeitung |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6181801B1 (en) * | 1997-04-03 | 2001-01-30 | Resound Corporation | Wired open ear canal earpiece |
DE202010013508U1 (de) | 2010-09-22 | 2010-12-09 | Hörfabric GmbH | Software-definiertes Hörgerät |
US20130198630A1 (en) * | 2012-01-30 | 2013-08-01 | Ability Apps, Llc. | Assisted hearing device |
DE102013009171A1 (de) * | 2013-05-29 | 2014-12-04 | Manuel Herrmann | Audiomaterial-Umwandlungsgerät zur Optimierung der Klangwiedergabe aus der Sicht einer hörenden Person |
EP3111672B1 (de) * | 2014-02-24 | 2017-11-15 | Widex A/S | Hörgerät mit unterstützer unterdrückung von störgeräuschen |
WO2016022905A1 (en) * | 2014-08-08 | 2016-02-11 | The Regents Of The University Of California | External device leveraged hearing assistance and noise suppression device, method and systems |
-
2018
- 2018-09-04 EP EP18769105.0A patent/EP3679729B1/de active Active
- 2018-09-04 WO PCT/EP2018/073718 patent/WO2019043246A1/de unknown
Also Published As
Publication number | Publication date |
---|---|
EP3679729B1 (de) | 2022-06-22 |
WO2019043246A1 (de) | 2019-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69027731T2 (de) | Elektroakustischer Wandler und Tonwiedergabesystem | |
DE69022762T2 (de) | Vorrichtung zur Lärmverminderung. | |
DE69833746T2 (de) | Drahtgebundene hörmuschel für einen offenen gehörgang | |
Laurence et al. | A comparison of behind-the-ear high-fidelity linear hearing aids and two-channel compression aids, in the laboratory and in everyday life | |
DE69912289T2 (de) | Kopfhörer | |
US7738665B2 (en) | Method and system for providing hearing assistance to a user | |
DE3204567A1 (de) | Hoergeraet | |
EP3430819B1 (de) | Ohrhörer mit getrennten mikrofonen für binauralaufnahmen und zum telefonieren | |
DE112008002187T5 (de) | Hinter-dem-Ohr-Hörhilfe, deren Mikrophon in einen Eingang des Ohrkanals gesetzt ist | |
EP2782260A1 (de) | Verfahren und Vorrichtung zur Steuerung einer Sprachkommunikation sowie Verwendung derselben | |
DE112019005682T5 (de) | Ohrbügel mit einer wiederherstellungsfunktion der sprecherstimme | |
EP2617127B1 (de) | Verfahren und system zur bereitstellung einer hörhilfe für einen benutzer | |
DE602006000772T2 (de) | Hörinstrument | |
EP3679729B1 (de) | Mehrzweck-hochleistungshörgerät mit einem mobilen endgerät, insbesondere smartphone | |
EP3742759A1 (de) | Hörgerät sowie verfahren zum betrieb eines hörgerätes | |
EP1707031B1 (de) | Hörsystem für schwerhörige personen | |
DE102011006148B4 (de) | Kommunikationssystem mit Telefon und Hörvorrichtung sowie Übertragungsverfahren | |
EP3913618A1 (de) | Verfahren zum betrieb eines hörgeräts und hörgerät | |
DE102008032852A1 (de) | Kommunikationsgerät mit Funktionalität einer Hörhilfe | |
Killion | Compression: distinctions | |
EP0723381B2 (de) | Vorrichtung zur Hörunterstützung | |
DE202011105898U1 (de) | Software-definiertes Hörgerät für ein Multimedia-Handy (Smartphone) | |
DE102013019501A1 (de) | Hörgerätesystem | |
DE102015119834A1 (de) | Mikrofon-Kopfhörer-Einrichtung für eine externe Recheneinheit und Verfahren zum sicheren Echtzeit-Übertragen von rechner-prozessierten Klangsignalen | |
DE3204567C3 (de) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200330 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20220223 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502018009998 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1500578 Country of ref document: AT Kind code of ref document: T Effective date: 20220715 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220922 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220923 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220922 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221024 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221022 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502018009998 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20220930 |
|
26N | No opposition filed |
Effective date: 20230323 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230516 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220904 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20230920 Year of fee payment: 6 Ref country code: GB Payment date: 20230920 Year of fee payment: 6 Ref country code: AT Payment date: 20230915 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230921 Year of fee payment: 6 Ref country code: DE Payment date: 20230925 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20231001 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220622 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20180904 |