EP3139638A1 - Hörgerät zur anzeige eines pathologischen zustands - Google Patents
Hörgerät zur anzeige eines pathologischen zustands Download PDFInfo
- Publication number
- EP3139638A1 EP3139638A1 EP15184032.9A EP15184032A EP3139638A1 EP 3139638 A1 EP3139638 A1 EP 3139638A1 EP 15184032 A EP15184032 A EP 15184032A EP 3139638 A1 EP3139638 A1 EP 3139638A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- feedback
- hearing aid
- pattern
- measured
- base pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/39—Aspects relating to automatic logging of sound environment parameters and the performance of the hearing aid during use, e.g. histogram logging, or of user selected programs or settings in the hearing aid, e.g. usage logging
Definitions
- the disclosure relates to a device having an ear monitoring functionality.
- the disclosure relates to a hearing aid adapted to indicate a pathological condition of a user of the hearing aid based on non-invasive in-situ monitoring of the middle ear status.
- the middle ear is a cavity located behind the eardrum (tympanic membrane).
- the middle ear is maintained at the same pressure as the atmospheric pressure through pressure equalization via the Eustachian tube.
- the pressure of the middle ear becomes different from that of the atmospheric pressure.
- Variation in middle ear pressure such as negative pressure or alternating periods of negative, normal and positive pressure may be a risk factor or symptom for middle ear problems.
- Most middle ear problems result in stiffening of the tympanic membrane due to pathological difference in pressure between the middle ear and the atmospheric pressure. This can interfere with the ability of the middle ear to transfer sounds from the outer ear to the inner ear.
- Otitis Media can cause temporary hearing loss. If left untreated, it can cause permanent hearing loss. A hearing loss itself delays development of language skills, and children who already have a hearing loss are more affected and delayed in their development if an untreated hearing loss is caused by Otitis Media occurs.
- Otitis Media An early detection of Otitis Media would limit the detrimental effects caused by the hearing loss and limit the associated discomfort and pain.
- parents, teachers and other people around the child typically fail to notice the exact condition of the child's middle ear. Therefore, parents would be relieved if they were advised on when to seek medical help for deductive diagnosis of a potential middle ear problem.
- the parts of the inner ear that contribute to hearing and balance are filled with clear and odourless fluid.
- This fluid is linked through the cochlear aqueduct to the fluid that surrounds and supports the brain.
- Healthy cochlear fluids are vital to good hearing and balance while healthy cerebral fluids are vital to life. Changes in these fluids may occur.
- Meniere's disease is caused by changes in cochlear fluids.
- an analysis of the pressure of the cerebral fluid is used to diagnose brain-related conditions such as cerebral malaria (swelling of the brain due to malaria-filled blood cells blocking cerebral blood supply), meningitis (infection of the outer layers of the brain), and subarachnoid haemorrhage (bleeding around the brain).
- cerebral malaria swelling of the brain due to malaria-filled blood cells blocking cerebral blood supply
- meningitis infection of the outer layers of the brain
- subarachnoid haemorrhage bleeding around the brain.
- the traditional approach for measuring cerebral fluid pressure is the lumbar puncture (also called spinal tap) which is invasive and has significant risks. It involves local anaesthesia, insertion of a hollow needle in the spine, and the measurement of the pressure in the spine.
- the disclosure relates to indication of a pathological condition based on an in-situ and non-invasive technique.
- indication is implemented using a hearing aid that is in operating position at a hearing aid user.
- a variation in middle ear affects pressure equalization and in effect, affects such as increase the stiffness of the tympanic membrane.
- This change such as increase in the stiffness of the tympanic membrane affects acoustic feedback detected in response to an input sound signal, which may either include the sound received from the user's auditory environment or a predefined signal with or without the sound received from the auditory environment.
- Measuring the acoustic feedback determines the middle ear condition and forms the basis for detecting pathological condition using a state classifier.
- the disclosure further refers to a pending application EP14176716.0 titled "Hearing device with ear monitoring Function", which is incorporated here by reference.
- a hearing aid adapted to indicate a pathological condition of a user of the hearing aid when the hearing aid is in use.
- the hearing aid includes a signal generator, an output transducer and a feedback measurement unit.
- the signal generator is adapted to generate an electrical output signal.
- the output transducer is adapted to transform the electrical output signal to an acoustic output signal and to direct the acoustic output signal towards a tympanic membrane of the user.
- the feedback measurement unit adapted to measure an acoustic feedback produced by the tympanic membrane in response to the acoustic output signal.
- a feedback path logger is adapted to continuously track the measured acoustic feedback and a feedback path modeller is adapted to generate a base pattern across a plurality of frequencies of the tracked acoustic feedback.
- the feedback path logger is adapted to continuously track the measured acoustic feedback and the feedback path modeller is adapted to generate a measured pattern across the plurality of frequencies of the tracked acoustic feedback.
- the hearing aid further includes a comparator and a state classifier. The comparator is adapted to determine a variation between the measured pattern and the base pattern and the state classifier adapted to identify at least one pathological condition corresponding to the determined variation.
- a hearing aid adapted to indicate a pathological condition of a user of the hearing aid when the hearing aid is in use.
- the hearing aid includes an input transducer, a processing unit, an output transducer and a feedback measurement unit.
- the input transducer is adapted to transform an input sound signal into an electrical input signal.
- the processing unit adapted to generate an electrical output signal by processing the electrical input signal.
- the output transducer is adapted to transform the processed electrical output signal to an acoustic output signal and to direct the acoustic output signal towards a tympanic membrane of the user.
- the feedback measurement unit adapted to measure an acoustic feedback produced by the tympanic membrane in response to the acoustic output signal.
- a feedback path logger is adapted to continuously track the measured acoustic feedback and a feedback path modeller is adapted to generate a base pattern across a plurality of frequencies of the tracked acoustic feedback.
- the feedback path logger is adapted to continuously track the measured acoustic feedback and the feedback path modeller is adapted to generate a measured pattern across the plurality of frequencies of the tracked acoustic feedback.
- the hearing aid further includes a comparator and a state classifier. The comparator is adapted to determine a variation between the measured pattern and the base pattern and the state classifier adapted to identify at least one pathological condition corresponding to the determined variation.
- hearing aid is in use
- hearing aid in use refers to that the hearing aid is positioned at the user in its operating position.
- BTE behind the ear aids
- the term hearing aid in use is explained by way of a behind the ear aids (BTE) that includes a case, an earmould or dome and a connection between them. In use, the case sits behind the pinna with the connection from the case coming down the front into the ear, where the earmould sits.
- BTE behind the ear aids
- the hearing aid provides an in-situ monitoring of the pathological condition of the user.
- the hearing aid includes a health monitor wearable
- the wearable unit is in position at or in the ear in order to be used as monitoring the stiffness of the tympanic membrane in accordance with the disclosure.
- the hearing aid in use refers to positioning the wearable at or in the ear of the user of the ear as an ear level monitoring unit without an amplification of the input sound signal as is the case in conventional hearing aid.
- the processing unit is adapted to generate an electrical output signal by processing the electrical input signal.
- the processing unit may be adapted to process the electrical input signal. This may include processing other than amplifying the electrical input signal. However, the amplification or other processing does not correspond to the hearing impairment of the user.
- the input transducer includes a microphone and may also include a microphone array.
- the processing using the processing unit, may include band pass filtering the electrical input signal into a number of frequency bands to obtain a number of band limited signal and amplifying the band limited signal by frequency specific gain factor.
- the processing unit may be adapted to perform a number of other operations such as compression, noise reduction, microphone array beamsteering, etc.
- the output transducer typically includes a speaker, usually also referred as receiver.
- the output transducer may be positioned in a mould that is positioned in the ear, ear canal or bony part of the ear canal.
- the speaker may be positioned in a BTE casing and the acoustic output signal is delivered to the tympanic membrane via a sound tube that directs the acoustic output signal from the output transducer to the tympanic membrane.
- the input sound signal includes a sound signal that the input transducer receives from acoustic environment when the hearing aid is in use.
- the input sound signal includes a predefined sound signal of predefined characteristics with or without the sound signal that the input transducer receives from acoustic environment when the hearing aid is in use.
- the predefined sound signal may be considered as a probe signal that may either be provided independently or in combination with the sound that the input transducer receives from the auditory environment when the hearing aid is in use.
- the hearing aid may include a signal generator that is adapted to generate the predefined sound signal of the predefined characteristics.
- the predefined characteristics is defined by a specific frequency and specific level.
- the specific frequency is selected from a range between 100 Hz to 4 KHz.
- the predetermined frequency may include a frequency such as 250 Hz, or 500 Hz, or 1000 Hz, or 2000 Hz, or 4000 Hz. Other frequencies within or outside the range is also possible.
- the predefined frequency may be implemented as a frequency sweep.
- the predefined sound signal may include one or more of a broad band noise, narrow band noise and clicks.
- the specific level when amplified or unamplified is below the perceivable level of the user.
- the specific level when amplified or unamplified is above the perceivable level of the user.
- the "perceivable level" is defined by the predefined sound signal having a characteristic signal pressure level such that in unamplified or amplified form, the signal pressure level or amplified signal pressure level is such that the user starts perceiving the predefined sound signal as sound.
- an unamplified predefined sound signal is related to frequency specific hearing threshold of the user whereas the amplified predefined sound signal is related to 0 dB SPL (20 micropascal sound pressure).
- the predefined sound signal may be used to obtain feedback measurement for identification of pathological conditions without distorting the signal of interest, such as speech signals during normal operation of the hearing aid.
- a predefined frequency specific amplification to the feedback signal may be applied before performing feedback measurement. In the latter embodiment of the above perceivable level, the feedback measurement is relatively more reliable.
- the processing unit may be adapted to process the sound signal received from the auditory environment such that the deterioration in sound quality or negative affect in speech intelligibility because of the predefined sound signal is minimized.
- the feedback measurement unit may be adapted to separate out the feedback corresponding only to the predefined sound signal only.
- the isolated feedback measurement relating to the predefined sound signal alone may be used to generate the base pattern and measured pattern.
- the base pattern and the measured pattern are generated in accordance to the feedback measurement corresponding only to the sound signal received at the input transducer from the auditory environment.
- the base pattern and the measured pattern are generated in accordance to the feedback measurement corresponding to a combination of the sound signal received at the input transducer from the auditory environment and the predefined sound signal.
- the feedback measurement unit includes a feedback estimator adapted to estimate the acoustic feedback.
- a feedback estimator adapted to estimate the acoustic feedback.
- Such estimation is based on conventionally known feedback estimation algorithms such as in known feedback cancellation techniques using adaptive filters, where an estimation the acoustic feedback path is made to create a signal to cancel the feedback signal.
- Other estimation techniques are available in Guo Meng, Analysis, Design, and Evaluation of Acoustic Feedback Cancellation Systems for Hearing Aids, Aalborg University (2013 ); A. Spriet et al., Adaptive feedback cancellation in hearing aids, Journal of the Franklin Institute 343 (2006) 545-573 ; etc.
- the feedback measurement unit includes a measurement microphone and a level estimator.
- the measurement microphone is housed in an ear mould of the hearing aid and the ear mould is adapted to be placed within the ear canal of the user.
- the measurement microphone is adapted to receive the sound reflected from the tympanic membrane in response to the input sound signal and to transform the reflected sound to a reflected electrical sound signal.
- the level estimator is adapted to estimate the level from the reflected electrical sound signal.
- the level estimator may rely on peak or average amplitude, on the root mean square level of the signal, or on some statistical property of the signal. For example, in one aspect, the level is based on magnitude or magnitude squared of the respective reflected electrical signal.
- the determination may be based on a short term basis, such as a level based on a short time interval, such as for example the last 5 ms to 40 ms or such as the last 10 ms.
- the level may then be converted to a domain such as a logarithmic domain or any other domain.
- the skilled person would find it reasonable to implement the comparator for determining level difference using a number of conventionally known techniques.
- continuously tracking refers to recording data whenever the feedback measurement unit produces feedback measurements.
- the functioning of the feedback measurement unit such as feedback estimator is generally pre-configured such as during a fitting session.
- the base pattern for each frequency or sampled frequencies across the plurality of frequencies, the base pattern comprises average or weighted average of feedback values as available through continuous tracking at different measurement points during the time duration. Also, for the specific frequency or sampled frequencies across the plurality of frequencies, the measured pattern comprises average or weighted average of feedback values at different measurement points during the subsequent time duration.
- the "sampled frequencies" refer to discretely chosen frequencies within a plurality range comprising the plurality of frequencies.
- the different measurement points are defined as measurement separated by essentially the same time period.
- This implementation may include a time counter in order to identify distinct measurement points.
- the different measurement points are defined as environment classified measurement points such that auditory environment specific measurements are obtained.
- This implementation may include an environment classifier that is adapted to classify the auditory environment such as loud, medium, soft, etc. in accordance with the sound received at the input transducer of the hearing aid. Once an environment for which the measurement is to be obtained is detected, the measurements are made.
- the different measurement points are defined as activity classified measurement points such that the activity specific measurement points are obtained.
- This implementation may include an activity classifier that is adapted to classify a user's activity such as sleeping, running, etc.
- sensors available at the hearing aid or external sensors may include Electroencephalography sensors, heart rate monitors, etc. Measurements over the time duration such as a week or a month or more than a month to generate base pattern, and subsequent time duration such as a week or a month or more than a month would account for daily variation in middle ear measurements originating from variability of the hearing aid positioning especially that of mould in the ear canal, growth of the child's ear canal, variations in temperature, activity level, sweat, jaw movement and ear wax build up.
- a receiver of transmitter-receiver unit comprising within the heairng aid receives an instruction signal for defining a start point and end point of the time duration and the subsequent time duration.
- the start point and end point of the time duration and the subsequent time duration may be predefined at a fitting session.
- the hearing aid is programmed to adaptively define the start point and end point for the time duration and the subsequent time duration based on predefined rule such as based on environment classification rule i.e. when the a specific identified environment repeats more than x number of times like user already been exposed to loud environment 10 times. Other rules for defining the time duration and subsequent time duration specific to a user would be apparent to the skilled person.
- the subsequent time duration follows the time duration.
- the base pattern is the primary pattern - one or more measure patterns generated based on feedback measurements as obtained from one or more subsequent time durations are compared against the base pattern.
- the modeller may update the base pattern (available in the memory) by incorporating the data points of the measured pattern (available from the memory or logger) into the base pattern for creating an updated base pattern.
- the updated base pattern may then be used as a base pattern for comparison with measured patterns from other subsequent time durations.
- the figure in later sections does not show a communication channel between the modeller and the memory. However, the modeller may be communicatively connected to the memory.
- the base pattern and the measured pattern represents a feedback level curve at each or at sampled frequencies across the plurality of frequencies. Additionally or alternatively, the base pattern and the measure pattern represent a feedback level curve for a specific frequency at different measurement points during the time duration and subsequent time duration respectively.
- the base pattern and the measured pattern may also be represented as mathematical functions, i.e. base function and measured function.
- the hearing aid includes a derivative unit adapted to determine a first order and/ or higher order derivative of the base pattern and/ or the measured pattern.
- the derivative may include time based derivative or frequency based derivative.
- the derivative unit may include derivative techniques that are well-known in the art like Laplace derivative operator.
- the functioning of the derivative unit may be included in the comparator.
- the comparator is adapted to determine the variation between the base pattern and the measured pattern. Such determination may include a number of implementations. For example, it may be suitable that variation relating to particular frequency may be preferentially "weighted" compared to other frequencies to provide improved statistical analysis. In this manner, important frequency values or ranges can be afforded more weight.
- determining the variation includes evaluating difference, for a specific frequency, between the measured pattern comprising feedback values at the measurement points during the subsequent time duration and the base pattern comprising feedback values at the measurement points during the time duration. In another embodiment, determining the variation includes evaluating difference, at at least one frequency across the plurality of frequencies, between the measured pattern comprising feedback value for each frequency across the plurality of frequencies and the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- determining the variation includes evaluating difference, for a specific frequency, between a time derivative value of a first order and/ or higher order derivative of the measured pattern comprising feedback values at the measurement points during the subsequent time duration and a time derivative of a first order and/ or higher order derivative of the base pattern comprising feedback values at the measurement points during the time duration. In another embodiment, determining the variation includes evaluating difference, at at least one frequency across the plurality of frequencies, between a frequency derivate value of a first order and/ or higher order derivative of the measured pattern comprising feedback value for each frequency across the plurality of frequencies and a frequency derivative value of a first order and/ or higher order derivative of the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- determining the variation includes evaluating difference, for a specific frequency, between a parameter of a feature of the measured pattern comprising feedback values at the measurement points during the subsequent time duration and a comparable parameter of a comparable feature of the base pattern comprising feedback values at the measurement points during the time duration.
- determining the variation includes evaluating difference between a parameter of a feature of the measured pattern comprising feedback value for each frequency across the plurality of frequencies and a comparable parameter of a comparable feature of the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- the parameter may include width, height, depth, slope, etc. and the feature may include peak, valley, crater, etc. as represented in the pattern. The skilled person would appreciate that other parameters and features may also be included.
- determining the variation includes evaluating difference, for a specific frequency, between a parameter of a feature of first order and/ or higher order time derivative of the measured pattern comprising feedback values at the measurement points during the subsequent time duration and a comparable parameter of a comparable feature of first order and/ or higher order time derivative of the base pattern comprising feedback values at the measurement points during the time duration.
- determining the variation includes evaluating difference between a parameter of a feature of a first order and/ or higher order frequency derivative of the measured pattern comprising feedback value for each frequency across the plurality of frequencies and a comparable parameter of a comparable feature of a first order and/ or higher order frequency derivative of the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- the parameter may include width, height, depth, slope, etc. and the feature may include peak, valley, crater, etc. as represented in the patterns. The skilled person would appreciate that other parameters and features may also be included.
- determining the variation includes evaluating difference, for a specific frequency, between shape and/ or size of the measured pattern/ a section of the measured pattern and shape and/ or size of the base pattern/ corresponding section of the base pattern.
- the measured pattern comprising feedback values at the measurement points during the subsequent time duration and the base pattern comprising feedback values at the measurement points during the time duration.
- determining the variation includes evaluating difference between shape and/ or size of the measured pattern/ a section of the measured pattern and shape and/ or size of the base pattern/ corresponding section of the base pattern.
- the measured pattern comprising feedback value for each frequency across the plurality of frequencies and the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- determining the variation includes evaluating difference, for a specific frequency, between shape and/ or size of a first order and/ or higher order derivative of the measured pattern/ a section of the measured pattern and shape and/ or size of a first order and/ or the higher order derivative of the base pattern/ corresponding section of the base pattern.
- the measured pattern comprising feedback values at the measurement points during the subsequent time duration and the base pattern comprising feedback values at the measurement points during the time duration.
- determining the variation includes evaluating difference between shape and/ or size of a first order and/ or higher order derivative of the measured pattern/ a section of the measured pattern and shape and/ or size of a first order and/ or higher order derivative of the base pattern/ corresponding section of the base pattern.
- the measured pattern comprising feedback value for each frequency across the plurality of frequencies and the base pattern comprising feedback value for each frequency across the plurality of frequencies.
- the patterns may be generated using known curve fitting techniques, and the patterns may be compared for variations using conventional statistical analysis techniques.
- the comparator is adapted to categorize the determined variation in a variation type in accordance to the determination of the variation between the measured pattern and the base pattern.
- the variation type may include categorization based on a predefined dictionary of vibration types.
- the hearing aid includes a memory.
- the memory is adapted to store a plurality of predefined variations and/ or a plurality predefined variation types.
- the memory further stores associations of each of the stored plurality of predefined variations and/ or stored plurality predefined variation types with one or more possible pathological condition.
- the memory is adapted to store the base pattern and/ or first order and/ or higher order derivative of the base pattern as generated after the time duration.
- the comparator is adapted to access the memory to retrieve the base pattern for determining the variation between the measured pattern and the base pattern.
- the pathological conditions that may be screened for, identified or monitored may include one or more conditions like Otitis Media, meningitis, subarachnoid hemorrhage, cerebral malaria, attention-deficit Disorder, dyslexia, Parkinson's Disease, Heart Disease, Alzheimer's Disease, Juvenile Diabetes, Autism, etc., indication for loss of hearing or loss of hearing of certain frequencies.
- the state classifier may be adapted to access information stored in the memory and to identify the pathological condition by comparing the determined variation with pathological condition associated with the stored predefined variation and/ or predefined variation type that represents the determined variation/ determined variation type.
- the predefined variation and/ or predefined variation type thus defines a variation / variation type that is linked to at least one pathological condition. This may be implemented via a search module that is adapted to search a look up table stored in the memory. Many way of implementing are known for associating or indexing the variation/ variation type with the pathological condition and searching the pathological condition in accordance to the measured variation and variation type.
- the hearing aid may further include a notification generator adapted to generate and transmit an indicator signal, corresponding to the identified pathological condition, to an indicator module for producing a perceivable effect.
- the perceivable effect may be selected from a group consisting of a visual signal at the hearing aid device/ remote device like a smartphone, a vibration of the hearing aid device/ remote device like the smartphone, an audio signal using the receiver of the hearing aid device/ speaker of a remote device like a smartphone, text signal at the remote device like smartphone.
- the notification generator may be adapted to produce the indicator signal and thus perceivable effect at the indicator module that is a function of the magnitude or type of variation or identified pathological condition. For example, for a hearing aid having an LED for status indication, if the pathological condition is a generally considered less dangerous, then the indicator produces an ORANGE LED light whereas for a pathological condition that is considered dangerous, the indicator produces a RED LED light. It may also be envisaged that the notification generator may also be adapted to generate a positive indicator signal representative of non detection of any pathological condition-such as a GREEN LED light.
- the details of the indicator signal is stored in the memory and/ or cloud server via transmission of the details from the hearing aid to the cloud server.
- Such details may include one or more of determined variation / variation type, identified pathological conditions, time stamp of the identification of the pathological condition, environment class or activity class corresponding to the time stamp.
- the time stamp defines time as an identifier of when an event occurred.
- the hearing aid may be adapted to track the measured feedback measurements during the time duration and the subsequent time duration respectively.
- the measured feedback may then be transmitted form the hearing aid to the external electronics such as a smartphone and/ or automatically uploaded to user's profile in a cloud server.
- the smartphone and/ or a cloud service may include features that offer functioning of the following features disclosed above such as functionalities of the data modeller, comparator, state classifier, memory, and notification generator, in order to indicate the pathological conditions.
- the skilled person would envisage implementing these features externally to the hearing aid.
- the user's doctor or medical service provider is also alerted when any pathological condition is identified.
- the processing unit is adapted to adjust at least one parameter, such as gain, of the hearing device based on the determined variation between the measured pattern and the base pattern.
- a method for indicating a pathological condition of a user of the hearing aid when the hearing aid is in use includes measuring an acoustic feedback, using an acoustic feedback measurement unit, produced by a tympanic membrane of the user in response to an acoustic output signal directed towards a tympanic membrane of the user.
- This method further includes i) continuously tracking, during a time duration, the measured acoustic feedback and generating a base pattern across a plurality of frequencies of the tracked acoustic feedback; and ii) continuously tracking, during a subsequent time duration, the measured acoustic feedback and generating a measured pattern across the plurality of frequencies of the tracked acoustic feedback.
- a pathological condition is determined in accordance with a variation between the measured pattern and the base pattern.
- the base pattern and the measured pattern is transmitted from the hearing aid to an external electronic device.
- the external electronic device being adapted to determine a variation between the measured pattern and the base pattern; and to identify a pathological condition corresponding to the determined variation.
- a comparator comprised within the hearing aid is used to determine a variation between the measured pattern and the base pattern; and identifying, using a state classifier comprised within the hearing aid, a pathological condition corresponding to the determined variation.
- the external electronic device and/ or the state classifier may be adapted to identify the pathological condition by comparing the determined variation with pathological condition associated with the stored predefined variation and/ or predefined variation type that represents the determined variation/ determined variation type.
- the electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure.
- Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
- the disclosed hearing aid is typically adapted to improve or augment the hearing capability of a user by receiving an input sound signal from a user's surroundings, generating a corresponding audio signal, possibly modifying the audio signal and providing the possibly modified audio signal as an audible signal to at least one of the user's ears.
- the "hearing aid” may further refer to a device such as an earphone or a headset adapted to receive an audio signal electronically, possibly modifying the audio signal and providing the possibly modified audio signals as an audible signal to at least one of the user's ears.
- the hearing aid is adapted to be worn in any known way. This may include arranging a unit of the hearing device behind the ear with a tube leading air-borne acoustic signals into the ear canal or with a receiver/ loudspeaker arranged close to or in the ear canal such as in a Behind-the-Ear type hearing aid, and/ or ii) arranging the hearing device entirely or partly in the pinna and/ or in the ear canal of the user such as in a In-the-Ear type hearing aid or In-the-Canal/ Completely-in-Canal type hearing aid.
- the hearing aid is also adapted to amplify the incoming sound signal in order to address hearing impairment of the user of the hearing aid.
- hearing aid in another embodiment, includes an ear level monitoring unit that is arranged entirely or partly in the pinna and/ or in the ear canal of the user such that feedback measurements as disclosed herein are made but without the need of conventional hearing aid processing such as amplification of incoming sound signal to address hearing impairment of the user of the ear level monitoring unit.
- the disclosed hearing aid may be positioned bilaterally at two ears as part of a "binaural hearing system".
- the hearing aids are adapted to cooperatively provide audible signals to both of the user's ears.
- a further comparison between the left ear variation and right ear variation may be performed in order to categorise as similar indication or different indication.
- the binaural hearing system may further include auxiliary device(s) that communicates with at least one hearing aids, the auxiliary device affecting the operation of the hearing aids and/or benefitting from the functioning of the hearing aids.
- auxiliary device may include at least one of remote controls, remote microphones, audio gateway devices, mobile phones, public-address systems, car audio systems or music players or a combination thereof.
- the audio gateway is adapted to receive a multitude of audio signals such as from an entertainment device like a TV or a music player, a telephone apparatus like a mobile telephone or a computer, a PC.
- the audio gateway is further adapted to select and/or combine an appropriate one of the received audio signals (or combination of signals) for transmission to the at least one hearing aid.
- the remote control is adapted to control functionality and operation of the at least one hearing devices. The function of the remote control may be implemented in a SmartPhone or other electronic device, the SmartPhone/ electronic device possibly running an application that controls functionality of the at least one hearing device.
- Figure 1 illustrates a hearing aid in position according to an embodiment of the disclosure.
- the figure shows a behind-the-ear type hearing aid where an output transducer is positioned in the ear or ear canal.
- the behind-the-ear housing 102 is positioned behind the ear 114 and includes components like input transducer, processing unit, etc.
- An ear mould 104 includes the output transducer and may also include a measurement microphone at 106.
- the input transducer and the output transducer are communicatively connected using a connecting wire 116.
- the hearing aid directs an acoustic output signal 108 towards a tympanic membrane 120 of the user.
- a part of the acoustic output signal 108 gets reflected as a reflected sound 112.
- the level of the reflected sound is a function of the stiffness of the tympanic membrane 120.
- stiffness is dependent on the pressure equalization capabilities of the middle ear 110. It is apparent that the feedback will increase with an increase in the stiffness of the tympanic membrane provided other conditions affecting the feedback such as vent specification, positioning of the mould, sealing of the mould with the canal, etc. are same across different feedback measurements.
- the ear mould may further include at least a vent 118, specification of which is based on obtaining a balance between occlusion and feedback problems.
- the measurement microphone 106 is adapted to capture the sound reflected from the tympanic membrane and feedback can then be measured from electrical signal corresponding to the reflected sound received at the measurement microphone 106.
- the feedback measurement may also be obtained using a feedback estimator.
- Figure 2 illustrates a hearing aid for indicating a pathological condition according to an embodiment of the disclosure.
- the embodiment is disclosed in relation to a typical hearing aid that is adapted to address hearing impairment of the user.
- the disclosure is useable for health monitoring wearable that are adapted to be positioned at or in ear, the wearable are not adapted to amplify sound signal as would be the case with conventional hearing aids.
- Other processing may preferably be included in the wearable devices such as noise reduction especially when the input sound signal includes sound from user's auditory environment.
- the disclosed hearing aid 200 is adapted to be located in or at the ear of the user.
- the hearing aid includes an input transducer 204 adapted to convert an input sound signal 202 into an electrical input signal.
- the sound received from the user's auditory environment is indicated as the input sound signal 202.
- a signal generator 216 is adapted to provide a predefined sound signal of predefined characteristics.
- the input sound signal includes the predefined sound signal with or without the sound signal that the input transducer receives from acoustic environment when the hearing aid is in use.
- the electrical signal is typically converted to a digital signal using an analog-to-digital converter AD.
- a forward signal path is defined between the input transducer 204 and output transducer 208, and comprising a processing unit 206.
- the electrical signal is processed in a processing unit 206, which is adapted to generate an electrical output signal by processing the electrical input signal such as band-pass filtering, amplification, noise reduction, etc..
- the processed electrical signal is typically coverted to an analog signal using a digital-to-analog conveter DA.
- An output transducer 208 is adapted to transform the processed electrical output signal to an acoustic output signal 108 and to direct the acoustic output signal towards a tympanic membrane (refer 120, Fig. 1 ) of the user.
- a part of the delivered acoustic output signal 108 is fed back into the input transducer 204, as shown as the feedback path 112, because of acoustic coupling between the output transducer and input transducer.
- the hearing aid includes a feedback estimator 210 for determining feedback along the feedback path 112 from the output transducer 208 to the input transducer 204.
- the feedback estimator may include an adaptive filter, which includes a variable filter part and an algorithm part.
- the variable filter part is controlled by a prediction error algorithm, e.g. an LMS (Least Means Squared) algorithm, in the algorithm part in order to predict the part of the microphone signal that is caused by feedback from the loudspeaker of the hearing aid.
- the prediction error algorithm uses a reference signal to find the setting of the adaptive filter that minimizes the prediction error when the reference signal is applied to the adaptive filter. Many known techniques are also useable to estimate feedback.
- the feedback estimator 210 may be part of the a feedback cancellation system further comprises a sum unit ('+') operatively coupled to the input transducer and the output of the feedback estimator, and wherein the feedback path estimate is subtracted from the electric input signal from the input transducer.
- the feedback measurement may be obtained by a combination of a measurement microphone that is adapted to receive the signal reflected from the tympanic membrane in response to the input sound signal and a level detector adapted to detect level of the reflected signal.
- the hearing aid may further include a feedback path logger 212 and a feedback path modeller 214.
- the logger 212 is adapted to continuously track the measured acoustic feedback and the modeller 214 is adapted to generate a measured pattern across the plurality of frequencies of the tracked acoustic feedback.
- the feedback path modeller is adapted to generate a base pattern based on the measured feedback and during a subsequent time duration, the feedback path modeller is adapted to generate a measured pattern based on the measured feedback.
- the modeller may be generated using known curve fitting techniques.
- the hearing aid may further include a derivative unit 230.
- the derivative unit is adapted to determine first order and/ or higher order derivative of the base pattern and measured pattern.
- the derivative may include time based derivative or frequency based derivative.
- the derivative unit may include derivative techniques that are well-known in the art like Laplace derivative operator.
- the hearing aid may further include a comparator 218 that is adapted to determine a variation between the measured pattern and the base pattern.
- the comparator may be based on statistical analysis algorithms that are suitable for comparing patterns (curves).
- the comparator may be further adapted to categorize the determined variation in a variation type in accordance to the determination of the variation between the measured pattern and the base pattern.
- the hearing aid may further include a memory 220 that is adapted to store, among other information, at least one of i) a plurality of predefined variations and/ or a plurality predefined variation types, ii) associations of each of the stored plurality of predefined variations and/ or stored plurality predefined variation types with one or more possible pathological condition; iii) the base pattern as generated and/ or first order and/ or higher order derviative of the base pattern after the time duration; and iv) an identified pathological conditions with a time stamp.
- the memory is in bi-directional communication with a state classifier 222.
- the hearing aid may further include a state classifier 222 adapted to identify a pathological condition corresponding to the determined variation.
- the state classifier is adapted to i) receive the variation and/ or variation type from the comparator and ii) access information stored in the memory and to identify the pathological condition by comparing the determined variation with pathological condition associated with the stored predefined variation and/ or predefined variation type that represents the determined variation/ determined variation type.
- the hearing aid may further include a notification generator 224 adapted to generate and transmit an indicator signal, corresponding to the identified pathological condition, to an indicator module 226 for producing a perceivable effect.
- the perceivable effect thus allows to produce an alarm to notify the user or others like parents, medical professional, etc.
- the hearing aid may further include a communication exchange module 228 comprising a transmitter-receiver unit to communicate with auxiliary devices.
- the notification signal is transmitted to an auxiliary device such as a smartphone to produce the alarm.
- the identified pathological condition is transmitted to a cloud server for storing the identified pathological condition.
- the receiver receives an instruction signal for defining a start and end of time duration and subsequent time duration.
- the hearing aid may be adapted to track the measured feedback measurements during the time duration and the subsequent time duration respectively.
- the measured feedback may then be transmitted using the exchange module 225 form the hearing aid to the external electronics such as a smartphone and/ or automatically uploaded to user's profile in a cloud server.
- the smartphone and/ or a cloud service may include features that offer functioning of the following features disclosed above such as functionalities of the data modeller, comparator, state classifier, memory, and notification generator, in order to indicate the pathological conditions.
- the skilled person would envisage implementing these features externally to the hearing aid.
- the user's doctor or medical service provider is also alerted when any pathological condition is identified.
- the hearing aid may further include a manually operable user interface such as a push button PB, allowing a user to control a function of the hearing aid, e.g. its processing or a volume setting.
- a manually operable user interface such as a push button PB, allowing a user to control a function of the hearing aid, e.g. its processing or a volume setting.
- Figure 3 illustrates comprising a base pattern and a measured pattern according to an embodiment of the disclosure.
- the graph 300 illustrates a base pattern 304 showing how feedback across a plurality of frequencies (frequency range) varies during a time duration.
- the frequency specific feedback (example 306) is average or weighted average of feedback for that specific frequency (f2) during the time duration.
- the graph 300 also illustrates a measured pattern 302 showing how feedback across the plurality of frequencies (frequency range) varies during a subsequent time duration.
- the frequency specific feedback (example 312) is average or weighted average of feedback for that specific frequency (f1) during the subsequent time duration.
- the comparator (refer 218, Fig. 2 ) is adapted to determine variation between the illustrated measured pattern and the base pattern.
- the comparator may be adapted to compare a parameter of a feature such as height of a feedback peak as shown by 306 for the base pattern and 312 for the measured pattern. Based on the comparison, the comparator may determine the frequencies at which same heighted feedback peaks occurred, i.e. f2 and f1 respectively. Additionally or alternatively, the comparator may compare the feedbacks at a specified frequency. For example, change in feedback at 314 for the base pattern to 308 for the measured pattern at frequency f3 and from 316 of the base pattern to 310 of the measured pattern at frequency f4. Other comparison in order to determine variation between the base pattern and the measured pattern may also be performed such as comparing rate of change of feedback in the measured pattern (slope 310-308) with that of in the base pattern (slope 316-314) for frequency range f3-f4.
- Figure 4 illustrates a method 400 for indicating a pathological condition according to an embodiment of the disclosure.
- the pathological condition is indicated for a user of the hearing aid when the hearing aid is in use.
- an acoustic feedback is measured using an acoustic feedback measurement unit, produced by a tympanic membrane of the user in response to an acoustic output signal directed towards a tympanic membrane of the user.
- the measured acoustic feedback is tracked and a base pattern across a plurality of frequencies of the tracked acoustic feedback is generated.
- the measured acoustic feedback is tracked and a measured pattern across the plurality of frequencies of the tracked acoustic feedback is generated.
- variation between the measured pattern and the base pattern is determined and lastly at 410, a pathological condition is determined in accordance with a variation between the measured pattern and the base pattern.
- the functions may be stored on or encoded as one or more instructions or code on a tangible computer-readable medium.
- the computer readable medium includes computer storage media adapted to store a computer program comprising program codes, instructions etc.
- such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Combinations of the above should also be included within the scope of computer-readable media.
- the computer program can also be transmitted via a transmission medium such as a wired or wireless link or a network, e.g. the Internet, and loaded into a device for being executed at a location different from that of the tangible medium.
- a computer readable medium is disclosed.
- the computer readable medium is adapted to include instructions which when executed by a device such as hearing aid and/ or external electronic device adapts the device to
- connection or “coupled” as used herein may include wirelessly connected or coupled.
- the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method is not limited to the exact order stated herein, unless expressly stated otherwise.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15184032.9A EP3139638A1 (de) | 2015-09-07 | 2015-09-07 | Hörgerät zur anzeige eines pathologischen zustands |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15184032.9A EP3139638A1 (de) | 2015-09-07 | 2015-09-07 | Hörgerät zur anzeige eines pathologischen zustands |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3139638A1 true EP3139638A1 (de) | 2017-03-08 |
Family
ID=54065267
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15184032.9A Withdrawn EP3139638A1 (de) | 2015-09-07 | 2015-09-07 | Hörgerät zur anzeige eines pathologischen zustands |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP3139638A1 (de) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018154143A1 (en) | 2017-02-27 | 2018-08-30 | Tympres Bvba | Measurement-based adjusting of a device such as a hearing aid or a cochlear implant |
EP3675524A1 (de) * | 2018-12-28 | 2020-07-01 | GN Hearing A/S | Verfahren zur bestimmung eines zustands eines pfads von akustischem feedback eines am kopf tragbaren hörgeräts sowie am kopf tragbares hörgerät |
CN113260305A (zh) * | 2019-06-25 | 2021-08-13 | 科利耳有限公司 | 基于身体噪声的健康监测 |
US11317222B2 (en) | 2019-12-17 | 2022-04-26 | Gn Hearing A/S | Method of determining a status of an acoustic feedback path of a head wearable hearing device and a head wearable hearing device |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009023633A1 (en) * | 2007-08-10 | 2009-02-19 | Personics Holdings Inc. | Musical, diagnostic and operational earcon |
WO2012082721A2 (en) * | 2010-12-13 | 2012-06-21 | The Board Of Trustees Of The University Of Illinois | Method and apparatus for evaluating dynamic middle ear muscle activity |
US20130070936A1 (en) | 2011-09-20 | 2013-03-21 | Oticon A/S | Control of an adaptive feedback cancellation system based on probe signal injection |
WO2013102867A1 (en) * | 2012-01-03 | 2013-07-11 | Consiglio Nazionale Delle Ricerche | Apparatus for clinical-audiometric investigation |
US20130188796A1 (en) | 2012-01-03 | 2013-07-25 | Oticon A/S | Method of improving a long term feedback path estimate in a listening device |
US20140146977A1 (en) | 2012-11-27 | 2014-05-29 | Oticon A/S | Method of controlling an update algorithm of an adaptive feedback estimation system and a decorrelation unit |
US20150043764A1 (en) | 2013-08-08 | 2015-02-12 | Oticon A/S | Hearing aid device and method for feedback reduction |
US20150063614A1 (en) | 2013-09-05 | 2015-03-05 | Oticon A/S | Method of performing an recd measurement using a hearing assistance device |
-
2015
- 2015-09-07 EP EP15184032.9A patent/EP3139638A1/de not_active Withdrawn
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009023633A1 (en) * | 2007-08-10 | 2009-02-19 | Personics Holdings Inc. | Musical, diagnostic and operational earcon |
WO2012082721A2 (en) * | 2010-12-13 | 2012-06-21 | The Board Of Trustees Of The University Of Illinois | Method and apparatus for evaluating dynamic middle ear muscle activity |
US20130070936A1 (en) | 2011-09-20 | 2013-03-21 | Oticon A/S | Control of an adaptive feedback cancellation system based on probe signal injection |
WO2013102867A1 (en) * | 2012-01-03 | 2013-07-11 | Consiglio Nazionale Delle Ricerche | Apparatus for clinical-audiometric investigation |
US20130188796A1 (en) | 2012-01-03 | 2013-07-25 | Oticon A/S | Method of improving a long term feedback path estimate in a listening device |
US20140146977A1 (en) | 2012-11-27 | 2014-05-29 | Oticon A/S | Method of controlling an update algorithm of an adaptive feedback estimation system and a decorrelation unit |
US20150043764A1 (en) | 2013-08-08 | 2015-02-12 | Oticon A/S | Hearing aid device and method for feedback reduction |
US20150063614A1 (en) | 2013-09-05 | 2015-03-05 | Oticon A/S | Method of performing an recd measurement using a hearing assistance device |
Non-Patent Citations (3)
Title |
---|
A. SPRIET ET AL.: "Adaptive feedback cancellation in hearing aids", JOURNAL OF THE FRANKLIN INSTITUTE, vol. 343, 2006, pages 545 - 573 |
GUO MENG, ANALYSIS, DESIGN, AND EVALUATION OF ACOUSTIC FEEDBACK CANCELLATION SYSTEMS FOR HEARING AIDS, 2013 |
MARGOLIS ROBERT H ET AL: "Wideband reflectance tympanometry in normal adults", THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, AMERICAN INSTITUTE OF PHYSICS FOR THE ACOUSTICAL SOCIETY OF AMERICA, NEW YORK, NY, US, vol. 106, no. 1, 1 July 1999 (1999-07-01), pages 265 - 280, XP012001058, ISSN: 0001-4966, DOI: 10.1121/1.427055 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018154143A1 (en) | 2017-02-27 | 2018-08-30 | Tympres Bvba | Measurement-based adjusting of a device such as a hearing aid or a cochlear implant |
EP3675524A1 (de) * | 2018-12-28 | 2020-07-01 | GN Hearing A/S | Verfahren zur bestimmung eines zustands eines pfads von akustischem feedback eines am kopf tragbaren hörgeräts sowie am kopf tragbares hörgerät |
EP3675526A1 (de) * | 2018-12-28 | 2020-07-01 | GN Hearing A/S | Verfahren zur bestimmung eines zustands eines pfads von akustischem feedback eines am kopf tragbaren hörgeräts sowie am kopf tragbares hörgerät |
US11736868B2 (en) | 2018-12-28 | 2023-08-22 | Gn Hearing A/S | Method of determining a status of an acoustic feedback path of a head wearable hearing device and a head wearable hearing device |
CN113260305A (zh) * | 2019-06-25 | 2021-08-13 | 科利耳有限公司 | 基于身体噪声的健康监测 |
US11317222B2 (en) | 2019-12-17 | 2022-04-26 | Gn Hearing A/S | Method of determining a status of an acoustic feedback path of a head wearable hearing device and a head wearable hearing device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9426582B2 (en) | Automatic real-time hearing aid fitting based on auditory evoked potentials evoked by natural sound signals | |
CN104244157B (zh) | 具有脑机接口的助听装置 | |
US9635469B2 (en) | Automatic real-time hearing aid fitting based on auditory evoked potentials | |
US11665488B2 (en) | Auditory device assembly | |
US11826138B2 (en) | Ear-worn devices with deep breathing assistance | |
US20180263562A1 (en) | Hearing system for monitoring a health related parameter | |
KR20120131778A (ko) | 청력 검사를 수행하는 방법과 이것을 이용한 청력 보조 장치 | |
EP3700229A1 (de) | Konfigurierbares hörinstrument | |
NO312570B1 (no) | Stöybeskyttelse med verifiseringsanordning | |
EP3481086B1 (de) | Verfahren zur anpassung der hörgerätekonfiguration auf basis von pupilleninformationen | |
EP3139638A1 (de) | Hörgerät zur anzeige eines pathologischen zustands | |
KR20130067311A (ko) | 보청기 시스템 및 보청기 시스템을 피팅하는 방법 | |
US20160014532A1 (en) | Hearing device with ear monitoring function | |
NO314380B1 (no) | Öreterminal | |
EP3138301B1 (de) | Verfahren und vorrichtung zur erhaltung der spektralen hinweise eines durch die physische anwesenheit eines digitalen hörgeräts veränderten tonsignals und abstimmung danach | |
AU2014268158A1 (en) | Hearing device with fit recognition | |
Nadon et al. | Field monitoring of otoacoustic emissions during noise exposure: Pilot study in controlled environment | |
Eddins et al. | Device and fitting protocol for a transitional intervention for debilitating hyperacusis | |
CN111108759B (zh) | 远程听力测试***以及建立听觉分布并调节助听器的方法 | |
US9781522B2 (en) | Systems and methods for detecting degradation of a microphone included in an auditory prosthesis system | |
NO314429B1 (no) | Öreterminal med mikrofon for naturlig stemmegjengivelse | |
Dillon | Hearing Aids | |
Lunner et al. | Automatic real-time hearing aid fitting based on auditory evoked potentials | |
US20220353625A1 (en) | Electronic hearing device and method | |
EP4084500A1 (de) | Elektronisches hörgerät und verfahren |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20170909 |