CN112289332A - Intelligent digital hearing aid control method, system, medium, equipment and application - Google Patents
Intelligent digital hearing aid control method, system, medium, equipment and application Download PDFInfo
- Publication number
- CN112289332A CN112289332A CN202011053813.9A CN202011053813A CN112289332A CN 112289332 A CN112289332 A CN 112289332A CN 202011053813 A CN202011053813 A CN 202011053813A CN 112289332 A CN112289332 A CN 112289332A
- Authority
- CN
- China
- Prior art keywords
- sound
- environment
- hearing aid
- mobile phone
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012545 processing Methods 0.000 claims abstract description 74
- 230000005236 sound signal Effects 0.000 claims abstract description 30
- 238000001914 filtration Methods 0.000 claims abstract description 24
- 230000002093 peripheral effect Effects 0.000 claims abstract description 19
- 238000004458 analytical method Methods 0.000 claims abstract description 18
- 230000003321 amplification Effects 0.000 claims abstract description 14
- 238000003199 nucleic acid amplification method Methods 0.000 claims abstract description 14
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000008569 process Effects 0.000 claims abstract description 9
- 238000013473 artificial intelligence Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 4
- 239000000779 smoke Substances 0.000 claims description 4
- 238000012549 training Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 abstract description 16
- 238000012216 screening Methods 0.000 abstract description 3
- 230000003993 interaction Effects 0.000 abstract description 2
- 230000009467 reduction Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 7
- 238000011161 development Methods 0.000 description 6
- 230000018109 developmental process Effects 0.000 description 6
- 230000007547 defect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 208000016354 hearing loss disease Diseases 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 206010011878 Deafness Diseases 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 230000010370 hearing loss Effects 0.000 description 2
- 231100000888 hearing loss Toxicity 0.000 description 2
- 206010056677 Nerve degeneration Diseases 0.000 description 1
- 208000032370 Secondary transmission Diseases 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 210000000860 cochlear nerve Anatomy 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/02—Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0272—Voice signal separating
- G10L21/028—Voice signal separating using properties of sound source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
- H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02087—Noise filtering the noise being separate speech, e.g. cocktail party
Landscapes
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Telephone Function (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention belongs to the technical field of intelligent control of rehabilitation instruments, and discloses a control method, a system, a medium, equipment and application of an intelligent digital hearing aid, wherein the control method comprises the steps of filtering, digitizing and storing external sound signals by a recording peripheral module; the mobile phone terminal processes the digital signal; simultaneously, current environment recognition is carried out based on the feature analysis result and the intelligent classification result in combination with GPS position information, different processing is carried out based on the recognized environment types, and meanwhile, the processing result is transmitted to the ear entrance end through the data transmission module; the data transmission module transmits data by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound. The invention fully utilizes the interaction function of the hearing aid and the mobile phone, greatly improves the processing capability, and even can utilize the advantages of a 5G network to carry out cloud processing. The invention firstly provides the idea of classifying various sound signals through an artificial smart phone APP and combining scene screening and amplification.
Description
Technical Field
The invention belongs to the technical field of intelligent control of rehabilitation instruments, and particularly relates to a control method, a control system, a control medium, a control device and an application of an intelligent digital hearing aid.
Background
Currently, in 2020, the development research foundation of China issues reports that: by the end of 2019, the aged population of China aged 65 years and older reaches 1.76 hundred million people, accounting for 12.6 percent of the total population. By 2022 years or so, the population over 65 years old in China will account for 14% of the total population, and the transition to the aging society is realized. After 2035 years, this part of the elderly will account for over 22% of the total population. The body functions of the elderly, including auditory nerve degeneration, are increasingly concerned about the development of hearing aids and other related products and technologies, such as siemens, rhoda, stark, kurtosis and the like. The hearing aid is a small-sized sound amplification device for compensating hearing loss, and plays an important role in solving the problem of hearing compensation of hearing loss people including the elderly, but the popularization of the hearing aid is not high among people with Chinese hearing impairment, and some people are idle after trial for a period of time due to various reasons. The main reasons for this are:
(1) early hearing aids, particularly analog hearing aids, are too bulky in size, are provided with departments such as external devices and wired earphones, are not comfortable and are easy to fatigue after being worn for a long time;
(2) some low-end hearing aids amplify various sounds indiscriminately, the actual use effect is not ideal, most of the existing digital hearing aids can classify sound signals acceptable by human ears into more than 4 channels according to frequency, and 48 channels can be obtained at most, but the actual requirements cannot be met;
(3) high-end hearing aids need to be regularly calibrated in places such as hospitals and the like, and are expensive, and most hearing aid products are different in price from thousands to tens of thousands yuan;
(4) the hearing aid on the current market is mainly divided into an in-ear type and an behind-the-ear type, but either type of the hearing aid is an independent device, the volume is limited, a small chip is integrated, the processing capacity of the hearing aid is limited, and the actual effect of the hearing aid is also insufficient in use of an obvious scene.
(5) Similarly, indiscriminate amplification can cause hearing impairment, and although the existing hearing aids have noise reduction functions, indiscriminate noise reduction can filter part of useful sound information, and part of people worry about unnecessary accidents caused by wearing the hearing aids.
Researchers have actually recognized the above-mentioned shortcomings and have been working on related studies, and according to the examination, academic research is related to a wide scope, and loudness compensation, voice noise reduction technology, echo cancellation technology and sound source localization technology are the core technologies of most researches. Similar to the new generation of noise reduction earphones released by apple, 2019 and 2020, active noise reduction earphones are more patents, and many related patent achievements are actually applied to the noise reduction function of the current hearing aid. In 2019, scholars at fifty-eight institute of the company of electronic science and technology in China put forward the idea of development of a digital hearing aid assisted by microsystem technology, but mainly develop from structural changes of the hearing aid.
In summary, the existing research and products do not depart from a given frame, that is, the hearing aid is an independent small device, all signal processing functions such as noise reduction and the like are considered based on the independent device, and the bluetooth function of some products is only used for supporting the functions of watching television, making telephone calls and the like. The advantages are easy to carry, and the sound source can be used for positioning when the ears are worn, but the defects are obvious, namely the processing capability is limited and the intelligence is far from enough.
Through the above analysis, the problems and defects of the prior art are as follows:
(1) the existing hearing aids have poor comfort, poor sound amplification effect, high price and limited processing capacity, and can damage hearing.
(2) The existing hearing aid control system or control method has limited processing capacity and insufficient intelligent degree.
The difficulty in solving the above problems and defects is:
the limited processing power of individual hearing aid devices results in significant limitations on the complexity of the associated signal processing algorithms; and the old people have poor learning ability and are not suitable for excessively complicated product operation.
The significance of solving the problems and the defects is as follows:
the usability and the user experience of the hearing aid product can be greatly improved, and the cost is greatly reduced.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an intelligent digital hearing aid control method, system, medium, equipment and application.
The invention is realized in such a way, and the intelligent digital hearing aid control method comprises the following steps:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals, including channelized filtering and statistical characteristic analysis; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the processed sound is transmitted by using Bluetooth after being coded and modulated; and the input end receives the Bluetooth signal, completes signal demodulation and performs sound recovery.
Further, the processing the digitized signal includes: and carrying out multi-channel filtering, characteristic analysis and artificial intelligence classification processing on the digitally processed signals.
Further, the current environment includes: a home environment, a mobile environment, a mall shopping environment, and a park community environment.
Further, the mobile phone terminal performs different processing based on the environment recognition result, including:
identifying doorbell, knock sound and various alarm information in a home environment; and identifying and amplifying the voices of relatives by artificial intelligence; meanwhile, the fixed sound source is amplified when the sound source is positioned to listen to the broadcast or television program;
judging the current moving state according to the information such as the moving speed and the like obtained by the GPS in the moving environment, and carrying out different processing based on different moving states;
carrying out parent voice recognition and amplification in a market environment, and filtering out background music or broadcast music signals; selecting and amplifying the sound with the maximum intensity according to different voiceprint characteristics;
under the cell environment, the sound with the maximum intensity is selected and amplified according to different voiceprint characteristics and sound intensities, and meanwhile, the square dance music is identified and the user is informed to select amplification according to the sound duration.
Further, the alarm information comprises gas alarm and smoke alarm of the household appliance.
Further, the performing different processing based on different moving states includes:
when the public transport means is used for moving, the arrival reminding voice recognition is carried out based on the fact that the electronic voice has different voiceprint characteristics or based on semantic analysis of the arrival reminding statement;
when the user walks, the user can recognize the ringing sound or the whistling sound and amplify the ringing sound.
Further, the speech features are set and stored by pre-training.
It is a further object of the invention to provide a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
It is another object of the present invention to provide a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the steps of:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
It is another object of the present invention to provide a smart digital hearing aid control system operating the smart digital hearing aid control method, the smart digital hearing aid control system comprising:
the mobile phone comprises a recording peripheral module, a mobile phone terminal, a data transmission module and an ear entrance end;
the recording peripheral module is used for filtering, digitizing and storing external sound signals;
the mobile phone terminal is used for carrying out multi-channel filtering, feature analysis and artificial intelligence classification processing on the digital signals; the system is used for identifying the current environment based on the feature analysis result and the intelligent classification result in combination with the GPS position information, performing different processing based on the identified environment type, and transmitting the processing result to the in-ear terminal through the data transmission module;
the data transmission module is used for transmitting data by using Bluetooth;
and the ear-in end is used for receiving the Bluetooth signal and recovering the sound.
By combining all the technical schemes, the invention has the advantages and positive effects that: according to the invention, the interaction function of the hearing aid and the mobile phone is fully utilized, the processing capability is greatly improved, and even the advantages of a 5G network can be utilized to carry out cloud processing; the invention firstly proposes the idea of classifying various sound signals through an artificial smart phone APP and combining scene screening and amplification; the invention carries out environment self-adaptive identification by means of a mobile phone positioning system according to places where old people frequently go, and the environment self-adaptive identification is mainly divided into four categories: home environment, mobile environment, shopping environment in shopping mall, park community environment; the invention provides a background music elimination method based on a 5G cloud for the shopping environment of a shopping mall for the first time; the sound processing is mainly finished at the existing mobile phone end, so that the development difficulty of the in-ear end is reduced, and the cost is greatly reduced; the invention can complete equipment upgrading by upgrading the APP.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained from the drawings without creative efforts.
Fig. 1 is a schematic diagram of an intelligent digital hearing aid control system according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of a control system of an intelligent digital hearing aid according to an embodiment of the present invention;
in the figure: 1. a recording peripheral module; 2. a mobile phone terminal; 3. a data transmission module; 4. the ear-in end.
Fig. 3 is a flow chart of a method for controlling a smart digital hearing aid according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of the control of an intelligent digital hearing aid according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In view of the problems in the prior art, the present invention provides a method, system, medium, device and application for controlling an intelligent digital hearing aid, and the present invention is described in detail below with reference to the accompanying drawings.
As shown in fig. 1-2, the intelligent digital hearing aid control system according to the present invention comprises:
the mobile phone comprises a recording peripheral module 1, a mobile phone terminal 2, a data transmission module 3 and an in-ear terminal 4;
the recording peripheral module 1 is used for filtering, digitizing and storing external sound signals;
the mobile phone terminal 2 is used for carrying out multi-channel filtering, feature analysis and artificial intelligence classification processing on the digital signals; the system is used for identifying the current environment based on the feature analysis result and the intelligent classification result in combination with the GPS position information, performing different processing based on the identified environment type, and transmitting the processing result to the ear entrance end 4 through the data transmission module 3;
the data transmission module 3 is used for transmitting data by using Bluetooth;
and the ear-in end 4 is used for receiving the Bluetooth signal and recovering the sound.
As shown in fig. 3 to 4, the method for controlling an intelligent digital hearing aid according to an embodiment of the present invention includes the following steps:
s101, acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
s102, the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
s103, the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
In step S102, the processing of the digitized signal provided by the embodiment of the present invention includes:
and carrying out multi-channel filtering, characteristic analysis and artificial intelligence classification processing on the digitally processed signals.
The current environment provided by the embodiment of the invention comprises: a home environment, a mobile environment, a mall shopping environment, and a park community environment.
In step S103, the processing, performed by the mobile phone terminal based on the environment recognition result, includes:
identifying doorbell, knock sound and various alarm information in a home environment; and identifying and amplifying the voices of relatives by artificial intelligence; meanwhile, the fixed sound source is amplified when the sound source is positioned to listen to the broadcast or television program;
judging the current moving state according to the information such as the moving speed and the like obtained by the GPS in the moving environment, and carrying out different processing based on different moving states;
carrying out parent voice recognition and amplification in a market environment, and filtering out background music or broadcast music signals; selecting and amplifying the sound with the maximum intensity according to different voiceprint characteristics;
under the cell environment, according to different voiceprint characteristics and sound intensity, the sound with the maximum intensity is selected and amplified, and meanwhile, music such as square dance and the like is identified and a user is informed to select amplification according to the sound duration.
The alarm information provided by the embodiment of the invention comprises but is not limited to gas alarm and smoke alarm of household appliances.
The different processing based on different moving states provided by the embodiment of the invention comprises the following steps:
when the public transport means is used for moving, the arrival reminding voice recognition is carried out based on the fact that the electronic voice has different voiceprint characteristics or based on semantic analysis of the arrival reminding statement;
when the user walks, the user can recognize the ringing sound or the whistling sound and amplify the ringing sound.
In step S102, the parent voice features provided in the embodiment of the present invention are set and stored through pre-training.
The technical effects of the present invention will be further described with reference to specific embodiments.
The invention provides a design idea of performing sound preprocessing by using a common terminal with strong processing capacity such as a mobile phone and the like and then performing secondary transmission by Bluetooth, namely, the whole hearing aid system is divided into three parts: recording peripheral equipment, a mobile phone terminal and an in-ear terminal.
The recording peripheral is a selectable part, and external sound can complete the functions of filtering, digitizing and storing sound signals through the recording function of the recording peripheral or the mobile phone;
the mobile phone terminal mainly completes intelligent processing of the sound signal and sends the processed sound signal through Bluetooth;
the in-ear end receives the Bluetooth signal and is similar to the existing noise reduction earphone to recover the sound, so that the secondary influence of the external sound is avoided. The proposal mainly has the following innovative characteristics:
(1) the interactive function of the hearing aid and the mobile phone is fully utilized, the processing capability is greatly improved, and even the cloud processing can be carried out by utilizing the advantages of a 5G network
(2) The idea of classifying various sound signals through an artificial smart phone APP and combining scene screening and amplification is put forward for the first time;
(3) according to the places where the old people frequently go, environment self-adaptive identification can be carried out by means of a mobile phone positioning system, and the method is mainly divided into four categories: home environment, mobile environment, shopping environment in shopping mall, park community environment;
(4) for the shopping environment of a shopping mall, a background music elimination method based on a 5G cloud is provided for the first time;
(5) the sound processing is mainly finished at the existing mobile phone end, so that the development difficulty of the in-ear end is reduced, and the cost is greatly reduced;
(6) the existing hearing aids do not support upgrading, and equipment upgrading can be completed by upgrading the APP by adopting the design of the invention.
In the case that the connection of the parts or the bluetooth pairing has been completed, the basic operation of the hearing aid is as follows in the steps of fig. 4:
the first step is as follows: the external sound signal completes the filtering and digitalizing functions of the sound signal through the recording function of the recording peripheral or the mobile phone;
the second step is that: the mobile phone end processes the digital signals by utilizing the powerful processing functions of the mobile phone end, and the functions comprise multi-channel filtering, characteristic analysis, artificial intelligence classification and the like;
the third step: the mobile phone end can identify the current environment by using the classification and feature analysis results and combining the GPS position information. Hearing aids are designed to mainly distinguish four major types of environments according to the places the elderly often go: home environment, mobile environment, shopping environment in shopping mall, park community environment.
The fourth step: the mobile phone further performs different processing according to the judgment environment type, and at this time, prompt selection can be performed by using voice control:
1) a home environment: the characteristic functions provided in this environment include: identifying a doorbell and a knock; identifying various alarm information, such as gas alarm, smoke alarm and the like of the household appliance; identifying and amplifying the voices of relatives by artificial intelligence; when a broadcast or television program is listened to, fixed sound source amplification is realized by combining sound source positioning.
2) A mobile environment: the old people mostly take public transport means or walk, and under the environment, the intelligent hearing aid can judge the current moving state according to information such as moving speed obtained by a GPS (global positioning system), and the intelligent hearing aid is mainly divided into two types: firstly, the arrival reminding voice is mainly recognized when a user takes a public vehicle (electronic voice has different voiceprint characteristics or semantic analysis of arrival reminding sentences is utilized), and secondly, the vehicle ring or whistle is mainly recognized and amplified when the user walks, so that the safety of the user is protected;
3) market environment: at the moment, mainly aiming at a noisy market environment, when the voices of the relatives are recognized, the voices of the relatives are specially recognized and amplified, and the characteristics of the voices of the relatives can be completely set and stored through pre-training; in other cases, the most intense sound is selected and amplified mainly according to different voiceprint characteristics, such as for conversational communication between the elderly and the salesperson. For this environment, the hearing aid is designed to retrieve and distinguish the broadcast music from the market and filter it out, i.e. to extract only the sound signal by synchronously subtracting the music signal from the received sound signal, taking into account the background music that is usually promotional.
4) Cell environment: under the environment, the mobile phone selectively amplifies the sound with the maximum intensity according to different voiceprint characteristics and sound intensity, and is used for direct conversation communication among the old. And the music such as square dance can be identified and the user can be informed to select amplification by combining the sound duration.
The fifth step: the mobile phone end sends the sound processing result in the selected environment to the Bluetooth module for sending;
and a sixth step: the in-ear end receives the Bluetooth signal and recovers the sound similar to the current noise reduction earphone.
MATLAB and third parties provide a very useful speech processing toolkit, including voicebox, whose feasibility can be easily learned by the relevant professionals, with the features embodied in different sound signals being very different. Baidu pronunciation and news flying speech recognition all provide relevant development kit for the professional, and cell-phone end speech recognition class APP uses a lot, and the correlation technique that this patent relates to all foresees, and the difference lies in the difference that adopts the recognition accuracy degree that different processing methods lead to, can provide the support for this patent.
It should be noted that the embodiments of the present invention can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided on a carrier medium such as a disk, CD-or DVD-ROM, programmable memory such as read only memory (firmware), or a data carrier such as an optical or electronic signal carrier, for example. The apparatus and its modules of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., or by software executed by various types of processors, or by a combination of hardware circuits and software, e.g., firmware.
The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A method for intelligent digital hearing aid control, the method comprising:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
2. The intelligent digital hearing aid control method according to claim 1, wherein the processing the digitized signals comprises: and carrying out multi-channel filtering, characteristic analysis and artificial intelligence classification processing on the digitally processed signals.
3. The intelligent digital hearing aid control method according to claim 1, wherein the current environment comprises: a home environment, a mobile environment, a mall shopping environment, and a park community environment.
4. The intelligent digital hearing aid control method according to claim 1, wherein the mobile phone performs different processing based on the environment recognition result, comprising:
identifying doorbell, knock sound and various alarm information in a home environment; and identifying and amplifying the voices of relatives by artificial intelligence; meanwhile, the fixed sound source is amplified when the sound source is positioned to listen to the broadcast or television program;
judging the current moving state according to the information such as the moving speed and the like obtained by the GPS in the moving environment, and carrying out different processing based on different moving states;
carrying out parent voice recognition and amplification in a market environment, and filtering out background music or broadcast music signals; selecting and amplifying the sound with the maximum intensity according to different voiceprint characteristics;
under the cell environment, the sound with the maximum intensity is selected and amplified according to different voiceprint characteristics and sound intensities, and meanwhile, the square dance music is identified and the user is informed to select amplification according to the sound duration.
5. The intelligent digital hearing aid control method according to claim 4, wherein the alarm information comprises a household appliance gas alarm, a smoke alarm.
6. The intelligent digital hearing aid control method according to claim 4, wherein the performing different processing based on different movement states comprises:
when the public transport means is used for moving, the arrival reminding voice recognition is carried out based on the fact that the electronic voice has different voiceprint characteristics or based on semantic analysis of the arrival reminding statement;
when the user walks, the user can recognize the ringing sound or the whistling sound and amplify the ringing sound.
7. The intelligent digital hearing aid control method according to claim 6, wherein the voice characteristics are set and stored by pre-training.
8. A computer device, characterized in that the computer device comprises a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to carry out the steps of:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
9. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the steps of:
acquiring an external sound signal by using a recording peripheral module, and filtering and digitally processing the acquired external sound signal;
the mobile phone end processes the digitized signals; the current environment is identified based on the data processing result and the GPS position information or the suggestive selection of the environment result is carried out by utilizing sound control;
the mobile phone terminal performs different processing based on the environment recognition or selection result; meanwhile, the sound processing result is transmitted by using Bluetooth; the ear-in end receives the Bluetooth signal and recovers the sound.
10. An intelligent digital hearing aid control system for operating the intelligent digital hearing aid control method according to any one of claims 1 to 7, wherein the intelligent digital hearing aid control system comprises:
the mobile phone comprises a recording peripheral module, a mobile phone terminal, a data transmission module and an ear entrance end;
the recording peripheral module is used for filtering, digitizing and storing external sound signals;
the mobile phone terminal is used for carrying out multi-channel filtering, feature analysis and artificial intelligence classification processing on the digital signals; the system is used for identifying the current environment based on the feature analysis result and the intelligent classification result in combination with the GPS position information, performing different processing based on the identified environment type, and transmitting the processing result to the in-ear terminal through the data transmission module;
the data transmission module is used for transmitting data by using Bluetooth;
and the ear-in end is used for receiving the Bluetooth signal and recovering the sound.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011053813.9A CN112289332A (en) | 2020-09-30 | 2020-09-30 | Intelligent digital hearing aid control method, system, medium, equipment and application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011053813.9A CN112289332A (en) | 2020-09-30 | 2020-09-30 | Intelligent digital hearing aid control method, system, medium, equipment and application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112289332A true CN112289332A (en) | 2021-01-29 |
Family
ID=74422276
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011053813.9A Pending CN112289332A (en) | 2020-09-30 | 2020-09-30 | Intelligent digital hearing aid control method, system, medium, equipment and application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112289332A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113194396A (en) * | 2021-04-23 | 2021-07-30 | 歌尔股份有限公司 | Hearing aid, method of controlling the same, and computer-readable storage medium |
| CN115312067A (en) * | 2022-10-12 | 2022-11-08 | 深圳市婕妤达电子有限公司 | Voice signal identification method and device based on human voice and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104869517A (en) * | 2014-12-26 | 2015-08-26 | 深圳市微纳集成电路与***应用研究院 | Bluetooth mobile phone hearing aid |
| CN105741856A (en) * | 2016-04-08 | 2016-07-06 | 王美金 | Earphone capable of prompting environmental crisis sounds in listening to music state |
| WO2017120956A1 (en) * | 2016-01-17 | 2017-07-20 | 谢文 | Method of giving alarm during headphone usage, and headphones for giving alarm |
| CN108429955A (en) * | 2018-04-19 | 2018-08-21 | 南京拙达科创加速器有限公司 | Release ambient sound enters the intelligent apparatus and method of earphone |
| US20200296500A1 (en) * | 2015-12-17 | 2020-09-17 | Huawei Technologies Co., Ltd. | Ambient Sound Processing Method And Device |
-
2020
- 2020-09-30 CN CN202011053813.9A patent/CN112289332A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104869517A (en) * | 2014-12-26 | 2015-08-26 | 深圳市微纳集成电路与***应用研究院 | Bluetooth mobile phone hearing aid |
| US20200296500A1 (en) * | 2015-12-17 | 2020-09-17 | Huawei Technologies Co., Ltd. | Ambient Sound Processing Method And Device |
| WO2017120956A1 (en) * | 2016-01-17 | 2017-07-20 | 谢文 | Method of giving alarm during headphone usage, and headphones for giving alarm |
| CN105741856A (en) * | 2016-04-08 | 2016-07-06 | 王美金 | Earphone capable of prompting environmental crisis sounds in listening to music state |
| CN108429955A (en) * | 2018-04-19 | 2018-08-21 | 南京拙达科创加速器有限公司 | Release ambient sound enters the intelligent apparatus and method of earphone |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113194396A (en) * | 2021-04-23 | 2021-07-30 | 歌尔股份有限公司 | Hearing aid, method of controlling the same, and computer-readable storage medium |
| CN113194396B (en) * | 2021-04-23 | 2023-01-24 | 歌尔股份有限公司 | Hearing aid, method of controlling the same, and computer-readable storage medium |
| CN115312067A (en) * | 2022-10-12 | 2022-11-08 | 深圳市婕妤达电子有限公司 | Voice signal identification method and device based on human voice and storage medium |
| CN115312067B (en) * | 2022-10-12 | 2022-12-27 | 深圳市婕妤达电子有限公司 | Voice signal identification method and device based on human voice and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10410634B2 (en) | Ear-borne audio device conversation recording and compressed data transmission | |
| US20210027617A1 (en) | Designer control devices | |
| CN1761265B (en) | Method and apparatus for multi-sensory speech enhancement on a mobile device | |
| US20220095061A1 (en) | Signal processing device, system and method for processing audio signals | |
| CN103888581B (en) | A kind of communication terminal and its method for recording call-information | |
| US7035091B2 (en) | Wearable computer system and modes of operating the system | |
| WO2019099699A1 (en) | Interactive system for hearing devices | |
| CN110312235A (en) | Audio frequency apparatus, operation method, device and the storage medium that real-time voice wakes up | |
| KR20170033641A (en) | Electronic device and method for controlling an operation thereof | |
| CN112532266A (en) | Intelligent helmet and voice interaction control method of intelligent helmet | |
| CN112289332A (en) | Intelligent digital hearing aid control method, system, medium, equipment and application | |
| CN108540660B (en) | Voice signal processing method and device, readable storage medium and terminal | |
| WO2019015503A1 (en) | Bluetooth headphones | |
| CN208094796U (en) | A kind of hearing aid and hearing assistance system | |
| CN103618835A (en) | Method and system for automatically switching scene mode according to magnitude of peripheral noise | |
| CN108235181A (en) | The method of noise reduction in apparatus for processing audio | |
| CN105007557A (en) | Intelligent hearing aid with voice identification and subtitle display functions | |
| TWI831785B (en) | Personal hearing device | |
| CN107483736A (en) | A kind of message treatment method and device of instant messaging application program | |
| JP2009178783A (en) | Communication robot and its control method | |
| US11189265B2 (en) | Systems and methods for assisting the hearing-impaired using machine learning for ambient sound analysis and alerts | |
| CN111491236A (en) | Active noise reduction earphone, awakening method and device thereof and readable storage medium | |
| US11589173B2 (en) | Hearing aid comprising a record and replay function | |
| EP2876902A1 (en) | Adjustable hearing aid device | |
| CN107957860A (en) | Can adjust automatically sound output method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |