CN115223582A - Audio noise processing method, system, electronic device and medium - Google Patents
Audio noise processing method, system, electronic device and medium Download PDFInfo
- Publication number
- CN115223582A CN115223582A CN202111540141.9A CN202111540141A CN115223582A CN 115223582 A CN115223582 A CN 115223582A CN 202111540141 A CN202111540141 A CN 202111540141A CN 115223582 A CN115223582 A CN 115223582A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- noise reduction
- audio
- voice
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims description 15
- 230000005236 sound signal Effects 0.000 claims abstract description 339
- 230000009467 reduction Effects 0.000 claims abstract description 266
- 238000012545 processing Methods 0.000 claims abstract description 141
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000005070 sampling Methods 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 19
- 238000012952 Resampling Methods 0.000 claims description 18
- 230000003993 interaction Effects 0.000 claims description 12
- 238000003860 storage Methods 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 230000002457 bidirectional effect Effects 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 6
- 238000000926 separation method Methods 0.000 claims description 6
- 238000011161 development Methods 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 16
- 238000004519 manufacturing process Methods 0.000 description 16
- 238000011946 reduction process Methods 0.000 description 12
- 230000004048 modification Effects 0.000 description 9
- 238000012986 modification Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 8
- 230000004913 activation Effects 0.000 description 6
- 238000013475 authorization Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Telephone Function (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The invention provides a method and a system for processing noise of audio, wherein the method comprises the following steps: acquiring an audio signal of a microphone end, and determining a sound source of the audio signal; if the sound source of the audio signal is a call audio signal, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, and inputting an obtained first noise reduction signal to a call module through an audio hardware abstraction layer; if the sound source of the audio signal is a local voice audio signal, the local voice audio signal is input into the voice assistant application software through the audio hardware abstraction layer, and the local voice audio signal is subjected to noise reduction processing and echo cancellation processing through a voice noise reduction algorithm integrated in the voice assistant application software; and if the sound source of the audio signal is the mobile phone interconnection voice audio signal, carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of the hardware abstraction layer. The invention reduces the hardware cost and the development cost of noise processing, and avoids the quality risk caused by greatly modifying the audio hardware abstraction layer.
Description
Technical Field
The present invention relates to the field of noise processing technologies, and in particular, to a method, a system, an electronic device, and a medium for processing noise of an audio.
Background
With the development of the internet of vehicles, voice, bluetooth calls and the like have become mainstream and important interaction modes in vehicles, and in a vehicle-mounted environment, the vehicle contains noises such as environmental noise, wind noise, tire noise, played audio and the like, so that the recorded signals of the voice, the bluetooth and the like of the vehicle are poor, and the quality of calls, identification and the like is not high. The application scenes of noise reduction in the vehicle are divided into three categories: the front-end audio processing method is used for front-end audio processing of a Bluetooth call, carPlay (a vehicle-mounted system issued by apple Inc. in the United states combines iOS equipment of a user with an instrument panel system), a vehicle-mounted internet terminal (Telematics BOX, TBOX) and other call functions, and is used for mobile phone interconnection voice audio processing of CarPlay, carlife (a mobile phone and vehicle intelligent interconnection product released by Baidu Inc.) and the like. Currently, one of the two processing schemes of hard noise reduction and soft noise reduction is mainly adopted in the industry.
The existing vehicle-mounted noise reduction method mainly adopts one of a hard noise reduction processing scheme and a soft noise reduction processing scheme for processing. The hard noise reduction means noise reduction and echo cancellation through an independent hardware noise reduction module, but the method has the defects that: 1) The hardware cost is high, and the hardware design difficulty of a recording channel and the like is high; 2) A Printed Circuit Board (PCB) occupies a large space; 3) Refreshing needs to be combined with firmware updating, noise reduction parameters/algorithms cannot be flexibly adjusted, updating cannot be performed through Over-the-Air Technology (OTA), and the refreshing difficulty during after-sale updating is large. Soft noise reduction refers to noise reduction by a software algorithm, but the method has the disadvantages that: 1) The cost is high, and because all algorithms are integrated in a System On Chip (SOC), the performance consumption of a CPU is extremely high, so that a high-performance SOC Chip is required to be adopted, and the cost is increased; if the performance of the CPU is insufficient, the time delay condition exists, and the noise reduction effect is poor; 2) Because all soft noise reduction algorithms are deployed in an Audio Hardware Abstraction Layer (Audio-HAL) of the android system, modifying the HAL Layer causes an increase in quality risk; 3) The soft noise reduction algorithm has a complex verification process, so that the production complexity is increased, and the production efficiency is reduced.
Disclosure of Invention
In order to solve the above prior art problems, the present invention provides an audio noise processing method, system, electronic device and medium, which reduces the noise interference of the vehicle audio, improves the quality of the vehicle audio, and reduces the hardware cost and development cost of noise processing by providing the audio signals of different sound sources with the noise reduction processing method suitable for them.
The first aspect of the present invention provides a method for processing noise in audio, including:
acquiring an audio signal of a microphone end, and determining a sound source of the audio signal;
if the sound source of the audio signal is a call audio signal, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, and inputting a first noise reduction signal obtained through the noise reduction processing to a call module through an audio hardware abstraction layer to complete bidirectional call interaction and response;
if the sound source of the audio signal is a local voice audio signal, inputting the local voice audio signal to voice assistant application software through an audio hardware abstraction layer, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
and if the sound source of the audio signal is a mobile phone interconnection voice audio signal, carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer.
Further, the denoising processing of the call audio signal by the DSP denoising chip includes:
the communication audio signal is gained through a DSP noise reduction chip to obtain a first gain signal;
performing noise separation and filtering on the first gain signal to obtain a single-track audio signal;
resampling the single sound channel audio signal to enable the sampling rate of the single sound channel audio signal to meet the sampling rate of the input signal of the communication module, and taking the resampled single sound channel audio signal as a first noise reduction signal.
Further, the resampling the mono audio signal, in particular:
and carrying out hardware resampling on the single-sound-channel audio signal through an ADSP chip arranged in the SOC chip.
Further, before the voice audio signal is input to the voice assistant application software through the audio hardware abstraction layer and subjected to noise reduction processing and echo cancellation processing by the voice noise reduction algorithm integrated in the voice assistant application software, the method further includes:
acquiring an audio signal of a loudspeaker end as a reference signal;
mixing the reference signal and the voice audio signal to obtain a mixed audio signal;
and inputting the mixed audio signal into a CPU (central processing unit), and calling the voice noise reduction algorithm integrated in the voice assistant application software.
Further, before the noise reduction processing is performed on the call audio signal through the DSP noise reduction chip, the method further includes:
and setting an audio source program into a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial port communication protocol.
Further, before performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software, the method further includes:
and setting an audio source program into an intelligent voice mode, and switching the DSP noise reduction chip into an intelligent voice channel mode.
Further, the determining a sound source of the audio signal, specifically:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
A second aspect of the present invention provides a noise processing system for audio, comprising:
the audio signal acquisition and sound source judgment module is used for acquiring an audio signal at a microphone end and determining a sound source of the audio signal;
the call audio signal processing module is used for carrying out noise reduction processing on the call audio signal through the DSP noise reduction chip when the sound source of the audio signal is the call audio signal, and inputting a first noise reduction signal obtained through the noise reduction processing into the call module through the audio hardware abstraction layer so as to complete bidirectional call interaction and response;
the local voice audio signal processing module is used for inputting the sound source of the audio signal into voice assistant application software through an audio hardware abstraction layer when the sound source of the audio signal is a local voice audio signal, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
and the mobile phone interconnection voice audio signal processing module is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal through the noise reduction unit of the audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal.
A third aspect of the present invention provides an electronic device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the method of noise processing of audio according to any of the first aspects as described above when executing the computer program.
A fourth aspect of the present invention provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program runs, an apparatus in which the computer-readable storage medium is located is controlled to execute the method for processing noise of audio according to any one of the first aspect.
Compared with the prior art, the embodiment of the invention has the beneficial effects that:
the invention provides a method and a system for processing noise of audio, wherein the method comprises the following steps: acquiring an audio signal of a microphone end, and determining a sound source of the audio signal; if the sound source of the audio signal is a call audio signal, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, and inputting a first noise reduction signal obtained through the noise reduction processing to a call module passing through an audio hardware abstraction layer so as to complete bidirectional call interaction and response; if the sound source of the audio signal is a local voice audio signal, inputting the local voice audio signal to voice assistant application software through an audio hardware abstraction layer, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software; and if the sound source of the audio signal is a mobile phone interconnection voice audio signal, carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer. The invention separates the audio signals according to the sound sources of the audio signals, adopts different noise reduction methods aiming at the audio signals of different sound sources, reduces the hardware cost and the development cost of noise processing, and avoids the quality risk caused by greatly modifying the audio hardware abstract layer.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for processing noise of audio according to embodiment 1 of the present invention;
fig. 2 is a flowchart of a method for processing noise of audio according to embodiment 2 of the present invention;
fig. 3 is a flowchart of a method for processing noise of audio according to embodiment 3 of the present invention;
fig. 4 is a device diagram of a noise processing system for audio provided in embodiment 5 of the present invention;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be understood that the step numbers used herein are for convenience of description only and are not intended as limitations on the order in which the steps are performed.
It is to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The terms "comprises" and "comprising" indicate the presence of the described features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term "and/or" refers to and includes any and all possible combinations of one or more of the associated listed items.
Currently, one of the two processing schemes of hard noise reduction processing and soft noise reduction is mainly adopted in the industry: the noise reduction is realized only by adopting hard noise reduction, the requirement on a hardware noise reduction module is higher due to conversation voice and the like, an independent noise reduction module is required to be specially adopted, noise reduction echo is carried out by the noise reduction module, but the scheme has serious rise to the hardware cost, the occupied space of a Printed Circuit Board (PCB) is large, firmware is required to be updated every time, noise reduction parameters/algorithms cannot be flexibly adjusted, particularly after-sale updating is carried out, the refreshing difficulty is large, and OTA updating cannot be carried out.
Soft noise reduction is singly adopted, and because the algorithm required by the soft noise reduction is integrated in the SOC, if the soft noise reduction is adopted for the call voice, compared with the hard noise reduction, the performance consumption of a CPU is extremely high, if the performance is insufficient, the problem of time delay exists, and the call effect is reduced; and the call soft noise reduction algorithm needs to be deployed in the Audio-HAL of the android system, so that the quality risk is increased due to the fact that the HAL layer is modified, and the complexity of a production line is easily influenced and the production beat is slowed down due to the fact that multiple soft noise reduction algorithm verification steps are adopted.
Compared with the method of either hard noise reduction or soft noise reduction adopted in the industry, the invention provides the audio noise processing method combining hard noise reduction and soft noise reduction.
A first aspect.
Referring to fig. 1, an embodiment 1 of the present invention provides a method for processing noise of an audio, including steps S100, S200, S300, and S400; after the execution of step S100 is finished, one of steps S200, S300, or S400 is selected to be executed according to the result of S100; and steps S200, S300 and S400 are in parallel relationship, not in sequence relationship. Specifically, the method comprises the following steps:
s100, acquiring an audio signal at a microphone end, and determining a sound source of the audio signal.
It should be noted that the audio signal at the microphone end is an input signal of the user to the microphone end, and after the DSP chip acquires the audio signal at the microphone end, the sound source of the audio signal is determined by the vehicle-mounted system.
It will be appreciated that, since the audio channels of different audio signals are different, determining the sound source of the audio signal may be: and judging the sound source of the audio signal through the sound source circulation channel of the audio signal. Since the frequency domains of different audio signals are different, determining the sound source of the audio signal may also be determining the sound source of the audio signal according to the frequency domain of the audio signal.
Preferably, the determining a sound source of the audio signal, in particular:
and judging the sound source of the audio signal through the sound source flow channel of the audio signal.
S200, if the sound source of the audio signal is a call audio signal, noise reduction processing is carried out on the call audio signal through the DSP noise reduction chip, and a first noise reduction signal obtained through the noise reduction processing is input to the call module through the audio hardware abstraction layer, so that bidirectional call interaction and response are completed.
It should be noted that the call audio signal includes: bluetooth call, carPlay phone, ECALL (car emergency call system), BCAll (push-to-talk rescue, mainly for roadside rescue), and other call audio signals. And carrying out noise reduction processing on the call audio signal through the DSP noise reduction chip, namely carrying out hard noise reduction processing on the call audio signal.
It can be understood that after the audio signal of the microphone end is collected by the DSP chip and the vehicle-mounted system judges that the audio signal is the call audio signal, the noise reduction processing is directly carried out inside the DSP chip to obtain a first noise reduction signal, and the first noise reduction signal is transmitted to the call module through the audio hardware abstraction layer to complete the two-way call interaction and response.
S300, if the sound source of the audio signal is a local voice audio signal, inputting the local voice audio signal to voice assistant application software through an audio hardware abstraction layer, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software.
It should be noted that the local voice audio signal includes: vehicle-mounted artificial intelligent voice, vehicle-mounted voice recognition assistant and other local voice audio signals. And performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software, namely performing soft noise reduction on the local voice audio signal.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the local audio signal is a local audio signal, the local audio signal is transmitted to the CPU, and is input to the voice assistant application software through the audio hardware abstraction layer, and the local audio signal is subjected to noise reduction processing and echo cancellation processing through the voice noise reduction algorithm integrated in the voice assistant application software.
S400, if the sound source of the audio signal is a mobile phone interconnection voice audio signal, carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer.
It should be noted that the mobile phone interconnection voice audio is voice and music mixed sound, and the mobile phone interconnection voice audio signal includes: and the cellphone interconnection voice audio signals of third-party application programs such as Carplay, carlife and the like are provided, and the third-party application programs do not provide the noise reduction function. And performing noise reduction processing on the mobile phone interconnection voice audio signal through the noise reduction unit of the audio hardware abstraction layer, namely performing soft noise reduction on the mobile phone interconnection voice audio signal.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is the mobile phone interconnection audio signal, it needs to perform audio monitoring when playing music, transmit the local audio signal to the CPU, and perform noise reduction processing on the mobile phone interconnection audio signal through the vehicle-mounted SOC system at the audio hardware abstraction layer.
In the audio noise processing method provided in embodiment 1 of the present invention, audio signals are separated according to a sound source of the audio signals, a DSP noise reduction chip is used for noise reduction for call audio signals, a voice noise reduction algorithm is used for noise reduction for local voice audio signals, and a noise reduction unit of a hardware abstraction layer is used for noise reduction for mobile phone interconnection voice audio signals, that is, different noise reduction methods are used for audio signals of different sound sources, so as to reduce vehicle-mounted audio noise interference, improve vehicle-mounted audio quality, and reduce hardware cost and development cost of noise processing.
In addition, the noise reduction process of the call audio signal does not occupy the performance of a CPU, HAL layer codes do not need to be changed, authorization or activation is not needed to influence a production line, a voice resource package, a Bluetooth telephone and the like are decoupled, and the call fault probability is reduced; for the noise reduction after-sale updating of the call audio signal, a DSP chip is not required to be replaced, the after-sale updating is carried out only through software upgrading and refreshing, the voice noise reduction algorithm can be upgraded through OTA at any time, and the hardware refreshing cost is reduced.
For the noise reduction process of the local voice audio signal, because the microphone arrangement position, the angle, the distance, the difference of the interior trim and the noise environment such as an engine, an air conditioner, tire noise and road noise are different in each vehicle type, in order to ensure good voice recognition effect, the voice awakening threshold value, the voice parameters such as a vehicle interior reverberation signal model and the like need to be calibrated and adjusted along with the change of the vehicle type, the voice noise reduction algorithm provided by the scheme is integrated on an APP layer, only the parameters of the APP layer are modified, the HAL layer can be not modified, the rapid modification and the application of each vehicle type can be realized, the voice tuning parameters can be adjusted more flexibly according to different vehicle types and different application scenes, an independent hardware noise reduction module can be reduced, the occupation of a PCB is reduced, the dependence on the hardware is reduced, the cost is greatly reduced, the noise reduction of the local voice audio signal can be updated after sale, the tuning parameters can be adjusted flexibly, the firmware does not need to be updated, and the refreshing cost is reduced.
For the noise reduction process of the mobile phone interconnection voice audio signal, because the DSP cannot support noise reduction under the condition of voice and music mixing, the DSP cannot support noise reduction of mobile phone interconnection voice audio signals of third-party application programs such as Carplay, carlife and the like which do not provide a noise reduction function, therefore, the noise reduction process of the mobile phone interconnection voice audio signal is processed by a vehicle SOC system on an HAL layer, the occupation of a PCB is reduced, the dependence on hardware is reduced, and the cost is greatly reduced.
Referring to fig. 2, steps S100 to S400 of the audio noise processing method according to embodiment 2 of the present invention are the same as steps S100 to S400 of embodiment 1, except that: in step S200, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, including:
s210, the call audio signal is gained through the DSP noise reduction chip, and a first gain signal is obtained.
It should be noted that the gain is an amplification factor of the signal.
S220, performing noise separation and filtering on the first gain signal to obtain a single-channel audio signal.
It should be noted that, the separator filters the signal to perform denoising processing.
It can be understood that the DSP noise reduction chip gains the call audio signal, separates and filters out the external environment noise, and eliminates the noise, thereby improving the call quality.
S230 resamples the monaural audio signal, so that the sampling rate of the monaural audio signal satisfies the sampling rate of the input signal of the call module, and uses the resampled monaural audio signal as a first noise reduction signal.
It should be noted that the resampling is to resample a signal to obtain a signal that satisfies the sampling rate of the input signal of the call module. Because the sampling rate of the signal output by the DSP noise reduction chip is different from the sampling rate of the input signal of the call module, the signal needs to be resampled. For example, the sampling rate of the signal with the sampling rate of 48K output by the DSP noise reduction chip is changed into one of the sampling rates of 8K, 24K or 16K of the input signal of the call module by resampling.
Preferably, the mono audio signal is resampled in step S230, specifically:
and carrying out hardware resampling on the single-sound-channel audio signal through a built-in ADSP chip in the SOC chip.
It should be noted that, the hardware resampling is performed by using the ADSP chip built in the SOC chip, and then the hardware resampling is sent to the core algorithm processing engine, instead of using software resampling of the android frame layer, which greatly reduces the overhead of the system and increases the system efficiency.
In the audio noise processing method provided in embodiment 2 of the present invention, the DSP noise reduction chip performs gain, separation, filtering, and resampling on the call audio signal, so that the signal of the call audio signal output by the DSP can be completely input to the call module, thereby completing bidirectional call interaction and response. The noise reduction process of the call audio signal does not occupy CPU performance, HAL layer codes do not need to be changed, authorization or activation is not needed to influence a production line, a voice resource packet, a Bluetooth telephone and the like are decoupled, and the call fault probability is reduced; for the noise reduction after-sale updating of the call audio signal, a DSP chip is not required to be replaced, the after-sale updating is carried out only through software upgrading and refreshing, the voice noise reduction algorithm can be upgraded through OTA at any time, and the hardware refreshing cost is reduced.
Referring to fig. 3, steps S100 to S400 of the audio noise processing method according to embodiment 3 of the present invention are the same as steps S100 to S400 of embodiment 1, except that: before the step S300 is input to the voice assistant application software through the audio hardware abstraction layer, and the noise reduction processing and the echo cancellation processing are performed on the voice audio signal through the voice noise reduction algorithm integrated in the voice assistant application software, the method further includes:
and S310, acquiring an audio signal at a loudspeaker end as a reference signal.
It should be noted that the DSP collects the audio signal at the speaker end in real time as a reference signal.
And S320, mixing the reference signal and the voice audio signal to obtain a mixed audio signal.
It should be noted that the DSP collects and converts the multiple signals, such as the reference signal and the voice audio signal, through an ADC (analog-to-digital converter), and performs sound mixing in a time-division multiplexing (TDM) mode to obtain a single signal, and then transmits the single signal to the CPU, thereby implementing simultaneous transmission of multiple signals.
S330, inputting the audio-mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
It should be noted that, the speech noise reduction algorithm integrated in the speech assistant application software in the SOC is called to implement noise reduction and echo cancellation on the speech audio signal, thereby ensuring good recognition effect. The interface function of the speech noise reduction algorithm is as shown in table 1:
TABLE 1
It can be understood that the voice noise reduction algorithm for noise reduction and echo cancellation of the voice audio signal is integrated in the voice assistant application software, so that HAL layer modification is not needed, independent hardware noise reduction modules can be reduced, occupation of a PCB (printed circuit board) is reduced, dependence on hardware is reduced, cost is greatly reduced, tuning parameters can be flexibly adjusted, firmware does not need to be updated, and refreshing cost is reduced.
In the audio noise processing method provided by embodiment 3 of the present invention, for the noise reduction process of the local audio signal, since each vehicle type has different noise environments such as the position, angle, distance, and interior due to the difference of the microphone arrangement, and the engine, air conditioner, tire noise, and road noise in the vehicle, in order to ensure a good voice recognition effect, the voice parameters such as the voice wake-up threshold, and the in-vehicle reverberation signal model need to be calibrated and adjusted as the vehicle type changes, after mixing multiple audio channels, the audio signal is noise-reduced by the voice noise reduction algorithm integrated in the voice assistant application software, and since the voice noise reduction algorithm is integrated in the APP layer, only the parameter of the APP layer is modified, and no modification of the hall layer is required, so that each vehicle type can be quickly modified and adapted, the voice tuning parameter can be more flexibly adjusted according to different vehicle types and different application scenarios, and an individual hardware noise reduction module can be reduced, the occupation of the PCB is reduced, the dependence on hardware is reduced, the cost is greatly reduced, and the noise-reduced after-sale update of the noise reduction of the local audio signal can be flexibly adjusted, and the firmware does not need to be updated, and the cost is reduced.
Steps S100 to S400 of the audio noise processing method provided in embodiment 4 of the present invention are the same as steps S100 to S400 in embodiment 1, except that:
before the step S200 of performing noise reduction processing on the call audio signal by using the DSP noise reduction chip, the method further includes:
and setting an audio source program into a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial port communication protocol.
It should be noted that the SPI serial communication protocol is a synchronous serial interface technology, is a high-speed, full-duplex, synchronous communication bus, and has the advantages of full-duplex communication support, simple communication, high data transmission rate, and the like.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is a call audio signal, the audio source program is set to a call mode, and the DSP is notified to switch to a call channel mode through the SPI serial message.
Before performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software in step S300, the method further includes:
and setting an audio source program into an intelligent voice mode, and switching the DSP noise reduction chip into an intelligent voice channel mode.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system judges that the audio signal is the local voice audio signal, the audio source program is set to be in the intelligent voice mode, and the DSP is informed to switch to the intelligent voice channel mode through the SPI serial port message.
If the soft noise reduction mode same as that of the local voice audio signal is adopted to reduce the noise of the call audio signal, more difficulties and problems are caused. The first problem is that the complexity and the occupied space of the soft noise reduction algorithm are increased, the running performance of a CPU is consumed, and time delay may exist. The second problem is that the noise reduction of the call audio signal is different from the noise reduction of the voice audio signal, because the noise reduction algorithm of the voice audio signal can be integrated in the voice assistant APP of the application layer, and because the bluetooth call algorithm BTNR in the soft noise reduction scheme of the call audio signal involves a deeper bottom layer, a soft noise reduction library needs to be integrated in the HAL layer, an interface library is called, functions are modified to configure and create a recording thread, and finally, the soft noise reduction can be realized only by sending the reduced recording to the voice assistant. The scheme can cause that the interfaces of the android HAL layer need to be deeply changed, the modification risk is high, and problems are easy to occur. The third problem is that the general soft noise reduction algorithm needs to be authorized and activated, if the call audio signal also adopts the soft noise reduction algorithm, the production line needs to perform at least two times of call and voice algorithm verification as the local voice audio signal soft noise reduction, the complexity of the production line is increased, the production beat is slowed down, and the unauthorized problem in some scenes is easily caused. The soft noise reduction algorithm of the call audio signal and the soft noise reduction algorithm of the local voice audio signal are required to be stored in a voice resource packet together, when the voice resource packet is lost, the telephone recording function can be directly influenced, the coupling is high, the telephone function is required to be higher in grade than the voice, the voice resource packet is large, and the probability of telephone unavailability is increased due to the fact that the copy upgrading and the like are easy to lose.
Therefore, embodiment 4 of the present invention provides an audio noise processing method, where call audio signal noise reduction is performed based on a DSP chip to perform hard noise reduction: the user inputs the audio frequency to the microphone, and DSP directly falls the processing of making an uproar by bottom DSP chip inside after sampling conversation audio frequencies such as bluetooth/CarPlay phone/ECALL/BCAll, and the recording after falling the noise is transmitted to bluetooth APP at last and is used, accomplishes conversation recognition function. By adopting the scheme, the noise reduction of the call audio signal does not need to occupy the performance of a CPU (Central processing Unit) or change HAL (half-life) layer codes, does not need authorization or activation to influence a production line, decouples a voice resource packet, a Bluetooth telephone and the like, and reduces the probability of call failure.
A second aspect.
Referring to fig. 4, an embodiment 5 of the present invention provides an audio noise processing system, including:
the audio signal acquiring and sound source determining module 100 acquires an audio signal at a microphone end and determines a sound source of the audio signal.
It should be noted that the audio signal at the microphone end is an input signal of the user to the microphone end, and after the DSP chip acquires the audio signal at the microphone end, the sound source of the audio signal is determined by the vehicle-mounted system.
It will be appreciated that, since the audio channels of different audio signals are different, determining the source of the audio signal may be: and judging the sound source of the audio signal through the sound source circulation channel of the audio signal. Since the frequency domains of different audio signals are different, determining the sound source of the audio signal may also be determining the sound source of the audio signal according to the frequency domain of the audio signal.
Preferably, the determining of the sound source of the audio signal, in particular:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
And the call audio signal processing module 200 is configured to, when the sound source of the audio signal is a call audio signal, perform noise reduction processing on the call audio signal through the DSP noise reduction chip, and input a first noise reduction signal obtained through the noise reduction processing to the call module through the audio hardware abstraction layer, so as to complete bidirectional call interaction and response.
It should be noted that the call audio signal includes: bluetooth call, carPlay phone, ECALL, BCAll, etc. And carrying out noise reduction processing on the call audio signal through the DSP noise reduction chip, namely carrying out hard noise reduction processing on the call audio signal.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is a call audio signal, the noise reduction processing is directly performed inside the DSP chip to obtain a first noise reduction signal, and the first noise reduction signal is transmitted to the call module through the audio hardware abstraction layer to complete the two-way call interaction and response.
The local speech audio signal processing module 300 is configured to, when the sound source of the audio signal is a local speech audio signal, input the local speech audio signal to the speech assistant application software through the audio hardware abstraction layer, and perform noise reduction processing and echo cancellation processing on the local speech audio signal through a speech noise reduction algorithm integrated in the speech assistant application software.
It should be noted that the local voice audio signal includes: vehicle-mounted artificial intelligent voice, vehicle-mounted voice recognition assistant and other local voice audio signals. And performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software, namely performing soft noise reduction on the local voice audio signal.
It can be understood that, after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is a local voice audio signal, the local voice audio signal is transmitted to the CPU, and is input to the voice assistant application software through the audio hardware abstraction layer, and the local voice audio signal is subjected to noise reduction processing and echo cancellation processing through the voice noise reduction algorithm integrated in the voice assistant application software.
And the mobile phone interconnection voice audio signal processing module 400 is configured to perform noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of the audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal.
It should be noted that the mobile phone interconnection voice audio is voice and music mixed sound, and the mobile phone interconnection voice audio signal includes: and the cellphone interconnection voice audio signals of third-party application programs such as carplay, carlife and the like, wherein the third-party application programs do not provide the noise reduction function. And the noise reduction unit of the audio hardware abstraction layer is used for carrying out noise reduction on the mobile phone interconnection voice audio signal, namely carrying out soft noise reduction on the mobile phone interconnection voice audio signal.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is a mobile phone interconnection audio signal, it is necessary to perform audio monitoring while playing music, transmit the local audio signal to the CPU, and perform noise reduction processing on the mobile phone interconnection audio signal through the vehicle-mounted SOC system on the HAL layer.
In the audio noise processing system provided in embodiment 5 of the present invention, audio signals are separated according to a sound source of the audio signals, a DSP noise reduction chip is used for noise reduction for call audio signals, a voice noise reduction algorithm is used for noise reduction for local voice audio signals, and a noise reduction unit on a hardware abstraction layer is used for noise reduction for mobile phone interconnection voice audio signals, that is, different noise reduction methods are used for audio signals of different sound sources, so as to reduce noise interference of vehicle audio, improve quality of vehicle audio, and reduce hardware cost and development cost of noise processing.
In addition, the noise reduction process of the call audio signal does not occupy the CPU performance, does not need to change HAL layer codes, does not need authorization or activation to influence a production line, decouples a voice resource packet, a Bluetooth telephone and the like, and reduces the probability of call failure; for the noise reduction after-sale updating of the call audio signal, a DSP chip is not required to be replaced, the after-sale updating is carried out only through software upgrading and refreshing, the voice noise reduction algorithm can be upgraded through OTA at any time, and the hardware refreshing cost is reduced.
For the noise reduction process of the local voice audio signal, because the microphone arrangement position, the angle, the distance, the difference of the interior trim and the noise environment such as an engine, an air conditioner, tire noise and road noise are different in each vehicle type, in order to ensure good voice recognition effect, voice awakening threshold values, voice parameters such as a vehicle interior reverberation signal model need to be calibrated and adjusted along with the change of the vehicle type, the voice noise reduction algorithm provided by the scheme is integrated on an APP layer, only the parameters of the APP layer are modified, HAL layer modification can be omitted, rapid modification and application of each vehicle type can be realized, the voice tuning parameters can be adjusted more flexibly according to different vehicle types and different application scenes, an independent hardware noise reduction module can be reduced, the occupation of a PCB is reduced, the dependence on hardware is reduced, the cost is greatly reduced, after-sale updating and flexible tuning parameters of the noise reduction of the local voice audio signal can be adjusted, firmware updating is omitted, and the refreshing cost is reduced.
For the noise reduction process of the mobile phone interconnection voice audio signal, because the DSP cannot support noise reduction under the condition of voice and music mixing, the DSP cannot support noise reduction of mobile phone interconnection voice audio signals of third-party application programs such as Carplay, carlife and the like which do not provide a noise reduction function, therefore, the noise reduction process of the mobile phone interconnection voice audio signal is processed by a vehicle SOC system on an HAL layer, the occupation of a PCB is reduced, the dependence on hardware is reduced, and the cost is greatly reduced.
In the audio noise processing system provided in embodiment 6 of the present invention, the modules 100 to 400 are the same as the modules 100 to 400 in embodiment 5, except that: the call audio signal processing module 200 is further configured to execute steps S210-S230:
s210, the communication audio signal is gained through the DSP noise reduction chip, and a first gain signal is obtained.
It should be noted that the gain is an amplification factor of the signal.
S220, performing noise separation and filtering on the first gain signal to obtain a single-channel audio signal.
It should be noted that, the separator filters the signal to perform denoising processing.
It can be understood that the DSP noise reduction chip gains the call audio signal, separates and filters out the external environment noise, and eliminates the noise, thereby improving the call quality.
S230 resamples the monaural audio signal, so that the sampling rate of the monaural audio signal satisfies the sampling rate of the input signal of the call module, and uses the resampled monaural audio signal as a first noise reduction signal.
It should be noted that the resampling is to resample a signal to obtain a signal that satisfies the sampling rate of the input signal of the call module. Because the sampling rate of the signal output by the DSP noise reduction chip is different from the sampling rate of the input signal of the call module, the signal needs to be resampled. For example, the sampling rate of the signal with the sampling rate of 48K output by the DSP noise reduction chip is changed into one of the sampling rates of 8K, 24K or 16K of the input signal of the call module by resampling.
Preferably, the mono audio signal is resampled in step S230, specifically:
and carrying out hardware resampling on the single-sound-channel audio signal through a built-in ADSP chip in the SOC chip.
It should be noted that, the hardware resampling is performed by using the ADSP chip built in the SOC chip, and then the hardware resampling is sent to the core algorithm processing engine, instead of using software resampling of the android frame layer, which greatly reduces the overhead of the system and increases the system efficiency.
In the audio noise processing system provided in embodiment 6 of the present invention, the DSP noise reduction chip performs gain, separation, filtering, and resampling on the call audio signal, so that the signal of the call audio signal output by the DSP can be completely input to the call module, thereby completing bidirectional call interaction and response. The noise reduction process of the call audio signal does not occupy CPU performance, HAL layer codes do not need to be changed, authorization or activation is not needed to influence a production line, a voice resource packet, a Bluetooth telephone and the like are decoupled, and the call fault probability is reduced; for the noise reduction after-sale updating of the call audio signal, a DSP chip is not required to be replaced, the after-sale updating is carried out only through software upgrading and refreshing, the voice noise reduction algorithm can be upgraded through OTA at any time, and the hardware refreshing cost is reduced.
In the audio noise processing system provided in embodiment 7 of the present invention, the modules 100 to 400 are the same as the modules 100 to 400 in embodiment 5, except that: the local audio signal processing module 300 is further configured to execute steps S310-S3330:
and S310, acquiring an audio signal at a loudspeaker end as a reference signal.
It should be noted that the DSP collects the audio signal at the speaker end in real time as a reference signal.
And S320, mixing the reference signal and the voice audio signal to obtain a mixed audio signal.
It should be noted that, after the reference signal and the multiple signals such as the voice audio signal are collected and converted by the DSP through the ADC, the reference signal and the multiple signals are mixed in a TDM time division multiplexing mode to obtain one signal and then transmitted to the CPU, so that the multiple signals are transmitted simultaneously.
S330, inputting the audio-mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
It should be noted that, the speech noise reduction algorithm integrated in the speech assistant application software in the SOC is called to implement noise reduction and echo cancellation on the speech audio signal, thereby ensuring good recognition effect. The interface function of the speech noise reduction algorithm is as shown in table 1:
TABLE 1
It can be understood that the speech noise reduction algorithm for noise reduction and echo cancellation of the speech audio signal is integrated in the speech assistant application software, so that modification of an HAL layer is not required, an independent hardware noise reduction module can be reduced, occupation of a PCB (printed circuit board) is reduced, dependence on hardware is reduced, cost is greatly reduced, tuning parameters can be flexibly adjusted, firmware does not need to be updated, and refreshing cost is reduced.
In the noise processing system for audio provided in embodiment 7 of the present invention, for the noise reduction process of the local voice audio signal, since each vehicle type has different noise environments such as the position, angle, distance, and interior due to the difference of the microphone arrangement, and the engine, air conditioner, tire noise, and road noise in the vehicle, in order to ensure a good voice recognition effect, the voice parameters such as the voice wake-up threshold, and the in-vehicle reverberation signal model need to be calibrated and adjusted as the vehicle type changes, after mixing multiple audio channels, the voice audio signal is noise-reduced by the voice noise reduction algorithm integrated in the voice assistant application software, and since the voice noise reduction algorithm is integrated in the APP layer, only the parameter of the APP layer is modified, and no modification of the tuning layer is required, so that each vehicle type can be quickly modified and adapted, the voice tuning parameter can be more flexibly adjusted according to different vehicle types and different application scenarios, and an individual hardware noise reduction module can be reduced, PCB occupation can be reduced, dependence on hardware can be reduced, and cost can be greatly reduced.
The modules 100 to 400 of the audio noise processing system provided in embodiment 8 of the present invention are the same as the modules 100 to 400 in embodiment 5, except that: the call audio signal processing module 200 is further configured to:
and setting an audio source program into a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial port communication protocol.
It should be noted that the SPI serial communication protocol is a synchronous serial interface technology, is a high-speed, full-duplex, synchronous communication bus, and has the advantages of full-duplex communication support, simple communication, high data transmission rate, and the like.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system determines that the audio signal is a call audio signal, the audio source program is set to a call mode, and the DSP is notified to switch to a call channel mode through the SPI serial message.
The local voice audio signal processing module 300 is further configured to:
and setting an audio source program into an intelligent voice mode, and switching the DSP noise reduction chip into an intelligent voice channel mode.
It can be understood that after the audio signal at the microphone end is collected by the DSP chip and the vehicle-mounted system judges that the audio signal is the local voice audio signal, the audio source program is set to be in the intelligent voice mode, and the DSP is informed to switch to the intelligent voice channel mode through the SPI serial port message.
If the same soft noise reduction mode as the local voice audio signal is adopted to reduce the noise of the call audio signal, more difficulties and problems exist. The first problem is that the complexity and the occupied space of the soft noise reduction algorithm are increased, the running performance of a CPU is consumed, and time delay may exist. The second problem is that the noise reduction of the call audio signal is different from the noise reduction of the voice audio signal, because the noise reduction algorithm of the voice audio signal can be integrated in the voice assistant APP of the application layer, and because the bluetooth call algorithm BTNR in the soft noise reduction scheme of the call audio signal involves a deeper bottom layer, a soft noise reduction library needs to be integrated in the HAL layer, an interface library is called, functions are modified to configure and create a recording thread, and finally, the soft noise reduction can be realized only by sending the reduced recording to the voice assistant. The scheme can cause that the interfaces of the android HAL layer need to be deeply changed, the modification risk is high, and problems are easy to occur. The third problem is that the general soft noise reduction algorithm needs to be authorized and activated, if the call audio signal also adopts the soft noise reduction algorithm, the production line needs to perform at least two times of call and voice algorithm verification as the local voice audio signal soft noise reduction, the complexity of the production line is increased, the production beat is slowed down, and the unauthorized problem in some scenes is easily caused. The soft noise reduction algorithm of the call audio signal and the soft noise reduction algorithm of the local voice audio signal are required to be stored in a voice resource packet, when the voice resource packet is lost, the telephone recording function can be directly influenced, the coupling is high, the telephone function is required to be higher in grade than the voice, the voice resource packet is large, and the loss is easy to occur due to copy upgrading and the like, so that the probability of telephone unavailability is increased.
Therefore, in the audio noise processing system provided in embodiment 8 of the present invention, the call audio signal noise reduction is performed based on a DSP chip to perform hard noise reduction: the user is to microphone input audio frequency, and DSP directly falls the noise processing by bottom DSP chip inside after sampling conversation audio frequencies such as bluetooth/CarPlay phone/ECALL/BCAll, and the recording after falling the noise is transmitted to bluetooth APP at last and is used, accomplishes conversation recognition function. By adopting the scheme, the communication audio signal noise reduction does not need to occupy the performance of a CPU (Central processing Unit) or change HAL (half-line architecture) layer codes, does not need authorization or activation to influence a production line, decouples a voice resource packet, a Bluetooth telephone and the like, and reduces the communication fault probability.
In a third aspect.
The present invention provides an electronic device, including:
a processor, a memory, and a bus;
the bus is used for connecting the processor and the memory;
the memory is used for storing operation instructions;
the processor is configured to invoke the operation instruction, and the executable instruction causes the processor to perform an operation corresponding to the audio noise processing method shown in the first aspect of the present application.
In an alternative embodiment, an electronic device is provided, as shown in fig. 5, the electronic device 5000 shown in fig. 5 includes: a processor 5001 and a memory 5003. The processor 5001 and the memory 5003 are coupled, such as via a bus 5002. Optionally, the electronic device 5000 may also include a transceiver 5004. It should be noted that the transceiver 5004 is not limited to one in practical application, and the structure of the electronic device 5000 is not limited to the embodiment of the present application.
The processor 5001 may be a CPU, general purpose processor, DSP, ASIC, FPGA or other programmable logic device, transistor logic device, hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 5001 may also be a combination of computing functions, e.g., comprising one or more microprocessors, a combination of a DSP and a microprocessor, or the like.
The memory 5003 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an EEPROM, a CD-ROM or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
The memory 5003 is used for storing application program codes for executing the present solution, and the execution is controlled by the processor 5001. The processor 5001 is configured to execute application program code stored in the memory 5003 to implement the teachings of any of the foregoing method embodiments.
Wherein, the electronic device includes but is not limited to: mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like.
A fourth aspect.
The present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of noise processing of audio as set forth in the first aspect of the present application.
Yet another embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, which, when run on a computer, enables the computer to perform the corresponding content in the aforementioned method embodiments.
Claims (10)
1. A method of noise processing audio, comprising:
acquiring an audio signal of a microphone end, and determining a sound source of the audio signal;
if the sound source of the audio signal is a call audio signal, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, and inputting a first noise reduction signal obtained through the noise reduction processing to a call module through an audio hardware abstraction layer to complete bidirectional call interaction and response;
if the sound source of the audio signal is a local voice audio signal, inputting the local voice audio signal to voice assistant application software through an audio hardware abstraction layer, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
and if the sound source of the audio signal is a mobile phone interconnection voice audio signal, carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer.
2. The method for processing noise of audio frequency according to claim 1, wherein the noise reduction processing of the call audio signal by the DSP noise reduction chip includes:
the communication audio signal is gained through a DSP noise reduction chip to obtain a first gain signal;
performing noise separation and filtering on the first gain signal to obtain a single-channel audio signal;
and resampling the single-sound-channel audio signal to enable the sampling rate of the single-sound-channel audio signal to meet the sampling rate of the input signal of the communication module, and taking the resampled single-sound-channel audio signal as a first noise reduction signal.
3. A method for noise processing of audio according to claim 2, wherein said resampling of the mono audio signal is performed by:
and carrying out hardware resampling on the single-sound-channel audio signal through an ADSP chip arranged in the SOC chip.
4. The method for processing noise in audio according to claim 1, wherein before the audio is input to a voice assistant application software through an audio hardware abstraction layer and subjected to noise reduction processing and echo cancellation processing by a speech noise reduction algorithm integrated in the voice assistant application software, the method further comprises:
acquiring an audio signal of a loudspeaker end as a reference signal;
mixing the reference signal and the voice audio signal to obtain a mixed audio signal;
and inputting the mixed audio signal into a CPU (central processing unit), and calling the voice noise reduction algorithm integrated in the voice assistant application software.
5. The method for processing noise of audio frequency according to claim 1, wherein before the noise reduction processing is performed on the call audio signal by the DSP noise reduction chip, the method further comprises:
and setting an audio source program into a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial port communication protocol.
6. The method for processing noise in audio frequency according to claim 1, wherein before the noise reduction processing and echo cancellation processing of the local audio signal by the speech noise reduction algorithm integrated in the voice assistant application software, the method further comprises:
and setting an audio source program into an intelligent voice mode, and switching the DSP noise reduction chip into an intelligent voice channel mode.
7. A method for processing noise in audio according to claim 1, wherein the determining the source of the audio signal comprises:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
8. A noise processing system for audio, comprising:
the audio signal acquisition and sound source judgment module is used for acquiring an audio signal at a microphone end by a sound source and determining a sound source of the audio signal;
the call audio signal processing module is used for carrying out noise reduction processing on the call audio signal through the DSP noise reduction chip when the sound source of the audio signal is the call audio signal, and inputting a first noise reduction signal obtained through the noise reduction processing to the call module through the audio hardware abstraction layer so as to complete bidirectional call interaction and response;
the local voice audio signal processing module is used for inputting the sound source of the audio signal into voice assistant application software through an audio hardware abstraction layer when the sound source of the audio signal is a local voice audio signal, and performing noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
and the mobile phone interconnection voice audio signal processing module is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal.
9. An electronic device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the noise processing method of audio according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, comprising a stored computer program, wherein the computer program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform the method of noise processing audio according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111540141.9A CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111540141.9A CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115223582A true CN115223582A (en) | 2022-10-21 |
| CN115223582B CN115223582B (en) | 2024-01-30 |
Family
ID=83606003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111540141.9A Active CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115223582B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030069727A1 (en) * | 2001-10-02 | 2003-04-10 | Leonid Krasny | Speech recognition using microphone antenna array |
| US20090310795A1 (en) * | 2006-05-31 | 2009-12-17 | Agere Systems Inc. | Noise Reduction By Mobile Communication Devices In Non-Call Situations |
| US20130343558A1 (en) * | 2012-06-26 | 2013-12-26 | Parrot | Method for denoising an acoustic signal for a multi-microphone audio device operating in a noisy environment |
| CN104575510A (en) * | 2015-02-04 | 2015-04-29 | 深圳酷派技术有限公司 | Noise reduction method, noise reduction device and terminal |
| US20170155756A1 (en) * | 2015-11-27 | 2017-06-01 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling voice signal |
| US20180035231A1 (en) * | 2016-07-26 | 2018-02-01 | Line Corporation | Method and system for audio quality enhancement |
| US20190057712A1 (en) * | 2018-01-24 | 2019-02-21 | Hisense Mobile Communications Technology Co., Ltd. | Noise reduction method and electronic device |
| CN110097891A (en) * | 2019-04-22 | 2019-08-06 | 广州视源电子科技股份有限公司 | A kind of microphone signal processing method, device, equipment and storage medium |
| CN110769111A (en) * | 2019-10-28 | 2020-02-07 | 珠海格力电器股份有限公司 | Noise reduction method, system, storage medium and terminal |
| CN111683319A (en) * | 2020-06-08 | 2020-09-18 | 北京爱德发科技有限公司 | Call pickup noise reduction method, earphone and storage medium |
| CN112235674A (en) * | 2020-09-24 | 2021-01-15 | 海菲曼（天津）科技有限公司 | Active noise reduction processing method, system and chip based on noise analysis |
| CN113096677A (en) * | 2021-03-31 | 2021-07-09 | 深圳市睿耳电子有限公司 | Intelligent noise reduction method and related equipment |
| CN113163152A (en) * | 2021-03-30 | 2021-07-23 | 九音(南京)集成电路技术有限公司 | Multi-dimensional sound pickup and noise reduction method, video teleconference system and computer storage medium |
| GB202112256D0 (en) * | 2020-08-31 | 2021-10-13 | Parker Tom Richard | Systems and methods for moderating noise levels in a communication session |
-
2021
- 2021-12-16 CN CN202111540141.9A patent/CN115223582B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030069727A1 (en) * | 2001-10-02 | 2003-04-10 | Leonid Krasny | Speech recognition using microphone antenna array |
| US20090310795A1 (en) * | 2006-05-31 | 2009-12-17 | Agere Systems Inc. | Noise Reduction By Mobile Communication Devices In Non-Call Situations |
| US20130343558A1 (en) * | 2012-06-26 | 2013-12-26 | Parrot | Method for denoising an acoustic signal for a multi-microphone audio device operating in a noisy environment |
| CN104575510A (en) * | 2015-02-04 | 2015-04-29 | 深圳酷派技术有限公司 | Noise reduction method, noise reduction device and terminal |
| US20170155756A1 (en) * | 2015-11-27 | 2017-06-01 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling voice signal |
| US20180035231A1 (en) * | 2016-07-26 | 2018-02-01 | Line Corporation | Method and system for audio quality enhancement |
| US20190057712A1 (en) * | 2018-01-24 | 2019-02-21 | Hisense Mobile Communications Technology Co., Ltd. | Noise reduction method and electronic device |
| CN110097891A (en) * | 2019-04-22 | 2019-08-06 | 广州视源电子科技股份有限公司 | A kind of microphone signal processing method, device, equipment and storage medium |
| CN110769111A (en) * | 2019-10-28 | 2020-02-07 | 珠海格力电器股份有限公司 | Noise reduction method, system, storage medium and terminal |
| CN111683319A (en) * | 2020-06-08 | 2020-09-18 | 北京爱德发科技有限公司 | Call pickup noise reduction method, earphone and storage medium |
| GB202112256D0 (en) * | 2020-08-31 | 2021-10-13 | Parker Tom Richard | Systems and methods for moderating noise levels in a communication session |
| CN112235674A (en) * | 2020-09-24 | 2021-01-15 | 海菲曼（天津）科技有限公司 | Active noise reduction processing method, system and chip based on noise analysis |
| CN113163152A (en) * | 2021-03-30 | 2021-07-23 | 九音(南京)集成电路技术有限公司 | Multi-dimensional sound pickup and noise reduction method, video teleconference system and computer storage medium |
| CN113096677A (en) * | 2021-03-31 | 2021-07-09 | 深圳市睿耳电子有限公司 | Intelligent noise reduction method and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115223582B (en) | 2024-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8019454B2 (en) | Audio processing system | |
| US9978355B2 (en) | System and method for acoustic management | |
| US8065026B2 (en) | Vehicle computer system with audio entertainment system | |
| CN112437383B (en) | Multi-sound-source adjusting method and device, vehicle and storage medium | |
| US20040078104A1 (en) | Method and apparatus for an in-vehicle audio system | |
| CN109273006A (en) | Sound control method, onboard system, vehicle and the storage medium of onboard system | |
| CN110389743B (en) | Vehicle-mounted audio system and vehicle | |
| CN110730406A (en) | Method for outputting two paths of independent sound sources based on Android system | |
| CN113055783A (en) | Vehicle audio output method and device, electronic equipment and storage medium | |
| CN113763956A (en) | Interaction method and device applied to vehicle | |
| CN113225716A (en) | Vehicle-mounted karaoke realization method, system, equipment and storage medium | |
| CN115223582B (en) | Audio noise processing method, system, electronic device and medium | |
| CN116142101A (en) | Entertainment system and method for vehicle, vehicle and storage medium | |
| KR101500177B1 (en) | Audio system of vehicle | |
| CN116709112A (en) | Audio data processing method, system, data processing device and storage medium | |
| CN111666062A (en) | Audio processing device and method and vehicle-mounted information entertainment system | |
| Every et al. | A Software-Centric Solution to Automotive Audio for General Purpose CPUs | |
| CN114827835A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium | |
| CN114827834A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium | |
| CN112235694B (en) | In-vehicle voice processing method and system, electronic device and storage medium | |
| CN116841950A (en) | Audio data transmission method, device, chip and computer readable storage medium | |
| CN114827797A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium | |
| CN117111877A (en) | Audio focus control method, device, equipment and storage medium | |
| US20240132002A1 (en) | Vehicle-mounted audio playing method and apparatus, multimedia host, and storage medium | |
| CN210402477U (en) | Voice-controlled intelligent automobile data recorder |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |