CN110536193A - A kind of processing method and processing device of audio signal - Google Patents
A kind of processing method and processing device of audio signal Download PDFInfo
- Publication number
- CN110536193A CN110536193A CN201910671546.2A CN201910671546A CN110536193A CN 110536193 A CN110536193 A CN 110536193A CN 201910671546 A CN201910671546 A CN 201910671546A CN 110536193 A CN110536193 A CN 110536193A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- audio
- collection module
- preset threshold
- amplitude
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention discloses a kind of processing method and processing devices of audio signal, it is related to electronic technology field, the sound hole solved in main microphon connection is blocked, in the case that the sound hole of secondary microphone connection is not blocked, the larger problem of environmental noise accounting in the audio signal that electronic equipment is got.Electronic equipment is according to collected first audio signal of the first audio collection module, determine the first audio collection module exception, and amplitude and the first preset threshold according to the first audio signal, adjustment ratio is calculated, the first preset threshold is the amplitude threshold that the first audio collection module currently acquires audio signal；The collected audio signal of second audio collection module is adjusted using adjustment ratio, obtains the second audio signal；Determine the audio signal that the difference of the first audio signal and the second audio signal gets for electronic equipment.
Description
Technical field
This application involves electronic technology field more particularly to a kind of processing method and processing devices of audio signal.
Background technique
Current electronic equipment (such as mobile phone) is generally using two microphones (such as main MIC and secondary MIC) acquisition audio signal.
In the collected audio signal of main MIC, the voice signal accounting of user is larger, and environmental noise accounts for smaller.It is acquired in secondary MIC
To audio signal in, the voice signal of user accounts for smaller, and environmental noise accounting is larger.In general, electronic equipment adopts main MIC
The audio letter that difference between the audio signal collected and the collected audio signal of secondary MIC is finally got as electronic equipment
Number, effectively shield environmental noise.
In order to facilitate acquisition audio signal, the sound hole connecting with MIC is offered on electronic equipment casing.When user is hand-held
When there is object on electronic equipment or electronic equipment periphery, it is possible that the sound hole of main MIC connection is blocked, and secondary MIC connection
Sound hole situation about not being blocked.In this case, environmental noise accounts in the audio signal that electronic equipment is finally got
It is bigger, affect user experience.
Summary of the invention
The application provides a kind of processing method and processing device of audio signal, is able to solve the sound hole quilt in main MIC connection
Blocking, and in the case that the sound hole of secondary MIC connection is not blocked, environment is made an uproar in the audio signal that electronic equipment is finally got
The problem of sound accounting is larger, influences user experience.
In order to achieve the above objectives, the application adopts the following technical scheme that
In a first aspect, providing a kind of processing method of audio signal, which is applied to include the first audio collection
The electronic equipment of module and the second audio collection module.Specifically, electronic equipment is collected according to the first audio collection module
The first audio signal, it is pre- according to the amplitude of the first audio signal and first after determining the first audio collection module exception
If threshold value (amplitude threshold that the first audio collection module currently acquires audio signal), adjustment ratio is calculated, and using adjustment ratio
The example adjustment collected audio signal of the second audio collection module, obtains the second audio signal；Later, electronic equipment determines first
The difference of audio signal and the second audio signal is the audio signal that the electronic equipment is got.
In the scene of the first audio collection module exception, electronic equipment adaptively adjusts the second audio collection module and adopts
The audio signal collected, to obtain the second audio signal so that collected first audio signal of the first audio collection module with
Difference between second audio signal keeps within a preset range, effectively shielding environmental noise, improving user experience.
Optionally, in a kind of possible implementation of the application, above-mentioned " electronic equipment is according to the first audio signal
Amplitude and the first preset threshold calculate adjustment ratio " method are as follows: electronic equipment is by the amplitude of the first audio signal and the
The ratio of one preset threshold is determined as adjustment ratio.
Optionally, in the alternatively possible implementation of the application, above-mentioned " electronic equipment is adjusted using adjustment ratio
The collected audio signal of second audio collection module, obtains the second audio signal " method are as follows: electronic equipment determine adjustment ratio
The product of example and the collected audio signal of the second audio collection module is the second audio signal.
Optionally, above-mentioned " to be acquired according to the first audio collection module in the alternatively possible implementation of the application
The first audio signal arrived, determine the first audio collection module exception " method are as follows: electronic equipment judges the first audio signal
Whether amplitude is less than the first preset threshold, if the amplitude of the first audio signal is less than the first preset threshold, it is determined that first
Audio collection module is abnormal；Alternatively, electronic equipment judges whether the Energy distribution of the first audio signal meets preset condition, if the
The Energy distribution of one audio signal is unsatisfactory for preset condition, it is determined that the first audio collection module is abnormal；Alternatively, electronic equipment is sentenced
Whether whether the amplitude of disconnected first audio signal meet less than the Energy distribution of the first preset threshold and the first audio signal
Preset condition, if the amplitude of the first audio signal, less than the first preset threshold, and the Energy distribution of the first audio signal is discontented
Sufficient preset condition, it is determined that the first audio collection module is abnormal.
Optionally, in the alternatively possible implementation of the application, electronic equipment also uses adjustment ratio adjustment the
One preset threshold, the first preset threshold after being adjusted, and the second preset threshold (the second audio is adjusted using adjustment ratio
Acquisition module currently acquires the amplitude threshold of audio signal), the second preset threshold after being adjusted.Adjusted first is default
Threshold value judges whether the collected audio signal of the first audio collection module is abnormal for electronic equipment in the follow-up process.Adjustment
The second preset threshold afterwards judges the collected audio signal of the second audio collection module for electronic equipment in the follow-up process
It is whether abnormal.
Second aspect provides a kind of processing unit of audio signal, and it includes the first audio collection mould which, which is located at,
The electronic equipment of block and the second audio collection module, the processing unit can be realized first aspect and its any one possible reality
Function in existing mode.These functions can also execute corresponding software realization by hardware realization by hardware.Hardware
Or software includes one or more modules corresponding with above-mentioned function.
In a kind of possible mode of the application, the processing unit of the audio signal can include determining that unit, calculate
Unit and adjustment unit, the determination unit, computing unit and adjustment unit can execute above-mentioned first aspect and its any one
Corresponding function in the processing method of the audio signal of possible implementation.Such as: determination unit, for according to the first audio
Collected first audio signal of acquisition module determines the first audio collection module exception.Computing unit, in determination unit
In the case where determining the first audio collection module exception, according to the amplitude of the first audio signal and the first preset threshold, calculate
Adjustment ratio, the first preset threshold are the amplitude threshold that the first audio collection module currently acquires audio signal.Adjustment unit is used
In adjusting the collected audio signal of the second audio collection module using adjustment ratio, the second audio signal is obtained.Determination unit,
It is also used to determine the audio signal that the difference of the first audio signal and the second audio signal gets for processing unit.
The third aspect provides a kind of equipment, including processor and memory；The memory and the processor coupling
It closes；The memory is for storing computer program code, and the computer program code includes instruction, when the processor is held
When row described instruction, the equipment executes the processing side of first aspect and its audio signal of any one possible implementation
Corresponding function in method.
Fourth aspect also provides a kind of computer readable storage medium, and meter is stored in the computer readable storage medium
The instruction of calculation machine；When computer instruction is run in the processing unit of audio signal, the processing unit of the audio signal is executed such as
The processing method of audio signal described in above-mentioned first aspect and its various possible implementations.
5th aspect, also provides a kind of computer program product, which includes computer instruction, works as meter
Calculation machine is instructed when running in the processing unit of audio signal, so that the processing unit of audio signal executes such as above-mentioned first aspect
And its processing method of audio signal described in various possible implementations.
It should be noted that above-mentioned computer instruction can be stored in computer storage medium in whole or in part,
In, what the first computer storage medium can be packaged together with processor, it can also be individually encapsulated with processor, the application couple
This is not construed as limiting.
The description of second aspect in the application, the third aspect, fourth aspect, the 5th aspect and its various implementations, can
With reference to the detailed description in first aspect and its various implementations；Also, second aspect, the third aspect, fourth aspect,
The beneficial effect of five aspects and its various implementations, can be with reference to the beneficial effect in first aspect and its various implementations
Analysis, details are not described herein again.
In this application, the name of the processing unit of above-mentioned audio signal does not constitute limit to equipment or functional module itself
Fixed, in practical implementations, these equipment or functional module can occur with other titles.As long as each equipment or functional module
Function is similar with the application, belongs within the scope of the claim of this application and its equivalent technologies.
These aspects or other aspects of the application in the following description can more straightforward.
Detailed description of the invention
Fig. 1 is a kind of hardware configuration example schematic of equipment provided by the embodiments of the present application；
Fig. 2A is the distribution schematic diagram one of main microphon and secondary microphone in the embodiment of the present application；
Fig. 2 B is the distribution schematic diagram two of main microphon and secondary microphone in the embodiment of the present application；
Fig. 3 is the flow diagram one of the processing method of audio signal provided by the embodiments of the present application；
Fig. 4 is the flow diagram two of the processing method of audio signal provided by the embodiments of the present application；
Fig. 5 is the structural schematic diagram of the processing unit of the embodiment of the present application sound intermediate frequency signal；
Fig. 6 is the structural schematic diagram of computer program product in the embodiment of the present application.
Specific embodiment
The embodiment of the present application provides a kind of processing method of audio signal, can be applied to include at least two audio collections
The electronic equipment of module (such as microphone).It specifically can be applied to after establishing voice communication, electronic equipment acquires the language of user
During sound data.
For including the electronic equipment of the first audio collection module and the second audio collection module, the first audio is being determined
In the case where acquisition module exception, in order to reduce the accounting of environmental noise in the audio signal that electronic equipment is got, electronics is set
It is standby that the collected audio signal of the second audio collection module is adaptively adjusted, so that the collected audio of the first audio collection module
Difference between signal and the second audio collection module audio signal adjusted keeps within a preset range, effectively shielding
Environmental noise improves user experience.
For example, the electronic equipment in the embodiment of the present application can be mobile phone (mobile phone 100 as shown in Figure 1), plate
Computer, personal computer (personal computer, PC), personal digital assistant (personal digital
Assistant, PDA), net book, the terminal devices such as wearable electronic.Specific shape of the embodiment of the present application to electronic equipment
Formula is not done specifically limited.
For example, above-mentioned electronic equipment can be used for and establish voice communication between other electronic equipments, and execute the application
The method that embodiment provides, obtains the audio signal for indicating the voice data of user.Alternatively, being installed in above-mentioned electronic equipment
There is the client for voice communication, after which can establish communication link between other clients, executes this Shen
Please embodiment provide method, obtain the audio signal for indicating the voice data of user.
As shown in Figure 1, mobile phone 100 can specifically include: processor for using mobile phone 100 as above-mentioned electronic equipment
101, radio frequency (radio frequency, RF) circuit 102, memory 103, touch screen 104, blue-tooth device 105, one or more
A sensor 106, WiFi device 107, positioning device 108, voicefrequency circuit 109, Peripheral Interface 110 and power supply device 111 etc.
Component.These components can be communicated by one or more communication bus or signal wire (not shown in figure 1).Art technology
Personnel are appreciated that hardware configuration shown in Fig. 1 does not constitute the restriction to mobile phone, and mobile phone 100 may include than illustrating more
More or less component perhaps combines certain components or different component layouts.
It is specifically introduced below with reference to all parts of the Fig. 1 to mobile phone 100:
Processor 101 is the control centre of mobile phone 100, using the various pieces of various interfaces and connection mobile phone 100,
By running or executing the application program being stored in memory 103, and the data that calling is stored in memory 103, hold
The various functions and processing data of row mobile phone 100.In some embodiments, processor 101 may include that one or more processing are single
Member.In some embodiments of the embodiment of the present application, above-mentioned processor 101 can also include fingerprint authentication chip, for acquisition
To fingerprint verified.
Radio circuit 102 can be used for receive and send messages or communication process in, wireless signal sends and receivees.Particularly,
After radio circuit 102 can receive the downlink data of base station, handled to processor 101；In addition, the data for being related to uplink are sent out
Give base station.In general, radio circuit includes but is not limited to antenna, at least one amplifier, transceiver, coupler, low noise
Amplifier, duplexer etc..In addition, radio circuit 102 can also be communicated with other equipment by wireless communication.The wireless communication
Any communication standard or agreement, including but not limited to global system for mobile communications, general packet radio service, code point can be used
Multiple access, wideband code division multiple access, long term evolution, Email, short message service etc..
Memory 103 is stored in memory 103 by operation for storing application program and data, processor 101
Application program and data execute the various functions and data processing of mobile phone 100.Memory 103 mainly includes storage program
Area and storage data area, wherein storing program area can the (ratio of application program needed for storage program area, at least one function
Such as sound-playing function, image player function)；Storage data area can store according to the number created when using mobile phone 100
According to (such as audio data, phone directory etc.).In addition, memory 103 may include high-speed random access memory (RAM), may be used also
To include nonvolatile storage, such as disk memory, flush memory device or other volatile solid-state parts etc..Memory
103 can store various operating systems, for example,Operating system,Operating system etc..Above-mentioned memory 103
It can be independent, be connected by above-mentioned communication bus with processor 101；Memory 103 can also be integrated with processor 101
Together.
Touch screen 104 can specifically include Trackpad 104-1 and display 104-2.
Wherein, Trackpad 104-1 can acquire the touch event of the user of mobile phone 100 on it or nearby (for example user makes
With operation of any suitable object such as finger, stylus on Trackpad 104-1 or near Trackpad 104-1), and will adopt
The touch information collected is sent to other devices (such as processor 101).Wherein, touch of the user near Trackpad 104-1
Event can be referred to as suspension touch control；Suspension touch control can refer to, user be not necessarily in order to select, move or drag target (such as
Icon etc.) and Trackpad is directly contacted, and user is only needed to be located near equipment to execute wanted function.Furthermore, it is possible to
Trackpad 104-1 is realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.
Display (also referred to as display screen) 104-2 can be used for showing information input by user or be supplied to the information of user
And the various menus of mobile phone 100.Display 104- can be configured using forms such as liquid crystal display, Organic Light Emitting Diodes
2.Trackpad 104-1 can be covered on display 104-2, when Trackpad 104-1 detects touch on it or nearby
After event, processor 101 is sent to determine the type of touch event, and being followed by subsequent processing device 101 can be according to the class of touch event
Type provides corresponding visual output on display 104-2.Although Trackpad 104-1 and display screen 104-2 are to make in Fig. 1
The function that outputs and inputs of mobile phone 100 is realized for two independent components, but in some embodiments it is possible to by Trackpad
104-1 and display screen 104-2 are integrated and that realizes mobile phone 100 output and input function.It is understood that touch screen 104 is
It is stacked by the material of multilayer, Trackpad (layer) and display screen (layer) is only illustrated in the embodiment of the present application, other layers exist
It is not recorded in the embodiment of the present application.In addition, the front that Trackpad 104-1 can be configured in the form of full panel in mobile phone 100,
The front that display screen 104-2 can also be configured in the form of full panel in mobile phone 100, can be realized as in the front of mobile phone in this way
The structure of Rimless.
In addition, mobile phone 100 can also have fingerprint identification function.For example, can be in the back side (such as the postposition of mobile phone 100
The lower section of camera) configuration fingerprint extracting device 112, or configured in the front (such as lower section of touch screen 104) of mobile phone 100
Fingerprint extracting device 112.In another example fingerprint extracting device 112 can be configured in touch screen 104 to realize fingerprint recognition function
The fingerprint identification function that energy, i.e. fingerprint extracting device 112 can be integrated with touch screen 104 to realize mobile phone 100.At this
In the case of kind, which is configured in touch screen 104, can be a part of touch screen 104, can also be with
Other modes configure in touch screen 104.The main component of fingerprint extracting device 112 in the embodiment of the present application is fingerprint sensing
Device, the fingerprint sensor can use any kind of detection technology, including but not limited to optical profile type, condenser type, piezoelectric type or
Supersonic etc..
Mobile phone 100 can also include blue-tooth device 105, for realizing mobile phone 100 and other short-range equipment (such as hand
Machine, smartwatch etc.) between data exchange.Blue-tooth device in the embodiment of the present application can be integrated circuit or bluetooth core
Piece etc..
Mobile phone 100 can also include at least one sensor 106, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ring
The light and shade of border light adjusts the brightness of the display of touch screen 104, proximity sensor can when mobile phone 100 is moved in one's ear,
Close the power supply of display.As a kind of motion sensor, accelerometer sensor can detect (generally three in all directions
Axis) acceleration size, can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as
Horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；As for
The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor that mobile phone 100 can also configure, herein not
It repeats again.
Wireless Fidelity (wireless fidelity, WiFi) device 107, follows Wi-Fi phase for providing for mobile phone 100
The network insertion of standard agreement is closed, mobile phone 100 can be linked into Wi-Fi access point by WiFi device 107, and then help user
It sends and receive e-mail, browse webpage and access Streaming Media etc., it provides wireless broadband internet access for user.At other
In some embodiments, which can also be used as Wi-Fi wireless access point, and Wi-Fi net can be provided for other equipment
Network access.
Positioning device 108, for providing geographical location for mobile phone 100.It is understood that the positioning device 108 is specific
It can be global positioning system (global positioning system, GPS) or Beidou satellite navigation system, Russia
The receiver of the positioning systems such as GLONASS.Positioning device 108, will after receiving the geographical location that above-mentioned positioning system is sent
The information is sent to processor 101 and is handled, or is sent to memory 103 and is saved.In other some embodiments
In, which can also be auxiliary global satellite positioning system (assisted global positioning
System, AGPS) receiver, AGPS system as secondary server by assisting positioning device 108 to complete ranging and fixed
Position service, in this case, the positioning device of assisted location service device network and equipment such as mobile phone 100 by wireless communication
108 (i.e. GPS receivers) communicate and provide positioning assistance.In other some embodiments, which is also possible to
Location technology based on Wi-Fi access point.Since each Wi-Fi access point has a globally unique media access control
The address (media access control, MAC), equipment can scan and collect the Wi- of surrounding in the case where opening Wi-Fi
The broadcast singal of Fi access point, therefore the available MAC Address broadcast out to Wi-Fi access point；Equipment can by these
Network is sent to location server to the data (such as MAC Address) of mark Wi-Fi access point by wireless communication, by location-based service
Device retrieves the geographical location of each Wi-Fi access point, and combines the degree of strength of Wi-Fi broadcast singal, calculates this and sets
Standby geographical location is simultaneously sent in the positioning device 108 of the equipment.
Voicefrequency circuit 109, loudspeaker 113, microphone 114 can provide the audio interface between user and mobile phone 100.Audio
Electric signal after the audio data received conversion can be transferred to loudspeaker 113, be converted to sound by loudspeaker 113 by circuit 109
Sound signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 114, after being received by voicefrequency circuit 109
Audio data is converted to, then audio data is exported to radio circuit 102 to be sent to such as another mobile phone, or by audio number
It is further processed according to output to memory 103.
Mobile phone 100 may include two or more microphones 114.It include main microphon and secondary wheat with mobile phone 100
For gram wind.The two microphones can be deployed in the lower section of touch screen 104, as shown in Figure 2 A；It is also possible to main microphon
It is deployed in the lower section of touch screen 104, secondary microphone is deployed in the back side of mobile phone 100, as shown in Figure 2 B, certain main microphon and pair
Deployed position of the microphone in mobile phone 100 can also be other, will not enumerate here.
Peripheral Interface 110, for (such as keyboard, mouse, external-connection displayer, outside to be deposited for external input-output apparatus
Reservoir, subscriber identification module card etc.) various interfaces are provided.Such as by universal serial bus (universal serial bus,
USB) interface is connect with mouse, is known by the user of hard contact and telecom operators' offer on subscriber identification module card card slot
Other module card (subscriber identification module, SIM) card is attached.Peripheral Interface 110 can by with
The input/output peripheral equipment of said external is couple to processor 101 and memory 103.
In embodiments of the present invention, mobile phone 100 can be led to by Peripheral Interface 110 and the other equipment in equipment group
Letter, for example, being shown etc. by the display data that Peripheral Interface 110 can receive other equipment transmission, the embodiment of the present invention pair
This is not intended to be limited in any.
Mobile phone 100 can also include the power supply device 111 (such as battery and power management chip) powered to all parts,
Battery can be logically contiguous by power management chip and processor 101, thus charged by the realization management of power supply device 111,
The functions such as electric discharge and power managed.
Although Fig. 1 is not shown, mobile phone 100 can also include camera (front camera and/or rear camera), flash of light
Lamp, micro projector, near-field communication (near field communication, NFC) device etc., details are not described herein.
Wherein, the executing subject of the processing method of audio signal provided by the embodiments of the present application can be the place of audio signal
Device is managed, which can be the center for electronic equipment (mobile phone 100 as shown in Figure 1) or the electronic equipment
The module for being used to handle audio signal in processor (central processing unit, CPU) or the electronic equipment,
Or for handling the client of audio signal in the electronic equipment.
The embodiment of the present application executes audio signal with the electronic equipment for including the first audio-frequency module and the second audio-frequency module
For processing method, the processing method of audio signal provided by the present application is illustrated.
It is detailed to a kind of processing method progress of audio signal provided by the embodiments of the present application below by specific embodiment
Explanation.
As shown in figure 3, the processing method of audio signal provided by the embodiments of the present application includes:
S301, electronic equipment obtain the audio signal 1 of the first audio collection module acquisition and the second audio collection module is adopted
The audio signal 2 of collection.
S302, electronic equipment determine the first audio collection module exception according to audio signal 1.
Optionally, electronic equipment can determine that the first audio is adopted according to the amplitude and/or Energy distribution of audio signal 1
It is abnormal to collect module.
Wherein, electronic equipment can be determined using following methods: electronic equipment samples the audio signal 1 in unit period,
The sampled value of audio signal 1 is obtained, and calculates the absolute value of the amplitude of the sampled value of audio signal 1, and calculates multiple samplings
The average value of the absolute value of the amplitude of value obtains the average value of the amplitude of the sampled value of audio signal 1, which is audio letter
Number 1 amplitude.
If the sound hole connecting with the first audio collection module is blocked, the collection of the first audio collection module will lead to
To the amplitude of audio signal 1 be greatly reduced, be likely less than the first preset threshold, which is the first audio collection
The threshold value of module acquisition audio signal.Based on this, electronic equipment can carry out time-domain analysis to audio signal 1, determine that audio is believed
Whether number 1 amplitude is less than the first preset threshold.
When determining the amplitude of audio signal 1 less than the first preset threshold, electronic equipment determines the first audio collection module
Whether the duration when amplitude of collected audio signal 1 is less than the first preset threshold is greater than preset duration, preset duration
It can be set dynamically according to the design needs.
Electronic equipment acquires the audio signal of user speech call by the first audio collection module, and it is logical to calculate user speech
The amplitude of audio signal when words, the amplitude of audio signal when conversing by comparing user speech and the first preset threshold
Size, determine user speech call when audio signal amplitude whether less than the first preset threshold, it may be assumed that determine the first sound
Whether frequency acquisition module collects the amplitude of audio signal 1 less than the first preset threshold.
The threshold value of the first audio collection module acquisition audio signal is known as the first preset threshold in the embodiment of the present application, and second
The threshold value of audio collection module acquisition audio signal is known as the second preset threshold.
In practical applications, preset threshold (first preset threshold or the of the embodiment of the present application can be obtained according to experiment
Two preset thresholds), it may be assumed that by radio reception hole plug, sound hole acquires audio signal when being blocked, and sound hole is collected when being blocked
The amplitude of audio signal is preset threshold.
Here the determination of the first preset threshold is described.Optionally, it can will be connect with the first audio collection module
Radio reception hole plug after, using the first audio collection module multi collect audio signal, obtain the audio signal that multi collect arrives
Amplitude average value, using obtained average value as the first preset threshold.As an implementation, when passing through multi collect
It, can be by acquiring the audio signal with different acoustic wave characters (such as male voice, female when audio signal obtains the first preset threshold
Sound, old man, children etc.) obtain the first preset threshold.As an implementation, it can be blocked by different blocking modes and the
The sound hole (e.g., different blocking angles utilize different objects blocking sound hole etc.) of one audio collection module connection, obtains respectively
The amplitude of first audio collection module collected audio signal of institute under various different blocking modes, calculate acquired in audio
The average value of the amplitude of signal obtains the first preset threshold.
The determination method of second preset threshold can refer to the determination method of the first preset threshold, no longer go to live in the household of one's in-laws on getting married one by one here
It states.
In addition, higher frequency signal energy is relatively weak because low frequency signal energy is relatively strong；When sound hole is blocked, big portion
Divide low frequency signal that can be collected by sound hole by audio collection module by gap or shell resonance mode；But it is most of high
Frequency signal can not be collected by sound hole by audio collection module；Therefore when sound hole is blocked, audio collection module institute
Collected audio signal is mainly low frequency signal.
Based on this, electronic equipment obtains the energy of audio signal 1 after can carrying out Fourier FFT conversion to audio signal 1
Distribution, by judging whether the Energy distribution of collected audio signal 1 meets preset condition, it may be assumed that frequency is higher than default frequency
The energy value summation of the audio signal 1 of point is used as high-frequency energy magnitude, the energy by frequency lower than the audio signal 1 of the default frequency point
Magnitude summation is used as low frequency energy value；Judge whether high-frequency energy magnitude and the ratio of the low frequency energy value are less than preset value, such as
Fruit high-frequency energy magnitude and the ratio of the low frequency energy value are less than preset value, it is determined that the Energy distribution of audio signal 1 is unsatisfactory for
Preset condition.
If the amplitude of audio signal 1 is unsatisfactory for presetting less than the Energy distribution of the first preset threshold and/or audio signal 1
Condition, then electronic equipment determines the first audio collection module exception, that is, is determined at the sound hole of the first audio collection module connection
The voice of the first audio collection module inputs abnormal in blocked or electronic equipment.
S303, electronic equipment calculate the amplitude of audio signal 1 and the ratio of the first preset threshold, are adjusted ratio.
Adjustment ratio are as follows: the amplitude of audio signal 1/the first preset threshold.
S304, electronic equipment adjust audio signal 2 using adjustment ratio, obtain audio signal 3.
S305, electronic equipment determine the audio that the difference of audio signal 1 and audio signal 3 finally gets for electronic equipment
Signal.
The amplitude of audio signal 1 is less than the first preset threshold, and for shielding environment noise, electronic equipment adaptively will
Audio signal 2 is adjusted to audio signal 3, so that the difference between audio signal 1 and audio signal 3 is kept in preset range.
In addition, electronic equipment also needs to adjust the first preset threshold and the second preset threshold after adjusting audio signal 2,
In order to which electronic equipment is during subsequent radio reception, judge whether audio collection module is abnormal.
As shown in figure 4, processing method provided by the embodiments of the present application further includes S401.
S401, electronic equipment are using adjustment ratio the first preset threshold of adjustment, the first preset threshold after being adjusted, with
And the second preset threshold, the second preset threshold after being adjusted are adjusted using adjustment ratio.
To sum up, in the case where the first audio collection module exception, electronic equipment is adopted by the way that the second audio is adaptively adjusted
Collect the audio signal of module acquisition, so that the audio signal finally got is relatively clear, environmental noise is smaller, improves user
Experience.
It is above-mentioned that mainly scheme provided by the embodiments of the present application is described from the angle of method.In order to realize above-mentioned function
Can, it comprises execute the corresponding hardware configuration of each function and/or software module.Those skilled in the art should be easy to anticipate
Know, unit and algorithm steps described in conjunction with the examples disclosed in the embodiments of the present disclosure, the application can with hardware or
The combining form of hardware and computer software is realized.Some function is actually with the side of hardware or computer software driving hardware
Formula executes, specific application and design constraint depending on technical solution.Professional technician can be to each specific
Using using different methods to achieve the described function, but this realize it is not considered that exceeding scope of the present application.
The embodiment of the present application can carry out the division of functional module according to above method example to electronic equipment, for example, can
With each functional module of each function division of correspondence, two or more functions can also be integrated in a processing module
In.Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.It needs
It is noted that be schematical, only a kind of logical function partition to the division of module in the embodiment of the present application, it is practical real
It is current that there may be another division manner.
As shown in figure 5, being a kind of structural schematic diagram of the processing unit of audio signal provided by the embodiments of the present application.Audio
The processing unit of signal is used to be in the collected audio signal of audio collection module, such as executing Fig. 3 and/or Fig. 4 institute
The method shown.The processing unit of audio signal can include determining that unit 50, computing unit 51 and adjustment unit 52.
Determination unit 50, for determining the first audio according to collected first audio signal of the first audio collection module
Acquisition module is abnormal.Computing unit 51 is used in the case where determination unit 50 determines the first audio collection module exception, according to
The amplitude of first audio signal and the first preset threshold, calculate adjustment ratio, and the first preset threshold is the first audio collection mould
Block currently acquires the amplitude threshold of audio signal.Adjustment unit 52, for adjusting the second audio collection module using adjustment ratio
Collected audio signal obtains the second audio signal.Determination unit 50 is also used to determine the first audio signal and the second audio
The difference of signal is the audio signal that processing unit is got.
For example, determination unit 50 can be used for executing S302 and S305 in conjunction with Fig. 3 and Fig. 4, computing unit 51 can be used for
S303 is executed, adjustment unit 52 can be used for executing S304 and S401.
Optionally, computing unit 51 is specifically used for: by the ratio of the amplitude of the first audio signal and the first preset threshold,
It is determined as adjustment ratio.
Optionally, adjustment unit 52 is specifically used for: determining adjustment ratio and the collected audio of the second audio collection module
The product of signal is the second audio signal.
Optionally, whether determination unit 50 is specifically used for: judging the amplitude of the first audio signal less than the first default threshold
Value；If the amplitude of the first audio signal is less than the first preset threshold, it is determined that the first audio collection module is abnormal；Alternatively, sentencing
Whether the Energy distribution of disconnected first audio signal meets preset condition；If the Energy distribution of the first audio signal is unsatisfactory for default item
Part, it is determined that the first audio collection module is abnormal；Alternatively, judging the amplitude of the first audio signal whether less than the first default threshold
Whether the Energy distribution of value and the first audio signal meets preset condition；If the amplitude of the first audio signal is less than first
Preset threshold, and the Energy distribution of the first audio signal is unsatisfactory for preset condition, it is determined that the first audio collection module is abnormal.
Optionally, adjustment unit 52 is also used to: being used adjustment ratio, is adjusted, is adjusted to the first preset threshold
The first preset threshold afterwards；Using adjustment ratio, the second preset threshold is adjusted, the default threshold of second after being adjusted
Value, the second preset threshold are the amplitude threshold that the second audio collection module currently acquires audio signal.
Certainly, the processing unit of audio signal provided by the embodiments of the present application includes but is not limited to above-mentioned module, such as sound
The processing unit of frequency signal can also include storage unit 53.
Storage unit 53 can be used for storing the program code etc. of the processing unit of the audio signal.
As an example, it in conjunction with Fig. 1, determination unit 50, computing unit 51 in the processing unit of audio signal and adjusts
The function that whole unit 52 is realized is identical as the function of processor 101 in Fig. 1, in the function and Fig. 1 that storage unit 53 is realized
The function of memory 103 is identical.
The explanation of related content can refer to above method embodiment in the present embodiment, and details are not described herein again.
Another embodiment of the application also provides a kind of computer readable storage medium, deposits in the computer readable storage medium
Instruction is contained, when instruction is run in the processing unit of audio signal, the processing unit of the audio signal executes the above method
Each step in method flow shown in embodiment.
Another embodiment of the application also provides a kind of electronic equipment, which includes the processing dress of above-mentioned audio signal
It sets.
In some embodiments, disclosed method may be embodied as being coded in machine readable format computer-readable
Computer program instructions that are on storage medium or being coded on other non-transient media or product.
Fig. 6 schematically shows the conceptual partial view of computer program product provided by the embodiments of the present application, described
Computer program product includes the computer program for executing computer processes on the computing device.
In one embodiment, computer program product is provided using signal bearing medium 60.The signal is held
Carrying medium 60 may include one or more program instructions, and the above needle can be provided when being run by one or more processors
To Fig. 3 or Fig. 4 function of describing or partial function.Thus, for example, the embodiment with reference to shown in Fig. 3, S301~S305's
One or more features can be undertaken by one or more instructions associated with signal bearing medium 60.In addition, in Fig. 6
Program instruction also describes example instruction.
In some instances, signal bearing medium 60 may include computer-readable medium 61, such as, but not limited to, hard disk
Driver, compact disc (CD), digital video disk (DVD), digital magnetic tape, memory, read-only memory (read-only
Memory, ROM) or random access memory (random access memory, RAM) etc..
In some embodiments, signal bearing medium 60 may include computer recordable media 62, such as but unlimited
In, memory, read/write (R/W) CD, R/W DVD, etc..
In some embodiments, signal bearing medium 60 may include communication media 63, such as, but not limited to, number
And/or analogue communication medium (for example, fiber optic cables, waveguide, wired communications links, wireless communication link, etc.).
Signal bearing medium 60 can by wireless communication media 63 (for example, abide by 802.11 standard of IEEE or
The wireless communication medium of other transport protocols) Lai Chuanda.One or more program instructions can be, for example, computer is executable
Instruction or logic implement instruction.
In some instances, it such as can be configured as, ring for the processing unit of Fig. 3 or Fig. 4 audio signal described
Ying Yu passes through one or more programs in computer-readable medium 61, computer recordable media 62, and/or communication media 63
Instruction provides various operations, function or movement.
It should be understood that arrangement described herein is only used for exemplary purpose.Thus, those skilled in the art will manage
Solution, other arrangements and other elements (for example, machine, interface, function, sequence and functional group etc.) can be by instead
Use, and some elements can as expected result and omit together.In addition, many in described element is can
With being implemented as discrete or distributed component or combine the other components real with position in any suitable combination
The functional entity applied.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When being realized using software program, can entirely or partly realize in the form of a computer program product.The computer
Program product includes one or more computer instructions.On computers load and execute computer executed instructions when, all or
Partly generate the process or function according to the embodiment of the present application.Computer can be general purpose computer, special purpose computer, calculating
Machine network or other programmable devices.Computer instruction may be stored in a computer readable storage medium, or from one
Computer readable storage medium is transmitted to another computer readable storage medium, for example, computer instruction can be from a net
Website, computer, server or data center pass through wired (such as coaxial cable, optical fiber, Digital Subscriber Line (digital
Subscriber line, DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer,
Server or data center are transmitted.Computer readable storage medium can be any usable medium that computer can access
Either comprising data storage devices such as one or more server, data centers that can be integrated with medium.Usable medium can
To be magnetic medium (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid-state is hard
Disk (solid state disk, SSD)) etc..
The above, the only specific embodiment of the application.Those familiar with the art is according to the application
The specific embodiment of offer, it is contemplated that change or replacement, should all cover within the scope of protection of this application.
Claims (12)
1. a kind of processing method of audio signal, applied to the electricity including the first audio collection module and the second audio collection module
Sub- equipment characterized by comprising
According to collected first audio signal of first audio collection module, determine that first audio collection module is different
Often；
According to the amplitude and the first preset threshold of first audio signal, adjustment ratio, first preset threshold are calculated
The amplitude threshold of audio signal is currently acquired for first audio collection module；
The collected audio signal of second audio collection module is adjusted using the adjustment ratio, obtains the second audio letter
Number；
The difference for determining first audio signal and second audio signal is that the audio that the electronic equipment is got is believed
Number.
2. processing method according to claim 1, which is characterized in that the amplitude according to first audio signal
With the first preset threshold, adjustment ratio is calculated, comprising:
By the ratio of the amplitude of first audio signal and first preset threshold, it is determined as the adjustment ratio.
3. processing method according to claim 1 or 2, which is characterized in that described using described in adjustment ratio adjustment
The collected audio signal of second audio collection module, obtains the second audio signal, comprising:
The product for determining the adjustment ratio and the collected audio signal of the second audio collection module is second sound
Frequency signal.
4. processing method described in any one of -3 according to claim 1, which is characterized in that described according to first audio
Collected first audio signal of acquisition module determines that first audio collection module is abnormal, comprising:
Judge whether the amplitude of first audio signal is less than first preset threshold；If first audio signal
Amplitude is less than first preset threshold, it is determined that first audio collection module is abnormal；
Alternatively,
Judge whether the Energy distribution of first audio signal meets preset condition；If the energy of first audio signal point
Cloth is unsatisfactory for the preset condition, it is determined that first audio collection module is abnormal；
Alternatively,
Judge whether the amplitude of first audio signal is less than first preset threshold and first audio signal
Energy distribution whether meet preset condition；If the amplitude of first audio signal is less than first preset threshold, and
The Energy distribution of first audio signal is unsatisfactory for the preset condition, it is determined that first audio collection module is abnormal.
5. processing method described in any one of -4 according to claim 1, which is characterized in that the processing method further include:
First preset threshold is adjusted using the adjustment ratio, the first preset threshold after being adjusted；
Second preset threshold is adjusted using the adjustment ratio, the second preset threshold after being adjusted, the second default threshold
Value is the amplitude threshold that second audio collection module currently acquires audio signal.
6. a kind of processing unit of audio signal, which is characterized in that adopted positioned at including the first audio collection module and the second audio
Collect the electronic equipment of module, the processing unit includes:
Determination unit, for determining first sound according to collected first audio signal of first audio collection module
Frequency acquisition module is abnormal；
Computing unit, in the case where the determination unit determines the first audio collection module exception, according to described
The amplitude of first audio signal and the first preset threshold, calculate adjustment ratio, and first preset threshold is first sound
Frequency acquisition module currently acquires the amplitude threshold of audio signal；
Adjustment unit obtains for adjusting the collected audio signal of the second audio collection module using the adjustment ratio
Two audio signals；
The determination unit is also used to determine that the difference of first audio signal and second audio signal is the processing
The audio signal that device is got.
7. processing unit according to claim 6, which is characterized in that the computing unit is specifically used for:
By the ratio of the amplitude of first audio signal and first preset threshold, it is determined as the adjustment ratio.
8. processing unit according to claim 6 or 7, which is characterized in that the adjustment unit is specifically used for:
The product for determining the adjustment ratio and the collected audio signal of the second audio collection module is second sound
Frequency signal.
9. the processing unit according to any one of claim 6-8, which is characterized in that the determination unit is specifically used
In:
Judge whether the amplitude of first audio signal is less than first preset threshold；If first audio signal
Amplitude is less than first preset threshold, it is determined that first audio collection module is abnormal；
Alternatively,
Judge whether the Energy distribution of first audio signal meets preset condition；If the energy of first audio signal point
Cloth is unsatisfactory for the preset condition, it is determined that first audio collection module is abnormal；
Alternatively,
Judge whether the amplitude of first audio signal is less than first preset threshold and first audio signal
Energy distribution whether meet preset condition；If the amplitude of first audio signal is less than first preset threshold, and
The Energy distribution of first audio signal is unsatisfactory for the preset condition, it is determined that first audio collection module is abnormal.
10. the processing unit according to any one of claim 6-9, which is characterized in that the adjustment unit is also used to:
Using the adjustment ratio, first preset threshold is adjusted, first preset threshold after being adjusted；
Using the adjustment ratio, the second preset threshold is adjusted, second preset threshold after being adjusted is described
Second preset threshold is the amplitude threshold that second audio collection module currently acquires audio signal.
11. a kind of computer readable storage medium, including instruction, which is characterized in that when described instruction is in the processing of audio signal
When being run on device, so that the processing unit of the audio signal executes the audio as described in any one of claim 1-5
The processing method of signal.
12. a kind of equipment characterized by comprising processor and memory；
The memory is coupled with the processor；The memory is for storing computer program code, the computer journey
Sequence code includes instruction, and when the processor executes described instruction, the equipment is executed such as any one of claim 1-5
The processing method of the audio signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910671546.2A CN110536193B (en) | 2019-07-24 | 2019-07-24 | Audio signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910671546.2A CN110536193B (en) | 2019-07-24 | 2019-07-24 | Audio signal processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110536193A true CN110536193A (en) | 2019-12-03 |
| CN110536193B CN110536193B (en) | 2020-12-22 |
Family
ID=68660803
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910671546.2A Active CN110536193B (en) | 2019-07-24 | 2019-07-24 | Audio signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110536193B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111667842A (en) * | 2020-06-10 | 2020-09-15 | 北京达佳互联信息技术有限公司 | Audio signal processing method and device |
| CN113590868A (en) * | 2021-06-11 | 2021-11-02 | 深圳供电局有限公司 | Sound threshold updating method and device, computer equipment and storage medium |
| CN113630504A (en) * | 2021-08-16 | 2021-11-09 | 上海明略人工智能(集团)有限公司 | Method and device for acquiring abnormal information of sound recording system, electronic equipment and storage medium |
| CN115641882A (en) * | 2022-10-27 | 2023-01-24 | 深圳市移文科技有限公司 | Intelligent recording starting method and device for wearable equipment and wearable equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7995771B1 (en) * | 2006-09-25 | 2011-08-09 | Advanced Bionics, Llc | Beamforming microphone system |
| CN102801861A (en) * | 2012-08-07 | 2012-11-28 | 歌尔声学股份有限公司 | Voice enhancing method and device applied to cell phone |
| CN202957890U (en) * | 2012-08-07 | 2013-05-29 | 歌尔声学股份有限公司 | Voice reinforcing device applied to handset |
| CN106303804A (en) * | 2016-07-28 | 2017-01-04 | 维沃移动通信有限公司 | The control method of a kind of mike and mobile terminal |
| CN106331359A (en) * | 2016-08-31 | 2017-01-11 | 广东欧珀移动通信有限公司 | Speech signal acquisition method and apparatus and terminal |
| CN109005272A (en) * | 2018-07-24 | 2018-12-14 | Oppo（重庆）智能科技有限公司 | Voice pick-up method and Related product |
| CN109561222A (en) * | 2017-09-27 | 2019-04-02 | 华为终端（东莞）有限公司 | A kind of method for detecting abnormality and device of voice data |
-
2019
- 2019-07-24 CN CN201910671546.2A patent/CN110536193B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7995771B1 (en) * | 2006-09-25 | 2011-08-09 | Advanced Bionics, Llc | Beamforming microphone system |
| CN102801861A (en) * | 2012-08-07 | 2012-11-28 | 歌尔声学股份有限公司 | Voice enhancing method and device applied to cell phone |
| CN202957890U (en) * | 2012-08-07 | 2013-05-29 | 歌尔声学股份有限公司 | Voice reinforcing device applied to handset |
| CN106303804A (en) * | 2016-07-28 | 2017-01-04 | 维沃移动通信有限公司 | The control method of a kind of mike and mobile terminal |
| CN106331359A (en) * | 2016-08-31 | 2017-01-11 | 广东欧珀移动通信有限公司 | Speech signal acquisition method and apparatus and terminal |
| CN109561222A (en) * | 2017-09-27 | 2019-04-02 | 华为终端（东莞）有限公司 | A kind of method for detecting abnormality and device of voice data |
| CN109005272A (en) * | 2018-07-24 | 2018-12-14 | Oppo（重庆）智能科技有限公司 | Voice pick-up method and Related product |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111667842A (en) * | 2020-06-10 | 2020-09-15 | 北京达佳互联信息技术有限公司 | Audio signal processing method and device |
| CN111667842B (en) * | 2020-06-10 | 2023-10-31 | 北京达佳互联信息技术有限公司 | Audio signal processing method and device |
| CN113590868A (en) * | 2021-06-11 | 2021-11-02 | 深圳供电局有限公司 | Sound threshold updating method and device, computer equipment and storage medium |
| CN113630504A (en) * | 2021-08-16 | 2021-11-09 | 上海明略人工智能(集团)有限公司 | Method and device for acquiring abnormal information of sound recording system, electronic equipment and storage medium |
| CN113630504B (en) * | 2021-08-16 | 2024-03-12 | 上海明略人工智能(集团)有限公司 | Method and device for acquiring abnormal information of recording system, electronic equipment and storage medium |
| CN115641882A (en) * | 2022-10-27 | 2023-01-24 | 深圳市移文科技有限公司 | Intelligent recording starting method and device for wearable equipment and wearable equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110536193B (en) | 2020-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110536193A (en) | A kind of processing method and processing device of audio signal | |
| CN104135501A (en) | Page sharing method, device and system | |
| CN107943489A (en) | Data sharing method and mobile terminal | |
| CN113660650B (en) | Method and related device for device reconnection | |
| CN106681860B (en) | A kind of data back up method and data backup device | |
| CN109901980B (en) | Serial port log capturing circuit, method, terminal and computer readable storage medium | |
| US9453866B2 (en) | Method, device and storage medium for controlling antenna | |
| CN109737938B (en) | Terminal device | |
| JP6862564B2 (en) | Methods, devices and non-volatile computer-readable media for image composition | |
| CN112134995A (en) | Method, terminal and computer readable storage medium for searching application object | |
| CN109766080A (en) | Micro services register method, device, electronic equipment and readable storage medium storing program for executing | |
| CN105871425B (en) | The method and apparatus that first equipment receives synchronization message from the second equipment | |
| CN110189368A (en) | Method for registering images, mobile terminal and computer readable storage medium | |
| CN108958936A (en) | Application programe switch-over method, mobile terminal and computer readable storage medium | |
| CN109522276B (en) | Application icon management method, terminal and computer-readable storage medium | |
| CN208445606U (en) | Housing unit and electronic equipment | |
| CN108810262B (en) | Application configuration method, terminal and computer readable storage medium | |
| CN114338872A (en) | Folding mechanism and mobile terminal | |
| US11327639B2 (en) | Split view exiting method, split view exiting device, and electronic device | |
| CN109102153A (en) | A kind of identity management method and device | |
| CN110489657B (en) | Information filtering method and device, terminal equipment and storage medium | |
| CN103336677A (en) | Method, device and system for outputting images to display equipment | |
| CN105898738A (en) | Method and device for obtaining auxiliary numbers and portable multifunctional device | |
| CN109831798A (en) | Signal acquiring method, system, storage medium and mobile terminal | |
| CN109494888A (en) | Wireless charging receiving terminal, terminal, system, method and readable storage medium storing program for executing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |