CN106898356B - Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip - Google Patents
Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip Download PDFInfo
- Publication number
- CN106898356B CN106898356B CN201710150388.7A CN201710150388A CN106898356B CN 106898356 B CN106898356 B CN 106898356B CN 201710150388 A CN201710150388 A CN 201710150388A CN 106898356 B CN106898356 B CN 106898356B
- Authority
- CN
- China
- Prior art keywords
- waveform
- data packet
- pitch period
- lost
- packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012545 processing Methods 0.000 title claims abstract description 15
- 238000004891 communication Methods 0.000 claims abstract description 27
- 238000001914 filtration Methods 0.000 claims description 40
- 238000006467 substitution reaction Methods 0.000 claims description 25
- 238000005070 sampling Methods 0.000 claims description 20
- 238000001514 detection method Methods 0.000 claims description 19
- 230000003044 adaptive effect Effects 0.000 claims description 18
- 238000009499 grossing Methods 0.000 claims description 6
- 108090000623 proteins and genes Proteins 0.000 description 14
- 230000000694 effects Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 210000005069 ears Anatomy 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Mobile Radio Communication Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention is suitable for the technical field of Bluetooth voice, and provides a packet loss hiding method, a device and a Bluetooth voice processing chip suitable for Bluetooth voice communication. By adopting the technical scheme of the invention, the packet loss error can be effectively hidden, the Bluetooth voice call quality is improved, and the voice call distance is increased.
Description
Technical Field
The invention belongs to the technical field of Bluetooth communication, and particularly relates to a packet loss hiding method and device suitable for Bluetooth voice call and a Bluetooth voice processing chip.
Background
Bluetooth voice communication is a short-distance wireless communication technology, traditional electric wires are omitted, voice data are transmitted in the air, the conditions of packet error and packet loss are easily generated at a receiving end, voice communication is not consistent, and Bluetooth voice communication quality and communication distance are greatly influenced. The packet loss concealment technology (PLC) compensates lost data packets by using synthesized data packets, and performs packet loss concealment by using the masking effect of human ears, so that the voice call effect of Bluetooth can be improved to a great extent, the voice call is continuous, and the data packets cannot be lost or go wrong.
As shown in fig. 1, when a receiving end of a bluetooth headset detects a packet loss of a bluetooth voice packet, after the packet loss is hidden by a PLC module, an interrupted voice waveform is converted into a continuous voice waveform, and then the continuous voice waveform is converted into a voice by a digital-to-analog converter (DAC) and played.
At present, the packet loss concealment method mainly comprises an insertion technology (silence, white noise and packet replacement), a time domain correction technology and a waveform substitution method based on fundamental tone detection. The insertion technique is to fill a gap caused by packet loss with a simple substitute, and the common substitute is silence, noise or a previous voice packet. The time domain correction technology is to utilize the front and back voice packets of the notch waveform and the filtering technology to make the data of the notch continuous as much as possible, so that a certain hiding effect can be achieved, but the effect is not obvious, and the method has great use limitation. The pitch period based waveform substitution technology is a method for detecting the pitch period of voice through an algorithm, for unvoiced sound, a simple repetition technology is used for filling a waveform gap, for voiced sound, a pitch period closest to the gap is used for filling the gap, and the method is simple and effective and can achieve good hiding effect. However, in the case of continuous packet loss, the hiding effect is still not good, and when waveform substitution is performed, data continuity before and after the gap is not good, resulting in poor call quality.
Disclosure of Invention
The embodiment of the invention provides a packet loss hiding method and device suitable for Bluetooth voice communication and a Bluetooth voice processing chip, and aims to solve the existing problems.
In an embodiment of the present invention, a packet loss hiding method applicable to a bluetooth voice call is provided, where the method includes:
gene cycle detection: detecting a pitch period before the packet loss of the Bluetooth voice data packet by adopting a correlation coefficient method, and obtaining a correlation coefficient Rmax corresponding to the gene period;
a waveform replacing step: generating a substitute waveform according to a waveform corresponding to the lost data packet in a previous pitch period of the lost data packet, and substituting the substitute waveform for the waveform of the lost data packet;
and self-adaptive filtering: and performing adaptive smoothing filtering on the waveforms on the two sides of the waveform gap formed by the lost data packet according to the corresponding waveforms of the waveforms on the two sides of the waveform gap formed by the lost data packet in the previous pitch period.
The adaptive filtering step specifically includes:
respectively extracting the waveform LD of a data packet on the left side of a waveform gap formed by the lost data packet and the waveform RD of a data packet on the right side of the waveform gap formed by the lost data packet, wherein the voice data of each data packet comprises 30 voice sampling points;
respectively extracting waveforms LDP and RDP of a previous pitch period corresponding to the waveforms LD and RD;
respectively filtering the waveforms LD and RD by using the waveforms LDP and RDP to obtain the smoothed waveforms LDC and RDC, wherein the filtering formula is as follows:
LDC[i]=( LDP[i]* (i/Rf) + LD[i]* (30-(i/Rf)))/30，
RDC[i]=( RDP[i]* (30-(i/Rf)) + RD[i]* (i/Rf))/30，
wherein i is an integer between 0 and 29, and Rf = Rmax + 1.
In the embodiment of the present invention, before the pitch period detecting step, a bluetooth voice data packet loss detecting step is further included, which detects whether the received bluetooth voice data packet is lost.
In an embodiment of the present invention, the pitch period detecting step specifically includes:
setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
In the embodiment of the present invention, in the waveform replacing step,
when the number of the lost data packets is one, the substitute waveform adopts a waveform corresponding to the lost data packet in a pitch period before the lost data packet;
and when the lost data packets are a plurality of continuous data packets, taking the waveform corresponding to the first lost data packet in the previous pitch period as a substitute waveform of the first data packet, sequentially attenuating each voice sampling point of the waveform corresponding to the other lost data packet in the previous pitch period by 1/(15 x 30) to form a substitute waveform of the other lost data packet, and if the number of the continuous lost data packets is more than 16, directly attenuating the substitute waveform after more than 16 data packets to 0.
In an embodiment of the present invention, a packet loss hiding device suitable for a bluetooth voice call is further provided, where the device includes:
the gene period detection unit is used for detecting a pitch period before the Bluetooth voice data packet is lost by adopting a correlation coefficient method and obtaining a correlation coefficient Rmax corresponding to the gene period;
the waveform replacing unit is used for generating a replacing waveform according to the waveform corresponding to the lost data packet in the previous pitch period of the lost data packet and replacing the waveform of the lost data packet with the replacing waveform; and
and the adaptive filtering unit is used for performing adaptive smooth filtering on the waveforms on two sides of the waveform gap formed by the lost data packet according to the corresponding waveforms of the waveforms on two sides of the waveform gap formed by the lost data packet in the previous pitch period.
The filtering formula adopted by the self-adaptive filtering unit is as follows:
LDC[i]=( LDP[i]* (i/Rf) + LD[i]* (30-(i/Rf)))/30，
RDC[i]=( RDP[i]* (30-(i/Rf)) + RD[i]* (i/Rf))/30，
wherein Rf = Rmax +1, i is an integer between 0 and 29,
LD and RD respectively represent the waveform of a packet to the left and the waveform of a packet to the right of a waveform gap formed by the lost packet, LDP and RDP respectively represent the waveforms of the previous pitch period corresponding to the waveforms LD and RD, and LDC and RDC respectively represent the waveforms corresponding to the waveforms LD and RD after filtering.
In the embodiment of the present invention, the packet loss hiding device suitable for bluetooth voice communication further includes a bluetooth voice data detecting unit, where the bluetooth voice data detecting unit is configured to detect whether the bluetooth voice data packet is lost.
In the embodiment of the invention, the gene cycle detection unit performs gene cycle detection by adopting the following steps:
setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
In the embodiment of the present invention, the waveform substitution unit generates a substitution waveform by using the following waveform substitution formula:
W[j]= WP[j]，1≤j≤30，
W[j]= WP[j]*(1-（j-30）/(15*30),30<j≤480，
W[j]=0，j>480,
where W represents a substitute waveform for the missing data packet, WP represents a waveform corresponding to the missing data packet in a previous pitch period, and j represents a j-th point in the waveform. .
In the embodiment of the present invention, a bluetooth voice processing chip is further provided, where the bluetooth voice processing chip includes at least one processor, a memory, and an interface, and the at least one processor, the memory, and the interface are all connected through a bus;
the memory stores computer-executable instructions;
and the at least one processor executes the computer execution instruction stored in the memory, so that the Bluetooth voice processing chip executes the packet loss hiding method suitable for the Bluetooth voice call.
Compared with the prior art, when the packet loss waveform is replaced, the multi-frame attenuation method is adopted, the condition of wrong sound can be effectively avoided, even if the packet loss amount is large, the actual effect can be easily accepted by human ears, when the replaced waveform is filtered, the self-adaptive window filtering technology is adopted, the filtering strength can be self-adaptively adjusted, the method is more suitable for the characteristic of variable voice, the smoothness of the replaced waveform is improved, the communication quality is improved, the defect that the flexibility of a fixed window is insufficient is also avoided, when the integral packet loss rate of the Bluetooth voice communication is less than 15%, the packet loss error can be effectively hidden, the Bluetooth voice communication quality is improved, and the voice communication distance is increased.
Drawings
Fig. 1 is a block diagram of a bluetooth call packet loss processing system in the prior art;
fig. 2 is a flowchart of an implementation of a packet loss hiding method suitable for a bluetooth voice call according to an embodiment of the present invention;
FIG. 3 is a flow diagram of an implementation of pitch period detection in FIG. 2;
FIG. 4 is a waveform diagram of pitch period detection in FIG. 2;
FIG. 5 is a schematic diagram of an alternative waveform for a lost voice packet;
FIG. 6 is a flow chart of an implementation of the adaptive smoothing filter of FIG. 2;
fig. 7 is a schematic structural diagram of a packet loss concealment apparatus suitable for bluetooth voice communication according to a second embodiment of the present invention;
fig. 8 is a schematic structural diagram of a bluetooth voice processing chip according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The following detailed description of the implementation of the present invention is made with reference to specific embodiments:
example one
Fig. 2 shows an implementation flow of a packet loss concealment method suitable for a bluetooth voice call according to an embodiment of the present invention, where the method includes steps S1 to S4, which are described in detail below.
Step S1: and detecting the packet loss of the Bluetooth voice data.
In this step, whether the received bluetooth voice data is lost or not is detected, and whether the received bluetooth voice data is lost or not is detected. When the mobile phone is in a Bluetooth call, voice is coded and encrypted, the voice is transmitted to a receiving end through RF, a controller of the receiving end decodes and decrypts the hollow voice data, if the receiving is successful, correct voice data can be obtained through verification, the voice data are transmitted to a receiving person through a DAC, if the receiving is failed and the verification is unsuccessful, the packet is marked as an error packet or an empty packet, packet loss hiding processing is carried out in the subsequent steps, new voice waveforms are compensated, and errors are hidden as much as possible.
Step S2: and detecting a pitch period.
It should be noted that the frequency range of human voice is 200Hz-66 Hz, and the voice sampling frequency of bluetooth voice call is 8000 Hz, so that the pitch period range of human voice data samples (samples) is 40-120, that is, the maximum period is 120 voice data samples. The voice packet of bluetooth is 30 voice data sampling points, and when the bluetooth packet is lost, the pitch period before the packet is lost needs to be solved first.
In step S2, a method of calculating a correlation coefficient is used to calculate a pitch period, and a maximum point Rmax of the correlation coefficient R, which is an initiation point of the pitch period, is calculated by using a characteristic that the larger the correlation coefficient is, the stronger the data correlation is, as shown in fig. 3 and 4, the specific step of pitch period detection includes:
step S201: setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
step S202: sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
step S203: and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
In step S202, the larger the value of N is, the more accurate the calculated gene period is, and if the value of N is too small, the gene period calculation error may be caused, so in this embodiment, the value of N is set to N ≧ 120, that is, more than one pitch period, thereby preventing the gene period calculation error; in step S202, according to the pitch period range being 40-120 speech data samples, when calculating the correlation coefficient, the sliding range of the sliding window is set to 40-120 speech data samples, thereby avoiding redundant calculation and improving the detection speed of pitch period detection.
Step S3: and the waveform substitution is to generate a substitution waveform according to the waveform corresponding to the lost data packet in the previous pitch period of the lost data packet and substitute the substitution waveform for the waveform of the lost data packet.
It should be noted that, because of the instability of the bluetooth system, when a packet loss occurs, a situation of continuous packet loss often occurs later, and in order to make the effect of continuous frame loss acceptable to human ears and hide errors as much as possible for this feature of bluetooth voice communication, in this embodiment, on the basis of simple waveform substitution, a multi-frame attenuation method is used for waveform substitution. The specific waveform substitution rules are as follows:
when the number of the lost data packets is one, the substitute waveform adopts a waveform corresponding to the lost data packet in a pitch period before the lost data packet;
and when the lost data packets are a plurality of continuous data packets, taking the waveform corresponding to the first lost data packet in the previous pitch period as a substitute waveform of the first data packet, sequentially attenuating each voice sampling point of the waveform corresponding to the other lost data packet in the previous pitch period by 1/(15 x 30) to form a substitute waveform of the other lost data packet, and if the number of the continuous lost data packets is more than 16, directly attenuating the substitute waveform after more than 16 data packets to 0.
Since each bluetooth voice data packet includes 30 voice data samples, the waveform substitution rule can be expressed by the following formula:
W[j]= WP[j]，1≤j≤30，
W[j]= WP[j]*(1-（j-30）/(15*30),30<j≤480，
W[j]=0，j>480,
where W represents a substitute waveform for the missing data packet, WP represents a waveform corresponding to the missing data packet in a previous pitch period, and j represents a j-th point in the waveform.
Through bluetooth voice packet loss experiments, it is found that under the condition of a large amount of packet loss, a simple periodic waveform substitution is used, a wrong sound is directly introduced, and the sound effect is unacceptable. A schematic diagram of a specific waveform substitution is shown in fig. 5.
Step S4: and the adaptive smoothing filter is used for performing adaptive smoothing filtering on the waveforms on two sides of the waveform gap formed by the lost data packet according to the corresponding waveforms of the waveforms on two sides of the waveform gap formed by the lost data packet in the previous pitch period.
After the waveform substitution step is completed, a relatively large data fall may exist between the original voice waveform and the substituted waveform, noise often occurs if the waveform is not processed, in order to enable smooth transition between the original voice waveform and the substituted waveform and avoid noise to improve the call quality, smooth filtering needs to be performed on two groups of data, the problem of noise caused by excessive sound can be solved through smooth filtering, if the filtering is too large, the sound can be caused to be problematic, and people can hear the voice with a feeling of stuffiness. In order to enable smooth filtering to achieve a better effect, i.e., smooth transition can be achieved, and excessive error sounds cannot be introduced, in this embodiment, an adaptive window filtering technology is adopted, so that filtering strength can be adaptively adjusted, the method is more suitable for the characteristics of changeable voice, smoothness of a substitute waveform is improved, conversation quality is improved, and the defect that the flexibility of a fixed window is insufficient is also avoided. As shown in fig. 6, the adaptive filtering step specifically includes:
step S401: respectively extracting the waveform LD of a data packet on the left side of a waveform gap formed by the lost data packet and the waveform RD of a data packet on the right side of the waveform gap formed by the lost data packet, wherein the voice data of each data packet comprises 30 voice sampling points;
step S402: respectively extracting waveforms LDP and RDP of a previous pitch period corresponding to the waveforms LD and RD;
step S403: respectively filtering the waveforms LD and RD by using the waveforms LDP and RDP to obtain the smoothed waveforms LDC and RDC, wherein the filtering formula is as follows:
LDC[i]=( LDP[i]* (i/Rf) + LD[i]* (30-(i/Rf)))/30，
RDC[i]=( RDP[i]* (30-(i/Rf)) + RD[i]* (i/Rf))/30，
wherein i is an integer between 0 and 29, and Rf = Rmax + 1.
Example two
Fig. 7 shows a packet loss concealment apparatus suitable for bluetooth voice communication according to a second embodiment of the present invention, which includes a bluetooth voice data detection unit 710, a gene period detection unit 720, a waveform substitution unit 730, and an adaptive filtering unit 740. The following is a detailed description.
The bluetooth voice data detecting unit 710 is configured to detect whether the bluetooth voice data packet is lost;
the gene period detecting unit 720 is configured to detect a pitch period before a bluetooth voice packet is lost by using a correlation coefficient method, and obtain a correlation coefficient Rmax corresponding to the gene period;
the gene cycle detection unit 720 performs gene cycle detection by the following steps:
setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
The waveform replacing unit 730, configured to generate a replacing waveform according to a waveform corresponding to the lost packet in a previous pitch period of the lost packet, and replace the waveform of the lost packet with the replacing waveform;
the waveform substitution unit 730 generates a substitution waveform by using the following waveform substitution formula:
W[j]= WP[j]，1≤j≤30，
W[j]= WP[j]*(1-（j-30）/(15*30),30<j≤480，
W[j]=0，j>480,
where W represents a substitute waveform for the missing data packet, WP represents a waveform corresponding to the missing data packet in a previous pitch period, and j represents a j-th point in the waveform.
The adaptive filtering unit 740 is configured to perform adaptive smoothing filtering on the waveforms on both sides of the waveform gap formed by the lost packet according to the waveforms corresponding to the waveforms on both sides of the waveform gap formed by the lost packet in the previous pitch period, where the filtering formula is as follows:
LDC[i]=( LDP[i]* (i/Rf) + LD[i]* (30-(i/Rf)))/30，
RDC[i]=( RDP[i]* (30-(i/Rf)) + RD[i]* (i/Rf))/30，
wherein Rf = Rmax +1, i is an integer between 0 and 29,
LD and RD respectively represent the waveform of a packet to the left and the waveform of a packet to the right of a waveform gap formed by the lost packet, LDP and RDP respectively represent the waveforms of the previous pitch period corresponding to the waveforms LD and RD, and LDC and RDC respectively represent the waveforms corresponding to the waveforms LD and RD after filtering.
EXAMPLE III
As shown in fig. 8, a bluetooth voice processing chip according to a third embodiment of the present invention includes at least one processor 810, a memory 820 and an interface 830, where the at least one processor 810, the memory 820 and the interface 830 are all connected by a bus;
the memory 820 stores computer-executable instructions;
the at least one processor 810 executes the computer-executable instructions stored in the memory, so that the bluetooth voice processing chip executes the packet loss concealment method applicable to bluetooth voice communication according to the first embodiment.
In summary, by using the method, apparatus and chip of the present invention, when performing bluetooth voice packet loss waveform substitution, a multi-frame attenuation method is used, which can effectively avoid the situation of wrong voice, and even if the packet loss amount is large, the actual effect can be easily accepted by human ears, when filtering the substituted waveform, an adaptive window filtering technique is used, which can adaptively adjust the filtering strength, and is more suitable for the characteristics of changeable voice, improve the smoothness of the substituted waveform, improve the communication quality, and avoid the defect that the fixed window is not flexible enough, and when the overall packet loss rate of bluetooth voice communication is less than 15%, the packet loss error can be effectively hidden, the bluetooth voice communication quality is improved, and the voice communication distance is increased.
Notably, one of ordinary skill in the art will understand that: the steps or part of the steps for implementing the above method embodiments may be implemented by hardware related to program instructions, the program may be stored in a computer-readable storage medium, and when executed, the program performs the steps including the above method embodiments, and the storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (9)
1. A packet loss hiding method suitable for Bluetooth voice call is characterized by comprising the following steps:
pitch period detection: detecting a pitch period before a Bluetooth voice data packet is lost by adopting a correlation coefficient method, and obtaining a correlation coefficient Rmax corresponding to the pitch period;
a waveform replacing step: generating a substitute waveform according to a waveform corresponding to the lost data packet in a previous pitch period of the lost data packet, and substituting the substitute waveform for the waveform of the lost data packet;
and self-adaptive filtering: according to the corresponding waveforms of the waveforms on the two sides of the waveform gap formed by the lost data packet in the previous pitch period, carrying out adaptive smoothing filtering on the waveforms on the two sides of the waveform gap formed by the lost data packet;
the pitch period detecting step specifically includes:
setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
2. The packet loss concealment method applicable to bluetooth voice communication according to claim 1, wherein the adaptive filtering step specifically includes:
respectively extracting the waveform LD of a data packet on the left side of a waveform gap formed by the lost data packet and the waveform RD of a data packet on the right side of the waveform gap formed by the lost data packet, wherein the voice data of each data packet comprises 30 voice sampling points;
respectively extracting waveforms LDP and RDP of a previous pitch period corresponding to the waveforms LD and RD;
respectively filtering the waveforms LD and RD by using the waveforms LDP and RDP to obtain the smoothed waveforms LDC and RDC, wherein the filtering formula is as follows:
LDC[i]＝(LDP[i]*(i/Rf)+LD[i]*(30-(i/Rf)))/30，
RDC[i]＝(RDP[i]*(30-(i/Rf))+RD[i]*(i/Rf))/30，
wherein i is an integer between 0 and 29, and Rf is Rmax + 1.
3. The packet loss concealment method for bluetooth voice communication according to claim 1, further comprising a bluetooth voice data packet loss detection step of detecting whether the received bluetooth voice data is lost before the pitch period detection step.
4. The packet loss concealment method for bluetooth voice communication according to claim 1, wherein in the waveform substitution step,
when the number of the lost data packets is one, the substitute waveform adopts a waveform corresponding to the lost data packet in a pitch period before the lost data packet;
and when the lost data packets are a plurality of continuous data packets, taking the waveform corresponding to the first lost data packet in the previous pitch period as a substitute waveform of the first data packet, sequentially attenuating each voice sampling point of the waveform corresponding to the other lost data packet in the previous pitch period by 1/(15 x 30) to form a substitute waveform of the other lost data packet, and if the number of the continuous lost data packets is more than 16, directly attenuating the substitute waveform after more than 16 data packets to 0.
5. A packet loss concealment apparatus for bluetooth voice communication, the apparatus comprising:
a pitch period detecting unit, configured to detect a pitch period before a packet loss of a bluetooth voice packet by using a correlation coefficient method, and obtain a correlation coefficient Rmax corresponding to the pitch period;
the waveform replacing unit is used for generating a replacing waveform according to the waveform corresponding to the lost data packet in the previous pitch period of the lost data packet and replacing the waveform of the lost data packet with the replacing waveform; and
the adaptive filtering unit is used for performing adaptive smooth filtering on the waveforms on two sides of the waveform gap formed by the lost data packet according to the corresponding waveforms of the waveforms on two sides of the waveform gap formed by the lost data packet in the previous pitch period;
the pitch period detection unit performs pitch period detection by adopting the following steps:
setting N continuous voice data sampling points on the left side from the lost data packet as a template window, and setting a sliding window with the length same as that of the template window, wherein N is more than or equal to 120;
sliding the sliding window from the 40 th point on the left of the lost data packet to the 120 th voice data sampling point on the left of the lost data packet, and respectively calculating the correlation coefficient R of the sliding window and the template window;
and comparing the correlation coefficients of the points to obtain the maximum correlation coefficient Rmax, and taking the pitch period corresponding to the correlation coefficient Rmax as the pitch period before the Bluetooth voice data packet is lost.
6. The packet loss concealment apparatus for bluetooth voice communication as claimed in claim 5, wherein the adaptive unit uses the following filtering formula:
LDC[i]＝(LDP[i]*(i/Rf)+LD[i]*(30-(i/Rf)))/30，
RDC[i]＝(RDP[i]*(30-(i/Rf))+RD[i]*(i/Rf))/30，
wherein, Rf is Rmax +1, i is an integer between 0 and 29,
LD and RD respectively represent the waveform of a packet to the left and the waveform of a packet to the right of a waveform gap formed by the lost packet, LDP and RDP respectively represent the waveforms of the previous pitch period corresponding to the waveforms LD and RD, and LDC and RDC respectively represent the waveforms corresponding to the waveforms LD and RD after filtering.
7. The apparatus according to claim 6, further comprising a bluetooth voice data detecting unit, wherein the bluetooth voice data detecting unit is configured to detect whether the bluetooth voice data packet is lost.
8. The packet loss concealment apparatus for bluetooth voice communication as claimed in claim 6, wherein the waveform substitution unit generates the substitution waveform by using the following waveform substitution formula:
W[j]＝WP[j]，1≤j≤30，
W[j]＝WP[j]*(1-(j-30)/(15*30),30<j≤480，
W[j]＝0，j>480,
where W represents a substitute waveform for the missing data packet, WP represents a waveform corresponding to the missing data packet in a previous pitch period, and j represents a j-th point in the waveform.
9. A Bluetooth voice processing chip is characterized by comprising at least one processor, a memory and an interface, wherein the at least one processor, the memory and the interface are connected through a bus;
the memory stores computer-executable instructions;
the at least one processor executes the computer-executable instructions stored in the memory, so that the bluetooth voice processing chip executes the packet loss concealment method applicable to bluetooth voice calls in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710150388.7A CN106898356B (en) | 2017-03-14 | 2017-03-14 | Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710150388.7A CN106898356B (en) | 2017-03-14 | 2017-03-14 | Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106898356A CN106898356A (en) | 2017-06-27 |
| CN106898356B true CN106898356B (en) | 2020-04-14 |
Family
ID=59193544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710150388.7A Active CN106898356B (en) | 2017-03-14 | 2017-03-14 | Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106898356B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110400569B (en) * | 2018-04-24 | 2022-01-11 | 广州安凯微电子股份有限公司 | Bluetooth audio repairing method and terminal equipment |
| CN113763974B (en) * | 2021-08-31 | 2023-05-16 | 易兆微电子(杭州)股份有限公司 | Packet loss compensation method and device, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101325631A (en) * | 2007-06-14 | 2008-12-17 | 华为技术有限公司 | Method and apparatus for implementing bag-losing hide |
| CN101366080A (en) * | 2006-08-15 | 2009-02-11 | 美国博通公司 | Re-phasing of decoder states after packet loss |
| EP2068306A1 (en) * | 2007-09-15 | 2009-06-10 | Huawei Technologies Co., Ltd. | Frame error concealment method and apparatus for highband signal |
| CN101588341A (en) * | 2008-05-22 | 2009-11-25 | 华为技术有限公司 | Lost frame hiding method and device thereof |
| CN101833954A (en) * | 2007-06-14 | 2010-09-15 | 华为终端有限公司 | Method and device for realizing packet loss concealment |
| CN101887723A (en) * | 2007-06-14 | 2010-11-17 | 华为终端有限公司 | Fine tuning method and device for pitch period |
| CN102598119A (en) * | 2009-04-21 | 2012-07-18 | 剑桥硅无线电有限公司 | Pitch estimation |
| CN103065636A (en) * | 2011-10-24 | 2013-04-24 | 中兴通讯股份有限公司 | Voice frequency signal frame loss compensation method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163304A1 (en) * | 2002-02-28 | 2003-08-28 | Fisseha Mekuria | Error concealment for voice transmission system |
| US8688437B2 (en) * | 2006-12-26 | 2014-04-01 | Huawei Technologies Co., Ltd. | Packet loss concealment for speech coding |
| US9325544B2 (en) * | 2012-10-31 | 2016-04-26 | Csr Technology Inc. | Packet-loss concealment for a degraded frame using replacement data from a non-degraded frame |
-
2017
- 2017-03-14 CN CN201710150388.7A patent/CN106898356B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101366080A (en) * | 2006-08-15 | 2009-02-11 | 美国博通公司 | Re-phasing of decoder states after packet loss |
| CN101325631A (en) * | 2007-06-14 | 2008-12-17 | 华为技术有限公司 | Method and apparatus for implementing bag-losing hide |
| CN101833954A (en) * | 2007-06-14 | 2010-09-15 | 华为终端有限公司 | Method and device for realizing packet loss concealment |
| CN101887723A (en) * | 2007-06-14 | 2010-11-17 | 华为终端有限公司 | Fine tuning method and device for pitch period |
| EP2068306A1 (en) * | 2007-09-15 | 2009-06-10 | Huawei Technologies Co., Ltd. | Frame error concealment method and apparatus for highband signal |
| CN101588341A (en) * | 2008-05-22 | 2009-11-25 | 华为技术有限公司 | Lost frame hiding method and device thereof |
| CN102598119A (en) * | 2009-04-21 | 2012-07-18 | 剑桥硅无线电有限公司 | Pitch estimation |
| CN103065636A (en) * | 2011-10-24 | 2013-04-24 | 中兴通讯股份有限公司 | Voice frequency signal frame loss compensation method and device |
Non-Patent Citations (1)
| Title |
|---|
| "VOIP中丢包补偿算法模型的研究";张成龙;《中国优秀硕士学位论文全文数据库 信息科技辑》;20130115;第30-34页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106898356A (en) | 2017-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102915737B (en) | The compensation method of frame losing and device after a kind of voiced sound start frame | |
| JP5362808B2 (en) | Frame loss cancellation in voice communication | |
| JP5281169B2 (en) | Transient signal encoding method and apparatus, decoding method and apparatus, and processing system | |
| EP3815082B1 (en) | Adaptive comfort noise parameter determination | |
| KR102299938B1 (en) | Time delay estimation method and device | |
| US9263049B2 (en) | Artifact reduction in packet loss concealment | |
| JP4968147B2 (en) | Communication terminal, audio output adjustment method of communication terminal | |
| JP5232151B2 (en) | Packet-based echo cancellation and suppression | |
| EP3444819B1 (en) | Voice signal cascade processing method and terminal, and computer readable storage medium | |
| CN106898356B (en) | Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip | |
| US8996389B2 (en) | Artifact reduction in time compression | |
| CN110447069A (en) | The method and apparatus of the Speech processing of environment adaptive noise | |
| KR20160124877A (en) | Voice frequency code stream decoding method and device | |
| CN108133712B (en) | Method and device for processing audio data | |
| CN109496333A (en) | A kind of frame losing compensation method and equipment | |
| CN111223492A (en) | Echo path delay estimation method and device | |
| KR101409305B1 (en) | Attenuation of overvoicing, in particular for generating an excitation at a decoder, in the absence of information | |
| JP6098149B2 (en) | Audio processing apparatus, audio processing method, and audio processing program | |
| CN108111702B (en) | Method for automatically compensating voice packet loss of VOIP system | |
| US20210327439A1 (en) | Audio data recovery method, device and Bluetooth device | |
| CN104934040B (en) | The duration adjusting and device of audio signal | |
| US11900951B2 (en) | Audio packet loss concealment method, device and bluetooth receiver | |
| JP2010539550A (en) | Transmission error spoofing of digital signals by complexity distribution | |
| CN113454714A (en) | Spectral shape estimation from MDCT coefficients | |
| JP2016177176A (en) | Voice processing device, program, method and switching device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191225 Address after: 518000 District 652, district a, huameiju business center, Xinhu Road, Haiyu community, Xin'an street, Bao'an District, Shenzhen City, Guangdong Province Applicant after: Jian Rong semiconductor (Shenzhen) Co., Ltd. Address before: 518000 Guangdong city of Shenzhen province science and Technology Park of Nanshan District high new technology building B505 Fu'an Applicant before: Jian Rong semiconductor (Shenzhen) Co., Ltd. Applicant before: Jianrong Integrated Circuit Technology (Zhuhai) Co., Ltd. Applicant before: ZHUHAI HUANGRONG INTEGRATED CIRCUIT TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |