CN111225102A - Bluetooth audio signal transmission method and device - Google Patents
Bluetooth audio signal transmission method and device Download PDFInfo
- Publication number
- CN111225102A CN111225102A CN202010055425.8A CN202010055425A CN111225102A CN 111225102 A CN111225102 A CN 111225102A CN 202010055425 A CN202010055425 A CN 202010055425A CN 111225102 A CN111225102 A CN 111225102A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- signal
- audio
- bluetooth
- stereo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
- H04M1/6058—Portable telephones adapted for handsfree use involving the use of a headset accessory device connected to the portable telephone
- H04M1/6066—Portable telephones adapted for handsfree use involving the use of a headset accessory device connected to the portable telephone including a wireless connection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/02—Details of telephonic subscriber devices including a Bluetooth interface
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The embodiment of the invention discloses a Bluetooth audio signal transmission method and a device, wherein the method comprises the following steps: constructing an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel with a target device end; obtaining a local digital audio signal; receiving A2DP music stream data sent by the target equipment terminal based on the constructed A2DP communication channel, and decoding to obtain a stereo audio signal; receiving voice stream data interacted with the target equipment side based on the constructed HFP bidirectional transmission channel while receiving the A2DP music stream data, and decoding to obtain a remote user sound signal; and/or sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target device side based on the RFCOMM communication channel. The method of the invention can realize the interoperation of the back transmission, the sound mixing, the monitoring playback and the like of the audio signal, and improve the transmission efficiency and the transmission quality of the audio signal.
Description
Technical Field
The embodiment of the invention relates to the technical field of wireless communication, in particular to a Bluetooth audio signal transmission method and device, and further relates to electronic equipment and a computer readable storage medium.
Background
With the continuous development of scientific technology, the digital wireless audio transmission technology is gradually perfected and matured, and the bluetooth audio transmission technology is also widely used, for example: the Bluetooth device is applied to Bluetooth devices such as Bluetooth earphones, Bluetooth sound boxes and Bluetooth microphones. However, the quality of the voice signal that can be transmitted by the current bluetooth device is generally poor, and the interoperation of multiple service functions, such as mixing together, listening and playing back together, and returning together, cannot be realized, which results in great limitation in specific applications.
Therefore, how to design a novel bluetooth audio signal wireless transmission scheme to implement simultaneous operation of multiple service functions becomes a major research point for those skilled in the art.
Disclosure of Invention
Therefore, the embodiment of the invention provides a bluetooth audio signal transmission method to solve the problem that the prior art cannot realize the interoperation of multi-service audio signals simultaneously based on bluetooth equipment, so that the communication efficiency and the communication quality are poor and the application requirements cannot be met.
In order to achieve the above object, the embodiments of the present invention provide the following technical solutions:
in a first aspect, an embodiment of the present invention provides a bluetooth audio signal transmission method, including: constructing an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel with a target device end; acquiring local audio data based on a preset microphone or a signal source, and converting the local audio data into a local digital audio signal; receiving and decoding A2DP music stream data sent by the target device side based on the A2DP communication channel to obtain a stereo audio signal; receiving voice stream data interacted with the target equipment end based on the HFP bidirectional transmission channel while receiving the A2DP music stream data, and decoding to obtain a remote user sound signal; and/or sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target device side based on the RFCOMM communication channel.
Further, the bluetooth audio signal transmission method further includes: transmitting the local digital audio signal and the stereoscopic audio signal to the target device side based on the HFP bidirectional transmission channel while receiving the A2DP music stream data.
Further, the bluetooth audio signal transmission method, sending the local digital audio signal and the stereo audio signal to the target device side based on the HFP bidirectional transmission channel, specifically includes: performing audio mixing processing on the local digital audio signal and the stereo audio signal according to a preset audio mixing coefficient to obtain a first audio mixing signal; and sending the first audio mixing signal to the target equipment terminal based on an uplink transmission channel in the HFP bidirectional transmission channel.
Further, the sending the acquired local digital audio signal, the remote user sound signal, and the stereo audio signal to the target device end based on the RFCOMM communication channel specifically includes: performing sound mixing processing on the local digital audio signal, the remote user sound signal and the stereo audio signal according to a preset sound mixing coefficient to respectively obtain a second left channel sound mixing signal and a second right channel sound mixing signal; performing stereo coding on the second left channel audio mixing signal and the second right channel audio mixing signal to obtain a stereo audio mixing signal; and sending the stereo mixed sound signal to the target equipment terminal based on an uplink transmission channel in the RFCOMM communication channel.
Further, the local digital audio signal specifically includes: at least one of an audio signal recorded by a local microphone and an audio signal stored locally.
In a second aspect, an embodiment of the present invention further provides a bluetooth audio signal transmission apparatus, including: the Bluetooth connection unit is used for constructing an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel with a target device end; the audio acquisition unit is used for acquiring local audio data based on a preset microphone or a signal source and converting the local audio data into a local digital audio signal; an A2DP decoding unit, configured to receive and decode A2DP music stream data sent by the target device side based on the A2DP communication channel, so as to obtain a stereo audio signal; an HFP decoding unit, configured to receive the A2DP music stream data and simultaneously receive voice stream data interacted with the target device side based on the HFP bidirectional transmission channel, and decode the received voice stream data to obtain a remote user sound signal; and/or the audio coding unit is used for sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target device side based on the RFCOMM communication channel.
Further, the bluetooth audio signal transmission device further includes: an HFP encoding unit configured to transmit the local digital audio signal and the stereoscopic audio signal to the destination device side based on the HFP bidirectional transmission channel while receiving the A2DP music stream data.
Further, the bluetooth audio signal transmission device includes: the HFP encoding unit is specifically configured to: performing audio mixing processing on the local digital audio signal and the stereo audio signal according to a preset audio mixing coefficient to obtain a first audio mixing signal; and sending the first audio mixing signal to the target equipment terminal based on an uplink transmission channel in the HFP bidirectional transmission channel.
Further, the audio encoding unit is specifically configured to: performing sound mixing processing on the local digital audio signal, the remote user sound signal and the stereo audio signal according to a preset sound mixing coefficient to respectively obtain a second left channel sound mixing signal and a second right channel sound mixing signal; performing stereo coding on the second left channel audio mixing signal and the second right channel audio mixing signal to obtain a stereo audio mixing signal; and sending the stereo mixed sound signal to the target equipment terminal based on an uplink transmission channel in the RFCOMM communication channel.
Further, the local digital audio signal specifically includes: at least one of an audio signal recorded by a local microphone and an audio signal stored locally.
In a third aspect, an embodiment of the present invention further provides a bluetooth audio signal transmission method, including: receiving a stereo sound mixing signal sent by an embedded Bluetooth device terminal based on a pre-constructed RFCOMM communication channel; receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel; decoding the stereo audio mixing signal and the first audio mixing signal respectively to obtain an initial audio signal; optimizing the initial audio signal to obtain a target audio signal; and carrying out voice transcription processing on the target audio data to obtain text recording data.
In a fourth aspect, an embodiment of the present invention further provides a bluetooth audio signal transmission apparatus, including: the first Bluetooth connection unit is used for receiving a stereo sound mixing signal sent by an embedded Bluetooth device terminal based on a pre-constructed RFCOMM communication channel; the second Bluetooth connection unit is used for receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel; a data decoding unit, configured to perform decoding processing on the stereo audio mixing signal and the first audio mixing signal respectively to obtain an initial audio signal; the data processing unit is used for carrying out optimization processing on the initial audio signal to obtain a target audio signal; and the data presentation unit is used for carrying out voice transcription processing on the target audio data to obtain text recording data.
In a fifth aspect, an embodiment of the present invention further provides an electronic device, including: a processor; and the memory is used for storing a program of the Bluetooth audio signal transmission method, and after the electronic equipment is powered on and runs the program of the Bluetooth audio signal transmission method through the processor, the electronic equipment executes any one of the Bluetooth audio signal transmission methods.
In a sixth aspect, the present invention further provides a computer-readable storage medium, where the computer-readable storage medium contains one or more program instructions, and the one or more program instructions are used for a server to execute the method in any of the above bluetooth audio signal transmission methods.
By adopting the Bluetooth audio signal transmission method, the interoperability of back transmission, sound mixing, monitoring and playback and the like of the audio signal can be realized based on the wireless Bluetooth, for example, a local user is allowed to make a call with a remote user while playing music, the locally played music can be shared with the other party, and the like, so that the transmission efficiency and the transmission quality of the audio signal are improved, and the use experience of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that other embodiments can be derived from the drawings provided by those of ordinary skill in the art without inventive effort.
Fig. 1 is a flowchart of a first bluetooth audio signal transmission method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a first bluetooth audio signal transmission apparatus according to an embodiment of the present invention;
fig. 3 is a flowchart of a second bluetooth audio signal transmission method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a second bluetooth audio signal transmission apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an electronic device according to an embodiment of the present invention;
fig. 6 is a schematic interaction diagram between an embedded bluetooth device and a target device in a bluetooth audio signal transmission method according to an embodiment of the present invention.
Detailed Description
The present invention is described in terms of particular embodiments, other advantages and features of the invention will become apparent to those skilled in the art from the following disclosure, and it is to be understood that the described embodiments are merely exemplary of the invention and that it is not intended to limit the invention to the particular embodiments disclosed. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following describes an embodiment of the first bluetooth audio signal transmission method according to the present invention in detail. As shown in fig. 1, which is a flowchart of a first bluetooth audio signal transmission method according to an embodiment of the present invention, a specific implementation process includes the following steps:
step S101: an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel are constructed between the target device end and the target device end.
In the embodiment of the present invention, the embedded bluetooth device may construct an RFCOMM communication channel, an A2DP communication channel, and an HFP bidirectional transmission channel with the target device side based on a preset protocol through the bluetooth connection unit. The target device end may refer to an intelligent terminal matched with the embedded bluetooth device, such as a smart phone, a notebook computer, and the like. The embedded bluetooth device may be a bluetooth headset, a bluetooth sound, an automatic machine radio station, or a bluetooth microphone, and is not limited herein.
The RFCOMM communication channel refers to a communication data transmission channel between the target device end and the embedded Bluetooth device which is constructed based on an RFCOMM communication protocol; the A2DP communication channel refers to a communication data transmission channel between the target device end and the embedded Bluetooth device which is constructed based on an A2DP music protocol; the HFP bidirectional transmission channel refers to a single-channel communication data bidirectional transmission channel between the target device side and the embedded bluetooth device, which is constructed based on the HFP session protocol. The RFCOMM communication protocol is a protocol based on Bluetooth equipment, and Bluetooth defines a communication mode of bottom layer radio frequency, a packaging format of a data packet, a connection establishment mode (pairing mode) of a communication channel and the like; the RFCOMM communication protocol is a serial linear emulation protocol based on the european telecommunications standards institute ETSI07.10 protocol that provides RS232 control and status signals such as corruption at baseband, CTS, and data signals, etc., providing transport capabilities for upper layer services such as traditional serial cable applications. In addition, the RFCOMM communication protocol can also be created separately, not relying on the standard bluetooth protocols (such as A2DP, HFP, etc. protocols) typically found with embedded bluetooth devices. It should be noted that the RFCOMM communication protocol is disclosed in the prior art, and is not described in detail herein.
Step S102: local audio data are collected based on a preset microphone or a signal source, and the local audio data are converted into local digital audio signals.
In the embodiment of the invention, the embedded bluetooth device can collect local audio data from a preset microphone or an audio source, and the microphone can be a local microphone of the embedded bluetooth device and also can be a wireless microphone receiver. In addition, in the actual implementation process, the audio data may also be read from a signal source such as an analog port, a digital port, or an audio file, and the specific implementation process includes, but is not limited to, the above-mentioned cases, and is not limited specifically herein.
After the local audio data is acquired, the local audio data may be converted into a local digital audio signal. The local digital audio signal may be a PCM signal or a PDM signal, but is not limited to the two signals listed above. The local audio data includes voice data recorded by a local microphone, locally stored audio data (such as audio playing content stored by an automatic machine station), and the like; accordingly, the local digital audio signal includes an audio signal recorded by a local microphone, a locally stored audio signal, and the like, where the audio signal includes a voice signal, a recorded musical instrument sound signal, and the like, and is not particularly limited herein.
In addition, in the step, an operation instruction signal input by a user can be received based on a preset key touch device, and the local data resource can be controlled based on the operation instruction signal; or, the operation instruction signal is transmitted to the target device end through the RFCOMM communication channel, and an application program (such as audio playing software) corresponding to the target device end is controlled. The button touch device can be a button touch screen arranged at the end of the embedded Bluetooth equipment.
Step S103: and receiving and decoding A2DP music stream data sent by the target device side based on the A2DP communication channel to obtain a stereo audio signal.
After the A2DP communication channel with the target device is constructed in the above step S101, the embedded bluetooth device in this step may receive A2DP music stream data sent by the target device based on the A2DP communication channel, and decode to obtain a stereo audio signal.
When any audio playing software on the target device side performs music playing operation, A2DP music streaming data can be transmitted through the Bluetooth connection unit and the A2DP communication channel constructed by the embedded Bluetooth device side. And decoding the received A2DP music stream data at the embedded Bluetooth equipment end to obtain a 44.1khz or 48khz stereo audio signal. Specifically, the decoding format may support the use of a stereo encoder such as SBC, AAC, etc., and is not particularly limited herein.
Further, the local digital audio signal and the stereo audio signal can be optimized according to a preset rule to obtain a local digital audio processing signal and a stereo audio processing signal; and carrying out sound mixing processing on the local digital audio processing signal and the stereo audio processing signal to obtain a first sound mixing signal.
Specifically, the process of performing optimization processing on the local digital audio signal includes: the local digital audio signal is processed in real time, for example: the processing may be performed on a sample-by-sample basis (e.g., audio time-domain filtering) or on a frame-by-frame basis (e.g., frequency-domain processing of the audio signal). In addition, the method may further include processing such as noise reduction, reverberation, and digital sound effect enhancement on the local digital audio signal collected by the microphone, and certainly, the optimization processing may also include simple gain adjustment processing and the like, which is not specifically limited herein, and finally, the local digital audio processing signal may be obtained. The process of optimizing the stereo audio signal comprises the following steps: the signal processing is performed on A2DP music stream data received through an A2DP communication channel, for example, in a karaoke scene, the original singing voice or the original sound of some instrument is eliminated from the received music, and a stereo audio processing signal is obtained. The method is characterized in that the elimination of the voice can be carried out in the frequency domain of the stereo audio signal, the voice is placed in a central channel for general songs, the component of the central channel is suppressed in the frequency domain through the characteristic, so that the voice transplantation can be realized, or the extraction of the accompaniment can be realized, the stereo accompaniment can be generated through the processing, the traditional algorithm realizes the extraction of the accompaniment through a left channel and a right channel subtraction method, the method can only obtain the single-channel accompaniment, and the listening experience is not good. The stereo audio processing signal may then be mixed with audio data collected by local microphones, stored audio data, or audio data picked up by other microphones.
Step S104: and receiving voice stream data interacted with the target device side based on the HFP bidirectional transmission channel while receiving the A2DP music stream data, and decoding to obtain a remote user sound signal.
While executing the step S103, in this step, the embedded bluetooth device may receive voice stream data interacted with the target device side based on the HFP bidirectional transmission channel, and decode the voice stream data to obtain a remote user voice signal.
After the HFP session is initiated on the target device side, the target device side can establish a single-channel HFP bidirectional transmission channel with the embedded bluetooth device through the bluetooth connection unit in the intelligent system. And receiving the HFP audio data based on the HFP bidirectional transmission channel at the embedded Bluetooth device end, and performing subsequent decoding. The HFP audio data stream includes, but is not limited to, cvsd of 8khz and msbc of 16 khz. The remote user sound signal is obtained through the decoding process.
Further, the local digital audio signal can be optimized according to a preset rule, and a local digital audio processing signal is output; processing the remote user sound signal according to a preset rule, and outputting a remote user sound processing signal; and carrying out sound mixing processing on the local digital audio processing signal and the remote user sound processing signal, and outputting a sound mixing signal or a stereo sound mixing signal.
Specifically, the process of performing optimization processing on the local digital audio signal includes: processing the local digital audio signal in real time, such as: the processing is performed on a sample-by-sample basis (e.g., audio time-domain filtering) and may also be performed on a frame-by-frame basis (e.g., frequency-domain processing of the audio signal). In addition, the method can also comprise the steps of carrying out noise reduction, reverberation, digital sound effect enhancement and other processing on the local digital audio signals collected by the microphone, and the optimization processing can also comprise simple processingThe gain adjustment processing and the like of (3) are not particularly limited herein. It should be noted that, in practical implementation, the processed local digital audio signal may be denoted as VLThe local digital audio signal VLMay be one of 8khz, 16khz, 44.1khz or 48khz, so that the local digital audio signal VLMay be different from the sampling rate specified for the HFP session. Therefore, before the audio mixing process, it is necessary to determine whether the sampling rate of the local digital audio processing signal is the same as the sampling rate of the remote user audio signal in the HFP session, and if not, the local digital audio processing signal is resampled by using a preset resampling filter, so that the local digital audio processing signal and the remote user audio signal are processed to have the same sampling rate, thereby facilitating sending the local digital audio signal to the remote user. Wherein the sampling rate refers to the frequency of sampling. In addition, the process of performing signal processing on the remote user sound signal according to a preset rule comprises signal processing such as noise reduction and gain. The remote user sound signal can be recorded as VR。
Step S105: and sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target device side based on the RFCOMM communication channel.
While the above steps S103 and S104 are executed, in this step, the acquired local digital audio signal, the remote user sound signal and the stereo audio signal may be sent to the target device side based on the RFCOMM communication channel.
In the embodiment of the present invention, while receiving voice stream data interacting with the target device side based on the HFP bidirectional transmission channel, the obtained local digital audio signal, the remote user sound signal, and the stereo audio signal may be transmitted to the target device side based on the RFCOMM communication channel. Specifically, the sending the acquired local digital audio signal, the remote user sound signal, and the stereo audio signal to the target device end based on the RFCOMM communication channel specifically includes: performing sound mixing processing on the local digital audio signal, the remote user sound signal and the stereo audio signal according to a preset sound mixing coefficient to respectively obtain a second left channel sound mixing signal and a second right channel sound mixing signal; performing stereo coding on the second left channel audio mixing signal and the second right channel audio mixing signal to obtain a stereo audio mixing signal; and sending the stereo mixed sound signal to the target equipment terminal based on an uplink transmission channel in the RFCOMM communication channel.
In addition, the sending of the local digital audio signal and the stereoscopic audio signal to the target device side based on the HFP bidirectional transmission channel may be specifically implemented in the following manner: performing audio mixing processing on the local digital audio signal and the stereo audio signal according to a preset audio mixing coefficient to obtain a first audio mixing signal; and sending the first audio mixing signal to the target equipment terminal based on an uplink transmission channel in the HFP bidirectional transmission channel.
As shown in fig. 6, the technical architecture of the embedded bluetooth device is designed to simultaneously maintain a plurality of channels of the embedded bluetooth device connected to a target device (e.g. a smart terminal such as a mobile phone), including an RFCOMM communication channel constructed based on an RFCOMM communication protocol (i.e. SWISS or SWISS communication protocol in fig. 6) for bidirectionally transmitting data and controlling communication, an A2DP communication channel constructed based on a downlink A2DP music protocol of the target device, and an HFP bidirectional transmission channel constructed based on an HFP session protocol, and can implement interoperation of data content carried by the three protocols, for example, a user can listen to A2DP music and make an HFP phone call with another remote user, and share a local voice signal (i.e. a local digital audio signal) and a mixed audio signal (i.e. a stereo audio signal) with the remote user through the HFP bidirectional transmission channel by using the technical solution of the present invention, and records the contents of double talk and local music through RFCOMM protocol. In this case, the multi-protocol content interoperability module in the device may obtain both the local digital audio signal (at least one of the audio signal recorded by the local microphone and the locally stored audio signal),Remote user voice signal VR(decoded downstream from HFP), A2DP downstream stereo audio signal<ML,MR>In the interoperation module, the first mixed sound signal V may be uplink for HFPUSuch mixing is performed: vU=a*VL+b*ML+c*MRWhere a, b, and c may be numbers with absolute values greater than or equal to zero and less than or equal to 1. For the RFCOMM up-line recording, the mixing of three signals can be performed: left channel signal (i.e. second left channel mixing signal) MixL=d*VL+e*VR+f*MLRight channel signal (i.e. second right channel mixing signal) MixR=(1-d)*VL+(1-e)*VR+f*MRWhere d, e, f are coefficients equal to or greater than zero and equal to or less than 1, and then on the stereo signal<MixL,MixR>And performing stereo coding to obtain a stereo mixed sound signal, and transmitting the stereo mixed sound signal back to a target device end (such as an intelligent terminal like a mobile phone) in real time through an RFCOMM channel.
By adopting the first Bluetooth audio signal transmission method, the interoperability of back transmission, sound mixing, monitoring and playback and the like of the audio signal can be realized based on the wireless Bluetooth, for example, a local user is allowed to make a call with a remote user while playing music, the locally played music can be shared with the other party, and the like, so that the transmission efficiency and the transmission quality of the audio signal are improved, and the use experience of the user is improved.
Corresponding to the first bluetooth audio signal transmission method, the invention also provides a first bluetooth audio signal transmission device. Since the embodiment of the apparatus is similar to the above-mentioned method embodiment, the description is relatively simple, and please refer to the description of the above-mentioned method embodiment, and the following description of the embodiment of the first bluetooth audio signal transmission apparatus is only illustrative. Please refer to fig. 2, which is a schematic diagram of a first bluetooth audio signal transmission apparatus according to an embodiment of the present invention.
The first Bluetooth audio signal transmission device comprises the following parts:
and a bluetooth connection unit 201 for constructing an RFCOMM communication channel, an A2DP communication channel, and an HFP bidirectional transmission channel with the target device.
The audio acquisition unit 202 is configured to acquire local audio data based on a preset microphone or a signal source, and convert the local audio data into a local digital audio signal.
An A2DP decoding unit 203, configured to receive and decode A2DP music stream data sent by the target device side based on the A2DP communication channel, so as to obtain a stereo audio signal.
After the A2DP communication channel with the target device side is constructed in the bluetooth connection unit 201, the A2DP decoding unit 203 may receive A2DP music stream data transmitted by the target device side based on the A2DP communication channel and decode the data to obtain a stereo audio signal.
An HFP decoding unit 204, configured to receive the A2DP music stream data and simultaneously receive voice stream data interacted with the target device side based on the HFP bidirectional transmission channel, and decode the received voice stream data to obtain a remote user sound signal; and/or the presence of a gas in the gas,
while the A2DP decoding unit 203 operates, the HFP decoding unit 204 may receive voice stream data interacted with the target device side based on the HFP bidirectional transmission channel, and decode the voice stream data to obtain a remote user voice signal.
An audio encoding unit 205, configured to send the acquired local digital audio signal, the remote user sound signal, and the stereo audio signal to the target device side based on the RFCOMM communication channel.
While the above-mentioned A2DP decoding unit 203 and HFP decoding unit 204 are running, the audio encoding unit 205 may transmit the acquired local digital audio signal, the remote user sound signal, and the stereo audio signal to the target device side based on the RFCOMM communication channel.
In the embodiment of the present invention, while receiving voice stream data interacting with the target device side based on the HFP bidirectional transmission channel, the obtained local digital audio signal, the remote user sound signal, and the stereo audio signal may be transmitted to the target device side based on the RFCOMM communication channel. Specifically, the sending the acquired local digital audio signal, the remote user sound signal, and the stereo audio signal to the target device end based on the RFCOMM communication channel specifically includes: performing sound mixing processing on the local digital audio signal, the remote user sound signal and the stereo audio signal according to a preset sound mixing coefficient to respectively obtain a second left channel sound mixing signal and a second right channel sound mixing signal; performing stereo coding on the second left channel audio mixing signal and the second right channel audio mixing signal to obtain a stereo audio mixing signal; and sending the stereo mixed sound signal to the target equipment terminal based on an uplink transmission channel in the RFCOMM communication channel.
In addition, the sending of the local digital audio signal and the stereoscopic audio signal to the target device side based on the HFP bidirectional transmission channel may be specifically implemented in the following manner: performing audio mixing processing on the local digital audio signal and the stereo audio signal according to a preset audio mixing coefficient to obtain a first audio mixing signal; and sending the first audio mixing signal to the target equipment terminal based on an uplink transmission channel in the HFP bidirectional transmission channel.
As shown in fig. 6, the technical architecture of the embedded bluetooth device is designed to simultaneously maintain a plurality of channels of the embedded bluetooth device connected to a target device (e.g., a smart terminal such as a mobile phone), including an RFCOMM communication channel constructed based on an RFCOMM communication protocol for bi-directional data transmission and communication control, an A2DP communication channel constructed based on a downlink A2DP music protocol of the target device, and an HFP bi-directional transmission channel constructed based on an HFP session protocol, and can implement interoperation of data content carried by the three protocols, for example, a user can make an HFP call with another remote user while listening to A2DP music, and simultaneously share a local speech signal (i.e., a local digital audio signal) and a music mixing signal (i.e., a stereo audio signal) with the remote user through the HFP bi-directional transmission channel, and via the RFCOMM protocolThe double talk content and the local music content are recorded. In this case, the multi-protocol content interoperability module in the device will simultaneously obtain the local digital audio signal (at least one of the audio signal recorded by the local microphone and the locally stored audio signal), the remote user sound signal VR(decoded downstream from HFP), A2DP downstream stereo audio signal<ML,MR>In the interoperation module, the first mixed sound signal V may be uplink for HFPUSuch mixing is performed: vU=a*VL+b*ML+c*MRWhere a, b, and c may be numbers with absolute values greater than or equal to zero and less than or equal to 1. For the RFCOMM up-line recording, the mixing of three signals can be performed: left channel signal (i.e. second left channel mixing signal) MixL=d*VL+e*VR+f*MLRight channel signal (i.e. second right channel mixing signal) MixR=(1-d)*VL+(1-e)*VR+f*MRWhere d, e, f are coefficients equal to or greater than zero and equal to or less than 1, and then on the stereo signal<MixL,MixR>And performing stereo coding to obtain a stereo mixed sound signal, and transmitting the stereo mixed sound signal back to a target equipment end (an intelligent terminal such as a mobile phone and the like) in real time through an RFCOMM channel.
By adopting the first Bluetooth audio signal transmission device, the interoperability of back transmission, sound mixing, monitoring and playback and the like of audio signals can be realized based on wireless Bluetooth, for example, a local user is allowed to make a call with a remote user while playing music, the locally played music can be shared with the other party, and the like, so that the transmission efficiency and the transmission quality of the audio signals are improved, and the use experience of the user is improved.
Corresponding to the first Bluetooth audio signal transmission method and device, the invention also provides a second Bluetooth audio signal transmission method and device. Since the method and apparatus are similar to the above-mentioned method and apparatus embodiments, the description is simple, and please refer to the description of the above-mentioned first method and apparatus embodiment, and the following description of the second bluetooth audio signal transmission method and apparatus is only illustrative. Fig. 3 and 4 are a flowchart and a schematic diagram of a second bluetooth audio signal transmission method and apparatus according to an embodiment of the present invention, respectively.
The second bluetooth audio signal transmission method of the invention specifically comprises the following steps:
step S301: and receiving a stereo mixed sound signal sent by the embedded Bluetooth device terminal based on a pre-constructed RFCOMM communication channel.
Step S302: and receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel.
Step S303: and respectively decoding the stereo audio mixing signal and the first audio mixing signal to obtain an initial audio signal.
Step S304: and optimizing the initial audio signal to obtain a target audio signal.
Step S305: and carrying out voice transcription processing on the target audio data to obtain text recording data.
In the embodiment of the invention, the target device end can receive the stereo audio mixing signal sent by the embedded Bluetooth device end based on the pre-constructed RFCOMM communication channel; receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel; then, the stereo audio mixing signal and the first audio mixing signal are decoded respectively to obtain an initial audio signal, the initial audio signal is optimized to obtain a target audio signal, and voice transcription processing is carried out on the target audio data to obtain text recording data, so that users can take an important telephone conversation. The target device end may refer to an intelligent terminal such as a smart phone or a notebook computer, and is not specifically limited herein.
By adopting the second Bluetooth audio signal transmission method, high-quality audio data can be obtained based on the constructed communication channel, recording can be realized while telephone communication is carried out, the transmission efficiency and the transmission quality of audio signals between Bluetooth devices are improved, and the use experience of users is improved.
The second bluetooth audio signal transmission device of the invention comprises the following parts:
the first bluetooth connection unit 401 is configured to receive a stereo mix signal sent by an embedded bluetooth device based on a pre-constructed RFCOMM communication channel.
A second bluetooth connection unit 402, configured to receive the first audio mixing signal sent by the embedded bluetooth device based on a pre-constructed HFP bidirectional transmission channel.
A data decoding unit 403, configured to perform decoding processing on the stereo mix signal and the first mix signal respectively to obtain initial audio signals.
And a data processing unit 404, configured to perform optimization processing on the initial audio signal to obtain a target audio signal.
A data presentation unit 405, configured to perform voice transcription processing on the target audio data to obtain text recording data.
By adopting the second Bluetooth audio signal transmission device, high-quality audio data can be acquired based on the constructed communication channel, recording can be realized while telephone communication is carried out, the transmission efficiency and the transmission quality of audio signals between Bluetooth devices are improved, and the use experience of users is improved.
Corresponding to the two Bluetooth audio signal transmission methods, the invention also provides electronic equipment realized based on the Bluetooth audio signal transmission method. Since the embodiment of the electronic device is similar to the above method embodiment, the description is relatively simple, and please refer to the description of the above method embodiment, and the electronic device described below is only schematic. Fig. 5 is a schematic view of an electronic device according to the present invention.
An electronic device according to the present invention includes:
a processor 301 and a memory 302; the memory is used for storing a program 303 of a bluetooth audio signal transmission method, and the electronic device executes any one of the above bluetooth audio signal transmission methods after being powered on and running the program 303 of the bluetooth audio signal transmission method through the processor 301.
In addition, the invention also provides a computer storage medium corresponding to the Bluetooth audio signal transmission method. Since the embodiment of the computer storage medium is similar to the above method embodiment, the description is simple, and please refer to the description of the above method embodiment, and the computer storage medium described below is only schematic.
The computer storage medium contains one or more program instructions for the server to perform the bluetooth audio signal transmission method described above.
In an embodiment of the present invention, the processor or the processing module may be an integrated circuit chip having signal processing capability. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The processor reads the information in the storage medium and completes the steps of the method in combination with the hardware.
The storage medium may be a memory, for example, which may be volatile memory or nonvolatile memory, or which may include both volatile and nonvolatile memory.
The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory.
The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (ddr Data Rate SDRAM), Enhanced SDRAM (ESDRAM), synclink DRAM (SLDRAM), and Direct memory bus RAM (DRRAM).
The storage media described in connection with the embodiments of the invention are intended to comprise, without being limited to, these and any other suitable types of memory.
Those skilled in the art will appreciate that the functionality described in the present invention may be implemented in a combination of hardware and software in one or more of the examples described above. When software is applied, the corresponding functionality may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.
Claims (10)
1. A method for bluetooth audio signal transmission, comprising:
constructing an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel with a target device end;
acquiring local audio data based on a preset microphone or a signal source, and converting the local audio data into a local digital audio signal;
receiving and decoding A2DP music stream data sent by the target device side based on the A2DP communication channel to obtain a stereo audio signal;
receiving voice stream data interacted with the target equipment end based on the HFP bidirectional transmission channel while receiving the A2DP music stream data, and decoding to obtain a remote user sound signal; and/or sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target device side based on the RFCOMM communication channel.
2. The bluetooth audio signal transmission method according to claim 1, further comprising: transmitting the local digital audio signal and the stereoscopic audio signal to the target device side based on the HFP bidirectional transmission channel while receiving the A2DP music stream data.
3. The method for transmitting the bluetooth audio signal according to claim 1, wherein the sending the local digital audio signal and the stereo audio signal to the target device side based on the HFP bidirectional transmission channel specifically includes:
performing audio mixing processing on the local digital audio signal and the stereo audio signal according to a preset audio mixing coefficient to obtain a first audio mixing signal;
and sending the first audio mixing signal to the target equipment terminal based on an uplink transmission channel in the HFP bidirectional transmission channel.
4. The bluetooth audio signal transmission method according to claim 1, wherein the sending the acquired local digital audio signal, the remote user audio signal, and the stereo audio signal to the target device based on the RFCOMM communication channel specifically includes:
performing sound mixing processing on the local digital audio signal, the remote user sound signal and the stereo audio signal according to a preset sound mixing coefficient to respectively obtain a second left channel sound mixing signal and a second right channel sound mixing signal;
performing stereo coding on the second left channel audio mixing signal and the second right channel audio mixing signal to obtain a stereo audio mixing signal;
and sending the stereo mixed sound signal to the target equipment terminal based on an uplink transmission channel in the RFCOMM communication channel.
5. The method for transmitting bluetooth audio signals according to claim 1, wherein the local digital audio signals specifically include: at least one of an audio signal recorded by a local microphone and an audio signal stored locally.
6. A bluetooth audio signal transmission device, comprising:
the Bluetooth connection unit is used for constructing an RFCOMM communication channel, an A2DP communication channel and an HFP bidirectional transmission channel with a target device end;
the audio acquisition unit is used for acquiring local audio data based on a preset microphone or a signal source and converting the local audio data into a local digital audio signal;
an A2DP decoding unit, configured to receive and decode A2DP music stream data sent by the target device side based on the A2DP communication channel, so as to obtain a stereo audio signal;
an HFP decoding unit, configured to receive the A2DP music stream data and simultaneously receive voice stream data interacted with the target device side based on the HFP bidirectional transmission channel, and decode the received voice stream data to obtain a remote user sound signal; and/or the presence of a gas in the gas,
and the audio coding unit is used for sending the acquired local digital audio signal, the remote user sound signal and the stereo audio signal to the target equipment terminal based on the RFCOMM communication channel.
7. A method for bluetooth audio signal transmission, comprising:
receiving a stereo sound mixing signal sent by an embedded Bluetooth device terminal based on a pre-constructed RFCOMM communication channel;
receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel;
decoding the stereo audio mixing signal and the first audio mixing signal respectively to obtain an initial audio signal;
optimizing the initial audio signal to obtain a target audio signal;
and carrying out voice transcription processing on the target audio data to obtain text recording data.
8. A bluetooth audio signal transmission device, comprising:
the first Bluetooth connection unit is used for receiving a stereo sound mixing signal sent by an embedded Bluetooth device terminal based on a pre-constructed RFCOMM communication channel;
the second Bluetooth connection unit is used for receiving a first audio mixing signal sent by the embedded Bluetooth equipment terminal based on a pre-constructed HFP bidirectional transmission channel;
a data decoding unit, configured to perform decoding processing on the stereo audio mixing signal and the first audio mixing signal respectively to obtain an initial audio signal;
the data processing unit is used for carrying out optimization processing on the initial audio signal to obtain a target audio signal;
and the data presentation unit is used for carrying out voice transcription processing on the target audio data to obtain text recording data.
9. An electronic device, comprising:
a processor; and
a memory for storing a program of a bluetooth audio signal transmission method, the electronic device performing the bluetooth audio signal transmission method of any one of the above claims 1 to 5 or 7 after being powered on and running the program of the bluetooth audio signal transmission method through the processor.
10. A computer readable storage medium containing one or more program instructions for execution by a server of a bluetooth audio signal transmission method as claimed in any one of claims 1 to 5 or 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010055425.8A CN111225102A (en) | 2020-01-17 | 2020-01-17 | Bluetooth audio signal transmission method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010055425.8A CN111225102A (en) | 2020-01-17 | 2020-01-17 | Bluetooth audio signal transmission method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111225102A true CN111225102A (en) | 2020-06-02 |
Family
ID=70831820
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010055425.8A Pending CN111225102A (en) | 2020-01-17 | 2020-01-17 | Bluetooth audio signal transmission method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111225102A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113225716A (en) * | 2021-04-19 | 2021-08-06 | 北京塞宾科技有限公司 | Vehicle-mounted karaoke realization method, system, equipment and storage medium |
CN116566963A (en) * | 2023-07-12 | 2023-08-08 | 腾讯科技(深圳)有限公司 | Audio processing method and device, electronic equipment and storage medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110662206A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Bluetooth-based high-definition music and voice transmission operation method |
CN110662207A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | High-quality music and voice transmission operation method based on Bluetooth |
CN110662204A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Music and voice transmission operation method based on Bluetooth |
CN110661907A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Bluetooth-based high-definition call recording method |
-
2020
- 2020-01-17 CN CN202010055425.8A patent/CN111225102A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110662206A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Bluetooth-based high-definition music and voice transmission operation method |
CN110662207A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | High-quality music and voice transmission operation method based on Bluetooth |
CN110662204A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Music and voice transmission operation method based on Bluetooth |
CN110661907A (en) * | 2018-07-01 | 2020-01-07 | 张德明 | Bluetooth-based high-definition call recording method |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113225716A (en) * | 2021-04-19 | 2021-08-06 | 北京塞宾科技有限公司 | Vehicle-mounted karaoke realization method, system, equipment and storage medium |
CN116566963A (en) * | 2023-07-12 | 2023-08-08 | 腾讯科技(深圳)有限公司 | Audio processing method and device, electronic equipment and storage medium |
CN116566963B (en) * | 2023-07-12 | 2023-10-13 | 腾讯科技(深圳)有限公司 | Audio processing method and device, electronic equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11831697B2 (en) | System for audio communication using LTE | |
JP7302006B2 (en) | Methods for operating Bluetooth devices | |
CN108886647B (en) | Earphone noise reduction method and device, master earphone, slave earphone and earphone noise reduction system | |
US20150281853A1 (en) | Systems and methods for enhancing targeted audibility | |
US8982744B2 (en) | Method and system for a subband acoustic echo canceller with integrated voice activity detection | |
CN103312912B (en) | A kind of mixer system and method | |
EP3228096B1 (en) | Audio terminal | |
US20140226842A1 (en) | Spatial audio processing apparatus | |
WO2008046967A1 (en) | Time scaling of multi-channel audio signals | |
WO2021160040A1 (en) | Audio transmission method and electronic device | |
CN102067210B (en) | Apparatus and method for encoding and decoding audio signals | |
CN111225102A (en) | Bluetooth audio signal transmission method and device | |
US20220286538A1 (en) | Earphone device and communication method | |
CN111246331A (en) | Wireless panorama sound mixing sound earphone | |
CN111385780A (en) | Bluetooth audio signal transmission method and device | |
JP4513514B2 (en) | Multipoint call system, portable terminal device, volume adjustment method used therefor, and program thereof | |
US20110235632A1 (en) | Method And Apparatus For Performing High-Quality Speech Communication Across Voice Over Internet Protocol (VoIP) Communications Networks | |
CN110366752A (en) | A kind of voice frequency dividing transmission method, plays end, source circuit and plays terminal circuit source | |
CN111261175A (en) | Bluetooth audio signal transmission method and device | |
KR100918571B1 (en) | Voice over internet protocol communication system for providing users with background music while phone conversation in peer-to-peer | |
JP7316384B2 (en) | Encoding device, decoding device, encoding method and decoding method | |
KR20080085376A (en) | Method and apparatus for function for audio mixing and adding sound effect in audio data using bluetooth digital audio player | |
JP2011030120A (en) | Interphone system | |
CN116189694A (en) | Audio processing method and device and electronic equipment | |
KR100861440B1 (en) | Audio processing apparatus of USB VoIP |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200602 |