WO2021185077A1 - 一种音频处理方法、装置及*** - Google Patents

一种音频处理方法、装置及*** Download PDF

Info

Publication number
WO2021185077A1
WO2021185077A1 PCT/CN2021/078884 CN2021078884W WO2021185077A1 WO 2021185077 A1 WO2021185077 A1 WO 2021185077A1 CN 2021078884 W CN2021078884 W CN 2021078884W WO 2021185077 A1 WO2021185077 A1 WO 2021185077A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio data
earphone
wireless
audio
box
Prior art date
Application number
PCT/CN2021/078884
Other languages
English (en)
French (fr)
Inventor
尹明婕
缪海波
常青
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21772414.5A priority Critical patent/EP4109922A4/en
Priority to US17/912,295 priority patent/US20230147435A1/en
Publication of WO2021185077A1 publication Critical patent/WO2021185077A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/08—Mouthpieces; Microphones; Attachments therefor
    • H04R1/083—Special constructions of mouthpieces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1025—Accumulators or arrangements for charging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016—Earpieces of the intra-aural type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00—Details of connection covered by H04R, not provided for in its groups
    • H04R2420/07—Applications of wireless loudspeakers or wireless microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/17—Hearing device specific tools used for storing or handling hearing devices or parts thereof, e.g. placement in the ear, replacement of cerumen barriers, repair, cleaning hearing devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks

Definitions

  • the embodiments of the present application relate to the field of electronic technology, and in particular, to an audio processing method, device, and system.
  • true wireless stereo (TWS) headsets are becoming more and more popular among users.
  • the embodiments of the application provide an audio processing method, device, and system that can pick up the user’s voice through a headset box, and return the user’s voice picked up by the headset box to the user through a wireless headset such as a TWS headset, and the headset box can be separated from the user The mouth is closer, so the sound pickup effect is better, and the user's back listening effect is also better.
  • an embodiment of the present application provides an audio processing method, which is applied to an audio processing system, and the audio processing system includes an electronic device, a wireless earphone, and an earphone box.
  • the method includes: establishing a wireless connection between the wireless earphone and the electronic device, and establishing a wireless connection between the wireless earphone and the earphone box.
  • the earphone box collects sound signals and generates first audio data. Then, the earphone box sends the first audio data to the wireless earphone.
  • the wireless earphone performs sound effect processing on the received first audio data to obtain second audio data.
  • the electronic device sends the third audio data to the wireless earphone.
  • the wireless earphone performs mixing processing on the second audio data and the third audio data to obtain fourth audio data.
  • the wireless earphone plays the fourth audio data.
  • the earphone box may be an earphone box for storing TWS earphones.
  • the wireless headset may be a TWS headset, a neckband wireless headset, or other wireless headsets.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the wireless headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated.
  • the user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the wireless headset is also very close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • this solution can break the restriction that the earpiece of the wireless earphone and the sound pickup device are closer together, and can also get rid of the trouble of wired transmission or the connection line of the non-wireless earphone.
  • the wireless headset includes a first earplug and a second earplug.
  • the earphone box sending the first audio data to the wireless earphone includes: the earphone box sending the first audio data to the first earplug and the second earplug.
  • the second audio data includes fifth audio data and sixth audio data.
  • the wireless headset performs sound effect processing on the first audio data to obtain the second audio data, including: the first earplug performs sound effect processing on the first audio data to obtain the fifth audio data.
  • the second earplug performs sound effect processing on the first audio data to obtain sixth audio data.
  • the electronic device sending the third audio data to the wireless earphone includes: the electronic device sending the third audio data to the first earplug and the second earplug.
  • the fourth audio data includes seventh audio data and eighth audio data.
  • the wireless earphone mixes the second audio data with the third audio data to obtain the fourth audio data, including: the first earplug combines the fifth audio data with the first audio data.
  • the three audio data are mixed to obtain the seventh audio data; the second earplug performs the mixed processing of the sixth audio data and the third audio data to obtain the eighth audio data.
  • a dual-transmission connection is established between the wireless headset, the headset box and the electronic device, that is, the two earplugs of the wireless headset establish a wireless connection with the headset box and the electronic device, respectively, and can exchange data with the headset box and the electronic device.
  • the wireless headset includes a first earplug and a second earplug
  • the headset box sends the first audio data to the wireless headset, including: the headset box sends the first audio data to the first earplug.
  • the wireless earphone performs sound effect processing on the first audio data to obtain the second audio data, including: the first earplug performs sound effect processing on the first audio data to obtain the second audio data.
  • the electronic device sending the third audio data to the wireless earphone includes: the electronic device sending the third audio data to the first earplug.
  • the wireless earphone mixes the second audio data and the third audio data to obtain the fourth audio data, including: the first earplug mixes the second audio data and the third audio data to obtain the fourth audio data.
  • the method further includes: the first earplug sends fourth audio data to the second earplug.
  • a forwarding connection is established between the wireless headset, the headset box and the electronic device, that is, an earplug of the wireless headset establishes a wireless connection with the headset box and the electronic device, which can interact with the electronic device of the headset box and connect
  • the interactive data is forwarded to another earplug of TWS.
  • the method further includes: after the electronic device detects the first preset operation of the user, displaying an application interface of the target application, and the first preset operation is used to start the target application.
  • the earphone box can be used to pick up the sound, and the TWS earphone can be used to listen back.
  • the method further includes: the wireless earphone sends the first audio data to the electronic device; the electronic device performs processing on the first audio data through the target application. Business processing.
  • the wireless headset may also send the first audio data to the electronic device, so that the target application of the electronic device performs related service processing according to the first audio data.
  • the method further includes: establishing a wireless connection between the earphone box and the electronic device. After the earphone box collects the sound signal and generates the first audio data, the method further includes: the earphone box sends the first audio data to the electronic device; and the electronic device performs service processing on the first audio data through the target application.
  • the earphone box may also send the first audio data to the electronic device, so that the target application of the electronic device performs related service processing according to the first audio data.
  • the method further includes: the electronic device prompts the user whether to enter the target mode; the electronic device enters the target mode after detecting the operation instructed by the user to enter the target mode .
  • the electronic device can automatically prompt the user whether to enter the target mode.
  • the electronic device can enter the target mode according to the user's instruction, so that the earphone box can be used to pick up sound, and a wireless connection can be established between the electronic device, the wireless earphone, and the earphone box to exchange audio data.
  • the target application is a preset application.
  • the preset application can use the earphone box to pick up the sound. After the electronic device turns on the preset music, a wireless connection can be established between the electronic device, the wireless earphone, and the earphone box to interact audio data.
  • the method further includes: after the electronic device detects the second preset operation of the user, displaying a setting interface, and the setting interface includes a target mode control. After detecting the user's operation on the target mode control, the electronic device enters the target mode.
  • the electronic device can enter the target mode according to the user's instruction operation, so that the earphone box can be used to pick up the sound, and the wireless earphone can be used to listen back.
  • the wireless headset stores the first communication address of the headset box
  • the headset box stores the second communication address of the wireless headset.
  • Establishing a wireless connection between the wireless earphone and the earphone box includes: after the wireless earphone or earphone box detects a third preset operation of the user, the wireless earphone and the earphone box establish a wireless connection according to the first communication address and the second communication address.
  • the wireless earphone or earphone box receives the connection information from the electronic device, the wireless earphone and the earphone box establish a wireless connection according to the first communication address and the second communication address.
  • the wireless earphone and earphone box can be the equipment that is used in the factory.
  • the wireless earphone and earphone box can establish a wireless connection according to the user's instructions and the communication address of the other party saved with each other.
  • a wireless connection is established between the wireless earphone and the electronic device, and the wireless connection between the wireless earphone and the earphone box is established, including: establishing a wireless connection between the electronic device and the wireless earphone; the electronic device and the earphone Establish a wireless connection between the boxes. Then, the electronic device sends the first communication address of the wireless earphone to the earphone box; the electronic device sends the second communication address of the earphone box to the wireless earphone. The earphone box and the wireless earphone establish a wireless connection according to the first communication address and the second communication address.
  • the electronic device can first establish a wireless connection with the wireless earphone and the earphone box, and then exchange the communication addresses of the wireless earphone and the earphone box, so that the wireless earphone and the earphone box establish a wireless connection according to the communication address of the other party.
  • the wireless connection is a Bluetooth connection
  • the headset box uses a Bluetooth audio codec to encode audio data.
  • the Bluetooth audio codec can compress the audio data obtained through the high sampling rate to a lower data volume, so that it can be quickly transmitted through Bluetooth, so that the pickup data of the headset box can reach the wireless headset or electronic device in real time and quickly. Achieve high-bandwidth Bluetooth audio pickup and audio transmission, and realize the real-time return of the user's voice.
  • an embodiment of the present application provides a headset box, including: a wireless communication module, a microphone, and an audio module.
  • the wireless communication module is used to establish a wireless connection with the wireless headset.
  • the microphone is used to collect sound signals.
  • the audio module is used to generate first audio data according to the sound signal.
  • the wireless communication module is also used to send the first audio data to the wireless earphone.
  • the earphone box can pick up the user's voice, convert it into the first audio data and send it to the wireless earphone, so that the wireless earphone can perform related processing or play the user's voice according to the first audio data, so that the sound can be heard back.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the wireless headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated.
  • the user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the wireless headset is also very close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • the wireless communication module is further configured to send the first audio data to the wireless earphone, including: sending the first audio data to the first earplug and the second earplug of the wireless earphone. Or, send the first audio data to the first earbud of the wireless earphone.
  • the earphone box and the two earplugs of the wireless headset both establish a wireless connection, and the first audio data can be sent to both the two earplugs of the wireless headset.
  • the earphone box only establishes a wireless connection with one earplug of the wireless earphone, and the first audio data can be sent to the earplug.
  • the wireless communication module is further used to: establish a wireless connection with the electronic device; and send the first audio data generated by the audio module to the electronic device.
  • the earphone box can send the first audio data to the electronic device, so that the electronic device performs related service processing on the first audio data.
  • the wireless communication module is used to establish a wireless connection with the wireless headset, which specifically includes: receiving the communication address of the wireless headset from the electronic device; and establishing a wireless connection with the wireless headset according to the communication address.
  • the headset box can establish a wireless connection with the wireless headset according to the communication address of the wireless headset sent by the electronic device.
  • the earphone box further includes a storage module that stores the communication address of the wireless earphone; the wireless communication module is used to establish a wireless connection with the wireless earphone, which specifically includes: the earphone box detects the user's After the preset operation or the connection information from the electronic device is received, a wireless connection is established with the wireless headset according to the communication address.
  • the earphone box can be operated according to the user's instructions and combined with the communication address of the wireless earphone to establish a wireless connection with the wireless earphone.
  • the wireless connection is a Bluetooth connection
  • the audio module also includes a Bluetooth audio codec module.
  • the Bluetooth audio codec module is used to encode audio data.
  • the Bluetooth audio codec module can compress the audio data obtained through high sampling rate to a lower data volume, it can be quickly transmitted through Bluetooth, so that the pickup data of the headset box can reach the wireless headset quickly and in real time. Therefore, high-bandwidth Bluetooth audio pickup and audio transmission can be realized, and the user's voice can be heard back in real time.
  • the embodiments of the present application provide an audio processing method, which is applied to an audio processing system.
  • the audio processing system includes a wireless headset and a headset box.
  • the method includes: establishing a wireless connection between the wireless earphone and the earphone box.
  • the earphone box collects sound signals and generates first audio data.
  • the earphone box sends the first audio data to the wireless earphone.
  • the wireless earphone performs sound effect processing on the first audio data to obtain second audio data.
  • the wireless earphone plays the second audio data.
  • the wireless earphone and the earphone box establish a dual-transmission connection, and both earplugs of the wireless earphone perform data interaction with the earphone box.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the wireless headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated. The user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the wireless headset is also very close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • an embodiment of the present application provides an audio processing method, which is applied to an audio processing system.
  • the audio processing system includes a wireless headset and a headset box.
  • the wireless headset includes a first earplug and a second earplug.
  • the method includes: a wireless headset and A wireless connection is established between the earphone boxes; the earphone box collects sound signals and generates first audio data; the earphone box sends the first audio data to the first earbud; the first earbud performs sound effect processing on the first audio data to obtain the second audio data ;
  • the first earplug sends the second audio data to the second earplug; the first earplug and the second earplug play the second audio data.
  • the wireless headset establishes a forwarding connection with the headset box, and the headset box performs data interaction with one of the earbuds of the wireless headset.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the wireless headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated. The user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the wireless headset is also very close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • an embodiment of the present application provides an audio processing system, including: an electronic device, a wireless earphone, and an earphone box.
  • the electronic device, the wireless earphone and the earphone box are used to establish a wireless connection between the wireless earphone and the electronic device, and the wireless connection between the wireless earphone and the earphone box.
  • the earphone box is also used to collect sound signals and generate first audio data.
  • the earphone box is also used to send the first audio data to the wireless earphone.
  • the wireless headset is also used to perform sound effect processing on the first audio data to obtain second audio data.
  • the electronic device is also used to send third audio data to the wireless earphone.
  • the wireless earphone is also used for mixing the second audio data and the third audio data to obtain the fourth audio data.
  • the wireless earphone is also used to play the fourth audio data.
  • the electronic device, wireless earphone, and earphone box in the audio processing system are used to execute the audio processing method in any possible design of any one of the above aspects.
  • the wireless headset includes a first earplug and a second earplug.
  • the earphone box is used to send the first audio data to the wireless earphone, which specifically includes: sending the first audio data to the first earplug and the second earplug.
  • the second audio data includes fifth audio data and sixth audio data.
  • the wireless headset is used to perform sound effect processing on the first audio data to obtain the second audio data, which specifically includes: performing sound effect processing on the first audio data through the first earplug to obtain the fifth audio data; and performing the sound effect processing on the first audio data through the second earplug
  • the data is subjected to sound effect processing to obtain sixth audio data.
  • the electronic device is configured to send the third audio data to the wireless earphone, which specifically includes: sending the third audio data to the first earplug and the second earplug.
  • the fourth audio data includes seventh audio data and eighth audio data.
  • the wireless earphone is used for mixing the second audio data and the third audio data to obtain the fourth audio data, including: mixing the fifth audio data and the third audio data through the first earplug to obtain the seventh audio data. Audio data; the sixth audio data and the third audio data are mixed through the second earplug to obtain the eighth audio data.
  • the wireless headset includes a first earplug and a second earplug.
  • the earphone box is used for sending the first audio data to the wireless earphone, including: sending the first audio data to the first earplug.
  • the wireless earphone is used for performing sound effect processing on the first audio data to obtain the second audio data, including: the first earplug is used for performing sound effect processing on the first audio data to obtain the second audio data.
  • the electronic device is configured to send the third audio data to the wireless earphone, including: sending the third audio data to the first earplug.
  • the wireless earphone is used for mixing the second audio data and the third audio data to obtain the fourth audio data, including: the first earplug is used for mixing the second audio data and the third audio data to obtain Fourth audio data.
  • the wireless headset is also used to send fourth audio data to the second earplug through the first earplug.
  • the electronic device is further configured to display the application interface of the target application after detecting the first preset operation of the user, and the first preset operation is used to start the target application.
  • the wireless earphone is also used to send the first audio data to the electronic device after the earphone box sends the first audio data to the wireless earphone.
  • the electronic device is also used to perform service processing on the first audio data through the target application.
  • the earphone box is also used to send the first audio data to the electronic device after collecting the sound signal and generating the first audio data.
  • the electronic device is also used to perform service processing on the first audio data through the target application.
  • the electronic device is also used to prompt the user whether to enter the target mode after displaying the application interface of the target application; enter the target mode after detecting the user's instruction to enter the target mode.
  • the target application is a preset application.
  • the electronic device is also used to display a setting interface after detecting the second preset operation of the user, and the setting interface includes the target mode control; after detecting the user's operation on the target mode control, enter Target mode.
  • the wireless headset stores the first communication address of the headset box
  • the headset box stores the second communication address of the wireless headset.
  • the wireless earphone and the earphone box are used to establish a wireless connection between the wireless earphone and the earphone box, including: after the wireless earphone or earphone box detects the third preset operation of the user, the wireless earphone and the earphone box are used for according to the first communication address Establish a wireless connection with the second communication address.
  • the wireless earphone and earphone box are used to establish a wireless connection according to the first communication address and the second communication address.
  • the electronic device, the wireless headset, and the headset box are used to establish a wireless connection between the wireless headset and the electronic device, and to establish a wireless connection between the wireless headset and the headset box, including: The electronic device is also used to establish a wireless connection with the earphone box; the electronic device is used to send the first communication address of the wireless earphone to the earphone box; the electronic device is also used to connect the earphone box The second communication address is sent to the wireless headset; the headset box and the wireless headset are used to establish a wireless connection according to the first communication address and the second communication address.
  • the wireless connection is a Bluetooth connection
  • the headset box uses a Bluetooth audio codec to encode audio data.
  • an embodiment of the present application provides an audio processing device, which is included in an audio device.
  • the device has the function of realizing the behavior of the audio device in any one of the above aspects and possible designs, so that the audio device executes the audio processing method in any one of the above possible designs.
  • This function can be realized by hardware, or by hardware executing corresponding software.
  • the hardware or software includes at least one module or unit corresponding to the above-mentioned functions.
  • the device may include an audio module or a microphone.
  • the audio device may be the above-mentioned electronic device, wireless earphone or earphone box.
  • an embodiment of the present application provides an audio device, including: one or more processors; and a memory, in which code is stored.
  • the audio device is caused to execute the audio processing method executed by the audio device in any of the above-mentioned possible designs.
  • the audio device may be the above-mentioned electronic device, wireless earphone or earphone box.
  • an embodiment of the present application provides a computer-readable storage medium, including computer instructions, which, when the computer instructions run on an audio device, cause the audio device to execute the audio processing method in any one of the possible designs of the foregoing aspects.
  • the audio device may be the above-mentioned electronic device, wireless earphone or earphone box.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, enables the computer to execute the audio processing method executed by the audio device in any one of the above-mentioned possible designs.
  • the audio device may be the above-mentioned electronic device, wireless earphone or earphone box.
  • the embodiments of the present application provide a chip system, which is applied to audio equipment.
  • the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by wires; the interface circuit is used to receive signals from the memory of the audio device and send signals to the processor.
  • the signals include the memory Stored computer instructions; when the processor executes the computer instructions, it causes the audio device to execute the audio processing method in any one of the possible designs of the above aspects.
  • the audio device may be the above-mentioned electronic device, wireless earphone or earphone box.
  • FIG. 1 is a schematic structural diagram of an audio processing system provided by an embodiment of the application
  • FIG. 2 is a schematic diagram of the earplug structure of a TWS headset provided by an embodiment of the application;
  • FIG. 3 is a schematic structural diagram of an earphone box provided by an embodiment of the application.
  • FIG. 4 is a schematic structural diagram of a mobile phone provided by an embodiment of this application.
  • 5A is a schematic diagram of a connection architecture between a TWS headset, a headset box, and a mobile phone according to an embodiment of the application;
  • FIG. 5B is a schematic diagram of another connection architecture between a TWS headset, a headset box, and a mobile phone according to an embodiment of the application;
  • 6A is a schematic diagram of a connection between a TWS headset, a headset box, and a mobile phone according to an embodiment of the application;
  • FIG. 6B is a schematic diagram of another connection between a TWS headset, a headset box, and a mobile phone according to an embodiment of the application;
  • FIG. 7 is a flowchart of an audio processing method provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of a mobile phone interface provided by an embodiment of the application.
  • FIG. 9 is a schematic diagram of another mobile phone interface provided by an embodiment of the application.
  • FIG. 10 is a flowchart of another audio processing method provided by an embodiment of the application.
  • FIG. 11A is a flowchart of establishing a Bluetooth connection provided by an embodiment of the application.
  • FIG. 11B is a schematic diagram of another mobile phone interface provided by an embodiment of this application.
  • FIG. 12A is another flowchart for establishing a Bluetooth connection provided by an embodiment of the application.
  • 12B is a schematic diagram of another mobile phone interface provided by an embodiment of this application.
  • FIG. 13 is a flowchart of another audio processing method provided by an embodiment of the application.
  • FIG. 14A is a flowchart of another audio processing method provided by an embodiment of the application.
  • 15 is a schematic structural diagram of another audio processing system provided by an embodiment of the application.
  • FIG. 16 is a schematic structural diagram of another audio processing system provided by an embodiment of the application.
  • FIG. 17 is a flowchart of another audio processing method provided by an embodiment of the application.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, “plurality” means two or more.
  • the microphone on the TWS headset is far from the user's mouth, and the sound picked up by the microphone on the TWS headset is likely to lack details and have poor signal-to-noise ratio. , Therefore, the return listening effect of TWS headphones is poor, and the user experience is poor.
  • the embodiment of the present application provides an audio processing method, which can be applied to back-to-listening scenarios where users need to hear their own voice through headphones, such as karaoke, live broadcast, singing, speech, or speech.
  • headphones such as karaoke, live broadcast, singing, speech, or speech.
  • the environment may be noisy, or the accompaniment sound may be louder, and karaoke users may not be able to hear their own voice clearly or hear their own voice delayed through the spread of sound in the air.
  • karaoke users can hear their own voice and accompaniment in real time by listening back, so that their voice matches the accompaniment, ensuring that they are not out of tune or out of tune, and adjust their voice status in time.
  • the person making a speech may not be able to hear his own voice clearly or hear his own voice delayed through the sound propagation in the air.
  • the person speaking can hear his own voice in real time by returning to the listener, so as to adjust his voice in real time to avoid abnormal voice.
  • the earphone box used to store the TWS earphone can collect the user's sound signal, and generate the first sound signal according to the collected sound signal. Audio data, and send the first audio data to the TWS headset.
  • the TWS headset can play the target audio data corresponding to the user's sound signal, thereby returning the user's voice to the user.
  • the target audio data may include the first audio data corresponding to the user's sound signal, or the target audio data may include the second audio data of which the first audio data is subjected to sound effect processing.
  • the process of collecting sound signals by the earphone box and converting the sound signals into first audio data may also be referred to as sound pickup by the earphone box or pickup by the earphone box, and the first audio data may also be called sound pickup data.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the TWS headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated. The user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the TWS headset is also close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • the TWS headset can also receive audio data sent by the electronic device (such as accompaniment during karaoke, or background music during live broadcast, etc.), and combine the target audio data corresponding to the user's sound signal with the audio data sent by the electronic device. The audio data is played together to the user.
  • audio data sent by the electronic device such as accompaniment during karaoke, or background music during live broadcast, etc.
  • wireless communication technology is used to transmit audio data between TWS headsets, headset boxes, and electronic devices, which can get rid of the shackles of wired transmission or non-TWS headset cables and improve user experience.
  • FIG. 1 shows a schematic diagram of the architecture of an audio processing system 01.
  • the audio processing system 01 includes a TWS headset 10 and a headset box 20.
  • the earphone box can be used to store TWS earphones.
  • There is a wireless connection between the TWS headset and the headset box and wireless communication technology can be used to transmit audio data.
  • the earphone box can collect the user's sound signal, generate first audio data according to the user's sound signal, and send the first audio data to the TWS earphone.
  • the TWS headset can play the target audio data corresponding to the user's sound signal to the user, thereby returning the user's voice to the user.
  • the target audio data includes first audio data, or includes second audio data after the first audio data is processed by sound effects.
  • the audio processing system 01 may further include an electronic device 30.
  • an electronic device 30 there is a wireless connection between the TWS headset and the headset box, and between the TWS headset and the electronic device, and wireless communication technology can be used to transmit audio data.
  • wireless communication technology there is also a wireless connection between the earphone box and the electronic device, and wireless communication technology may be used to transmit audio data.
  • the earphone box can collect the user's sound signal, generate first audio data according to the user's sound signal, and send the first audio data to the TWS earphone.
  • the TWS headset can also receive third audio data sent by the electronic device.
  • the TWS earphone can play the target audio data and the third audio data to the user together to realize the return listening function.
  • the target audio data includes first audio data, or includes second audio data after the first audio data has been processed by sound effects.
  • the TWS headset can mix the target audio data and the third audio data sent by the electronic device and then play it to the user.
  • the TWS headset can mix the target audio data corresponding to the user's sound signal with the accompaniment from the electronic device and then play it to the user.
  • the first audio data generated by the earphone box may also be sent to the electronic device, or forwarded to the electronic device through the TWS earphone, so that the electronic device can perform related service processing according to the target application currently used by the user.
  • the wireless communication technology used for audio data transmission may be Bluetooth (BT), infrared (IR), wireless local area networks, WLAN ) (Such as wireless fidelity (Wi-Fi) networks), global navigation satellite system (GNSS), frequency modulation (FM), or near field communication (NFC) )Wait.
  • BT Bluetooth
  • IR infrared
  • WLAN wireless local area networks
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • the TWS headset 10 in the audio processing system shown in FIG. 1 can also be replaced with other wireless headsets.
  • the wireless earphone does not have a pickup cable, and it does not need to be connected to the audio device through the earphone jack.
  • the TWS earphone 10 in the audio processing system shown in FIG. 1 can be replaced with a wireless earphone with a connecting wire between earplugs such as a neckband wireless earphone.
  • TWS earphones can generally include a pair of earplugs, for example, earplug 1 and earplug 2.
  • FIG. 2 shows a schematic structural diagram of the earplug 200 included in the TWS earphone.
  • the earplug 200 may include: a processor 210, a memory 220, a wireless communication module 230, an audio module 240, at least one receiver 250, at least one microphone 260, a sensor 270, a power supply 280, an input/output interface 290, and so on.
  • the memory 220 may be used to store application program codes, such as program codes for establishing a wireless connection with another earplug 200 of the TWS headset, and for making the earplug 200 wirelessly connect with the above-mentioned electronic device.
  • the processor 210 can execute the above program code to realize the function of the earplug 200 in the embodiment of the present application, for example, to control the wireless communication module 230 to receive audio data from the earphone box or electronic device, perform audio processing on the received audio data, and control The receiver 250 performs functions such as playing the processed audio data.
  • the processor 210 may be a general-purpose central processing unit (central processing unit, CPU), microprocessor, application-specific integrated circuit (ASIC), digital signal processor (digital signal processor, DSP) , Or one or more integrated circuits used to control the execution of the program of this application.
  • the memory 220 may also store a Bluetooth address (also referred to as a communication address) for uniquely identifying the earplug 200, and a Bluetooth address of the other earplug of the TWS headset.
  • the memory 220 may also store the pairing history of the electronic device successfully paired with the earplug 200 before.
  • the pairing history may include the Bluetooth address of the electronic device successfully paired with the earbud 200.
  • the earplug 200 can automatically connect back to the paired electronic device.
  • the memory 220 may also store the Bluetooth address of the earphone box for storing the earplug 200. Based on the Bluetooth address, the earplug 200 can establish a Bluetooth connection with the earphone box.
  • the aforementioned Bluetooth address may be a media access control (media access control, MAC) address.
  • the wireless communication module 230 is used to support the current earplug 200 and the other earplug of the TWS headset, wireless data exchange with various electronic devices and the headset box, and support the TWS headset to establish wireless connection with the electronic device and the headset box at the same time connect.
  • the wireless communication module 230 may be a Bluetooth module.
  • the earplug 200 can establish a Bluetooth connection with the earphone box and the electronic device through the Bluetooth module, so as to realize short-distance data exchange between each other.
  • the audio module 240 is used for converting digital audio data into analog audio electrical signal output, and also used for converting analog audio electrical signal input into digital audio data.
  • the audio module 240 can transmit audio data with the wireless communication module 230 to implement functions such as calling or playing music.
  • the audio module 240 may also include an audio codec for encoding and decoding audio data.
  • the audio codec may be a high-definition Bluetooth codec, which can encode the first audio data generated by the sound signal collected at a high sampling rate (for example, a sampling rate greater than or equal to 16kHz, such as 48kHz or 32kHz), so that The encoded first audio data can retain sound information of a higher bandwidth (for example, a bandwidth of 0-24k or a bandwidth of 0-16k), so as to obtain more realistic and highly clear sound information for subsequent listening to the user.
  • the amount of encoded data is small, and it can be transmitted at a high speed through wireless communication technologies such as Bluetooth.
  • the audio module 240 may also include an audio processing module for performing audio processing on audio data.
  • the audio processing module may include a sound effect processing module for performing sound effect processing on the first audio data sent by the earphone box.
  • the audio processing module may further include an audio mixing processing module, configured to perform audio mixing processing on the second audio data obtained by the sound effect processing and the third audio data sent by the electronic device.
  • the audio module 240 may be provided in the processor 210, or some functional modules of the audio module 240 may be provided in the processor 210.
  • At least one receiver 250 which can also be called a "handset" can be used to convert analog audio electrical signals into sound signals and play them.
  • the receiver 250 may convert the audio electrical signal received from the earphone box and the electronic device into a sound signal and play it.
  • the audio electrical signal is the audio data in the embodiment of the application.
  • At least one microphone 260 which may also be referred to as a "microphone” or “microphone”, is used to convert sound signals into analog audio electrical signals.
  • the microphone 260 can detect a sound signal when the user sings or speaks, and converts the sound signal into an analog audio electric signal.
  • the sensor 270 may include components such as a distance sensor 270 or a proximity light sensor 270.
  • the earplug 200 can determine whether it is worn by the user through the sensor 270.
  • the earplug 200 may further include a touch sensor 270 for detecting a user's touch operation.
  • the power supply 280 may be used to supply power to various components included in the earplug 200 of the TWS headset.
  • the power source 280 may be a battery, such as a rechargeable battery.
  • the input/output interface 290 is used to provide any wired connection between the earplug 200 of the TWS earphone and the earphone box.
  • the input/output interface 290 may be an electrical connector.
  • the earphone 200 of the TWS earphone When the earphone 200 of the TWS earphone is placed in the earphone box, the earphone 200 of the TWS earphone can be electrically connected to the earphone box (such as the input/output interface 290 included in the earphone box) through the electrical connector. After the electrical connection is established, the earphone box can charge the power source 280 of the earplug 200 of the TWS earphone. After the electrical connection is established, the earplug 200 of the TWS headset can also perform data communication with the headset box.
  • the earplug 200 of the TWS earphone can receive a pairing instruction from the earphone box through the electrical connector.
  • the pairing command is used to instruct the earplug 200 of the TWS headset to turn on the wireless communication module 230, so that the earplug 200 of the TWS headset can use the corresponding wireless communication protocol (such as Bluetooth) to pair and connect with the electronic device.
  • the wireless communication protocol such as Bluetooth
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the earplug 200 of the TWS headset. It may have more or fewer components than shown in FIG. 2, may combine two or more components, or may have a different component configuration.
  • the earplug 200 may also include an indicator light (which can indicate the status of the power of the earplug 200, etc.), a dust-proof net (which can be used with an earpiece), a motor, and other components.
  • the various components shown in FIG. 2 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing or application specific integrated circuits.
  • the wireless communication module 230 may receive the first audio data corresponding to the user's sound signal from the earphone box, and may also receive the third audio data sent by the electronic device.
  • the receiver 250 can play the target audio data and the third audio data corresponding to the user's sound signal, thereby converting the electrical signal corresponding to the audio data into a sound signal that the user can hear.
  • the target audio data includes first audio data, or includes second audio data after the first audio data is processed by sound effects.
  • the audio processing module may perform sound effect processing on the first audio data, and may also perform sound mixing processing on the second audio data obtained by the sound effect processing and the third audio data sent by the electronic device.
  • the receiver 250 can play the mixed audio data.
  • the audio data received by the wireless communication module 230 from the earphone box and the electronic device may be audio data encoded by an audio codec.
  • the wireless communication module 230 first decodes the received audio data, and then performs audio processing such as sound effect processing or audio mixing processing.
  • the amount of encoded data is small and can be transmitted at a high speed through wireless communication technologies such as Bluetooth.
  • FIG. 3 shows a schematic structural diagram of the earphone box 300.
  • the earphone box 300 can be used to store earplugs of TWS earphones.
  • the earphone box 300 includes a processor 310, a memory 320, a wireless communication module 330, an audio module 340, at least one microphone 350, a power supply 360, and an input/output interface 370.
  • the memory 320 can be used to store application program codes, which are controlled and executed by the processor 310 of the earphone box 300 to realize the functions of the earphone box 300. For example, it can realize the wireless connection and wireless connection between the earphone box 300 and TWS earphones or electronic devices. Communication and other functions.
  • the processor 310 may be a CPU, a microprocessor, an ASIC, a DSP, or one or more integrated circuits used to control the execution of the program of the present application.
  • the memory 320 may also store the Bluetooth address of the received earplug. Based on the Bluetooth address, the earphone box 300 can establish a Bluetooth connection with the earplug.
  • the Bluetooth address may be a MAC address.
  • the wireless communication module 330 is used to support the wireless data exchange between the earphone box 300 and the TWS earphone and/or electronic device, and supports the earphone box 300 to establish wireless connections with multiple devices at the same time.
  • the wireless communication module 330 may be a Bluetooth module.
  • the earphone box 300 can establish a Bluetooth connection with the TWS earphone and the electronic device through the Bluetooth module, so as to realize short-distance data exchange between each other.
  • the audio module 340 is used for converting analog audio electrical signal input into digital audio data.
  • the audio module 340 may be used to convert the analog audio electrical signal converted from the sound signal by the microphone 350 into the first audio data.
  • the audio module 340 may also include an audio codec for encoding and decoding audio data.
  • the audio codec may be a Bluetooth high-bandwidth codec.
  • the audio module 340 may be provided in the processor 310, or part of the functional modules of the audio module 340 may be provided in the processor 310.
  • At least one microphone 350 which may also be referred to as a "microphone” or “microphone”, is used to convert sound signals into analog audio electrical signals. For example, when the earphone box 300 is close to the user's mouth, the microphone 350 can collect the user's voice signal and convert it into an analog audio electrical signal during the user's speaking, singing or speaking process.
  • the earphone box 300 may be provided with at least one control, which can be used to trigger the earphone box 300 to establish a wireless connection with the TWS earphone, or trigger the re-pairing between the two earplugs of the TWS earphone, or trigger the earphone box 300 establishes a wireless connection with an electronic device and other operations.
  • the earphone box 300 may further include a power supply 360, which may be used to supply power to various components included in the earphone box 300.
  • the earphone box 300 may also be provided with a charging port for charging the earphone box 300 itself.
  • the earphone box 300 may further include an input/output interface 370. When the earplug of the TWS earphone is placed in the earphone box 300, the input/output interface 370 may be used to charge the earplug.
  • the earphone box 300 may also include other controls, which will not be described here.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the earphone box 300. It may have more or fewer components than shown in FIG. 3, may combine two or more components, or may have a different component configuration.
  • the earphone box 300 may also include components such as a control 380 or an indicator light 390.
  • the microphone 350 and the audio module 340 can convert the user's voice signal into the first audio data.
  • the wireless communication module 330 may send the first audio data to the TWS headset, so that the TWS headset can play the target audio data.
  • the target audio data includes first audio data, or includes second audio data after the first audio data has been processed by sound effects.
  • the wireless communication module 330 may also send the first audio data to the electronic device, so that the electronic device can perform processing such as audio recording.
  • the first audio data sent by the wireless communication module 330 to the TWS headset and the electronic device is audio data encoded by an audio codec.
  • the amount of encoded data is small and can be transmitted at a high speed through wireless communication technologies such as Bluetooth.
  • the electronic devices in the audio processing system can be mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, super mobile personal computers ( Ultra-mobile personal computer (UMPC), netbook or personal digital assistant (personal digital assistant, PDA) and other devices.
  • AR augmented reality
  • VR virtual reality
  • UMPC Ultra-mobile personal computer
  • PDA personal digital assistant
  • the embodiments of the present application do not limit the specific types of electronic devices.
  • FIG. 4 shows a schematic structural diagram of the mobile phone 100.
  • the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142, Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, A display screen 194, a subscriber identification module (SIM) card interface 195, and so on.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, DSP, baseband processor, and/or neural-network processing unit (NPU), etc.
  • AP application processor
  • GPU graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the internal memory 121 may be used to store computer executable program code, and the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the mobile phone 100 by running instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the processor 110 can realize the function of establishing a wireless connection (such as Bluetooth connection) between the mobile phone and multiple devices such as a TWS headset or a headset box by running instructions stored in the internal memory 121;
  • a wireless connection such as Bluetooth connection
  • the processor 110 can realize the function of establishing a wireless connection (such as Bluetooth connection) between the mobile phone and multiple devices such as a TWS headset or a headset box by running instructions stored in the internal memory 121;
  • the first audio data corresponding to the sound signal undergoes audio recording and other processing.
  • the wireless communication function of the mobile phone 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the wireless communication module 160 can provide wireless communication solutions including WLAN (such as Wi-Fi network), BT, GNSS, FM, NFC, IR, etc., which are applied on the mobile phone 100.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic waves and radiate it through the antenna 2.
  • the wireless communication module 160 can establish a wireless connection (such as a Bluetooth connection) with multiple devices such as a TWS headset or a headset box, and receive the first audio data from the TWS headset or headset box, and can also send The TWS headset transmits third audio data (for example, accompaniment).
  • a wireless connection such as a Bluetooth connection
  • multiple devices such as a TWS headset or a headset box
  • the TWS headset transmits third audio data (for example, accompaniment).
  • the mobile phone 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio electrical signals into analog audio electrical signals for output, and also used to convert analog audio electrical signals input into digital audio data.
  • the audio module 170 can transmit audio data with the wireless communication module 160, so as to implement functions such as call, music playback, audio recording, or audio file generation.
  • the audio module 170 may also include an audio codec for encoding and decoding audio data.
  • the audio module 170 may be provided in the processor 110, or some functional modules of the audio module 170 may be provided in the processor 110.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the mobile phone 100, which is different from the position of the display screen 194.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile phone 100.
  • the mobile phone 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the wireless communication module 160 may receive the first audio data corresponding to the user's sound signal from the earphone box or the TWS earphone, and may also send the third audio data to the TWS earphone.
  • the processor 110 may perform audio recording and other processing on the first audio data corresponding to the sound signal collected by the earphone box through the target application.
  • the display screen 194 may display the application interface of the target application.
  • the first audio data received by the wireless communication module 160 from the headset box or TWS headset is the audio data encoded by the audio codec, and the audio codec may encode the encoded audio data received by the wireless communication module.
  • the audio data is decoded.
  • the third audio data sent by the wireless communication module 160 to the TWS headset is also the audio data encoded by the audio encoder. The amount of encoded data is small and can be transmitted at a high speed through wireless communication technologies such as Bluetooth.
  • the audio processing system includes a TWS headset, a headset box, and an electronic device
  • the TWS headset has the structure shown in Figure 2
  • the headset box has the structure shown in Figure 3
  • the electronic device is a mobile phone with the structure shown in Figure 4.
  • a Bluetooth connection can be established between the TWS earphone, the earphone box and the mobile phone first.
  • the Bluetooth connection architecture between TWS headset, headset box and mobile phone includes the following two situations:
  • Case 1 Referring to Figure 5A, a Bluetooth connection is established between the TWS headset and the headset box, and a Bluetooth connection is established between the TWS headset and the mobile phone, and no Bluetooth connection is established between the mobile phone and the headset box.
  • a Bluetooth connection is established between the TWS headset and the headset box, a Bluetooth connection is established between the TWS headset and the mobile phone, and a Bluetooth connection is established between the mobile phone and the headset box.
  • the existing forwarding connection scheme, dual-transmitting connection scheme or other schemes can be used to establish a Bluetooth connection.
  • the mobile phone can establish a Bluetooth connection with each earbud of the TWS headset respectively, thereby interacting audio data with each earbud separately.
  • the Bluetooth connection can be maintained between the two earbuds, or the Bluetooth connection can be disconnected.
  • a Bluetooth connection can be established separately between the earphone box and each earplug of the TWS headset, so as to interact audio data with each earplug separately.
  • the TWS headset may include a main earbud and a secondary earbud; a Bluetooth connection is established between the main earbud and the mobile phone, and audio data can be exchanged; a Bluetooth connection is established between the primary and secondary earbuds, and the main The earbuds forward audio data to the auxiliary earbuds through the Bluetooth connection with the auxiliary earbuds.
  • a Bluetooth connection is established between the earphone box and the main earplug, which can interact audio data; the main earplug can forward audio data to the secondary earplug. It should be noted that when the user uses the TWS headset, the roles of the primary and secondary earplugs can be switched.
  • an embodiment of the present application provides an audio processing method, and the method may include:
  • a Bluetooth connection can be established between the mobile phone, TWS headset and the headset box, and audio transmission based on the Bluetooth connection; the headset box can collect the user's sound signal, convert the sound signal into audio data and send it to the TWS headset; TWS The headset can return the user's voice to the user.
  • the preset operation 1 may be a user's touch operation, voice instruction operation, or gesture operation.
  • the target mode may be the "professional listening mode" shown in FIG. 8, and the preset operation 1 may be an operation of the user clicking the control 801.
  • the mobile phone may also prompt the user of the function of the target mode.
  • the target mode is the professional back-to-listening mode
  • the function of the professional back-to-listening mode is: this mode can pick up the user's voice through the earphone box, and return the user's voice to the user through the TWS headset. It is understandable that the target mode can also have other names, such as earphone box pickup mode.
  • a Bluetooth connection is established between the TWS headset, the headset box and the mobile phone.
  • the target mode there can be multiple schemes for establishing a Bluetooth connection between the TWS headset, the headset box, and the mobile phone.
  • the TWS headset and headset box are used together at the factory.
  • the TWS headset pre-stores the Bluetooth address of the headset box, and the headset box also pre-stores the Bluetooth address of the TWS headset.
  • the mobile phone can first establish a Bluetooth connection with the TWS headset. Then, the mobile phone can send instruction information 1 to the TWS headset to instruct the TWS headset to establish a Bluetooth connection with the headset box. After receiving the instruction information 1, the TWS headset requests to establish a Bluetooth connection with the headset box according to the stored Bluetooth address of the headset box.
  • the headset box determines that the Bluetooth address of the device requesting the establishment of the Bluetooth connection matches the Bluetooth address of the TWS headset stored in itself, thereby establishing a Bluetooth connection with the TWS headset.
  • a Bluetooth connection can also be established between the mobile phone and the earphone box.
  • the mobile phone can first establish a Bluetooth connection with the headset box. Then, the mobile phone can send instruction information 2 to the headset box to instruct the headset box to establish a Bluetooth connection with the TWS headset. After receiving the instruction information 2, the headset box requests to establish a Bluetooth connection with the TWS headset according to the stored Bluetooth address of the TWS headset. The TWS headset determines that the Bluetooth address of the device requesting to establish a Bluetooth connection matches the Bluetooth address of the headset box stored in itself, thereby establishing a Bluetooth connection with the headset box.
  • the instruction information 1 and the instruction information 2 are used to instruct the TWS headset to establish a Bluetooth connection with the headset box, and therefore can also be referred to as connection information.
  • the connection information from the mobile phone may include the connection information directly sent by the mobile phone and the connection information forwarded by the mobile phone through other devices.
  • Solution 2 The TWS headset and the headset box are used together at the factory.
  • the TWS headset pre-stores the Bluetooth address of the headset box, and the headset box also pre-stores the Bluetooth address of the TWS headset.
  • the mobile phone can first establish a Bluetooth connection with the TWS headset. After the TWS headset detects the user's preset operation 2, it establishes a Bluetooth connection with the headset box.
  • the preset operation 2 may be a touch operation, a pressing operation, a voice operation, or the like.
  • the preset operation 2 is an operation in which the user voice instructs the TWS headset to establish a Bluetooth connection with the headset box.
  • the TWS headset detects preset operation 2
  • it requests to establish a Bluetooth connection with the headset box according to the stored Bluetooth address of the headset box.
  • the headset box determines that the Bluetooth address of the device requesting the establishment of the Bluetooth connection matches the Bluetooth address of the TWS headset stored in itself, it establishes a Bluetooth connection with the TWS headset.
  • the mobile phone can first establish a Bluetooth connection with the earphone box, and after the earphone box detects the user's preset operation 3, it establishes a Bluetooth connection with the TWS earphone.
  • the preset operation 3 may be a touch operation, a pressing operation, or a voice operation.
  • the preset operation 3 is an operation in which the user continuously presses the control 1 on the earphone box twice.
  • the headset box detects preset operation 3, it requests to establish a Bluetooth connection with the TWS headset according to the stored Bluetooth address of the TWS headset.
  • the TWS headset determines that the Bluetooth address of the device requesting to establish a Bluetooth connection matches the Bluetooth address of the headset box stored in itself, it establishes a Bluetooth connection with the headset box.
  • the preset operation 2 and the preset operation 3 may also be other operations, which are not limited in the embodiment of the present application.
  • the preset operation 2 may also be an operation in which the user clicks on a preset area on the earplug of the TWS headset three times in a row.
  • the mobile phone can establish a Bluetooth connection with the TWS headset, and establish a Bluetooth connection with the headset box.
  • the mobile phone can display a list of scanned Bluetooth devices. After the mobile phone detects that the user selects the TWS headset and headset box from the Bluetooth device list, it establishes a Bluetooth connection with both the TWS headset and headset box. Then, the mobile phone can instruct the TWS headset to establish a Bluetooth connection with the headset box. For example, the mobile phone can send the Bluetooth address of the TWS headset to the headset box, and send the Bluetooth address of the headset box to the TWS headset. Based on the Bluetooth address sent by the mobile phone, a Bluetooth connection is established between the TWS headset and the headset box.
  • the TWS earphone and earphone box may be the earphone box that is used in conjunction with the factory, or may not be the earphone box that is used in conjunction with the factory, which is not limited in the embodiment of the application.
  • the mobile phone may first establish a Bluetooth connection with the TWS headset, and after entering the target mode, the mobile phone instructs the TWS headset to establish a Bluetooth connection with the headset box.
  • the mobile phone can also establish a Bluetooth connection with the headset box.
  • the mobile phone After the mobile phone detects the user's operation to start the target application, it opens the target application and displays the application interface of the target application.
  • the headset box can collect the user's voice signal, convert the user's voice signal into audio data and send it to the TWS headset, and the TWS headset can listen to the user's voice back to the user.
  • the target application may be a K song application or a live broadcast application.
  • the user's operation of starting the target application may be an operation of clicking the icon of the target application on the desktop, and the application interface of the target application displayed on the mobile phone can be seen in FIG. 9.
  • the earphone box collects the user's voice signal, and generates first audio data.
  • the user can put the earphone box near the mouth, and the microphone of the earphone box can collect surrounding sound signals.
  • the surrounding sound signal mainly includes the user's sound signal, such as the sound made by the user's mouth or the tune hummed by the nose.
  • the voice signal of the user may be the voice of the user's speech, the voice of the host speaking, or the voice of the user singing.
  • the earphone box can convert the user's voice signal into the first audio data.
  • the user's voice signal may be an analog signal
  • the first audio data may be a digital signal.
  • the first audio data may be pulse code modulation (PCM) data.
  • the mobile phone when there is no Bluetooth connection between the mobile phone and the earphone box, the mobile phone can notify the earphone box to pick up the sound through the TWS earphone after opening the target application (for example, the K song application).
  • the target application for example, the K song application.
  • the mobile phone may notify the earphone box to start picking up sound according to the target application.
  • the target application as the K song application as an example
  • the mobile phone after the user selects a song to be sung from the K song application (for example, song 1 shown in Figure 9), the mobile phone notifies the earphone box to start picking up or through the TWS earphone to notify the earphone box to start pickup.
  • the earphone box starts to pick up sound after establishing a Bluetooth connection with the TWS earphone.
  • the mobile phone needs to process the sound pickup data of the earphone box, it performs business processing on the sound pickup data from the earphone box.
  • the pickup data is the aforementioned first audio data.
  • the sound pickup data from the earphone box may be the sound pickup data sent by the earphone box, or the sound pickup data forwarded by the earphone box through the TWS earphone.
  • the mobile phone determines that the pickup data of the earphone box needs to be processed, and the pickup data of the earphone box received subsequently is valid data. In this way, relevant processing is performed according to the subsequently received sound pickup data.
  • the earphone box detects the user's preset operation 4 and then starts to pick up the sound.
  • the preset operation 4 may be a user's pressing operation on a preset control on the earphone box, or a user's voice operation, etc.
  • the TWS headset after the TWS headset detects the user's preset operation 5, it notifies the headset box to start picking up sound.
  • the preset operation 5 may be a user's touch operation on a preset area on the earplug, or a user's voice operation.
  • the Bluetooth connection architecture between the TWS headset, the headset box, and the mobile phone may include the case 1 shown in FIG. 5A and the case 2 shown in FIG. 5B. The following first describes the case 1 shown in FIG. 5A.
  • the earphone box sends the first audio data to the TWS earphone.
  • the Bluetooth connection scheme between the TWS headset and the headset box may be the dual-transmission connection scheme shown in FIG. 6A or the forwarding connection scheme shown in FIG. 6B.
  • the following first takes the dual-flight connection scheme shown in FIG. 6A as an example for description, and the forwarding connection scheme shown in FIG. 6B will be described later.
  • the headset box can send the first audio data to the earplug 1 and the earplug 2 in the TWS headset through the Bluetooth module.
  • the data content sent by the earphone box to the earplug 1 and the earplug 2 may be the same or different.
  • the first audio data is mono audio data
  • the earphone box sends the same mono audio data to the earbud 1 and the earbud 2.
  • the first audio data includes left channel audio data and right channel audio data
  • the data content sent by the earphone box to the earplug 1 is the left channel audio data in the first audio data
  • the data content sent by the earphone box to the earplug 2 is the right channel audio data in the first audio data.
  • the TWS headset performs sound effect processing on the first audio data to obtain second audio data.
  • the first audio data may be the dry voice of the user's voice, and may be PCM data obtained by the microphone of the earphone box.
  • the sound effect processing is used to perform processing such as reverberation, modulation, compression, or speed change on the first audio data to obtain a better sound quality effect.
  • the sound effect processing algorithm may include one or more of the following: acoustic echo cancellation (AEC) algorithm, noise suppression (NS) algorithm, automatic gain control (AGC) algorithm, equalizer ( equalizer) algorithm, active noise cancellation (ANC), voice endpoint detection (VAD) algorithm, or (dynamic range compress, DRC) dynamic range compression algorithm, etc.
  • the earplug 1 and the earplug 2 of the TWS headset After the earplug 1 and the earplug 2 of the TWS headset receive the first audio data, they can perform sound effect processing on the first audio data through the internal sound effect processing module, respectively, so as to obtain the fifth audio data and the sixth audio data respectively.
  • the fifth audio data and the sixth audio data may be the same or different.
  • the fifth audio data and the sixth audio data are the same mono audio data; for another example, the fifth audio data is left channel audio data, and the sixth audio data is right channel audio data.
  • the second audio data may include the fifth audio data and the sixth audio data, and the second audio data may be a wet sound of a user's voice.
  • the mobile phone sends third audio data to the TWS headset according to the target application.
  • the third audio data may be audio data sent by the mobile phone according to the target application and matched with the pickup data of the earphone box.
  • the sound pickup data of the earphone box may be audio data corresponding to the human voice when the user K song
  • the third audio data may be the accompaniment sent by the mobile phone when the user K song.
  • the mobile phone can send the accompaniment of the song to the earphone box or through the TWS earphone.
  • the mobile phone can also notify the earphone box to start picking up sound.
  • the mobile phone can send the third audio data to the earplug 1 and the earplug 2 of the TWS headset.
  • the mobile phone sends data content to the two earplugs of the TWS headset, which may be the same or different.
  • the third audio data is a mono accompaniment, and the mobile phone can send the same mono accompaniment to both the earbud 1 and the earbud 2.
  • the third audio data includes left channel accompaniment and right channel accompaniment. The mobile phone can send the left channel accompaniment of the third audio data to the earplug 1 and the right channel accompaniment of the third audio data to the earplug 2.
  • the TWS headset performs audio mixing processing on the second audio data and the third audio data to obtain fourth audio data.
  • mixing processing refers to the integration of multiple audio data into one audio data.
  • the mixing processing algorithm may include at least one of the following: an averaging algorithm after linear superposition, a normalized mixing algorithm (also called an adaptive weighted mixing algorithm), or a resampling algorithm.
  • the earplug 1 and the earplug 2 can perform mixing processing on the second audio data and the third audio data through the internal mixing processing module, respectively, to obtain the fourth audio data. For example, in a karaoke scene, the earplug 1 and the earplug 2 can obtain the audio data of the user's wet voice and accompaniment mixed.
  • the earplug 1 can mix the fifth audio data and the third audio data received from the mobile phone to obtain the seventh audio data; the earplug 1 can mix the sixth audio data and the third audio data received from the mobile phone. Perform audio mixing processing to obtain eighth audio data.
  • the seventh audio data and the eighth audio data may be the same or different.
  • the seventh audio data and the eighth audio data are the same mono audio data; for another example, the seventh audio data is left channel audio data, and the eighth audio data is right channel audio data.
  • the fourth audio data includes the seventh audio data and the eighth audio data.
  • the TWS headset plays the fourth audio data.
  • the earplug 1 and the earplug 2 can respectively play the mixed fourth audio data for the user through the earpiece. Since the fourth audio data is the audio data after the second audio data and the third audio data are mixed, and the second audio data is the audio data after the sound effect processing of the first audio data corresponding to the user's sound signal, the earplug 1 and The earplug 2 plays the fourth audio data to the user, and can return the user's voice to the user.
  • the earplugs 1 and 2 can play the audio data of the user's wet voice and accompaniment to the user, and the user can hear his own voice and accompaniment.
  • the audio data played by the earplug 1 and the earplug 2 are the same, for example, the fourth audio data is played, and the fourth audio data is mono audio data. In some other embodiments, the audio data played by earplug 1 and earplug 2 are different. For example, earplug 1 plays the left channel audio data in the fourth audio data, and earplug 2 plays the right audio data in the fourth audio data. Channel audio data.
  • the earphone box sends the first audio data to the TWS earphone, and the TWS earphone obtains the second audio data after performing sound effect processing.
  • the mobile phone sends the third audio data to the TWS headset, and the TWS headset mixes the second audio data and the third audio data to obtain the fourth audio data.
  • the TWS headset plays the fourth audio data to the user.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the TWS headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated. The user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the TWS headset is also close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • this solution can break the restriction that the earpiece of the TWS headset and the pickup device are closer, and can also get rid of the trouble of wired transmission or the connection line of the non-TWS headset. Moreover, when the user uses two earplugs, the solution allows the user to hear his own voice while also giving the user an immersive accompaniment and other listening experience. In addition, the size of the earphone box can be convenient for users to hold and use.
  • karaoke users may not be able to hear their own voice clearly or hear their own voice through the spread of sound in the air. Delay, you need to return to listen to monitor your own voice in real time, to prevent out-of-tune or out-of-tune, so as to help users better adjust singing skills and singing status.
  • the above-mentioned first audio data may be the dry sound of the user K song voice
  • the second audio data may be the wet sound of the user K song voice
  • the third audio data may be It is the accompaniment issued by the mobile phone
  • the fourth audio data may be the audio data after the wet sound of the user's K song sound and the accompaniment are mixed.
  • the earphone box can pick up the sound signal of the user's K song, convert it into pickup data and send it to the TWS earphone for sound effect processing.
  • the TWS headset can also receive accompaniment sent by the mobile phone. TWS earphones can mix and play the processed audio data and accompaniment to the user.
  • the microphone used for sound pickup and the earpiece used for audio playback can be separated, the earpiece of the earphone can be closer to the user's ear, and the microphone of the earphone box can be closer to the user's mouth.
  • the sound details are not easy to lose, and the signal-to-noise ratio Higher, the pickup sound quality and pickup effect are better, and the return listening effect is also better.
  • the user can also get an immersive K song experience while monitoring whether his voice is out of sound.
  • the above step 706 may be omitted, that is, the TWS headset may not perform sound effect processing on the first audio data, and thus does not generate the second audio data.
  • the TWS headset obtains the fourth audio data after mixing the first audio data and the third audio data.
  • the TWS headset plays the fourth audio data after the first audio data and the third audio data are mixed and processed.
  • the TWS headset may also send the first audio data to the mobile phone, so that the target application of the mobile phone performs related processing according to the first audio data.
  • the method may further include:
  • the TWS headset sends the first audio data to the mobile phone.
  • At least one of the earplug 1 or the earplug 2 can send the first audio data to the mobile phone.
  • the earplug used by the TWS headset to send the first audio data to the mobile phone may be a preset earplug.
  • the earplug used by the TWS headset to send the first audio data to the mobile phone may be the main earplug.
  • both the earplug 1 and the earplug 2 send the first audio data to the mobile phone.
  • the mobile phone receives the first audio data sent by the two earbuds; or, after the mobile phone receives the first audio data sent by one earbud, it no longer receives the same first audio data sent by the other earbud; or the mobile phone discards it The first audio data sent by an earplug.
  • the first audio data is mono audio data, or the first audio data includes left channel audio data and right channel audio data.
  • the first audio data includes left channel audio data and right channel audio data.
  • Earplug 1 can send the left channel audio data of the first audio data to the mobile phone, and earplug 2 can send the first audio data to the mobile phone.
  • Right channel audio data in one audio data.
  • the mobile phone receives the first audio data from the earphone box only when it is determined that it needs to perform application processing according to the first audio data.
  • the target application as the K song application as an example
  • the mobile phone determines that the subsequent first audio data from the earphone box is valid data, so as to receive the first audio data from the earphone box.
  • the mobile phone does not receive the first audio data sent by the TWS headset.
  • the mobile phone performs service processing on the first audio data through the target application.
  • the mobile phone can perform related service processing on the first audio data through the target application.
  • the mobile phone may receive the first audio data from the earphone box, and only perform service processing on the subsequently received first audio data when the first audio data needs to be processed.
  • the target application as the K song application as an example
  • the mobile phone determines that the first audio data needs to be processed.
  • the first audio data is the audio data corresponding to the sound signal of the user's K song.
  • the mobile phone can record the first audio data through the K song application, synthesize the first audio data and the accompaniment to generate an audio file, play the audio file or upload it Audio files and other processing.
  • the mobile phone notifies the earphone box to pick up the sound when the first audio data needs to be processed, so that the mobile phone receives the first audio data from the earphone box when the first audio data needs to be processed.
  • the mobile phone can perform service processing on the first audio data through the target application after receiving the first audio data.
  • the earphone box may also be provided with an audio codec (codec), such as a high-definition Bluetooth codec.
  • codec such as a high-definition Bluetooth codec.
  • codec such as a high-definition Bluetooth codec.
  • the sampling rate of the sound signal by the microphone of the headset box can be larger, so that the audio data corresponding to the sound signal is encoded The amount of data is still small, and it can still be transmitted quickly within the transmission bandwidth of Bluetooth.
  • the greater the sampling rate of the sound signal the greater the bandwidth of the sound information that can be retained after the audio data corresponding to the sound signal is coded and decoded.
  • the bandwidth range of the sound information obtained after encoding and decoding can be about 0-24kHz; when the sampling rate of the microphone is 32kHz, the bandwidth range of the sound information obtained after encoding and decoding can be 0 ⁇ 16kHz or so. Therefore, the audio codec can be used to obtain higher bandwidth sound information, and the audio data can be transmitted via Bluetooth in real time and quickly.
  • the microphone of the earphone box may use a sampling rate greater than or equal to 16 kHz, such as 48 kHz or 32 kHz, to collect the user's voice signal, and generate the first audio data according to the user's voice signal.
  • the earphone box may use an audio codec to encode the first audio data, and then send it to the TWS earphone through the Bluetooth module.
  • the encoded first audio data has a small amount of data and can be transmitted at a high speed via Bluetooth.
  • the encoded first audio data can retain high-bandwidth (for example, 0-24kHz or 0-16kHz bandwidth) sound information, so that real and clear user sound information can be retained. Therefore, the audio codec can also be called High-definition Bluetooth codec.
  • the earbuds of the TWS headset can also be equipped with an audio codec.
  • the TWS headset After the TWS headset receives the encoded first audio data, in the above step 706, the TWS headset decodes the encoded first audio data to obtain the first audio data, and performs sound effect processing on the first audio data to obtain the second audio data.
  • the mobile phone sends the third audio data encoded by the audio codec to the TWS headset.
  • the TWS headset decodes the encoded third audio data through the audio codec to obtain the third audio data; and mixes the second audio data and the third audio data to obtain the first audio data.
  • Four audio data the TWS headset decodes the encoded third audio data through the audio codec to obtain the third audio data; and mixes the second audio data and the third audio data to obtain the first audio data.
  • the TWS headset may send the encoded first audio data to the mobile phone.
  • the mobile phone may be provided with an audio codec.
  • the mobile phone may decode the encoded first audio data to obtain the first audio data, so as to perform service processing on the first audio data through the target application.
  • the earphone box, TWS earphone and mobile phone are all equipped with an audio codec (or only an audio encoder can be set in the earphone box), which can compress the audio data obtained through high sampling rate to Low data volume, and rapid transmission through Bluetooth, so that the pickup data of the earphone box can reach the TWS headset and mobile phone in real time and quickly, so that the audio data sent by the mobile phone can also reach the TWS headset in real time and quickly, thereby achieving high Bandwidth Bluetooth audio pickup and audio transmission, realizing the real-time return of the user's voice.
  • an audio codec or only an audio encoder can be set in the earphone box
  • the codec is a system-level Bluetooth codec, which can be applied to various types of audio data, can be applied to various system applications and third-party applications, and is a general Bluetooth audio data coding and decoding method.
  • the mobile phone needs to open the target application first, and a Bluetooth connection needs to be established in advance between the TWS headset, the headset box, and the mobile phone.
  • This process can be implemented in multiple ways. For example, the process may be the process described in steps 701-703 above.
  • steps 701-703 above can be replaced with:
  • the mobile phone establishes a Bluetooth connection with the TWS headset.
  • the mobile phone displays a list of scanned Bluetooth devices. After the mobile phone detects that the user selects the TWS headset from the list, it establishes a Bluetooth connection with the TWS headset. For another example, if a Bluetooth connection has been established between the mobile phone and the TWS headset before, the TWS headset automatically connects back to the mobile phone.
  • a Bluetooth connection is established between the TWS headset and the headset box.
  • the TWS headset and the headset box are used together at the factory.
  • the TWS headset pre-stores the Bluetooth address of the headset box, and the headset box also pre-stores the Bluetooth address of the TWS headset.
  • the TWS headset detects the user's preset operation 2, it establishes a Bluetooth connection with the headset box.
  • the earphone box detects the user's preset operation 3, it establishes a Bluetooth connection with the TWS earphone.
  • step 1002 the process may further include step 1003:
  • the TWS headset sends the Bluetooth address of the mobile phone to the headset box.
  • the TWS headset sends the Bluetooth address of the headset box to the mobile phone.
  • the mobile phone Based on the Bluetooth address of the headset box sent by the TWS headset and the Bluetooth address of the mobile phone, the mobile phone establishes a Bluetooth connection with the headset box.
  • the mobile phone can send a Bluetooth connection request to the headset box according to the Bluetooth address of the headset box sent by the TWS headset.
  • the headset box determines that the Bluetooth address of the device requesting the Bluetooth connection matches the Bluetooth address of the headset box sent by the TWS headset, thereby establishing a Bluetooth connection with the mobile phone .
  • a Bluetooth connection is also established between the mobile phone and the headset box, and audio data can be transmitted.
  • process may also include:
  • the mobile phone After the mobile phone detects the user's operation to start the target application, it opens the target application and displays the application interface of the target application.
  • steps 701-703 above can be replaced with:
  • the mobile phone After the mobile phone detects the user's operation to start the target application, it opens the target application and displays the application interface of the target application, and the target application is a preset application.
  • the preset application is an application preset by the system or the user, and the preset application can perform related processing on the pickup data from the earphone box.
  • the interface for the user to set the preset application can be seen in FIG. 11B.
  • a Bluetooth connection is established between the TWS headset, the headset box, and the mobile phone.
  • the process of establishing a Bluetooth connection between the TWS headset, headset box and mobile phone can refer to the steps The related description in 702 will not be repeated here.
  • steps 701-703 above can be replaced with:
  • the mobile phone After the mobile phone detects the user's operation to start the target application, it opens the target application and displays the application interface of the target application.
  • the mobile phone prompts the user whether to enter the target mode.
  • the mobile phone After the mobile phone opens the target application, it can prompt the user whether to enter the target mode.
  • a Bluetooth connection can be established between the mobile phone, the TWS headset and the headset box, and the headset box can pick up sound.
  • a schematic diagram of the interface of the mobile phone prompting the user whether to enter the target mode can be seen in Fig. 12B.
  • the target mode is a professional listening mode, and the target mode may also have other names such as professional karaoke mode.
  • a Bluetooth connection is established between the mobile phone and the TWS headset and the headset box.
  • the operation of the user instructing to enter the target mode may be an operation of clicking the control 1200.
  • step 1203 the process of establishing a Bluetooth connection between the mobile phone and the TWS headset and the headset box may refer to the relevant description in the above step 702 for details.
  • the mobile phone can instruct the headset box according to the target application Start to pick up the sound.
  • the earphone box can begin to pick up sound after establishing a Bluetooth connection with the TWS earphone.
  • the earphone box detects the user's preset operation 4 and then starts to pick up the sound.
  • the TWS headset detects the user's preset operation 5, it instructs the headset box to start picking up sound.
  • the steps of establishing a Bluetooth connection between the TWS headset, the headset box, and the mobile phone do not have a clear sequence relationship with the steps of opening the target application on the mobile phone, and are not limited.
  • a Bluetooth connection can be established between the TWS headset, the headset box and the mobile phone.
  • the mobile phone can open the target application again.
  • the above description mainly focuses on the solution shown in FIG. 6A in which the TWS headset and the headset box, and between the TWS headset and the mobile phone, adopt a dual-fiber connection.
  • the following describes the scheme of forwarding connection between the TWS headset and the headset box, and between the TWS headset and the mobile phone shown in FIG. 6B.
  • step 705 can be replaced with:
  • the earphone box sends the first audio data to the main earplug in the TWS earphone.
  • a pair of earplugs of the TWS headset may include a main earplug and an auxiliary earplug, and the roles of the main earplug and the auxiliary earplug may be determined according to a preset strategy.
  • the main earplug is the earplug first taken out of the earphone box.
  • the main earplug is the earplug that the user first wears on the ear.
  • the main earplug is an earplug with a larger battery.
  • the roles of the primary and secondary earplugs can also be switched during the user's use.
  • the main earplug is an earplug with a relatively large power. After the power levels of the two earplugs change, the roles of the primary and secondary earplugs can be switched.
  • the first audio data can be sent to the main earplug in the TWS earphone through the Bluetooth module, and the earphone box does not send the first audio data to the secondary earplug.
  • step 706 can be replaced with:
  • the main earplug performs sound effect processing on the first audio data to obtain second audio data.
  • the main earplug can perform sound effect processing on the first audio data through an internal sound effect processing module, so as to obtain the second audio data.
  • step 707 can be replaced with:
  • the mobile phone sends third audio data to the main earplug according to the target application.
  • the mobile phone can send the third audio data to the main earplug, but does not send the third audio data to the secondary earplug.
  • step 708 can be replaced with:
  • the main earplug performs audio mixing processing on the second audio data and the third audio data to obtain fourth audio data.
  • the method may further include:
  • the primary earplug sends the fourth audio data to the secondary earplug.
  • the earphone box sends the first audio data to the main earplug, and the main earplug obtains the second audio data after performing sound effect processing.
  • the mobile phone sends the third audio data to the main earplug, and mixes the second audio data and the third audio data to obtain the fourth audio data.
  • the main earplug sends the processed fourth audio data to the auxiliary earplug. Therefore, in step 709, both the primary earplug and the secondary earplug can play the fourth audio data.
  • the fourth audio data is mono audio data
  • both the primary earplug and the secondary earplug play monophonic audio data
  • the fourth audio data is stereo audio data
  • the main earplug and the auxiliary earplug play left and right channel audio data respectively.
  • the primary earplug may send left/right channel audio data in the fourth audio data to the secondary earplug, and the primary earplug and the secondary earplug play the left and right channel audio data respectively.
  • step 710 can be replaced with:
  • the main earplug sends the first audio data to the mobile phone.
  • Bluetooth connection architecture corresponding to Case 1 shown in FIG. 5A.
  • a Bluetooth connection is also established between the headset box and the mobile phone.
  • the headset box does not need to forward the first audio data to the mobile phone through the TWS headset, but can directly transfer the first audio data through the Bluetooth connection.
  • the first audio data is sent to the mobile phone.
  • step 710 can be replaced with:
  • the earphone box sends the first audio data to the mobile phone.
  • step 710A can be replaced with:
  • the earphone box sends the first audio data to the mobile phone.
  • the user can use two earplugs of a pair of TWS earphones at the same time, and only use one of the earplugs of the TWS earphone.
  • the above description is based on the use of the earphone box and a pair of earplugs of the TWS headset as an example.
  • the audio processing system may also include only one earplug, and the earphone box is used in conjunction with one earplug of the TWS headset.
  • user 1 uses earplug 1, earphone box 1, and mobile phone 1.
  • the earphone box 1 picks up sound to obtain the first audio data.
  • the earplug 1 performs audio processing on the first audio data to obtain the second audio data.
  • the audio data played by the earplug 1 to the user includes fourth audio data obtained by mixing the second audio data and the third audio data sent by the mobile phone 1.
  • user 2 uses earplug 2, earphone box 2 and mobile phone 2.
  • the earphone box 2 picks up sound to obtain the first audio data.
  • the earplug 2 performs audio processing on the first audio data to obtain the second audio data.
  • the audio data played by the earplug 2 to the user includes fourth audio data obtained by mixing the second audio data and the third audio data sent by the mobile phone 2.
  • user 1 and user 2 can use the same mobile phone or different mobile phones, and user 1 and user 2 can use the same target application or different target applications on the same mobile phone.
  • user 1 and user 2 may use different mobile phone karaokes respectively.
  • user 1 and user 2 use the same K song application on the same mobile phone to sing the same song.
  • User 1 and user 2 can hear their own voices by returning to listen, but cannot hear other users' voices by returning to listen. sound.
  • the audio processing system may also include multiple earphone boxes and multiple earplugs.
  • Each user can conveniently hold a headphone box to pick up the sound.
  • Each user can use a pair of earplugs or one earplug.
  • a Bluetooth connection is established between the earplugs used by the same user and the earphone box, and the earplugs used by different users are also connected with the earphone box used by other users.
  • Each earphone box in the system can perform the operation of the earphone box in the above embodiment, and send the obtained first audio data to the earplug of each user.
  • the earplugs can perform sound effect processing on the first audio data obtained by each earphone box to obtain the second audio data, mix the second audio data with the third audio data sent by the mobile phone to obtain the fourth audio data, and play the fourth audio data. Audio data to the user.
  • user 1 uses earplug 1, earphone box 1 and mobile phone 1; at the same time, user 2 uses earplug 2, earphone box 2 and mobile phone 1.
  • User 1 and User 2 use the same target application on the same mobile phone.
  • the earphone box 1 and the earphone box 2 obtain respective first audio data, and send the first audio data to the earplug 1 and the earplug 2.
  • the earplug 1 performs sound effect processing on the first audio data from the earphone box 1 and the earphone box 2 to obtain the second audio data, and mixes the second audio data with the third audio data sent by the mobile phone 1 to obtain the fourth audio data.
  • the earplug 1 plays the fourth audio data to the user 1.
  • the earplug 2 performs sound effect processing on the first audio data from the earphone box 1 and the earphone box 2 to obtain the second audio data, and mixes the second audio data with the third audio data sent by the mobile phone 1 to obtain the fourth audio data.
  • the earplug 2 plays the fourth audio data to the user 2.
  • karaoke scene user 1 and user 2 use the same karaoke application on the same mobile phone to sing the same song.
  • User 1 can hear his own voice and user 2’s voice by returning You can also hear your own voice and the voice of user 1.
  • the following will take the audio processing system including the TWS headset with the structure shown in FIG. 2 and the headset box with the structure shown in FIG. 3 as an example, and the wireless communication technology used for audio data transmission is Bluetooth as an example.
  • the wireless communication technology used for audio data transmission is Bluetooth as an example.
  • the audio processing method may include:
  • a Bluetooth connection is established between the TWS headset and the headset box.
  • the TWS headset establishes a Bluetooth connection with the headset box after detecting the user's preset operation 2; or, after the headset box detects the user's preset operation 3, establishes a Bluetooth connection with the TWS headset connect.
  • the TWS headset and the headset box can automatically establish a Bluetooth connection.
  • the TWS headset is pre-stored with the Bluetooth address of the headset box, and the headset box is also pre-stored with the Bluetooth address of the TWS headset.
  • a Bluetooth connection can be established between the TWS headset and the headset box according to the stored Bluetooth address of the other party's device.
  • a Bluetooth connection can be established between the TWS headset and the headset box through other devices.
  • a TWS headset can establish a Bluetooth connection with a mobile phone
  • the headset box can establish a Bluetooth connection with a mobile phone.
  • the mobile phone can send the Bluetooth address of the TWS headset to the headset box, and send the Bluetooth address of the headset box to the TWS headset. Therefore, the TWS headset and the headset box can establish a Bluetooth connection with the counterpart device according to the Bluetooth address of the counterpart device obtained from the mobile phone.
  • the TWS headset includes two earplugs
  • the Bluetooth connection scheme between the TWS headset and the headset box may include a dual-transmission connection scheme or a forwarding connection scheme.
  • the earphone box collects the user's voice signal and generates first audio data.
  • the earphone box can collect nearby sound signals through its own microphone.
  • the user can hold the earphone box and place the earphone box near the mouth.
  • the earphone box can collect the user's voice signal, such as the voice of the user's speech, the voice of the host, or the voice of the user's singing.
  • the earphone box can generate the first audio data according to the collected voice signal of the user.
  • the earphone box sends the first audio data to the TWS earphone.
  • the earphone box sends the first audio data to the TWS earphone.
  • the earphone box can send the first audio data to the two earplugs of the TWS earphone.
  • the earphone box can send the first audio data to the main earplug in the TWS earphone.
  • the TWS headset performs sound effect processing on the first audio data to generate second audio data.
  • the two earplugs of the TWS headset after receiving the first audio data, respectively perform sound effect processing on the first audio data, thereby generating second audio data.
  • the primary earplug after receiving the first audio data, performs sound effect processing on the first audio data to generate second audio data, and sends the second audio data to the secondary earplug.
  • the TWS headset plays the second audio data.
  • the two earplugs of the TWS headset After the two earplugs of the TWS headset obtain the second audio data, they play the second audio data to the user. Since the second audio data is the data obtained by performing sound effect processing on the first audio data, and the first audio data is obtained based on the user’s voice signal, after the TWS headset plays the second audio data to the user, what the user hears is Your own voice, so that you can return to the user's voice. In other words, with this solution, users can hear their own voice in real time by listening back.
  • the earphone box can collect the user's sound signal, and generate audio data and send it to the TWS earphone.
  • the TWS earphone performs audio processing and then plays it to the user, so that the user can hear his own voice in real time.
  • the microphone used to pick up the user's voice signal is the microphone of the earphone box
  • the earpiece used to listen to the user's voice signal is the earpiece of the TWS headset. That is, the microphone for picking up the user's voice signal and the earpiece for returning the user's voice signal can be separated.
  • the user can hold the earphone box and place the earphone box close to the user's mouth.
  • the earphone box can pick up the details of the user's voice, the signal-to-noise ratio of the picked user's voice is high, and the sound pickup quality and sound pickup effect of the earphone box are better; and ,
  • the earpiece of the TWS headset is also close to the user's ear, and the audio playback effect is also better, so the return listening effect is better.
  • the earphone box and the TWS earphone may be respectively provided with an audio codec, for example, it may be a high-definition Bluetooth codec.
  • the audio data interacted between the earphone box and the TWS earphone may be data encoded by an audio codec.
  • the audio codec can be used to obtain high-bandwidth sound information, and audio data can be transmitted via Bluetooth in real time and quickly.
  • the above step 1704 may be omitted, that is, the TWS headset may not perform sound effect processing on the first audio data to generate the second audio data.
  • the TWS headset can directly play the first audio data.
  • the audio processing system includes two earplugs in the TWS headset.
  • the audio processing system may include an earplug in the TWS headset, such as the earplug 1.
  • the earplug 1 establishes a Bluetooth connection with the earphone box.
  • the earphone box sends the first audio data to the earplug 1.
  • the earplug 1 performs sound effect processing on the first audio data to generate second audio data.
  • the earplug 1 plays the second audio data.
  • the audio processing system includes a TWS headset.
  • the TWS earphones in the audio processing system can also be replaced with other wireless earphones, for example, a wireless earphone including two earplugs and a connecting wire between the two earplugs, such as a neckband wireless earphone.
  • a wireless earphone including two earplugs and a connecting wire between the two earplugs such as a neckband wireless earphone.
  • the audio processing method described in the above embodiment can still be used to return listening, which will not be repeated here.
  • the above description is based on an example in which the wireless communication technology used to transmit audio data is Bluetooth.
  • the wireless communication technology used to transmit audio data may also be other wireless technologies such as infrared, which is not limited in the embodiment of the present application.
  • the electronic device is a mobile phone.
  • the electronic device is other devices, such as a TV, a vehicle-mounted device, a computer, a speaker, or a smart watch, the method provided in the embodiment of the present application can also be used to perform audio processing, which will not be repeated here.
  • the electronic device includes hardware and/or software modules corresponding to each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods for each specific application in combination with the embodiments to implement the described functions, but such implementation should not be considered as going beyond the scope of the present application.
  • the electronic device may be divided into functional modules according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • An embodiment of the present application also provides an audio processing device, including one or more processors and one or more memories.
  • the one or more memories are coupled with one or more processors, and the one or more memories are used to store computer program codes.
  • the computer program codes include computer instructions.
  • the audio processing device Performing the above-mentioned related method steps implements the audio processing method in the above-mentioned embodiment.
  • the audio processing device may be a TWS headset, a headset box, or an electronic device in the foregoing method embodiment.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions run on the audio processing device, the audio processing device executes the above-mentioned related method steps to achieve the above The audio processing method in the embodiment.
  • the audio processing device may be a TWS headset, a headset box, or an electronic device in the foregoing method embodiment.
  • the embodiments of the present application also provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned related steps, so as to realize the audio processing method executed by the audio processing device in the above-mentioned embodiment.
  • the audio processing device may be a TWS headset, a headset box, or an electronic device in the foregoing method embodiment.
  • the embodiments of the present application also provide an audio processing device.
  • the audio processing device may specifically be a chip, a component, a module, or a chip system.
  • the audio processing device may include a connected processor and a memory; where the memory is used for storage.
  • Computer-executable instructions When the audio processing device is running, the processor can execute the computer-executable instructions stored in the memory, so that the audio processing device executes the audio processing methods in the foregoing method embodiments.
  • the audio processing device can be applied to the TWS earphone, earphone box or electronic device in the above method embodiment.
  • the audio processing device, computer readable storage medium, computer program product, or chip provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the above The beneficial effects in the provided corresponding methods will not be repeated here.
  • the audio processing system may include the above-mentioned TWS earphone and earphone box.
  • Each device in the audio processing system can be used to implement the audio processing method in the foregoing embodiment.
  • the audio processing system may include the above-mentioned TWS earphone, earphone box, and electronic equipment. Each device in the audio processing system can be used to implement the audio processing method in the foregoing embodiment.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be divided. It can be combined or integrated into another device, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate parts may or may not be physically separate.
  • the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Function (AREA)
  • Headphones And Earphones (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

本申请实施例提供一种音频处理方法、装置及***，涉及电子技术领域，能够通过耳机盒拾取用户的声音，并通过无线耳机将耳机盒拾取的用户的声音返听给用户，而耳机盒可以离用户的嘴部较近因而拾音效果较好，用户的返听效果也较好。方案为：无线耳机与电子设备之间建立无线连接，且无线耳机与耳机盒之间建立无线连接；耳机盒采集声音信号，并生成第一音频数据；耳机盒向无线耳机发送第一音频数据；无线耳机对第一音频数据进行音效处理，获得第二音频数据；电子设备向无线耳机发送第三音频数据；无线耳机将第二音频数据与第三音频数据进行混音处理，获得第四音频数据；无线耳机播放第四音频数据。本申请实施例用于返听。

Description

一种音频处理方法、装置及***
本申请要求于2020年03月17日提交国家知识产权局、申请号为202010187760.3、申请名称为“一种音频处理方法、装置及***”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子技术领域，尤其涉及一种音频处理方法、装置及***。
背景技术
为了摆脱有线耳机连接线的束缚和使用不便，真无线立体声(true wireless stereo，TWS)耳机越来越受到用户的青睐。
对于K歌或直播等需要返听的场景，在用户使用TWS耳机时，由于佩戴于耳部的TWS耳机上的麦克风离用户的嘴部较远，TWS耳机上的麦克风拾取的用户声音容易缺失细节，并且拾取的用户声音的信噪比较低，因而TWS耳机的返听效果较差，用户使用体验较差。
发明内容
本申请实施例提供一种音频处理方法、装置及***，能够通过耳机盒拾取用户的声音，并通过TWS耳机等无线耳机将耳机盒拾取的用户的声音返听给用户，而耳机盒可以离用户的嘴部较近因而拾音效果较好，用户的返听效果也较好。
为达到上述目的，本申请实施例采用如下技术方案：
一方面，本申请实施例提供了一种音频处理方法，应用于音频处理***，该音频处理***包括电子设备、无线耳机和耳机盒。该方法包括：无线耳机与电子设备之间建立无线连接，且无线耳机与耳机盒之间建立无线连接。耳机盒采集声音信号，并生成第一音频数据。而后，耳机盒向无线耳机发送第一音频数据。无线耳机对接收到的第一音频数据进行音效处理，获得第二音频数据。电子设备向无线耳机发送第三音频数据。无线耳机将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。无线耳机播放第四音频数据。
其中，该耳机盒可以是用于收纳TWS耳机的耳机盒。该无线耳机可以是TWS耳机、颈带式无线耳机或其他无线耳机。这样，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为无线耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效果较好；并且，无线耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。而且，该方案可以打破无线耳机的听筒和拾音器件离得较近的限制，还可以摆脱有线传输或非无线耳机的连接线的困扰。
在一种可能的设计中，无线耳机包括第一耳塞和第二耳塞。耳机盒向无线耳机发送第一音频数据，包括：耳机盒向第一耳塞和第二耳塞发送第一音频数据。第二音频数据包括第五音频数据和第六音频数据，无线耳机对第一音频数据进行音效处理，获 得第二音频数据，包括：第一耳塞对第一音频数据进行音效处理，获得第五音频数据。第二耳塞对第一音频数据进行音效处理，获得第六音频数据。电子设备向无线耳机发送第三音频数据，包括：电子设备向第一耳塞和第二耳塞发送第三音频数据。第四音频数据包括第七音频数据和第八音频数据，无线耳机将第二音频数据与第三音频数据进行混音处理，获得第四音频数据，包括：第一耳塞将第五音频数据与第三音频数据进行混音处理，获得第七音频数据；第二耳塞将第六音频数据与第三音频数据进行混音处理，获得第八音频数据。
在该方案中，无线耳机与耳机盒和电子设备之间建立了双发连接，即无线耳机的两只耳塞分别与耳机盒及电子设备建立了无线连接，可以分别与耳机盒和电子设备交互数据。
在另一种可能的设计中，无线耳机包括第一耳塞和第二耳塞，耳机盒向无线耳机发送第一音频数据，包括：耳机盒向第一耳塞发送第一音频数据。无线耳机对第一音频数据进行音效处理，获得第二音频数据，包括：第一耳塞对第一音频数据进行音效处理，获得第二音频数据。电子设备向无线耳机发送第三音频数据，包括：电子设备向第一耳塞发送第三音频数据。无线耳机将第二音频数据与第三音频数据进行混音处理，获得第四音频数据，包括：第一耳塞将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。该方法还包括：第一耳塞向第二耳塞发送第四音频数据。
在该方案中，无线耳机与耳机盒和电子设备之间建立了转发连接，即无线耳机的一只耳塞与耳机盒和电子设备建立了无线连接，可以与耳机盒的电子设备交互数据，并将交互的数据转发给TWS的另一只耳塞。
在另一种可能的设计中，该方法还包括：电子设备检测到用户的第一预设操作后，显示目标应用的应用界面，第一预设操作用于启动目标应用。
这样，在用户使用目标应用时，可以采用耳机盒进行拾音，并采用TWS耳机进行返听。
在另一种可能的设计中，在耳机盒向无线耳机发送第一音频数据之后，该方法还包括：无线耳机向电子设备发送第一音频数据；电子设备通过目标应用，对第一音频数据进行业务处理。
在该方案中，无线耳机还可以将第一音频数据发送给电子设备，以便电子设备的目标应用根据第一音频数据进行相关的业务处理。
在另一种可能的设计中，该方法还包括：耳机盒与电子设备之间建立无线连接。在耳机盒采集声音信号，并生成第一音频数据之后，该方法还包括：耳机盒向电子设备发送第一音频数据；电子设备通过目标应用，对第一音频数据进行业务处理。
在该方案中，耳机盒还可以将第一音频数据发送给电子设备，以便电子设备的目标应用根据第一音频数据进行相关的业务处理。
在另一种可能的设计中，在电子设备显示目标应用的应用界面之后，该方法还包括：电子设备提示用户是否进入目标模式；电子设备检测到用户指示进入目标模式的操作后，进入目标模式。
在该方案中，在打开目标应用后，电子设备可以自动提示用户是否进入目标模式。电子设备可以根据用户指示进入目标模式，从而可以采用耳机盒进行拾音，并且电子 设备、无线耳机及耳机盒之间可以建立无线连接以交互音频数据。
在另一种可能的设计中，目标应用为预设应用。
其中，预设应用可以采用耳机盒进行拾音，在电子设备打开预设音乐后，电子设备、无线耳机及耳机盒之间可以建立无线连接以交互音频数据。
在另一种可能的设计中，该方法还包括：电子设备检测到用户的第二预设操作后，显示设置界面，设置界面包括目标模式控件。电子设备检测到用户针对目标模式控件的操作后，进入目标模式。
在该方案中，电子设备可以根据用户的指示操作进入目标模式，从而可以采用耳机盒进行拾音，并采用无线耳机进行返听。
在另一种可能的设计中，无线耳机存储有耳机盒的第一通信地址，耳机盒存储有无线耳机的第二通信地址。无线耳机与耳机盒之间建立无线连接，包括：在无线耳机或耳机盒检测到用户的第三预设操作后，无线耳机和耳机盒根据第一通信地址和第二通信地址建立无线连接。或者，在无线耳机或耳机盒接收到来自电子设备的连接信息后，无线耳机和耳机盒根据第一通信地址和第二通信地址建立无线连接。
在该方案中，无线耳机和耳机盒可以为出厂时配套使用的设备。无线耳机和耳机盒可以根据用户的指示操作，以及相互保存的对方的通信地址建立无线连接。
在另一种可能的设计中，所无线耳机与电子设备之间建立无线连接，且无线耳机与耳机盒之间建立无线连接，包括：电子设备与无线耳机之间建立无线连接；电子设备与耳机盒之间建立无线连接。而后，电子设备将无线耳机的第一通信地址发送给耳机盒；电子设备将耳机盒的第二通信地址发送给无线耳机。耳机盒和无线耳机根据第一通信地址和第二通信地址建立无线连接。
在该方案中，电子设备可以首先与无线耳机和耳机盒建立无线连接，而后交换无线耳机和耳机盒的通信地址，以使得无线耳机和耳机盒根据对方的通信地址建立无线连接。
在另一种可能的设计中，该无线连接为蓝牙连接，耳机盒使用蓝牙音频编解码器对音频数据进行编码。
其中，蓝牙音频编解码器可以将通过高采样率获得的音频数据压缩至较低的数据量，从而通过蓝牙快速传输，使得耳机盒的拾音数据可以实时、快速地到达无线耳机或电子设备，实现高带宽的蓝牙音频拾音和音频传输，实现用户声音的实时返听。
另一方面，本申请实施例提供了一种耳机盒，包括：无线通信模块、麦克风和音频模块。无线通信模块用于，与无线耳机建立无线连接。麦克风用于，采集声音信号。音频模块用于，根据声音信号生成第一音频数据。无线通信模块还用于，向无线耳机发送第一音频数据。
在该方案中，耳机盒可以拾取用户的声音，并转换成第一音频数据发送给无线耳机，以便无线耳机根据第一音频数据进行相关处理或播放用户的声音等，实现声音的返听。这样，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为无线耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效 果较好；并且，无线耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
在一种可能的设计中，无线通信模块还用于，向无线耳机发送第一音频数据，包括：向无线耳机的第一耳塞和第二耳塞发送第一音频数据。或者，向无线耳机的第一耳塞发送第一音频数据。
也就是说，在双发连接方案中，耳机盒与无线耳机的两只耳塞均建立无线连接，可以向无线耳机的两只耳塞均发送第一音频数据。在转发方案中，耳机盒仅与无线耳机的一只耳塞建立了无线连接，可以向该耳塞发送第一音频数据。
在另一种可能的设计中，无线通信模块还用于：与电子设备建立无线连接；将音频模块生成的第一音频数据发送给电子设备。
在该方案中，耳机盒可以将第一音频数据发送给电子设备，以便电子设备对第一音频数据进行相关业务处理。
在另一种可能的设计中，无线通信模块用于，与无线耳机建立无线连接，具体包括：接收来自电子设备的无线耳机的通信地址；根据通信地址与无线耳机建立无线连接。
在该方案中，耳机盒可以根据电子设备发送的无线耳机的通信地址，与无线耳机建立无线连接。
在另一种可能的设计中，耳机盒还包括存储模块，该存储模块存储有无线耳机的通信地址；无线通信模块用于，与无线耳机建立无线连接，具体包括：在耳机盒检测到用户的预设操作或者接收到来自电子设备的连接信息后，根据通信地址与无线耳机建立无线连接。
在该方案中，耳机盒可以根据用户的指示操作，结合无线耳机的通信地址，与无线耳机建立无线连接。
在另一种可能的设计中，无线连接为蓝牙连接，音频模块还包括蓝牙音频编解码模块。蓝牙音频编解码模块用于对音频数据进行编码。
在该方案中，由于蓝牙音频编解码模块可以将通过高采样率获得的音频数据压缩至较低的数据量，从而通过蓝牙快速传输，使得耳机盒的拾音数据可以实时、快速地到达无线耳机，因而可以实现高带宽的蓝牙音频拾音和音频传输，实现用户声音的实时返听。
另一方面，本申请实施例提供了一种音频处理方法，应用于音频处理***。该音频处理***包括无线耳机和耳机盒。该方法包括：无线耳机和耳机盒之间建立无线连接。耳机盒采集声音信号，并生成第一音频数据。耳机盒向无线耳机发送第一音频数据。无线耳机对第一音频数据进行音效处理，获得第二音频数据。无线耳机播放第二音频数据。
该方案中，无线耳机与耳机盒建立了双发连接，无线耳机的两只耳塞均与耳机盒进行数据交互。其中，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为无线耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量 和拾音效果较好；并且，无线耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
另一方面，本申请实施例提供了一种音频处理方法，应用于音频处理***，音频处理***包括无线耳机和耳机盒，无线耳机包括第一耳塞和第二耳塞，该方法包括：无线耳机和耳机盒之间建立无线连接；耳机盒采集声音信号，并生成第一音频数据；耳机盒向第一耳塞发送第一音频数据；第一耳塞对第一音频数据进行音效处理，获得第二音频数据；第一耳塞向第二耳塞发送第二音频数据；第一耳塞和第二耳塞播放第二音频数据。
该方案中，无线耳机与耳机盒建立了转发连接，耳机盒与无线耳机的其中一只耳塞进行数据交互。其中，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为无线耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效果较好；并且，无线耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
另一方面，本申请实施例提供了一种音频处理***，包括：电子设备、无线耳机和耳机盒。电子设备、无线耳机和耳机盒用于，建立无线耳机与电子设备之间的无线连接，以及无线耳机与耳机盒之间的无线连接。耳机盒还用于，采集声音信号，并生成第一音频数据。耳机盒还用于，向无线耳机发送第一音频数据。无线耳机还用于，对第一音频数据进行音效处理，获得第二音频数据。电子设备还用于向无线耳机发送第三音频数据。无线耳机还用于，将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。无线耳机还用于，播放第四音频数据。
其中，音频处理***中的电子设备、无线耳机和耳机盒用于执行上述任一方面任一种可能的设计中的音频处理方法。
在一种可能的设计中，无线耳机包括第一耳塞和第二耳塞。耳机盒用于，向无线耳机发送第一音频数据，具体包括：向第一耳塞和第二耳塞发送第一音频数据。第二音频数据包括第五音频数据和第六音频数据。无线耳机用于，对第一音频数据进行音效处理，获得第二音频数据，具体包括：通过第一耳塞对第一音频数据进行音效处理，获得第五音频数据；通过第二耳塞对第一音频数据进行音效处理，获得第六音频数据。电子设备用于，向无线耳机发送第三音频数据，具体包括：向第一耳塞和第二耳塞发送第三音频数据。第四音频数据包括第七音频数据和第八音频数据。无线耳机用于，将第二音频数据与第三音频数据进行混音处理，获得第四音频数据，包括：通过第一耳塞将第五音频数据与第三音频数据进行混音处理，获得第七音频数据；通过第二耳塞将第六音频数据与第三音频数据进行混音处理，获得第八音频数据。
在另一种可能的设计中，无线耳机包括第一耳塞和第二耳塞。耳机盒用于，向无线耳机发送第一音频数据，包括：向第一耳塞发送第一音频数据。无线耳机用于，对第一音频数据进行音效处理，获得第二音频数据，包括：第一耳塞用于对第一音频数据进行音效处理，获得第二音频数据。电子设备用于，向无线耳机发送第三音频数据，包括：向第一耳塞发送第三音频数据。无线耳机用于，将第二音频数据与第三音频数 据进行混音处理，获得第四音频数据，包括：第一耳塞用于，将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。无线耳机还用于，通过第一耳塞向第二耳塞发送第四音频数据。
在另一种可能的设计中，电子设备还用于，检测到用户的第一预设操作后，显示目标应用的应用界面，第一预设操作用于启动目标应用。
在另一种可能的设计中，无线耳机还用于，在耳机盒向无线耳机发送第一音频数据之后，向电子设备发送第一音频数据。电子设备还用于，通过目标应用对第一音频数据进行业务处理。
在另一种可能的设计中，耳机盒还用于，在采集声音信号，并生成第一音频数据之后，向电子设备发送第一音频数据。电子设备还用于，通过目标应用对第一音频数据进行业务处理。
在另一种可能的设计中，电子设备还用于，在显示目标应用的应用界面之后，提示用户是否进入目标模式；检测到用户指示进入目标模式的操作后，进入目标模式。
在另一种可能的设计中，目标应用为预设应用。
在另一种可能的设计中，电子设备还用于，在检测到用户的第二预设操作之后，显示设置界面，设置界面包括目标模式控件；检测到用户针对目标模式控件的操作后，进入目标模式。
在另一种可能的设计中，无线耳机存储有耳机盒的第一通信地址，耳机盒存储有无线耳机的第二通信地址。无线耳机与耳机盒用于在无线耳机与耳机盒之间建立无线连接，包括：在无线耳机或耳机盒检测到用户的第三预设操作后，无线耳机和耳机盒用于根据第一通信地址和第二通信地址建立无线连接。或者，在无线耳机或耳机盒接收到来自电子设备的连接信息后，无线耳机和耳机盒用于根据第一通信地址和第二通信地址建立无线连接。
在另一种可能的设计中，电子设备、无线耳机和耳机盒用于，建立无线耳机与电子设备之间建立无线连接，以及无线耳机与耳机盒之间建立无线连接，具体包括：电子设备用于与无线耳机之间建立无线连接；电子设备还用于与耳机盒之间建立无线连接；电子设备用于将无线耳机的第一通信地址发送给耳机盒；电子设备还用于将耳机盒的第二通信地址发送给无线耳机；耳机盒和无线耳机用于根据第一通信地址和第二通信地址建立无线连接。
在另一种可能的设计中，无线连接为蓝牙连接，耳机盒使用蓝牙音频编解码器对音频数据进行编码。
另一方面，本申请实施例提供了一种音频处理装置，该装置包含在音频设备中。该装置具有实现上述方面及可能的设计中任一方法中音频设备行为的功能，使得音频设备执行上述方面任一项可能的设计中的音频处理方法。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。例如，该装置可以包括音频模块或麦克风等。该音频设备可以是上述电子设备、无线耳机或耳机盒。
又一方面，本申请实施例提供了一种音频设备，包括：一个或多个处理器；以及存储器，存储器中存储有代码。当代码被音频设备执行时，使得音频设备执行上述方 面任一项可能的设计中音频设备执行的音频处理方法。该音频设备可以是上述电子设备、无线耳机或耳机盒。
另一方面，本申请实施例提供了一种计算机可读存储介质，包括计算机指令，当计算机指令在音频设备上运行时，使得音频设备执行上述方面任一项可能的设计中的音频处理方法。该音频设备可以是上述电子设备、无线耳机或耳机盒。
又一方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行上述方面任一项可能的设计中音频设备执行的音频处理方法。该音频设备可以是上述电子设备、无线耳机或耳机盒。
另一方面，本申请实施例提供了一种芯片***，该芯片***应用于音频设备。该芯片***包括一个或多个接口电路和一个或多个处理器；接口电路和处理器通过线路互联；接口电路用于从音频设备的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行计算机指令时，使得音频设备执行上述方面任一项可能的设计中的音频处理方法。该音频设备可以是上述电子设备、无线耳机或耳机盒。
上述其他方面对应的有益效果，可以参见关于方法方面的有益效果的描述，此处不予赘述。
附图说明
图1为本申请实施例提供的一种音频处理***的架构示意图；
图2为本申请实施例提供的一种TWS耳机的耳塞结构示意图；
图3为本申请实施例提供的一种耳机盒的结构示意图；
图4为本申请实施例提供的一种手机的结构示意图；
图5A为本申请实施例提供的一种TWS耳机、耳机盒与手机的连接架构示意图；
图5B为本申请实施例提供的另一种TWS耳机、耳机盒与手机的连接架构示意图；
图6A为本申请实施例提供的一种TWS耳机与耳机盒及手机的连接示意图；
图6B为本申请实施例提供的另一种TWS耳机与耳机盒及手机的连接示意图；
图7为本申请实施例提供的一种音频处理方法流程图；
图8为本申请实施例提供的一种手机界面示意图；
图9为本申请实施例提供的另一种手机界面示意图；
图10为本申请实施例提供的另一种音频处理方法流程图；
图11A为本申请实施例提供的一种建立蓝牙连接的流程图；
图11B为本申请实施例提供的另一种手机界面示意图；
图12A为本申请实施例提供的另一种建立蓝牙连接的流程图；
图12B为本申请实施例提供的另一种手机界面示意图；
图13为本申请实施例提供的另一种音频处理方法流程图；
图14A为本申请实施例提供的另一种音频处理方法流程图；
图14B为本申请实施例提供的另一种音频处理方法流程图；
图15为本申请实施例提供的另一种音频处理***的架构示意图；
图16为本申请实施例提供的另一种音频处理***的架构示意图；
图17为本申请实施例提供的另一种音频处理方法流程图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。
现有技术中，在用户进行K歌或直播等需要返听的场景下，TWS耳机上的麦克风离用户的嘴部较远，TWS耳机上的麦克风拾取的声音容易缺失细节且信噪比较差，因而TWS耳机的返听效果较差，用户使用体验较差。
本申请实施例提供了一种音频处理方法，可以应用于K歌、直播、演唱、演讲或讲话等用户需要通过耳机听到自己声音的返听场景。举例来说，在K歌场景下，环境可能较为嘈杂，或者伴奏声音较大，K歌用户通过声音在空气中的传播，可能听不清自己的声音或者听到的自己的声音有延迟。该种情况下，K歌用户可以通过返听实时听到自己的声音和伴奏，以使得自己的声音与伴奏相匹配，确保自己没有走音或走调，并及时调整自己的声音状态。
在另一举例中，在嘈杂的晚会或活动表演现场，发表讲话的人通过声音在空气中的传播可能听不清自己的声音或者听到的自己的声音有延迟。该种情况下，发表讲话的人可以通过返听实时听到自己的声音，从而实时调整自己的声音，避免声音异常。
在本申请实施例提供的音频处理方法中，对于用户需要通过耳机听到自己声音的返听场景，用于收纳TWS耳机的耳机盒可以采集用户的声音信号，根据采集到的声音信号生成第一音频数据，并将第一音频数据发送给TWS耳机。TWS耳机可以播放用户的声音信号对应的目标音频数据，从而将用户的声音返听给用户。其中，该目标音频数据可以包括用户的声音信号对应的第一音频数据，或者该目标音频数据可以包括第一音频数据经过音效处理后的第二音频数据。其中，耳机盒采集声音信号并将声音信号转换成第一音频数据的过程，也可以称为耳机盒拾取声音或耳机盒拾音等，该第一音频数据也可以称为拾音数据。
这样，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为TWS耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效果较好；并且，TWS耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
在一些实施例中，TWS耳机还可以接收电子设备发送的音频数据(例如K歌时的伴奏，或直播时的背景音乐等)，并将用户的声音信号对应的目标音频数据与电子设备发送的音频数据一起播放给用户。
并且，TWS耳机、耳机盒及电子设备之间采用无线通信技术传输音频数据，这样可以摆脱有线传输或非TWS耳机的连接线的束缚，提高用户使用体验。
此外，在K歌或直播等返听场景下，当采用耳机盒拾音且双耳返听的情况下，用户还可以获得更好的沉浸感。
本申请实施例提供的音频处理方法，可以应用于音频处理***。图1示出了一种音频处理***01的架构示意图，该音频处理***01包括TWS耳机10和耳机盒20。其中，该耳机盒可以用于收纳TWS耳机。TWS耳机与耳机盒之间具有无线连接，可以采用无线通信技术传输音频数据。耳机盒可以采集用户的声音信号，根据用户的声音信号生成第一音频数据，并将第一音频数据发送给TWS耳机。TWS耳机可以将用户的声音信号对应的目标音频数据播放给用户，从而将用户的声音返听给用户。其中，该目标音频数据包括第一音频数据，或者包括第一音频数据经过音效处理后的第二音频数据。
在一些实施例中，如图1所示，该音频处理***01还可以包括电子设备30。其中，TWS耳机与耳机盒之间，以及TWS耳机与电子设备之间具有无线连接，可以采用无线通信技术传输音频数据。在一些实施例中，耳机盒与电子设备之间也具有无线连接，可以采用无线通信技术传输音频数据。
其中，耳机盒可以采集用户的声音信号，根据用户的声音信号生成第一音频数据，并将第一音频数据发送给TWS耳机。TWS耳机还可以接收电子设备发送的第三音频数据。TWS耳机可以将目标音频数据以及第三音频数据一起播放给用户，以实现返听功能。该目标音频数据包括第一音频数据，或者包括第一音频数据经过音效处理后的第二音频数据。例如，TWS耳机可以将目标音频数据和电子设备发送的第三音频数据进行混音处理后播放给用户。示例性的，在K歌场景下，TWS耳机可以将用户的声音信号对应的目标音频数据与来自电子设备的伴奏混音后播放给用户。
并且，耳机盒生成的第一音频数据还可以发送给电子设备，或者通过TWS耳机转发给电子设备，以便电子设备根据用户当前使用的目标应用进行相关的业务处理。
示例性的，在本申请实施例提供的音频处理***中，用于音频数据传输的无线通信技术可以是蓝牙(bluetooth，BT)，红外(infrared，IR)，无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，全球导航卫星***(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，或近距离无线通信技术(near field communication，NFC)等。本申请实施例对无线通信技术的具体类型不予限定。
需要说明的是，图1所示音频处理***中的TWS耳机10也可以替换为其他无线耳机。其中，无线耳机不具有拾音线，也不需要通过耳机孔与音频设备相连。例如，图1所示音频处理***中的TWS耳机10可以替换为颈带式无线耳机等耳塞之间具有连接线的无线耳机。
以下对音频处理***中各设备的结构进行举例说明。
TWS耳机通常可以包括一对耳塞，例如包括耳塞1和耳塞2。示例性的，图2示出了TWS耳机包括的耳塞200的一种结构示意图。该耳塞200可以包括：处理器210，存储器220，无线通信模块230，音频模块240，至少一个受话器250，至少一个麦克 风260，传感器270，电源280，以及输入/输出接口290等。
其中，存储器220可以用于存储应用程序代码，如用于与TWS耳机的另一只耳塞200建立无线连接，以及使得耳塞200与上述电子设备进行无线连接的程序代码。
处理器210可以执行上述程序代码，以实现本申请实施例中耳塞200的功能，例如控制无线通信模块230接收来自耳机盒或电子设备的音频数据，对接收到的音频数据进行音频处理，并控制受话器250对处理后的音频数据进行播放等功能。其中，该处理器210可以是一个通用中央处理器(central processing unit，CPU)，微处理器，特定应用集成电路(application-specific integrated circuit，ASIC)，数字信号处理器(digital signal processor，DSP)，或一个或多个用于控制本申请方案程序执行的集成电路等。
存储器220还可以存储有用于唯一标识该耳塞200的蓝牙地址(也可以称为通信地址)，以及TWS耳机的另一只耳塞的蓝牙地址。另外，该存储器220还可以存储有与该耳塞200之前成功配对过的电子设备的配对历史。例如，该配对历史可以包括与该耳塞200成功配对过的电子设备的蓝牙地址。基于该配对历史，该耳塞200能够自动回连至已配对的该电子设备。再例如，存储器220还可以存储有用于收纳该耳塞200的耳机盒的蓝牙地址。基于该蓝牙地址，该耳塞200能够与耳机盒建立蓝牙连接。例如，上述蓝牙地址可以为媒体访问控制(media access control，MAC)地址。
无线通信模块230，用于支持当前耳塞200与TWS耳机的另一只耳塞，与各种电子设备以及与耳机盒之间的无线数据交换，支持TWS耳机同时与电子设备和耳机盒之间建立无线连接。
例如，在一些实施例中，该无线通信模块230可以为蓝牙模块。耳塞200可以通过该蓝牙模块与耳机盒及电子设备之间建立蓝牙连接，以实现相互间的短距离数据交换。
音频模块240，用于将数字音频数据转换成模拟音频电信号输出，也用于将模拟音频电信号输入转换为数字音频数据。音频模块240可以与无线通信模块230之间传输音频数据，实现通话或音乐播放等功能。
音频模块240还可以包括音频编解码器，用于对音频数据进行编码和解码。例如，该音频编解码器可以为高清蓝牙编解码器，可以对高采样率(例如48kHz或32kHz等大于或者等于16kHz的采样率)采集到的声音信号所生成的第一音频数据进行编码，使得编码后的第一音频数据能够保留较高带宽(例如保留0-24k的带宽或0-16k的带宽)的声音信息，从而获得更为真实的和高度清晰声音信息以便后续返听给用户。并且，编码后的数据量较少，可以通过蓝牙等无线通信技术进行高速传输。
音频模块240还可以包括音频处理模块，用于对音频数据进行音频处理。例如，该音频处理模块可以包括音效处理模块，用于对耳机盒发送的第一音频数据进行音效处理。再例如，该音频处理模块还可以包括混音处理模块，用于将音效处理获得的第二音频数据和电子设备发送的第三音频数据进行混音处理。
在一些实施例中，音频模块240可以设置于处理器210中，或者音频模块240的部分功能模块设置于处理器210中。
至少一个受话器250，也可以称为“听筒”，可以用于将模拟音频电信号转换成 声音信号并播放。例如，当TWS耳机的耳塞200作为电子设备的音频输出设备时，受话器250可以将从耳机盒和电子设备接收到的音频电信号转换为声音信号并播放。该音频电信号即为本申请实施例中的音频数据。
至少一个麦克风260，也可以称为“话筒”，“传声器”，用于将声音信号转换为模拟音频电信号。例如，麦克风260可以检测用户唱歌或讲话时的声音信号，并将声音信号转换为模拟音频电信号。
传感器270可以包括距离传感器270或接近光传感器270等部件。耳塞200可以通过该传感器270确定是否被用户佩戴。在另一些实施例中，该耳塞200还可以包括触摸传感器270，用于检测用户的触摸操作。
电源280可以用于向TWS耳机的耳塞200包含的各个部件供电。在一些实施例中，该电源280可以是电池，如可充电电池。
输入/输出接口290，用于提供TWS耳机的耳塞200与耳机盒之间的任何有线连接。在一些实施例中，输入/输出接口290可以为电连接器。当TWS耳机的耳塞200置于耳机盒中时，TWS耳机的耳塞200可以通过该电连接器与耳机盒(如与耳机盒包括的输入/输出接口290)电连接。在该电连接建立后，耳机盒可以为TWS耳机的耳塞200的电源280充电。在该电连接建立后，TWS耳机的耳塞200还可以与耳机盒进行数据通信。例如，TWS耳机的耳塞200可以通过该电连接器接收来自耳机盒的配对指令。该配对命令用于指示TWS耳机的耳塞200打开无线通信模块230，从而使得TWS耳机的耳塞200可以采用对应的无线通信协议(如蓝牙)与电子设备进行配对连接。
可以理解的是，本申请实施例示意的结构并不构成对TWS耳机的耳塞200的具体限定。其可以具有比图2示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。例如，该耳塞200还可以包括指示灯(可以指示耳塞200的电量等状态)、防尘网(可以配合听筒使用)或马达等部件。图2所示的各种部件可以在包括一个或多个信号处理或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
在本申请的实施例中，无线通信模块230可以从耳机盒接收用户的声音信号对应的第一音频数据，还可以接收电子设备发送的第三音频数据。受话器250可以播放用户的声音信号对应的目标音频数据以及第三音频数据，从而将音频数据对应的电信号转化为用户可以听到的声音信号。其中，该目标音频数据包括第一音频数据，或者包括第一音频数据经过音效处理后的第二音频数据。
在一些实施例中，音频处理模块可以对第一音频数据进行音效处理，还可以将音效处理获得的第二音频数据与电子设备发送的第三音频数据进行混音处理。受话器250可以播放混音处理后的音频数据。
在另一些实施例中，无线通信模块230从耳机盒和电子设备接收到的音频数据，可以是音频编解码器编码后的音频数据。无线通信模块230对接收到的音频数据首先进行解码，而后再进行音效处理或混音处理等音频处理。编码后的数据量较少，可以通过蓝牙等无线通信技术进行高速传输。
示例性的，图3示出了耳机盒300的一种结构示意图。如图3所示，该耳机盒300可以用于收纳TWS耳机的耳塞。该耳机盒300包括处理器310，存储器320，无线通 信模块330，音频模块340，至少一个麦克风350，电源360，以及输入/输出接口370等。
其中，该存储器320可以用于存储应用程序代码，并由耳机盒300的处理器310来控制执行以实现耳机盒300的功能，例如可以实现耳机盒300与TWS耳机或电子设备的无线连接及无线通信等功能。其中，该处理器310可以是一个CPU，微处理器，ASIC，DSP，或一个或多个用于控制本申请方案程序执行的集成电路等。
存储器320还可以存储有收纳的耳塞的蓝牙地址。基于该蓝牙地址，耳机盒300能够与耳塞建立蓝牙连接。例如，该蓝牙地址可以为MAC地址。
无线通信模块330，用于支持耳机盒300与TWS耳机和/或电子设备之间的无线数据交换，支持耳机盒300同时与多个设备建立无线连接。
在一些实施例中，该无线通信模块330可以为蓝牙模块。耳机盒300可以通过该蓝牙模块与TWS耳机和电子设备之间建立蓝牙连接，以实现相互间的短距离数据交换。
音频模块340，用于将模拟音频电信号输入转换为数字音频数据。例如，音频模块340可以用于将麦克风350将声音信号转换成的模拟音频电信号转换成第一音频数据。
音频模块340还可以包括音频编解码器，用于对音频数据进行编码和解码，例如该音频编解码器可以为蓝牙高带宽编解码器。在一些实施例中，音频模块340可以设置于处理器310中，或将音频模块340的部分功能模块设置于处理器310中。
至少一个麦克风350，也可以称为“话筒”，“传声器”，用于将声音信号转换为模拟音频电信号。例如，耳机盒300靠近用户嘴部时，在用户说话、唱歌或讲话等发出声音的过程中，麦克风350可以采集用户的声音信号，并将其转换为模拟音频电信号。
在一些实施例中，该耳机盒300上可以设置有至少一个控件，可以用于触发耳机盒300与TWS耳机建立无线连接，或者触发TWS耳机的两只耳塞之间的重新配对，或者触发耳机盒300与电子设备建立无线连接等操作。
此外，耳机盒300还可以包括电源360，可以用于向耳机盒300包含的各个部件供电。该耳机盒300上还可以设置有充电口，用于耳机盒300自身进行充电。耳机盒300还可以包括输入/输出接口370，当TWS耳机的耳塞置于耳机盒300中时，输入/输出接口370可以用于为耳塞充电。
可以理解的是，该耳机盒300上还可以包括其他控件，此处不再一一说明。本申请实施例示意的结构并不构成对耳机盒300的具体限定。其可以具有比图3所示的更多或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。例如，该耳机盒300还可以包括控件380或指示灯390等部件。
在本申请的实施例中，麦克风350和音频模块340可以将用户的声音信号，转换为第一音频数据。无线通信模块330可以将第一音频数据发送给TWS耳机，以便TWS耳机播放目标音频数据。该目标音频数据包括第一音频数据，或者包括第一音频数据经过音效处理后的第二音频数据。无线通信模块330还可以将第一音频数据发送给电子设备，以便电子设备进行音频录制等处理。
在一些实施例中，无线通信模块330向TWS耳机和电子设备发送的第一音频数据， 是音频编解码器编码后的音频数据。编码后的数据量较少，可以通过蓝牙等无线通信技术进行高速传输。
其中，音频处理***中的电子设备可以是手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本或个人数字助理(personal digital assistant，PDA)等设备。本申请实施例对电子设备的具体类型不予限定。
示例性的，当电子设备为手机时，图4示出了手机100的一种结构示意图。如图4所示，手机100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，DSP，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
内部存储器121可以用于存储计算机可执行程序代码，可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行手机100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作***，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储手机100使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
例如，处理器110通过运行存储在内部存储器121的指令，从而实现手机与TWS耳机或耳机盒等多个设备建立无线连接(例如蓝牙连接)的功能；还可以通过目标应用，对耳机盒采集的声音信号对应的第一音频数据，进行音频录制等处理。
手机100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。
无线通信模块160可以提供应用在手机100上的包括WLAN(如Wi-Fi网络)，BT，GNSS，FM，NFC，IR等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160 还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在本申请的实施例中，无线通信模块160可以与TWS耳机或耳机盒盒等多个设备建立无线连接(例如蓝牙连接)，并接收来自TWS耳机或耳机盒的第一音频数据，还可以向TWS耳机发送第三音频数据(例如伴奏)。
手机100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
其中，音频模块170，用于将数字音频电信号转换成模拟音频电信号输出，也用于将模拟音频电信号输入转换为数字音频数据。音频模块170可以与无线通信模块160之间传输音频数据，从而实现通话，音乐播放，音频录制或生成音频文件等功能。音频模块170还可以包括音频编解码器，用于对音频数据进行编码和解码。
在一些实施例中，音频模块170可以设置于处理器110中，或者音频模块170的部分功能模块设置于处理器110中。
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于手机100的表面，与显示屏194所处的位置不同。
可以理解的是，本申请实施例示意的结构并不构成对手机100的具体限定。在本申请另一些实施例中，手机100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
在本申请的实施例中，无线通信模块160可以从耳机盒或TWS耳机接收用户的声音信号对应的第一音频数据，还可以向TWS耳机发送第三音频数据。处理器110可以通过目标应用，对耳机盒采集的声音信号对应的第一音频数据，进行音频录制等处理。显示屏194可以显示目标应用的应用界面。
在一些实施例中，无线通信模块160从耳机盒或TWS耳机接收到的第一音频数据，是音频编解码器编码后的音频数据，音频编解码器可以对无线通信模块接收到的编码后的音频数据进行解码。并且，无线通信模块160向TWS耳机发送的第三音频数据，也是音频编码器编码后的音频数据。编码后的数据量较少，可以通过蓝牙等无线通信技术进行高速传输。
以下将以音频处理***包括TWS耳机、耳机盒和电子设备，且TWS耳机具有图2所示的结构，耳机盒具有图3所示的结构，电子设备为具有图4所示结构的手机，用于传输音频数据的无线通信技术为蓝牙为例，对本申请实施例提供的音频处理方法进行阐述。
在本申请的实施例中，在用户使用耳机盒和TWS耳机进行返听时，TWS耳机、耳机盒及手机之间可以先建立蓝牙连接。TWS耳机、耳机盒及手机之间的蓝牙连接架构包括以下两种情况：
情况1、参见图5A，TWS耳机与耳机盒之间建立有蓝牙连接，且TWS耳机与手机之间建立有蓝牙连接，手机与耳机盒之间未建立有蓝牙连接。
情况2、参见图5B，TWS耳机与耳机盒之间建立有蓝牙连接，TWS耳机与手机之间建立有蓝牙连接，且手机与耳机盒之间建立有蓝牙连接。
其中，TWS耳机与手机之间，以及TWS耳机与耳机盒之间，可以采用现有的转发连接方案、双发连接方案或其他方案建立蓝牙连接。
例如，在双发连接方案中，参见图6A，手机可以与TWS耳机的每只耳塞分别建立蓝牙连接，从而与每只耳塞分别交互音频数据。在TWS耳机与手机之间建立双发连接方案后，两只耳塞之间可以保持蓝牙连接，也可以断开蓝牙连接。类似的，耳机盒与TWS耳机的每只耳塞之间可以分别建立蓝牙连接，从而与每只耳塞分别交互音频数据。
例如，在转发连接方案中，参见图6B，TWS耳机可以包括主耳塞和副耳塞；主耳塞和手机之间建立有蓝牙连接，可以交互音频数据；主、副耳塞之间建立有蓝牙连接，主耳塞通过与副耳塞之间的蓝牙连接向副耳塞转发音频数据。类似的，耳机盒和主耳塞之间建立有蓝牙连接，可以交互音频数据；主耳塞可以向副耳塞转发音频数据。需要注意的是，在用户使用TWS耳机的过程中，主、副耳塞的角色可以发生切换。
在一些实施例中，参见图7，本申请实施例提供了一种音频处理方法，该方法可以包括：
701、手机检测到用户的预设操作1后，进入目标模式。
在目标模式下，手机、TWS耳机及耳机盒之间可以建立蓝牙连接，并基于蓝牙连接进行音频传输；耳机盒可以采集用户的声音信号，并将声音信号转换成音频数据发送给TWS耳机；TWS耳机可以将用户的声音返听给用户。
其中，预设操作1可以是用户的触摸操作、语音指示操作或手势操作等。示例性的，目标模式可以为图8所示的“专业返听模式”，预设操作1可以为用户点击控件801的操作。
在一些实施例中，手机还可以将目标模式的功能提示给用户。示例性的，如图8所示，目标模式为专业返听模式，专业返听模式的功能为：该模式可以通过耳机盒拾取用户的声音，并通过TWS耳机将用户的声音返听给用户。可以理解的是，该目标模式也可以有其他的名称，例如耳机盒拾音模式等。
702、TWS耳机、耳机盒及手机之间建立蓝牙连接。
在目标模式下，TWS耳机、耳机盒及手机之间建立蓝牙连接的方案可以有多种，以下进行举例说明。
方案1：TWS耳机和耳机盒在出厂时配套使用，TWS耳机预先存储有耳机盒的蓝牙地址，耳机盒也预先存储有TWS耳机的蓝牙地址。在目标模式下，手机可以首先与TWS耳机建立蓝牙连接。而后，手机可以向TWS耳机发送指示信息1，以指示TWS耳机与耳机盒建立蓝牙连接。TWS耳机接收到指示信息1后，根据存储的耳机盒的蓝牙地址，请求与耳机盒建立蓝牙连接。耳机盒确定请求建立蓝牙连接的设备的蓝牙地址与自身存储的TWS耳机的蓝牙地址匹配，从而与TWS耳机建立蓝牙连接。可选地，手机与耳机盒之间也可以建立蓝牙连接。
或者，在目标模式下，手机可以首先与耳机盒建立蓝牙连接。而后，手机可以向耳机盒发送指示信息2，以指示耳机盒与TWS耳机建立蓝牙连接。耳机盒接收到指示信息2后，根据存储的TWS耳机的蓝牙地址，请求与TWS耳机建立蓝牙连接。TWS耳机确定请求建立蓝牙连接的设备的蓝牙地址与自身存储的耳机盒的蓝牙地址匹配，从而与耳机盒建立蓝牙连接。
其中，指示信息1和指示信息2用于指示TWS耳机与耳机盒建立蓝牙连接，因而也可以称为连接信息。来自手机的连接信息，可以包括手机直接发送的连接信息，以及手机通过其他设备转发的连接信息。
方案2：TWS耳机和耳机盒在出厂时配套使用，TWS耳机预先存储有耳机盒的蓝牙地址，耳机盒也预先存储有TWS耳机的蓝牙地址。在目标模式下，手机可以首先与TWS耳机建立蓝牙连接，TWS耳机检测到用户的预设操作2后，建立与耳机盒之间的蓝牙连接。
其中，该预设操作2可以是触摸操作、按压操作或语音操作等。示例性的，预设操作2为用户语音指示TWS耳机与耳机盒建立蓝牙连接的操作。TWS耳机检测到预设操作2后，根据存储的耳机盒的蓝牙地址，请求与耳机盒建立蓝牙连接。耳机盒确定请求建立蓝牙连接的设备的蓝牙地址与自身存储的TWS耳机的蓝牙地址匹配后，与TWS耳机建立蓝牙连接。
或者，手机可以首先与耳机盒建立蓝牙连接，耳机盒检测到用户的预设操作3后，建立与TWS耳机之间的蓝牙连接。
其中，该预设操作3可以是触摸操作、按压操作或语音操作等。示例性的，预设操作3为用户针对耳机盒上的控件1的连续按压两次的操作。耳机盒检测到预设操作3后，根据存储的TWS耳机的蓝牙地址，请求与TWS耳机建立蓝牙连接。TWS耳机确定请求建立蓝牙连接的设备的蓝牙地址与自身存储的耳机盒的蓝牙地址匹配后，与耳机盒建立蓝牙连接。
可以理解的是，预设操作2和预设操作3还可以是其他操作，本申请实施例不予限定。例如，预设操作2还可以是用户针对TWS耳机的耳塞上的预设区域，连续点击3次的操作。
方案3：在目标模式下，手机可以与TWS耳机建立蓝牙连接，并与耳机盒建立蓝牙连接。例如，在目标模式下，手机可以显示扫描到的蓝牙设备列表，手机检测到用户从蓝牙设备列表中选择TWS耳机和耳机盒后，与TWS耳机和耳机盒均建立蓝牙连接。而后，手机可以指示TWS耳机和耳机盒建立蓝牙连接。例如，手机可以将TWS耳机的蓝牙地址发送给耳机盒，并将耳机盒的蓝牙地址发送给TWS耳机。基于手机发送的蓝牙地址，TWS耳机和耳机盒之间建立蓝牙连接。在该方案中，TWS耳机与耳机盒可以是出厂时配套使用的耳机盒，也可以不是出厂时配套使用的耳机盒，本申请实施例不予限定。
以上是以手机进入目标模式后，TWS耳机、耳机盒及手机之间才建立蓝牙连接为例进行说明的。在其他一些实施例中，手机可以先与TWS耳机建立蓝牙连接，在进入目标模式后，手机再指示TWS耳机与耳机盒建立蓝牙连接。可选地，在进入目标模式后，手机还可以与耳机盒建立蓝牙连接。
703、手机检测到用户启动目标应用的操作后，打开目标应用并显示目标应用的应用界面。
其中，用户在使用目标应用时需要返听自己的声音。在用户使用目标应用时，耳机盒可以采集用户的声音信号，将用户的声音信号转换成音频数据并发送给TWS耳机，TWS耳机可以将用户的声音返听给用户。
例如，该目标应用可以是K歌应用或直播应用等。示例性的，以目标应用为K歌应用为例，用户启动目标应用的操作可以为点击桌面上目标应用的图标的操作，手机显示的目标应用的应用界面可以参见图9。
704、耳机盒采集用户的声音信号，并生成第一音频数据。
用户可以将耳机盒放到嘴部附近，耳机盒的麦克风可以采集周围的声音信号。周围的声音信号主要包括用户的声音信号，例如用户的嘴部发出的声音或鼻子哼出的曲调等。比如，用户的声音信号可以是用户演讲的声音、主持人说话的声音或用户唱歌的声音等。
耳机盒可以将用户的声音信号转化成第一音频数据。其中，用户的声音信号可以是模拟信号，第一音频数据可以是数字信号。例如，第一音频数据可以是脉冲编码调制(pulse code modulation，PCM)数据。
在一些实施例中，在手机与耳机盒之间不具有蓝牙连接的情况下，手机在打开目标应用(例如K歌应用)后，可以通过TWS耳机通知耳机盒进行拾音。在手机与耳机盒建立有蓝牙连接的情况下，手机在打开目标应用后，可以基于该蓝牙连接通知耳机盒进行拾音。
在另一些实施例中，手机在打开目标应用后，可以根据目标应用通知耳机盒开始拾音。以目标应用为K歌应用为例，手机在用户从K歌应用中选择一首待唱歌曲(例如图9所示的歌曲1)后，通知耳机盒开始拾音或者通过TWS耳机通知耳机盒开始拾音。
在另一些实施例中，耳机盒在与TWS耳机建立蓝牙连接后，即开始拾音。手机在需要处理耳机盒的拾音数据时，对来自耳机盒的拾音数据进行业务处理。其中，该拾音数据即为上述第一音频数据。来自耳机盒的拾音数据可以是耳机盒发送的拾音数据，也可以是耳机盒通过TWS耳机转发的拾音数据。以目标应用为K歌应用为例，手机在用户从K歌应用中选择一首待唱歌曲后，确定需要处理耳机盒的拾音数据，后续接收到的耳机盒的拾音数据为有效数据，从而根据后续接收到的拾音数据进行相关处理。
在其他一些实施例中，耳机盒检测到用户的预设操作4后开始拾音。例如，该预设操作4可以为用户针对耳机盒上预设控件的按压操作，或者用户的语音操作等。
在其他一些实施例中，TWS耳机检测到用户的预设操作5后，通知耳机盒开始拾音。例如，该预设操作5可以为用户针对耳塞上预设区域的触摸操作，或者用户的语音操作等。
如前所述，TWS耳机、耳机盒及手机之间的蓝牙连接架构可以包括图5A所示的情况1和图5B所示的情况2。以下首先针对图5A所示的情况1进行说明。
705、耳机盒将第一音频数据发送给TWS耳机。
如前所述，TWS耳机与耳机盒之间的蓝牙连接方案可以为图6A所示的双发连接 方案或图6B所示的转发连接方案等。以下首先以图6A所示的双发连接方案为例进行说明，关于图6B所示的转发连接方案将在后文进行说明。
在图6A所示的TWS耳机与耳机盒之间采用双发连接方案的情况下，耳机盒可以通过蓝牙模块向TWS耳机中的耳塞1和耳塞2发送第一音频数据。其中，耳机盒分别向耳塞1和耳塞2发送的数据内容可以相同或不同。例如，第一音频数据为单声道音频数据，耳机盒向耳塞1和耳塞2发送相同的单声道音频数据；再例如，第一音频数据包括左声道音频数据和右声道音频数据，耳机盒向耳塞1发送的数据内容为第一音频数据中的左声道音频数据，耳机盒向耳塞2发送的数据内容为第一音频数据中的右声道音频数据。
706、TWS耳机对第一音频数据进行音效处理，获得第二音频数据。
其中，第一音频数据可以为用户声音的干声，可以是耳机盒的麦克风获得的PCM数据。
该音效处理用于对第一音频数据进行混响、调制、压限或变速等处理，以获得更好的音质效果。例如，音效处理算法可以包括以下一项或多项：回声消除(acoustic echo cancellation，AEC)算法、噪声抑制(noise suppression，NS)算法、自动增益控制(automatic gain control，AGC)算法、均衡器(equalizer)算法、主动降噪算法(active noise cancellation，ANC)、语音端点检测(voice activity detection，VAD)算法或(dynamic range compress，DRC)动态范围压缩算法等。
TWS耳机的耳塞1和耳塞2接收到第一音频数据后，可以分别通过内部的音效处理模块对第一音频数据进行音效处理，从而分别获得第五音频数据和第六音频数据。第五音频数据与第六音频数据可以相同或不同。例如，第五音频数据和第六音频数据为相同的单声道音频数据；再例如，第五音频数据为左声道音频数据，第六音频数据为右声道音频数据。第二音频数据可以包括该第五音频数据和第六音频数据，该第二音频数据可以为用户声音的湿声。
707、手机根据目标应用向TWS耳机发送第三音频数据。
第三音频数据可以是手机根据目标应用发送的，与耳机盒的拾音数据相配合的音频数据。例如，耳机盒的拾音数据可以是用户K歌时的人声对应的音频数据，第三音频数据可以是用户K歌时手机发送的伴奏。
以目标应用为K歌应用为例，手机在用户选择一首待唱歌曲后，可以向耳机盒发送或通过TWS耳机向耳机盒发送该首歌曲的伴奏。
在一些实施例中，手机在用户选择一首待唱歌曲后，还可以通知耳机盒开始拾音。
手机可以向TWS耳机的耳塞1和耳塞2发送第三音频数据。其中，手机向TWS耳机的两只耳塞发送数据内容，可以相同也可以不同。比如，第三音频数据为单声道伴奏，手机可以向耳塞1和耳塞2均发送相同的单声道伴奏。再比如，第三音频数据包括左声道伴奏和右声道伴奏，手机可以向耳塞1发送第三音频数据中左声道伴奏，向耳塞2发送第三音频数据中右声道伴奏。
708、TWS耳机将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。
其中，混音处理是指把多个音频数据整合成一个音频数据。例如，混音处理算法 可以包括以下至少一项：线性叠加后求平均算法、归一化混音算法(也称自适应加权混音算法)或重采样算法等。
耳塞1和耳塞2可以分别通过内部的混音处理模块，对第二音频数据和第三音频数据进行混音处理，获得第四音频数据。例如，在K歌场景下，耳塞1和耳塞2可以获得用户的湿声与伴奏混音后的音频数据。
具体的，耳塞1可以对第五音频数据和从手机接收到的第三音频数据进行混音处理，获得第七音频数据；耳塞1可以对第六音频数据和从手机接收到的第三音频数据进行混音处理，获得第八音频数据。第七音频数据与第八音频数据可以相同或不同。例如，第七音频数据和第八音频数据为相同的单声道音频数据；再例如，第七音频数据为左声道音频数据，第八音频数据为右声道音频数据。第四音频数据包括该第七音频数据和第八音频数据。
709、TWS耳机播放第四音频数据。
耳塞1和耳塞2可以分别通过听筒为用户播放混音处理后的第四音频数据。由于第四音频数据为第二音频数据和第三音频数据混音后的音频数据，而第二音频数据为用户的声音信号对应的第一音频数据进行音效处理后的音频数据，因而耳塞1和耳塞2向用户播放第四音频数据，可以将用户的声音返听给用户。
例如，在K歌场景下，耳塞1和耳塞2可以向用户播放用户的湿声与伴奏混音后的音频数据，用户可以听到自己的声音以及伴奏。
在一些实施例中，耳塞1和耳塞2播放的音频数据是相同的，例如均播放第四音频数据，且第四音频数据为单声道音频数据。在其他一些实施例中，耳塞1和耳塞2播放的音频数据是不同的，例如耳塞1播放的是第四音频数据中的左声道音频数据，耳塞2播放的是第四音频数据中的右声道音频数据。
在步骤701-709描述的方案中，耳机盒向TWS耳机发送第一音频数据，TWS耳机进行音效处理后获得第二音频数据。手机向TWS耳机发送第三音频数据，TWS耳机将第二音频数据与第三音频数据进行混音处理后获得第四音频数据。TWS耳机向用户播放第四音频数据。
这样，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为TWS耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效果较好；并且，TWS耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
因而，该方案可以打破TWS耳机的听筒和拾音器件离得较近的限制，还可以摆脱有线传输或非TWS耳机的连接线的困扰。并且，当用户使用两只耳塞时，该方案在让用户返听到自己声音的同时，还可以给用户以沉浸式的伴奏等的聆听体验。此外，耳机盒的大小尺寸可以方便用户手持使用。
在K歌场景下，用户在K歌时由于伴奏的声音较大或者环境较为嘈杂等原因，K歌用户通过声音在空气中的传播，可能听不清自己的声音或者听到的自己的声音有延迟，需要返听来实时监听自己的声音，防止走音或者走调，从而帮助用户更好地调整 演唱技巧和演唱状态等。
在本申请实施例中，当目标应用为K歌应用时，上述第一音频数据可以是用户K歌声音的干声，第二音频数据可以是用户K歌声音的湿声，第三音频数据可以是手机下发的伴奏，第四音频数据可以是用户K歌声音的湿声与伴奏混合后的音频数据。也就是说，耳机盒可以拾取用户K歌的声音信号，转换成拾音数据并发送给TWS耳机进行音效处理。TWS耳机还可以接收手机发送的伴奏。TWS耳机可以将音效处理后的拾音数据和伴奏混音后播放给用户。这样，用于拾音的麦克风和用于音频播放的听筒可以分离，耳机的听筒可以离用户的耳朵较近，耳机盒的麦克风可以离用户的嘴部较近，声音细节不易缺失，信噪比较高，拾音音质和拾音效果较好，返听效果也较好。并且，当用户使用两只耳塞时，用户在监听自己的声音是否走音的同时，还可以得到沉浸式的K歌体验。
在其他一些实施例中，上述步骤706可以省略，即TWS耳机可以不对第一音频数据进行音效处理，因而并不生成第二音频数据。在上述步骤708中，TWS耳机将第一音频数据与第三音频数据进行混音处理后，获得第四音频数据。在上述步骤709中，TWS耳机播放第一音频数据与第三音频数据混音处理后的第四音频数据。
在一些实施例中，TWS耳机还可以将第一音频数据发送给手机，以便手机的目标应用根据第一音频数据进行相关处理。例如，参见图7，在上述步骤705之后，该方法还可以包括：
710、TWS耳机将第一音频数据发送给手机。
耳塞1或耳塞2中的至少一只耳塞可以将第一音频数据发送给手机。在一种实现方案中，TWS耳机用于向手机发送第一音频数据的耳塞，可以是预设的耳塞。在另一种实现方案中，TWS耳机用于向手机发送第一音频数据的耳塞可以是主耳塞。
在另一种实现方案中，耳塞1和耳塞2均向手机发送第一音频数据。手机接收两只耳塞分别发送的第一音频数据；或者，手机接收到一只耳塞发送的第一音频数据后，不再接收另一只耳塞发送的相同的第一音频数据；或者，手机丢弃其中一只耳塞发送的第一音频数据。例如，第一音频数据为单声道音频数据，或者第一音频数据包括左声道音频数据和右声道音频数据。
在另一种实现方案中，第一音频数据包括左声道音频数据和右声道音频数据，耳塞1可以向手机发送第一音频数据中的左声道音频数据，耳塞2可以向手机发送第一音频数据中的右声道音频数据。
在一些实施例中，手机在确定需要根据第一音频数据进行应用处理时，才接收来自耳机盒的第一音频数据。以目标应用为K歌应用为例，手机在用户选择一首待唱歌曲后，确定后续来自耳机盒的第一音频数据为有效数据，从而才接收来自耳机盒的第一音频数据。手机在用户选择待唱歌曲之前，不接收TWS耳机发送的第一音频数据。
711、手机通过目标应用对第一音频数据进行业务处理。
手机可以通过目标应用对第一音频数据进行相关业务处理。在一些实施例中，手机可以接收来自耳机盒的第一音频数据，在需要对第一音频数据进行业务处理时，才对后续接收到的第一音频数据进行业务处理。以目标应用为K歌应用为例，手机在用户选择一首待唱歌曲后，确定需要对第一音频数据进行业务处理。该第一音频数据为 用户K歌时的声音信号对应的音频数据，手机可以通过K歌应用对第一音频数据进行录音，将第一音频数据与伴奏合成后生成音频文件，播放音频文件或上传音频文件等处理。
在另一些实施例中，手机在需要对第一音频数据进行业务处理时才通知耳机盒进行拾音，这样手机在需要对第一音频数据进行业务处理时才会接收到来自耳机盒的第一音频数据，手机在接收到第一音频数据后即可通过目标应用对第一音频数据进行业务处理。
在其他一些实施例中，耳机盒还可以设置有音频编解码器(codec)，例如高清蓝牙编解码器。由于蓝牙的传输带宽是有限的，而音频编解码器的编码操作可以减少音频数据的数据量，因而耳机盒的麦克风对声音信号的采样率可以较大，这样声音信号对应的音频数据编码后的数据量仍然较少，仍可以在蓝牙的传输带宽内快速传输。而声音信号的采样率越大，声音信号对应的音频数据编解码后可保留的声音信息的带宽也就越大。例如，当麦克风的采样率为48kHz时，编解码后获得的声音信息的带宽范围可以为0～24kHz左右；当麦克风的采样率为32kHz时，编解码后获得的声音信息的带宽范围可以为0～16kHz左右。因而，采用音频编解码器可以获得较高带宽的声音信息，并且可以实时、快速地通过蓝牙传输音频数据。
在上述步骤704中，耳机盒的麦克风可以采用48kHz或32kHz等大于或者等于16kHz的采样率，采集用户的声音信号，并根据用户的声音信号生成第一音频数据。在上述步骤705中，耳机盒可以采用音频编解码器对第一音频数据进行编码后，再通过蓝牙模块发送给TWS耳机。这样，编码后的第一音频数据的数据量较少，可以通过蓝牙高速传输。并且，编码后的第一音频数据可以保留高带宽(例如0-24kHz或0-16kHz等带宽)的声音信息，从而可以保留真实、清晰的用户声音信息，因而该音频编解码器也可以称为高清蓝牙编解码器。
TWS耳机的耳塞也可以设置有音频编解码器。TWS耳机接收到编码后的第一音频数据后，在上述步骤706中，TWS耳机对编码后的第一音频数据进行解码获得第一音频数据，并对第一音频数据进行音效处理获得第二音频数据。
在上述步骤707中，手机向TWS耳机发送音频编解码器编码后的第三音频数据。
在上述步骤708中，TWS耳机通过音频编解码器对编码后的第三音频数据进行解码，从而获得第三音频数据；并将第二音频数据和第三音频数据进行混音处理，从而获得第四音频数据。
在上述步骤710中，TWS耳机可以将编码后的第一音频数据发送给手机。手机中可以设置有音频编解码器，在上述步骤711中，手机可以对编码后的第一音频数据进行解码后，获得第一音频数据，从而通过目标应用对第一音频数据进行业务处理。
在该方案中，耳机盒、TWS耳机和手机中均设置有音频编解码器(或者耳机盒中可以仅设置音频编码器)，该音频编解码器可以将通过高采样率获得的音频数据压缩至较低的数据量，从而通过蓝牙快速传输，使得耳机盒的拾音数据可以实时、快速地到达TWS耳机和手机，使得手机发送的音频数据也可以实时、快速地到达TWS耳机，从而可以实现高带宽的蓝牙音频拾音和音频传输，实现用户声音的实时返听。
并且，该编解码器是***级的蓝牙编解码器，可以应用于各类音频数据，可以应 用于各种***应用和第三方应用，是通用的蓝牙音频数据的编解码方式。
可以理解的是，在用户使用需要返听的目标应用时，手机需要先打开目标应用，且TWS耳机、耳机盒及手机之间需要预先建立蓝牙连接。该过程可以有多种实现方式。例如，该过程可以为上述步骤701-703描述的流程。
在其他一些实施例中，参见图10，上述步骤701-703描述的流程可以替换为：
1001、手机与TWS耳机建立蓝牙连接。
例如，手机显示扫描到的蓝牙设备列表，手机检测到用户从该列表中选择TWS耳机的操作后，与TWS耳机建立蓝牙连接。再例如，手机与TWS耳机之前建立过蓝牙连接，TWS耳机自动回连到手机。
1002、TWS耳机与耳机盒之间建立蓝牙连接。
在一些实施例中，TWS耳机和耳机盒在出厂时配套使用，TWS耳机预先存储有耳机盒的蓝牙地址，耳机盒也预先存储有TWS耳机的蓝牙地址。TWS耳机检测到用户的预设操作2后，建立与耳机盒之间的蓝牙连接。或者，耳机盒检测到用户的预设操作3后，建立与TWS耳机之间的蓝牙连接。
可选地，在步骤1002之后，该流程还可以包括步骤1003：
1003、TWS耳机将手机的蓝牙地址发送给耳机盒。
1004、TWS耳机将耳机盒的蓝牙地址发送给手机。
1005、基于TWS耳机发送的耳机盒的蓝牙地址和手机的蓝牙地址，手机与耳机盒建立蓝牙连接。
手机可以根据TWS耳机发送的耳机盒的蓝牙地址向耳机盒发送蓝牙连接请求，耳机盒确定请求蓝牙连接的设备的蓝牙地址与TWS耳机发送的耳机盒的蓝牙地址相匹配，从而与手机建立蓝牙连接。
基于步骤1003-1005，手机与耳机盒之间也建立了蓝牙连接，可以传输音频数据。
进一步地，该流程还可以包括：
1006、手机检测到用户启动目标应用的操作后，打开目标应用并显示目标应用的应用界面。
在其他一些实施例中，参见图11A，上述步骤701-703描述的流程可以替换为：
1101、手机检测到用户启动目标应用的操作后，打开目标应用并显示目标应用的应用界面，该目标应用为预设应用。
其中，预设应用为***或用户预先设置的应用，预设应用可以对来自耳机盒的拾音数据进行相关处理。示例性的，用户设置预设应用的界面可以参见图11B。
1102、TWS耳机、耳机盒及手机之间建立蓝牙连接。
与在目标模式下TWS耳机、耳机盒及手机之间建立蓝牙连接的过程类似，在手机检测到用户启动目标应用的操作后，TWS耳机、耳机盒及手机之间建立蓝牙连接的过程可以参见步骤702中的相关描述，此处不予赘述。
在另一些实施例中，参见图12A，上述步骤701-703描述的流程可以替换为：
1201、手机检测到用户启动目标应用的操作后，打开目标应用并显示目标应用的应用界面。
1202、手机提示用户是否进入目标模式。
手机在打开目标应用后，可以提示用户是否进入目标模式。在目标模式下，手机、TWS耳机及耳机盒之间可以建立蓝牙连接，且耳机盒可以拾音。
示例性的，手机提示用户是否进入目标模式的界面示意图可以参见图12B。如图12B所示，该目标模式为专业返听模式，该目标模式也可以有其他的名称例如专业K歌模式等。
1203、若手机检测到用户指示进入目标模式的操作，则手机与TWS耳机及耳机盒之间建立蓝牙连接。
示例性的，在图12B所示情况下，用户指示进入目标模式的操作可以为点击控件1200的操作。
在步骤1203中，手机与TWS耳机及耳机盒之间建立蓝牙连接的过程，具体可以参见上述步骤702中的相关描述。
基于图11A或图12A所示的方案，对于后续的步骤704来说，在一些实施例中，在手机打开目标应用，且耳机盒与TWS耳机建立蓝牙连接后，手机可以根据目标应用指示耳机盒开始拾音。在另一些实施例中，耳机盒在与TWS耳机建立蓝牙连接后，就可以开始拾音。在另一些实施例中，耳机盒检测到用户的预设操作4后开始拾音。在其他一些实施例中，TWS耳机检测到用户的预设操作5后，指示耳机盒开始拾音。
需要说明的是，在本申请的实施例中，TWS耳机、耳机盒及手机之间建立蓝牙连接的步骤，与手机打开目标应用的步骤之间并没有明确的先后关系，不予限定。手机打开目标应用后，TWS耳机、耳机盒及手机之间可以再建立蓝牙连接。或者，TWS耳机、耳机盒及手机之间建立蓝牙连接后，手机可以再打开目标应用。
以上主要针对图6A所示的，TWS耳机与耳机盒之间，以及TWS耳机与手机之间采用双发连接的方案进行了说明。以下对图6B所示的，TWS耳机与耳机盒之间，以及TWS耳机与手机之间采用转发连接的方案进行说明。
参见图13，上述步骤705可以替换为：
705A、耳机盒将第一音频数据发送给TWS耳机中的主耳塞。
其中，TWS耳机的一对耳塞可以包括主耳塞和副耳塞，主、副耳塞的角色可以根据预设策略确定。例如，主耳塞为首先从耳机盒中拿出的耳塞。再例如，主耳塞为用户首先佩戴在耳部的耳塞。再例如，主耳塞为电量较大的耳塞。
并且，主、副耳塞的角色还可以在用户的使用过程中发生切换。例如，主耳塞为电量较大的耳塞，在两只耳塞的电量发生变化后，主、副耳塞的角色可以切换。
耳机盒在生成第一音频数据后，可以通过蓝牙模块将第一音频数据发送给TWS耳机中的主耳塞，耳机盒未向副耳塞发送第一音频数据。
上述步骤706可以替换为：
706A、主耳塞对第一音频数据进行音效处理，获得第二音频数据。
主耳塞可以通过内部的音效处理模块，对第一音频数据进行音效处理，从而获得第二音频数据。
上述步骤707可以替换为：
707A、手机根据目标应用向主耳塞发送第三音频数据。
手机可以将第三音频数据发送给主耳塞，且未向副耳塞发送第三音频数据。
上述步骤708可以替换为：
708A、主耳塞将第二音频数据与第三音频数据进行混音处理，获得第四音频数据。
在步骤709之前，该方法还可以包括：
700、主耳塞将第四音频数据发送给副耳塞。
在该方案中，耳机盒向主耳塞发送第一音频数据，主耳塞进行音效处理后获得第二音频数据。手机向主耳塞发送第三音频数据，并将第二音频数据和第三音频数据进行混音处理后获得第四音频数据。主耳塞将处理获得的第四音频数据发送给副耳塞。以便，在步骤709中，主耳塞和副耳塞都可以播放第四音频数据。
在一些实施例中，第四音频数据为单声道音频数据，主耳塞和副耳塞均播放单声道音频数据。
在另一些实施例中，第四音频数据为立体声的音频数据，主耳塞和副耳塞分别播放左、右声道音频数据。
在另一些实施例中，主耳塞可以将第四音频数据中的左/右声道音频数据发送给副耳塞，主耳塞和副耳塞分别播放左、右声道音频数据。
上述步骤710可以替换为：
710A、主耳塞将第一音频数据发送给手机。
以上主要是针对图5A所示的情况1对应的蓝牙连接架构进行说明的。在图5B所示的情况2对应的蓝牙连接架构中，耳机盒与手机之间也建立了蓝牙连接，耳机盒不需要通过TWS耳机将第一音频数据转发给手机，而可以通过蓝牙连接直接将第一音频数据发送给手机。
例如，对于双发连接方案来说，参见图14A，上述步骤710可以替换为：
710B、耳机盒将第一音频数据发送给手机。
对于转发连接方案来说，参见图14B，上述步骤710A可以替换为：
710B、耳机盒将第一音频数据发送给手机。
需要说明的是，在本申请的实施例中，用户可以同时使用一对TWS耳机的两只耳塞，也仅使用TWS耳机中的其中一只耳塞。以上是以耳机盒与TWS耳机的一对耳塞配合使用为例进行说明的，参见图15，音频处理***也可以仅包括一只耳塞，耳机盒与TWS耳机的一只耳塞配合使用。
例如，用户1使用耳塞1，耳机盒1和手机1。耳机盒1拾音获得第一音频数据。耳塞1对第一音频数据进行音频处理获得第二音频数据，耳塞1播放给用户的音频数据包括第二音频数据与手机1发送的第三音频数据混合后的第四音频数据。
再例如，用户2使用耳塞2，耳机盒2和手机2。耳机盒2拾音获得第一音频数据。耳塞2对第一音频数据进行音频处理获得第二音频数据，耳塞2播放给用户的音频数据包括第二音频数据与手机2发送的第三音频数据混合后的第四音频数据。
其中，用户1和用户2可以使用同一手机或不同手机，用户1和用户2可以使用同一手机上的同一目标应用或不同目标应用。示例性的，用户1和用户2可以分别使用不同的手机K歌。再示例性的，用户1和用户2使用同一手机上的同一K歌应用唱同一首歌，用户1和用户2通过返听可以分别听到自己的声音，但通过返听无法听到其他用户的声音。
在其他一些实施例中，参见图16，音频处理***也可以包括多个耳机盒和多只耳塞，每个用户可以方便地手持一个耳机盒进行拾音，每个用户可以使用一对耳塞或一只耳塞，同一用户使用的耳塞与耳机盒之间建立有蓝牙连接，不同用户使用的耳塞与与其他用户使用的耳机盒之间也建立有蓝牙连接。该***中的每个耳机盒均可以执行以上实施例中耳机盒的操作，并将获得的第一音频数据发送给每个用户的耳塞。耳塞可以将每个耳机盒分别获得的第一音频数据进行音效处理后得到的第二音频数据，将第二音频数据与手机发送的第三音频数据混合后得到第四音频数据，并播放第四音频数据给用户。
例如，用户1使用耳塞1，耳机盒1和手机1；同时，用户2使用耳塞2，耳机盒2和手机1。用户1和用户2使用同一手机上的同一目标应用。耳机盒1和耳机盒2分别获得各自的第一音频数据，并将第一音频数据发送给耳塞1和耳塞2。耳塞1对来自耳机盒1和耳机盒2的第一音频数据进行音效处理后获得第二音频数据，将第二音频数据与手机1发送的第三音频数据混合后得到第四音频数据。耳塞1将第四音频数据播放给用户1。耳塞2对来自耳机盒1和耳机盒2的第一音频数据进行音效处理后获得第二音频数据，将第二音频数据与手机1发送的第三音频数据混合后得到第四音频数据。耳塞2将第四音频数据播放给用户2。
示例性的，在K歌场景下，用户1和用户2使用同一手机上的同一K歌应用合唱同一首歌，用户1通过返听可以听到自己的声音和用户2的声音，用户2通过返听也可以听到自己的声音和用户1的声音。
以下将以音频处理***包括具有图2所示结构的TWS耳机和具有图3所示结构的耳机盒，且音频数据传输采用的无线通信技术为蓝牙为例，对本申请实施例提供的音频处理方法进行阐述。
在一些实施例中，参见图17，该音频处理方法可以包括：
1701、TWS耳机和耳机盒之间建立蓝牙连接。
在一些实施例中，TWS耳机检测到用户的预设操作2后，建立与耳机盒之间的蓝牙连接；或者，耳机盒检测到用户的预设操作3后，建立与TWS耳机之间的蓝牙连接。
在另一些实施例中，在TWS耳机从耳机盒中拿出后，TWS耳机与耳机盒可以自动建立蓝牙连接。例如，该TWS耳机预先存储有耳机盒的蓝牙地址，耳机盒也预先存储有TWS耳机的蓝牙地址。在TWS耳机从耳机盒中拿出后，TWS耳机和耳机盒之间可以根据存储的对方设备的蓝牙地址建立蓝牙连接。
在其他一些实施例中，TWS耳机和耳机盒之间可以通过其他设备建立蓝牙连接。例如，TWS耳机可以与手机建立蓝牙连接，耳机盒可以与手机建立蓝牙连接。手机可以将TWS耳机的蓝牙地址发送给耳机盒，并将耳机盒的蓝牙地址发送给TWS耳机。从而，TWS耳机和耳机盒之间可以根据从手机获取的对方设备的蓝牙地址，与对方设备建立蓝牙连接。
其中，TWS耳机包括两只耳塞，TWS耳机与耳机盒之间的蓝牙连接方案可以包括双发连接方案或转发连接方案。
1702、耳机盒采集用户的声音信号，并生成第一音频数据。
耳机盒可以通过自身的麦克风采集附近的声音信号。用户可以手持耳机盒，并将 耳机盒放置在嘴部附近。这样，耳机盒可以采集到用户的声音信号，比如用户演讲的声音、主持人说话的声音或用户唱歌的声音等。耳机盒可以根据采集到的用户的声音信号生成第一音频数据。
1703、耳机盒将第一音频数据发送给TWS耳机。
耳机盒将第一音频数据发送给TWS耳机。其中，在双发连接方案中，耳机盒可以将第一音频数据发送给TWS耳机的两只耳塞。在转发连接方案中，耳机盒可以将第一音频数据发送给TWS耳机中的主耳塞。
1704、TWS耳机对第一音频数据进行音效处理，生成第二音频数据。
其中，在双发连接方案中，TWS耳机的两只耳塞在接收到第一音频数据后，分别对第一音频数据进行音效处理，从而生成第二音频数据。
在转发连接方案中，主耳塞接收到第一音频数据后，对第一音频数据进行音效处理从而生成第二音频数据，并将第二音频数据发送给副耳塞。
1705、TWS耳机播放第二音频数据。
TWS耳机的两只耳塞在获得第二音频数据后，将第二音频数据播放给用户。由于第二音频数据是对第一音频数据进行音效处理获得的数据，而第一音频数据是根据用户的声音信号获得的，因而TWS耳机将第二音频数据播放给用户后，用户听到的是自己的声音，从而可以实现用户声音的返听。也就是说，采用该方案，用户可以通过返听实时听到自己的声音。
在该方案中，耳机盒可以采集用户的声音信号，并生成音频数据发送给TWS耳机，TWS耳机进行音频处理后再播放给用户，使得用户可以实时返听到自己的声音。这样，用于拾取用户声音信号的麦克风为耳机盒的麦克风，用于返听用户声音信号的听筒为TWS耳机的听筒。即，用于拾取用户声音信号的麦克风与返听用户声音信号的听筒可以分离。用户可以手持耳机盒并将耳机盒靠近用户的嘴部，耳机盒可以拾取到用户的声音细节，拾取的用户声音的信噪比较高，耳机盒的拾音质量和拾音效果较好；并且，TWS耳机的听筒离用户的耳朵也很近，音频播放效果也较好，因而返听效果较好。
在一些实施例中，耳机盒和TWS耳机上可以分别设置有音频编解码器，例如可以是高清蓝牙编解码器。耳机盒与TWS耳机之间交互的音频数据，可以是音频编解码器编码后的数据。采用音频编解码器可以获得高带宽的声音信息，并且可以实时、快速地通过蓝牙传输音频数据。
在其他一些实施例中，上述步骤1704可以省略，即TWS耳机可以不对第一音频数据进行音效处理从而生成第二音频数据。在上述步骤1705中，TWS耳机可以直接播放第一音频数据。
以上是以音频处理***包括TWS耳机中的两只耳塞为例进行说明的。在其他一些实施例中，音频处理***可以包括TWS耳机中的一只耳塞，例如耳塞1。在上述步骤1701中，耳塞1与耳机盒建立蓝牙连接。在步骤1703中，耳机盒将第一音频数据发送给耳塞1。在步骤1704中，耳塞1对第一音频数据进行音效处理，生成第二音频数据。在步骤1705中，耳塞1播放第二音频数据。
需要说明的是，在以上实施例描述的音频处理方法中，音频处理***中包括TWS耳机。在其他一些实施例中，音频处理***中的TWS耳机也可以替换为其他无线耳机， 例如替换为包括两只耳塞且两只耳塞之间具有连接线的无线耳机，比如颈带式无线耳机等。当TWS耳机替换为其他耳机时，仍可以采用上述实施例描述的音频处理方法进行返听，这里不再赘述。
以上是以传输音频数据的无线通信技术为蓝牙为例进行说明的，用于传输音频数据的无线通信技术也可以是红外等其他无线技术，本申请实施例不予限定。
以上是以电子设备为手机为例进行说明的。当电子设备为其他设备，比如电视、车载设备、计算机、音箱或智能手表等时，也可以采用本申请实施例提供的方法进行音频处理，此处不予赘述。
可以理解的是，为了实现上述功能，电子设备包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤，本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
本实施例可以根据上述方法示例对电子设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块可以采用硬件的形式实现。需要说明的是，本实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
本申请实施例还提供一种音频处理装置，包括一个或多个处理器以及一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合，一个或多个存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当一个或多个处理器执行计算机指令时，使得音频处理装置执行上述相关方法步骤实现上述实施例中的音频处理方法。该音频处理装置可以是上述方法实施例中的TWS耳机、耳机盒或电子设备。
本申请的实施例还提供一种计算机可读存储介质，该计算机可读存储介质中存储有计算机指令，当该计算机指令在音频处理装置上运行时，使得音频处理装置执行上述相关方法步骤实现上述实施例中的音频处理方法。该音频处理装置可以是上述方法实施例中的TWS耳机、耳机盒或电子设备。
本申请的实施例还提供了一种计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行上述相关步骤，以实现上述实施例中音频处理装置执行的音频处理方法。该音频处理装置可以是上述方法实施例中的TWS耳机、耳机盒或电子设备。
另外，本申请的实施例还提供一种音频处理装置，这个音频处理装置具体可以是芯片，组件，模块或芯片***，该音频处理装置可包括相连的处理器和存储器；其中，存储器用于存储计算机执行指令，当音频处理装置运行时，处理器可执行存储器存储的计算机执行指令，以使音频处理装置执行上述各方法实施例中的音频处理方法。该音频处理装置可以应用于上述方法实施例中的TWS耳机、耳机盒或电子设备上。
其中，本实施例提供的音频处理装置、计算机可读存储介质、计算机程序产品或芯片等均用于执行上文所提供的对应的方法，因此，其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果，此处不再赘述。
本申请另一实施例提供了一种音频处理***，参见图1，该音频处理***可以包括上述TWS耳机和耳机盒。该音频处理***中的各设备可以用于实现上述实施例中的音频处理方法。
本申请另一实施例提供了一种音频处理***，参见图1，该音频处理***可以包括上述TWS耳机，耳机盒，以及电子设备。该音频处理***中的各设备可以用于实现上述实施例中的音频处理方法。
通过以上实施方式的描述，所属领域的技术人员可以了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (23)

  1. 一种音频处理方法，应用于音频处理***，其特征在于，所述音频处理***包括电子设备、无线耳机和耳机盒，所述方法包括：
    所述无线耳机与所述电子设备之间建立无线连接，且所述无线耳机与所述耳机盒之间建立无线连接；
    所述耳机盒采集声音信号，并生成第一音频数据；
    所述耳机盒向所述无线耳机发送所述第一音频数据；
    所述无线耳机对所述第一音频数据进行音效处理，获得第二音频数据；
    所述电子设备向所述无线耳机发送第三音频数据；
    所述无线耳机将所述第二音频数据与所述第三音频数据进行混音处理，获得第四音频数据；
    所述无线耳机播放所述第四音频数据。
  2. 根据权利要求1所述的方法，其特征在于，所述无线耳机包括第一耳塞和第二耳塞，所述耳机盒向所述无线耳机发送所述第一音频数据，包括：
    所述耳机盒向所述第一耳塞和所述第二耳塞发送所述第一音频数据；
    所述第二音频数据包括第五音频数据和第六音频数据，所述无线耳机对所述第一音频数据进行音效处理，获得第二音频数据，包括：
    所述第一耳塞对所述第一音频数据进行音效处理，获得所述第五音频数据；
    所述第二耳塞对所述第一音频数据进行音效处理，获得所述第六音频数据；
    所述电子设备向所述无线耳机发送第三音频数据，包括：
    所述电子设备向所述第一耳塞和所述第二耳塞发送所述第三音频数据；
    所述第四音频数据包括第七音频数据和第八音频数据，所述无线耳机将所述第二音频数据与所述第三音频数据进行混音处理，获得第四音频数据，包括：
    所述第一耳塞将所述第五音频数据与所述第三音频数据进行混音处理，获得所述第七音频数据；
    所述第二耳塞将所述第六音频数据与所述第三音频数据进行混音处理，获得所述第八音频数据。
  3. 根据权利要求1所述的方法，其特征在于，所述无线耳机包括第一耳塞和第二耳塞，所述耳机盒向所述无线耳机发送所述第一音频数据，包括：
    所述耳机盒向所述第一耳塞发送所述第一音频数据；
    所述无线耳机对所述第一音频数据进行音效处理，获得第二音频数据，包括：
    所述第一耳塞对所述第一音频数据进行音效处理，获得所述第二音频数据；
    所述电子设备向所述无线耳机发送第三音频数据，包括：
    所述电子设备向所述第一耳塞发送所述第三音频数据；
    所述无线耳机将所述第二音频数据与所述第三音频数据进行混音处理，获得第四音频数据，包括：
    所述第一耳塞将所述第二音频数据与所述第三音频数据进行混音处理，获得所述第四音频数据；
    所述方法还包括：
    所述第一耳塞向所述第二耳塞发送所述第四音频数据。
  4. 根据权利要求1-3任一项所述的方法，其特征在于，所述方法还包括：
    所述电子设备检测到用户的第一预设操作后，显示目标应用的应用界面，所述第一预设操作用于启动所述目标应用。
  5. 根据权利要求4所述的方法，其特征在于，在所述耳机盒向所述无线耳机发送所述第一音频数据之后，所述方法还包括：
    所述无线耳机向所述电子设备发送所述第一音频数据；
    所述电子设备通过所述目标应用，对所述第一音频数据进行业务处理。
  6. 根据权利要求4所述的方法，其特征在于，所述方法还包括：
    所述耳机盒与所述电子设备之间建立无线连接；
    在所述耳机盒生成所述第一音频数据之后，所述方法还包括：
    所述耳机盒向所述电子设备发送所述第一音频数据；
    所述电子设备通过所述目标应用，对所述第一音频数据进行业务处理。
  7. 根据权利要求4所述的方法，其特征在于，在所述电子设备显示所述目标应用的应用界面之后，所述方法还包括：
    所述电子设备提示所述用户是否进入目标模式；
    所述电子设备检测到所述用户指示进入所述目标模式的操作后，进入所述目标模式。
  8. 根据权利要求4所述的方法，其特征在于，所述目标应用为预设应用。
  9. 根据权利要求1所述的方法，其特征在于，所述方法还包括：
    所述电子设备检测到用户的第二预设操作后，显示设置界面，所述设置界面包括目标模式控件；
    所述电子设备检测到所述用户针对所述目标模式控件的操作后，进入所述目标模式。
  10. 根据权利要求1所述的方法，其特征在于，所述无线耳机存储有所述耳机盒的第一通信地址，所述耳机盒存储有所述无线耳机的第二通信地址，所述无线耳机与所述耳机盒之间建立无线连接，包括：
    在所述无线耳机或所述耳机盒检测到用户的第三预设操作后，所述无线耳机和所述耳机盒根据所述第一通信地址和所述第二通信地址建立无线连接；或者
    在所述无线耳机或所述耳机盒接收到来自所述电子设备的连接信息后，所述无线耳机和所述耳机盒根据所述第一通信地址和所述第二通信地址建立无线连接。
  11. 根据权利要求1所述的方法，其特征在于，所述无线耳机与所述电子设备之间建立无线连接，且所述无线耳机与所述耳机盒之间建立无线连接，包括：
    所述电子设备与所述无线耳机之间建立无线连接；
    所述电子设备与所述耳机盒之间建立无线连接；
    所述电子设备将所述无线耳机的第一通信地址发送给所述耳机盒；
    所述电子设备将所述耳机盒的第二通信地址发送给所述无线耳机；
    所述耳机盒和所述无线耳机根据所述第一通信地址和所述第二通信地址建立无线连接。
  12. 根据权利要求1所述的方法，其特征在于，所述无线连接为蓝牙连接，所述耳机盒使用蓝牙音频编解码器对音频数据进行编码。
  13. 一种音频处理***，其特征在于，包括：电子设备、无线耳机和耳机盒；
    所述电子设备、所述无线耳机和所述耳机盒用于，建立所述无线耳机与所述电子设备之间的无线连接，以及所述无线耳机与所述耳机盒之间的无线连接；
    所述耳机盒还用于，采集声音信号，并生成第一音频数据；
    所述耳机盒还用于，向所述无线耳机发送所述第一音频数据；
    所述无线耳机还用于，对所述第一音频数据进行音效处理，获得第二音频数据；
    所述电子设备还用于，向所述无线耳机发送第三音频数据；
    所述无线耳机还用于，将所述第二音频数据与所述第三音频数据进行混音处理，获得第四音频数据；
    所述无线耳机还用于，播放所述第四音频数据。
  14. 根据权利要求13所述的音频处理***，其特征在于，所述音频处理***中的所述电子设备、所述无线耳机和所述耳机盒用于执行如权利要求1-12中任一项所述的音频处理方法。
  15. 一种耳机盒，其特征在于，包括：无线通信模块、麦克风和音频模块；
    所述无线通信模块用于，与无线耳机建立无线连接；
    所述麦克风用于，采集声音信号；
    所述音频模块用于，根据所述声音信号生成第一音频数据；
    所述无线通信模块还用于，向所述无线耳机发送所述第一音频数据。
  16. 根据权利要求15所述的耳机盒，其特征在于，所述无线通信模块还用于，向所述无线耳机发送所述第一音频数据，包括：
    向所述无线耳机的第一耳塞和第二耳塞发送所述第一音频数据；或者
    向所述无线耳机的第一耳塞发送所述第一音频数据。
  17. 根据权利要求15或16所述的耳机盒，其特征在于，所述无线通信模块还用于：
    与电子设备建立无线连接；
    将所述音频模块生成的所述第一音频数据发送给所述电子设备。
  18. 根据权利要求15所述的耳机盒，其特征在于，所述无线通信模块用于，与无线耳机建立无线连接，具体包括：
    接收来自电子设备的所述无线耳机的通信地址；
    根据所述通信地址与所述无线耳机建立无线连接。
  19. 根据权利要求15所述的耳机盒，其特征在于，所述耳机盒还包括存储模块，所述存储模块用于存储所述无线耳机的通信地址；所述无线通信模块用于，与无线耳机建立无线连接，具体包括：
    在所述耳机盒检测到用户的预设操作或者接收到来自电子设备的连接信息后，根据所述通信地址与所述无线耳机建立无线连接。
  20. 根据权利要求15所述的耳机盒，其特征在于，所述无线连接为蓝牙连接，所述音频模块还包括蓝牙音频编解码模块，所述蓝牙音频编解码模块用于对音频数据进 行编码或解码。
  21. 一种音频处理装置，其特征在于，包括：
    一个或多个处理器；
    存储器；
    以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述音频处理装置执行时，使得所述音频处理装置执行如权利要求1-12中任一项所述的耳机盒执行的音频处理方法。
  22. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在计算机上运行时，使得所述计算机执行如权利要求1-12中任一项所述的耳机盒执行的音频处理方法。
  23. 一种计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如权利要求1-12中任一项所述的耳机盒执行的音频处理方法。
PCT/CN2021/078884 2020-03-17 2021-03-03 一种音频处理方法、装置及*** WO2021185077A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP21772414.5A EP4109922A4 (en) 2020-03-17 2021-03-03 METHOD, APPARATUS AND AUDIO PROCESSING SYSTEM
US17/912,295 US20230147435A1 (en) 2020-03-17 2021-03-03 Audio Processing Method, Apparatus, and System

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010187760.3A CN113411726A (zh) 2020-03-17 2020-03-17 一种音频处理方法、装置及***
CN202010187760.3 2020-03-17

Publications (1)

Publication Number Publication Date
WO2021185077A1 true WO2021185077A1 (zh) 2021-09-23

Family

ID=77677292

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078884 WO2021185077A1 (zh) 2020-03-17 2021-03-03 一种音频处理方法、装置及***

Country Status (4)

Country Link
US (1) US20230147435A1 (zh)
EP (1) EP4109922A4 (zh)
CN (1) CN113411726A (zh)
WO (1) WO2021185077A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023205667A3 (en) * 2022-04-21 2023-11-30 Sony Interactive Entertainment Inc. Audio charging case

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114257916A (zh) * 2022-01-13 2022-03-29 深圳市同力创科技有限公司 可提高收音里程的便携耳机
CN115038021B (zh) * 2022-07-05 2023-04-25 珠海市怒喵科技有限公司 真实无线立体声耳机、音频处理、发光以及震动方法
CN218416600U (zh) * 2022-10-14 2023-01-31 通力科技股份有限公司 电子设备收纳盒及耳戴设备***

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150058910A1 (en) * 2013-08-23 2015-02-26 Kevin Seveur Btv box and method for wireless communication of telvision audio
CN109121033A (zh) * 2018-07-23 2019-01-01 歌尔股份有限公司 蓝牙耳机充电盒和充电盒组件
CN110856066A (zh) * 2019-08-12 2020-02-28 深圳市探寻信息技术有限公司 无线k歌耳机、无线k歌耳机套件

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9191988B2 (en) * 2012-05-26 2015-11-17 Qualcomm Incorporated Smart pairing using bluetooth technology
CN108174457B (zh) * 2018-01-12 2020-09-01 恒玄科技(上海)股份有限公司 充电盒、蓝牙耳机的通信***和通信方法
CN109040446B (zh) * 2018-07-31 2021-07-27 Oppo广东移动通信有限公司 通话处理方法及相关产品

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150058910A1 (en) * 2013-08-23 2015-02-26 Kevin Seveur Btv box and method for wireless communication of telvision audio
CN109121033A (zh) * 2018-07-23 2019-01-01 歌尔股份有限公司 蓝牙耳机充电盒和充电盒组件
CN110856066A (zh) * 2019-08-12 2020-02-28 深圳市探寻信息技术有限公司 无线k歌耳机、无线k歌耳机套件

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023205667A3 (en) * 2022-04-21 2023-11-30 Sony Interactive Entertainment Inc. Audio charging case

Also Published As

Publication number Publication date
EP4109922A1 (en) 2022-12-28
US20230147435A1 (en) 2023-05-11
EP4109922A4 (en) 2023-08-16
CN113411726A (zh) 2021-09-17

Similar Documents

Publication Publication Date Title
WO2021185077A1 (zh) 一种音频处理方法、装置及***
US10809964B2 (en) Portable intelligent voice interactive control device, method and system
WO2019218368A1 (zh) 一种tws耳机、腕带式ai语音交互装置及***
WO2020132839A1 (zh) 应用于tws耳机单双耳切换的音频数据传输方法及设备
WO2020019821A1 (zh) 麦克风堵孔检测方法及相关产品
US20060262949A1 (en) Cable-connectable stereo headset
US11158318B2 (en) AI voice interaction method, device and system
WO2021180083A1 (zh) 蓝牙通信***和无线通信***
US9866947B2 (en) Dual-microphone headset and noise reduction processing method for audio signal in call
JP7442647B2 (ja) ブルートゥース通信方法および装置
WO2020063499A1 (zh) 一种无线耳机
WO2021170061A1 (zh) 无线扩音***及终端
WO2020132907A1 (zh) 一种音频数据的通信方法及电子设备
EP3379843B1 (en) Acoustic system, headphone device, loudspeaker device, and acoustic output method
US20180270557A1 (en) Wireless hearing-aid circumaural headphone
WO2022213689A1 (zh) 一种音频设备间语音互通的方法及设备
WO2020042491A9 (zh) 一种耳机远场交互方法、耳机远场交互配件及无线耳机
CN109120297B (zh) 一种耳机远场交互方法、耳机远场交互配件及无线耳机
CN210403185U (zh) 一种k歌设备
CN217388984U (zh) 一种无线耳机
WO2023184660A1 (zh) 一种沉浸式录音方法及装置
CN218416600U (zh) 电子设备收纳盒及耳戴设备***
CN112804608B (zh) 带助听功能tws耳机的使用方法、***、主机及存储介质
CN115022766B (zh) 音频数据播放方法及设备
TWI837436B (zh) 無線收納裝置及無線傳輸系統

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21772414

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021772414

Country of ref document: EP

Effective date: 20220921

NENP Non-entry into the national phase

Ref country code: DE