CN111128104B

CN111128104B - Wireless karaoke method, audio device and intelligent terminal

Info

Publication number: CN111128104B
Application number: CN201911370672.0A
Authority: CN
Inventors: 张德明
Original assignee: Beijing Sabine Technologies Ltd
Current assignee: Beijing Sabine Technologies Ltd
Priority date: 2019-12-26
Filing date: 2019-12-26
Publication date: 2022-09-09
Anticipated expiration: 2039-12-26
Also published as: CN111128104A

Abstract

The embodiment of the invention discloses a wireless karaoke method, audio equipment and an intelligent terminal. The method comprises the following steps: the method comprises the steps that a first audio device obtains an audio signal of the intelligent terminal through an A2DP channel, determines a basic audio signal and sends the basic audio signal in an RF mode; the method comprises the steps that first audio equipment acquires a first sound signal, and a first synthesis signal is determined according to the first sound signal and a basic audio signal; and transmitting the first composite signal to the intelligent terminal through an RFCOMM channel. According to the technical scheme provided by the invention, the audio equipment and the intelligent terminal are communicated through the RFCOMM channel, so that the audio signals can be synchronously transmitted by a plurality of audio equipment and the intelligent terminal, high-quality stereo signals can be bidirectionally transmitted, and the application scene of a plurality of people in karaoke is met.

Description

Wireless karaoke method, audio device and intelligent terminal

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a wireless karaoke method, audio equipment and an intelligent terminal.

Background

Along with the development of information technology, various karaoke software suitable for intelligent terminals are also used by more and more users, and are gradually becoming popular personal entertainment modes; when a user uses a mobile phone to song K, a wired microphone earphone needs to be inserted into an intelligent terminal or a microphone and a loudspeaker which are carried by the intelligent terminal are directly used, the user can be restrained by a cable and experiences badly, the user can easily generate echo and whistling to cause the song effect to be poor, and the user can not realize real-time monitoring of human voice, so that the user lacks the sense of presence. In the existing solution, when the wireless karaoke device communicates with the intelligent terminal device through audio signals, only low-quality single-channel 16khz or 8khz signals can be transmitted, or only one-way high-quality audio signals can be provided, and two-way 44.1khz or 48khz high-quality stereo signals cannot be provided. In addition, in the existing solution, only one user can sing by using the wireless microphone at the same time, and the simultaneous singing of multiple users cannot be realized, so that the user experience is poor.

Disclosure of Invention

The embodiment of the invention aims to provide a wireless karaoke method, audio equipment and an intelligent terminal, which are used for solving the technical problem of how to communicate between the audio equipment and the intelligent terminal or between the audio equipment and the audio equipment when the multi-wireless audio equipment is in audio communication with the intelligent terminal.

In order to achieve the above object, the embodiments of the present invention mainly provide the following technical solutions:

in a first aspect, an embodiment of the present invention provides a method for a wireless karaoke method, where the method includes:

the method comprises the steps that a first audio device obtains an audio signal of the intelligent terminal through an A2DP channel, determines a basic audio signal and sends the basic audio signal in an RF mode;

the method comprises the steps that first audio equipment acquires a first sound signal, and a first synthesis signal is determined according to the first sound signal and a basic audio signal;

and transmitting the first composite signal to the intelligent terminal through an RFCOMM channel.

Further, the method also includes:

the second audio equipment acquires a second sound signal;

determining a second synthesized signal according to the second sound signal and the basic audio signal acquired in the RF mode;

and transmitting the second composite signal to the intelligent terminal through an RFCOMM channel.

Further, the method further comprises:

the intelligent terminal acquires a first synthetic signal and a second synthetic signal through an RFCOMM channel;

and combining the first synthesized signal and the second synthesized signal according to the time stamp information of the first synthesized signal and the time stamp information of the second synthesized signal, and determining a third synthesized signal.

Further, the method further comprises:

the intelligent terminal acquires a third sound signal;

and combining the third synthesized signal and the third sound signal according to the time stamp information of the third synthesized signal and the time stamp information of the third sound signal, and determining a fourth synthesized signal.

Further, the method also includes:

the intelligent terminal acquires an image signal;

and combining the third synthetic signal and the image signal according to the time stamp information of the third synthetic signal and the time stamp information of the image signal, and determining a fifth synthetic signal.

Further, the method further comprises:

the intelligent terminal determines the first audio equipment according to the sequence of the Bluetooth connection established by the audio equipment or the indication information.

Further, transmitting the basic audio signal by an RF method includes:

transmitting the base audio signal over one or more of:

UHF frequency band, 2.4GHz frequency band and 5.8GHz frequency band.

Further, the audio device acquires the sound signal, and comprises one or more of the following sound effect processing:

changing the sound wave parameters of the sound signal, adding or subtracting the sound wave of the sound signal to or from the specified sound wave.

Further, the method further comprises:

performing howling prevention processing and playing an audio signal;

wherein the anti-howling process comprises: one or more of frequency shift method, wave trap method and adaptive filtering method.

In a second aspect, an embodiment of the present invention further provides an audio device, where the apparatus includes: an audio processing unit, an RFCOMM unit, an RF unit, wherein,

the audio processing unit is used for acquiring an audio signal of the intelligent terminal through an A2DP channel and determining a basic audio signal; acquiring a first sound signal, and determining a first synthetic signal according to the first sound signal and a basic audio signal;

the RFCOMM unit is used for sending a first synthesized signal to the intelligent terminal through an RFCOMM channel;

the RF unit is used for transmitting or acquiring a basic audio signal in an RF mode.

Further, transmitting the basic audio signal by an RF method includes:

transmitting the base audio signal over one or more of:

UHF frequency band, 2.4GHz frequency band and 5.8GHz frequency band.

Further, the audio device further comprises an effect processing unit for,

processing sound effects of one or more of the following:

changing the sound wave parameter of the first sound signal, adding or subtracting the sound wave of the first sound signal and the specified sound wave.

Further, the audio apparatus further includes a speaker unit for,

performing howling prevention processing and playing an audio signal;

In a third aspect, an embodiment of the present invention further provides an intelligent terminal, where the intelligent terminal includes: an A2DP unit, an RFCOMM unit, an audio processing unit, wherein,

the A2DP unit is used for transmitting audio signals through an A2DP channel;

the RFCOMM unit is used for acquiring a first synthetic signal of first audio equipment and a second synthetic signal of second audio equipment through an RFCOMM channel;

the audio processing unit is configured to combine the first synthesized signal and the second synthesized signal according to the timestamp information of the first synthesized signal and the timestamp information of the second synthesized signal, and determine a third synthesized signal.

Further, the RFCOMM unit is also used for,

and determining the first audio equipment according to the sequence of the audio equipment for establishing the Bluetooth connection or the indication information.

Further, the audio processing unit is also adapted to,

acquiring a third sound signal;

Further, the audio processing unit is further configured to:

acquiring an image signal;

The technical scheme provided by the embodiment of the invention at least has the following advantages:

1. the synchronous transmission of a plurality of audio devices and the intelligent terminal can be realized, and the application scene of multiple people playing songs K at the same time is met.

2. The audio device and the intelligent terminal are communicated through an RFCOMM channel, and high-quality stereo signals can be transmitted in two directions of 44.1khz or 48 khz.

3. The audio devices are communicated in an RF mode, so that low-delay audio signal transmission can be realized, and the problem that multiple devices need synchronous signals when multiple people simultaneously song K is solved.

Drawings

Fig. 1 is a flowchart of a wireless karaoke method according to embodiment 1 of the present invention.

Fig. 2 is a schematic diagram of signal transmission provided in embodiment 1 of the present invention.

Fig. 3 is a schematic structural diagram of an audio device according to embodiment 2 of the present invention.

Fig. 4 is a schematic structural diagram of an intelligent terminal provided in embodiment 3 of the present invention.

Detailed Description

The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure.

In the following description, for purposes of explanation rather than limitation, specific details are set forth such as the particular system architecture, interfaces, techniques, etc., in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

Hereinafter, a wireless karaoke method will be described in detail, which uses many application scenarios, in this embodiment, only a scenario of karaoke by multiple persons is taken as an example for description, as shown in fig. 1, the method includes the following steps:

step 110: the method comprises the steps that a first audio device obtains an audio signal of the intelligent terminal through an A2DP channel, determines a basic audio signal and sends the basic audio signal in an RF mode; the method comprises the steps that first audio equipment acquires a first sound signal, and a first synthesis signal is determined according to the first sound signal and a basic audio signal; and transmitting the first composite signal to the intelligent terminal through an RFCOMM channel.

For example, as shown in fig. 2, after the master microphone 001 and the slave microphone 002 respectively establish bluetooth connections with the mobile phone 000, the master microphone 001 acquires an A2DP audio signal of the mobile phone 000 through an A2DP channel, determines whether the audio signal is an accompaniment signal, and performs vocal cancellation processing if the audio signal is not the accompaniment signal, so as to obtain the accompaniment signal; if the accompaniment signal is a short frame coded signal, for example, a frame of no more than 5 ms, the accompaniment signal is transmitted to the slave microphone 002 through the RF method. Alternatively, the slave microphone 002 may be plural. The main microphone 001 acquires a first vocal signal of the user, and fuses the first vocal signal with the accompaniment signal. The two signals can be aligned according to the timestamp information of the first vocal signal and the accompaniment signal, so that the two signals can be synchronized, similarly, the method for synthesizing other signals in the patent can refer to the method, and the method is not repeated hereinafter. A first singing signal of 44.1khz or 48khz high quality stereo sound is formed and transmitted to the handset 000 over the RFCOMM channel.

Optionally, before step 120, a step of the audio device establishing a bluetooth connection with the intelligent terminal is further included: the intelligent terminal determines the first audio equipment according to the sequence of the Bluetooth connection established by the audio equipment or the indication information.

For example, as shown in fig. 2, a plurality of microphones and a mobile phone 000 are paired through bluetooth, and the mobile phone 000 records the sequence of successfully establishing an RFCOMM channel SOCKET connection between each microphone and the mobile phone 000, and records identity information, an RF communication address, and frequency information of each microphone. According to the selection of the user, determining which microphone is the main microphone 001 and which is the auxiliary microphone 002; if the user does not select, the last microphone successfully establishing the bluetooth connection with the mobile phone 000 is marked as the master microphone 001, and the other microphones are marked as the slave microphones 002. The master microphone 001 and the slave microphone 002 can be paired quickly according to the microphone identity information, the RF communication address and the frequency information recorded in the mobile phone 000, thereby realizing transmission of the accompaniment signal in an RF manner.

Optionally, the base audio signal is transmitted between the master microphone 001 and the slave microphone 002 by way of RF in one or more of the following manners: UHF frequency band, 2.4GHz frequency band and 5.8GHz frequency band. The audio equipment is communicated in an RF mode, and compared with other connection modes of Bluetooth or WIFI, the delay is lower and more controllable.

Optionally, the audio device acquires a sound signal, comprising: changing a sound wave parameter of the sound signal; and/or adding or subtracting sound waves of the sound signal and the specified sound waves. For example, after the main microphone 001 acquires the voice signal, or the voice signal and the accompaniment signal are fused to form the first singing signal, one or more sound effect processes may be performed, including but not limited to: reverberation, transposition, modifying one or more parts of the music, equalization, mixing, etc. Wherein modifying one or more sounds in the music includes, but is not limited to: eliminate the original singing and guitar sound. In addition, sound effect processing can also be performed on the smart terminal side.

Optionally, the audio device further comprises: and playing the audio signal and performing anti-howling processing. The howling prevention processing comprises the following steps: frequency shift method, wave trap method, adaptive filtering method.

For example, microphone 001 or microphone 002 may configure the speaker unit to play one or more of the following signals: the accompanying music, the voice signal collected by the microphone, and the singing signal synthesized by the voice signal and the accompanying signal. In order to prevent howling between microphone sound pickup and the loudspeaker system, the howling prevention processing can be carried out while playing the audio signal. For example, the anti-howling processing is performed by one or more of a frequency shift method, a filter trap method, and an adaptive filtering method. The frequency shift method comprises the following steps: shifting high frequencies in the mixed sound signal to middle and low frequencies through a frequency shifter, for example, shifting frequencies less than 10 hz; the wave trap method comprises: calculating a microphone signal frequency spectrum in real time, and filtering a frequency point with gain reaching a peak value through a trap filter; the adaptive filtering method includes: and (3) adaptively estimating acoustic loops of the loudspeaker returning to the microphone by using an adaptive filter based on minimum mean square error and the like, and adaptively eliminating the acoustic loops to achieve howling suppression.

Step 120: the second audio equipment acquires a second sound signal; determining a second synthesized signal according to the second sound signal and the basic audio signal acquired in the RF mode; and transmitting the second composite signal to the intelligent terminal through the RFCOMM channel.

For example, as shown in fig. 2, a second vocal signal is acquired from the microphone 002, the accompaniment signal transmitted from the main microphone 001 is acquired by RF, the second vocal signal is fused with the accompaniment signal to form a second singing signal of 44.1khz or 48khz high-quality stereo, and the second singing signal is transmitted to the mobile phone 000 through the RFCOMM channel.

In addition, similarly to step 110, the microphone 002 may also perform sound processing, audio signal playing and howling prevention processing, which is not described herein again.

Step 130: the intelligent terminal acquires a first synthetic signal and a second synthetic signal through an RFCOMM channel; and combining the first synthesized signal and the second synthesized signal according to the time stamp information of the first synthesized signal and the time stamp information of the second synthesized signal, and determining a third synthesized signal.

For example, as shown in fig. 2, after the mobile phone 000 acquires the first singing signal of the main microphone 001 and the second singing signal of the sub-microphone 002, in order to achieve synchronization of the two singing signals, time stamp information is acquired from a packet of the first singing signal or the second singing signal, and the first singing signal and the second singing signal are combined according to the time stamp information to achieve synchronization of audio signals, thereby forming a singing signal with voice of multiple persons. The signal is played or recorded on the mobile phone 000, and may also be sent to a server to be shared with other devices, systems or platforms.

Optionally, step 130 may further comprise the step of further synthesizing other audio signals:

the intelligent terminal acquires a third sound signal;

For example, the voice of the user on the mobile phone side is acquired by the microphone of the mobile phone 000, and the voice is merged with the singing signals acquired from the microphone 001 and the microphone 002, so that the signals are synchronized according to the time stamp information of the singing signal and the time stamp information of the user voice acquired by the mobile phone 000, and a song containing voices of a plurality of people can be formed and played or recorded on the mobile phone 000. In addition, the synthesized signal can be sent to a server or other terminals, and then social sharing of multiple devices and multiple platforms is achieved.

Optionally, step 130 may further comprise the step of further synthesizing the video signal:

the intelligent terminal acquires an image signal;

Video signals are acquired through a camera of the mobile phone 000, the video is fused with song signals acquired from the microphone 001 and the microphone 002, signal synchronization is achieved according to time stamp information of the song signals and time stamp information of the video signals acquired by the mobile phone 00, and videos containing multiple persons singing can be formed and played or recorded on the mobile phone 000. In addition, the songs and videos can be sent to a server or other terminals, so that social sharing of multiple devices and multiple platforms is achieved, for example, a live broadcast function is achieved.

In addition, similarly to step 110, the mobile phone 000 may also perform sound processing, which is not described herein again.

Corresponding to the foregoing embodiment 1, embodiment 2 of the present invention further provides an audio device, specifically as shown in fig. 3, the apparatus includes: an audio processing unit 202, an RFCOMM unit 201, an RF unit 203, wherein,

the audio processing unit 202 is configured to obtain an audio signal of the intelligent terminal through an A2DP channel, and determine a basic audio signal; acquiring a first sound signal, and determining a first synthetic signal according to the first sound signal and a basic audio signal;

the RFCOMM unit 201 is configured to send a first synthesized signal to the intelligent terminal through an RFCOMM channel;

the RF unit 203 is configured to transmit or acquire a base audio signal by an RF method.

Optionally, the transmitting the basic audio signal by RF includes:

transmitting the base audio signal over one or more of:

UHF frequency band, 2.4GHz frequency band and 5.8GHz frequency band.

Optionally, the audio device further comprises an acoustics processing unit for,

processing sound effects of one or more of the following:

Optionally, the audio device further comprises a speaker unit for,

performing howling prevention processing and playing an audio signal;

wherein the anti-howling process comprises: frequency shift method, wave trap method, adaptive filtering method.

Corresponding to the foregoing embodiment 1, embodiment 3 of the present invention further provides an intelligent terminal, and specifically as shown in fig. 4, the intelligent terminal includes: a2DP unit 301, audio processing unit 302, RFCOMM unit 303, wherein,

the A2DP unit 301 is used to transmit audio signals over the A2DP channel.

The RFCOMM unit 303 is configured to obtain a first synthesized signal of a first audio device and a second synthesized signal of a second audio device through an RFCOMM channel;

the audio processing unit 302 is configured to combine the first synthesized signal and the second synthesized signal according to the timestamp information of the first synthesized signal and the timestamp information of the second synthesized signal, and determine a third synthesized signal.

Further, the RFCOMM unit is also used for,

Further, the audio processing unit is also adapted to,

acquiring a third sound signal;

Further, the audio processing unit is further configured to:

acquiring an image signal;

and combining the third composite signal and the image signal according to the time stamp information of the third composite signal and the time stamp information of the image signal to determine a fifth composite signal.

In an embodiment of the present invention, the processor may be an integrated circuit chip having signal processing capability. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, discrete hardware component.

The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The processor reads the information in the storage medium and completes the steps of the method in combination with the hardware.

The storage medium may be a memory, for example, which may be volatile memory or nonvolatile memory, or which may include both volatile and nonvolatile memory.

The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory.

The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), SLDRAM (SLDRAM), and Direct Rambus RAM (DRRAM).

The storage media described in connection with the embodiments of the invention are intended to comprise, without being limited to, these and any other suitable types of memory.

Those skilled in the art will appreciate that the functionality described in the present invention may be implemented in a combination of hardware and software in one or more of the examples described above. When software is applied, the corresponding functionality may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.

Claims

1. A wireless karaoke method, comprising:

the method comprises the steps that a first audio device obtains an audio signal of the intelligent terminal through an A2DP channel, determines a basic audio signal and sends the basic audio signal to a second audio device in an RF mode;

the first audio equipment acquires a first sound signal, and aligns the first sound signal and the basic audio signal according to the time stamp information of the first sound signal and the basic audio signal, and a first synthesized signal is obtained by fusion;

the second audio equipment acquires a second sound signal; aligning the two signals according to the second sound signal and the timestamp information of the basic audio signal from the first audio equipment acquired in an RF mode, and fusing to obtain a second synthesized signal;

the first audio equipment sends the first synthesized signal to the intelligent terminal through an RFCOMM channel; the second audio equipment sends the second synthesized signal to the intelligent terminal through an RFCOMM channel;

the intelligent terminal acquires the first synthesized signal and the second synthesized signal through an RFCOMM channel; and combining the first synthesized signal and the second synthesized signal according to the time stamp information of the first synthesized signal and the time stamp information of the second synthesized signal, and determining a third synthesized signal.

2. The wireless karaoke method of claim 1, further comprising:

the intelligent terminal acquires a third sound signal;

and combining the third synthetic signal and the third sound signal according to the timestamp information of the third synthetic signal and the timestamp information of the third sound signal, and determining a fourth synthetic signal.

3. The wireless karaoke method as claimed in claim 2, further comprising:

the intelligent terminal acquires an image signal;

4. The wireless karaoke method as claimed in claim 1, further comprising:

and the intelligent terminal determines the first audio equipment according to the sequence or the indication information of the Bluetooth connection established by the audio equipment.

5. The wireless karaoke method according to claim 1, wherein the transmitting the basic audio signal through an RF manner comprises:

transmitting the base audio signal over one or more of:

UHF frequency band, 2.4GHz frequency band and 5.8GHz frequency band.

6. The wireless karaoke method as claimed in claim 1, wherein the audio device acquires the sound signal and comprises one or more of the following sound effect processing:

7. The wireless karaoke method of claim 1, further comprising:

performing anti-howling processing and playing an audio signal;