CN113965853B - Module device, audio processing method and related device - Google Patents
Module device, audio processing method and related device Download PDFInfo
- Publication number
- CN113965853B CN113965853B CN202111216104.2A CN202111216104A CN113965853B CN 113965853 B CN113965853 B CN 113965853B CN 202111216104 A CN202111216104 A CN 202111216104A CN 113965853 B CN113965853 B CN 113965853B
- Authority
- CN
- China
- Prior art keywords
- audio
- paths
- module
- processing module
- audio processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 238000000034 method Methods 0.000 claims abstract description 20
- 230000001360 synchronised effect Effects 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000001228 spectrum Methods 0.000 claims description 7
- 239000000523 sample Substances 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 3
- 101000893549 Homo sapiens Growth/differentiation factor 15 Proteins 0.000 description 2
- 101000692878 Homo sapiens Regulator of MON1-CCZ1 complex Proteins 0.000 description 2
- 102100026436 Regulator of MON1-CCZ1 complex Human genes 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 102100032912 CD44 antigen Human genes 0.000 description 1
- 102100023691 Coiled-coil-helix-coiled-coil-helix domain-containing protein 5 Human genes 0.000 description 1
- 101000868273 Homo sapiens CD44 antigen Proteins 0.000 description 1
- 101000906987 Homo sapiens Coiled-coil-helix-coiled-coil-helix domain-containing protein 5 Proteins 0.000 description 1
- 101001121074 Homo sapiens MICOS complex subunit MIC13 Proteins 0.000 description 1
- 108010003272 Hyaluronate lyase Proteins 0.000 description 1
- 102100026627 MICOS complex subunit MIC13 Human genes 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The application discloses a module device, an audio processing method, a computer device and a computer readable storage medium, wherein the module device comprises an audio acquisition module, a decoding processing module, an expansion module and an audio processing module; the audio processing module is connected with the expansion module through N paths of audio data lines; the expansion module expands the N paths of audio data lines into N x N paths of audio data lines, and is connected with the decoding processing module; the decoding processing module comprises N N/2 decoders, and every two audio data lines in N N audio data lines are connected with one decoder; the audio acquisition module comprises 2n x N microphones, and each four microphones are connected with a decoder. According to the method and the device, the number of the expansion modules is increased, the number of the microphones is expanded, the device can be free from the limitation of hardware resources, and services in more application scenes are supported.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a module device, an audio processing method, and a related device.
Background
In recent years, microphone MIC has undergone a process from analog to digital, from blurring to sharpness, from simple to complex, and from original simple functions such as recording and playing, multimedia, etc. to now more complex functions such as mixing, noise canceling, etc., and almost covers various industries.
At present, along with the development of industries such as artificial intelligence, intelligent home, intelligent sound box and the like, the effect of MIC is also important, but the existing hardware resources cannot meet the requirements under some more complex working scenes.
In the process of designing and implementing the present application, the inventors found that at least the following problems exist: the device is limited by hardware resources, and cannot meet the requirements of some MIC synchronous working scenes requiring more paths.
The foregoing description is provided for general background information and does not necessarily constitute prior art.
Disclosure of Invention
The application provides a module device, an audio processing method, a computer device and a computer readable storage medium, which can meet the scene requirement of synchronous work of more microphones.
The application provides a module equipment, include: the system comprises an audio acquisition module, a decoding processing module, an expansion module and an audio processing module;
the audio processing module is connected with the expansion module through the N paths of audio data lines;
the expansion module expands the N paths of audio data lines into N x N paths of audio data lines, and the N paths of audio data lines are connected with the decoding processing module, wherein the N and the N are integers larger than 1;
the decoding processing module comprises N N/2 decoders, and every two audio data lines in the N N audio data lines are connected with one decoder;
the audio acquisition module comprises 2n microphones, and every four microphones are connected with one decoder.
Optionally, the audio data line of the audio processing module is an integrated circuit built-in audio bus IIS, where the data line of each IIS is used for transmitting audio data of left and right two channels.
Optionally, the N is the maximum value of the number of paths of the synchronous transmission audio digital signal supported by the audio processing module;
and n is set based on the application scene of the module equipment, and is larger than 1 and smaller than or equal to the maximum value of the main frequency supported by the audio processing module.
Optionally, the expansion module is a field programmable gate array FPGA.
The application also provides an audio processing method applied to audio processing equipment or a module of the audio processing equipment, comprising the following steps:
collecting 2N paths of audio analog signals, wherein N is the number of paths of synchronous transmission audio data signals supported by the audio processing equipment, N is the spread spectrum multiple of an audio data line, and N are integers larger than 1;
decoding the 2n×n channels of audio analog signals to obtain n×n channels of audio digital signals, wherein each channel of audio digital signal corresponds to two channels of audio analog signals of left and right double channels;
and performing audio processing on the N-channel audio digital signals to obtain an audio file.
Optionally, performing audio processing on the n×n audio digital signals to obtain an audio file, including:
compressing the N-channel audio digital signals to obtain N-channel audio digital signals;
inputting the N paths of audio digital signals to an audio processing module, wherein the audio processing module is provided with N paths of audio data lines;
decompressing the N paths of audio digital signals through the audio processing module to obtain 2N-by-N paths of audio analog signals;
and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file.
Optionally, the N is the maximum value of the number of paths of the synchronous transmission audio digital signal supported by the audio processing module;
the n is set based on an application scene of the audio processing device, and is greater than 1 and less than or equal to a maximum value of a main frequency supported by the audio processing device.
The application also provides an audio processing device, comprising:
the acquisition module is used for acquiring 2N times of N paths of audio analog signals, wherein N is the number of paths of synchronous transmission audio data signals supported by the audio processing equipment, and N is the spread spectrum multiple of the audio data line;
the decoding processing module is used for decoding the 2N-channel audio analog signals to obtain N-channel audio digital signals, and each channel of audio digital signals corresponds to two channels of audio analog signals of left and right double channels;
and the audio processing module is used for carrying out audio processing on the N-channel audio digital signals to obtain an audio file.
The present application also provides a computer device comprising: the device comprises a transceiver, a memory and a processor, wherein the transceiver is used for receiving data or transmitting data;
the memory is used for storing a computer program;
the processor is configured to invoke the computer program from the memory to perform the steps of the method described above.
The present application also provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the method as described above.
As described above, a module apparatus of the present application includes an audio acquisition module, a decoding processing module, an expansion module, an audio processing module, and N audio data lines of the audio processing module; n is an integer greater than 1; the audio processing module is connected with the expansion module through N paths of audio data lines; the expansion module expands the N paths of audio data lines into N paths of audio data lines, wherein N is an integer greater than 1; the decoding processing module comprises N/2 decoders, every two audio data lines in the N audio data lines are connected with one decoder, the audio acquisition module comprises 2N microphones, and every four microphones are connected with one decoder. By the mode, the number of the microphones can be expanded without being limited by hardware resources, and the scene requirement of synchronous work of more microphones is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic structural diagram of a module device according to an embodiment of the present application;
FIG. 2 is a schematic view of another modular apparatus disclosed in an embodiment of the present application;
FIG. 3 is a flow chart of an audio processing method according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of an audio processing method according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an audio processing apparatus according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of modules and methods consistent with aspects of the present application as detailed in the accompanying claims.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present application, and are not of specific significance per se. Thus, "module," "component," or "unit" may be used in combination.
The embodiment of the application provides a module device, which can not be limited by hardware resources, expand the number of microphones and meet the scene requirement of synchronous work of more microphones. The embodiment of the application also provides an audio processing method, and the audio processing method can acquire 2N x N paths of audio analog signals for processing by the spread spectrum multiple N of the audio data line under the condition that the number of paths of the audio data signals supported by the audio processing equipment is N, namely, under the condition that hardware resources are limited, so as to obtain an audio file. Embodiments of the present application are described below with reference to the accompanying drawings.
Referring to fig. 1, a schematic structural diagram of a module device according to an embodiment of the present application is provided, where the module device includes an audio processing module 101, an expansion module 102, a decoding processing module 103, and an audio acquisition module 104. The audio processing module 101 is connected with the expansion module 102 through N paths of audio data lines, the expansion module 102 expands the N paths of audio data lines into N x N paths of audio data lines, the N x N paths of audio data lines are connected with the decoding processing module 103, and N and N are integers larger than 1; the decoding processing module 103 includes n×n/2 decoders, where every two audio data lines in n×n audio data lines are connected to one decoder; the audio acquisition module 104 includes 2n Microphones (MIC), wherein every four microphones are connected to one decoder in the decoding processing module 103, for example, MIC1 to MIC4 in the audio acquisition module shown in fig. 1 are connected to the decoder 1 in the decoding processing module 103, and further the decoded audio digital signal is connected to the expansion module 102 through the audio data lines p_d0 and p_d1.
In an alternative embodiment, each audio data line of the audio processing module 101 is an integrated circuit built-in audio bus IIS data line, where each IIS data line may be used to transmit left and right dual-channel audio data, and the audio data may be microphone data collected by a microphone. Each IIS data line may transmit two paths of microphone data simultaneously.
In an alternative embodiment, N is the maximum number of paths for the audio processing module 101 to synchronously transmit the audio digital signal. For example, the audio processing module 101 may have an N-way integrated circuit built-in audio bus IIS data line.
In an alternative embodiment, n is set based on an application scenario of the module device, where n is greater than 1 and less than or equal to a maximum value of the dominant frequency supported by the audio processing module. The number of microphones required by different application scenes is different, for example, intelligent sound boxes or vehicle-mounted equipment, and MICs of more than 10 paths are required to work simultaneously. Assuming that the number of MIC's required for the application scenario of the module device is X, each IIS data line may transmit two paths of microphone data at the same time, then N is equal to X/2N, so that the extension module 102 may extend N paths of audio data lines of the audio processing module 101 into n×n paths of audio data lines, so that X MIC's may be externally hung.
For example, assuming that the module device is applied to an intelligent sound box or a vehicle-mounted device, more than 10 MIC's are required to work simultaneously, and the audio processing module 101 has 4 audio data lines, the number of MIC's can only be 8, which is less than the number of MIC's required, without the extension module 102; the expansion module 102 expands 4 paths of audio data lines into 8 paths of audio data lines through 2 times of frequency multiplication, so that 16 MICs can be hung outside, and the number of the MICs is larger than 10 paths of MICs required by an intelligent sound box or vehicle-mounted equipment.
The maximum value of the main frequency supported by the audio processing module may be equal to the maximum frequency multiplication number of the extension module 102. Alternatively, N is equal to 4, N is equal to 2 or 4. That is, the audio processing module 101 may have 4 audio data lines; the expansion module 102 can perform 2-frequency multiplication or 4-frequency multiplication expansion on the 4-path audio data line to expand 8-path or 16-path audio data line.
Optionally, the expansion module 102 is a field programmable gate array (Field Programmable Gate Array, FPGA).
In the module device described in the embodiment of the present application, the audio processing module 101 is connected to the expansion module 102 through N paths of audio data lines; the expansion module 102 expands the N paths of audio data lines into N x N paths of audio data lines, wherein N is an integer greater than 1; the decoding processing module 103 includes n×n/2 decoders, each two audio data lines of the n×n audio data lines are connected to one decoder, and the audio acquisition module 104 includes 2n×n microphones, each four microphones being connected to one decoder. Therefore, the module equipment can be free from the limitation of hardware resources, the number of the microphones is expanded, and the scene requirement of synchronous work of more microphones is met.
For example, please refer to fig. 2, which is a schematic structural diagram of another module apparatus according to an embodiment of the present application. In the module apparatus shown in fig. 2, assuming that the audio data line is an IIS data line, the extension module is an FPGA, the decoder is a CODEC, N is equal to 4, and in the module apparatus shown in fig. 2, the audio processing module 201 is connected to the extension module 202 through 4 IIS data lines from iis_d0 to iis_d3; n is equal to 2, and the expansion module 202 expands the 4-way IIS data line into 8-way IIS data lines from p_iis_d0 to p_iis_d7 through 2-fold frequency; the decoding module 203 includes 4 CODECs, each two IIS data lines of the 8 IIS data lines are linked with one CODEC, and the audio acquisition module 204 includes 16 microphones MIC, each four MIC being connected with one CODEC. It can be seen that the module device shown in fig. 2 satisfies the scene requirement of synchronous operation of 16 microphones by increasing the number of microphones to 16 by extension in the case that the audio processing module has 4 IIS data lines.
Referring to fig. 3, a flow chart of an audio processing method shown in an embodiment of the present application is shown, where the audio processing method shown in fig. 3 may be applied to an audio processing device or a module of the audio processing device, where the audio processing device may be a portable device such as a smart watch, a mobile phone, a tablet computer, a notebook computer, or a home device such as a smart speaker, a smart television, or an unmanned control device such as an unmanned aerial vehicle, an unmanned automobile, or a robot. As shown in fig. 3, the audio processing method may include, but is not limited to, the following steps:
s201: the audio processing device collects 2n times N paths of audio analog signals.
Wherein N is the number of channels of the synchronous transmission audio data signal supported by the audio processing device, and N is the spread spectrum multiple of the audio data line. N and N are integers greater than 1. The audio processing device can collect 2n paths of audio analog signals through 2n MIC. Optionally, the number of channels of the audio data signal supported by the audio processing device for synchronous transmission is equal to the number of channels of the audio data signal possessed by the audio processing module in the audio processing device.
S202: the audio processing device carries out decoding processing on the 2N-channel audio analog signals to obtain N-channel audio digital signals.
Wherein, each channel of audio digital signal corresponds to two channels of audio analog signals of left and right double channels. Therefore, alternatively, the audio processing apparatus may decode the 2n×n audio analog signals by using n×n/2 decoders to obtain n×n audio digital signals.
S203: the audio processing device performs audio processing on the N-channel audio digital signals to obtain an audio file.
The audio processing may be mixing and eliminating noise of n×n audio digital signals.
Therefore, according to the audio processing method disclosed by the embodiment of the application, under the condition that the number of paths of synchronous transmission audio data signals supported by the audio processing equipment is equal to N, 2N times N paths of audio analog signals are collected and processed to obtain the audio file, so that the scene requirement of synchronous operation of more paths of microphones is met.
In an alternative embodiment, the audio processing device performs audio processing on n×n audio digital signals to obtain an audio file, which may include: compressing N-channel audio digital signals to obtain N-channel audio digital signals; inputting the N paths of audio digital signals to an audio processing module; decompressing the N paths of audio digital signals to obtain 2N paths of audio analog signals; and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file. Therefore, n×n audio digital signals need to be compressed before the audio processing device performs the audio processing operation, so as to obtain N audio digital signals, so that N audio digital signals are conveniently input to the audio processing module through N audio data lines, and correspondingly, the N audio digital signals need to be decompressed before the audio processing module performs the audio mixing or noise canceling processing, so as to obtain 2n×n audio analog signals, thereby realizing the processing of 2n×n audio analog signals under the condition that the audio processing module has N audio data lines.
In an alternative embodiment, in step S201, N is the maximum value of the number of paths of the synchronous transmission audio data signal supported by the audio processing device. n is set based on an application scene in which the terminal device processes audio data, and n is greater than 1 and less than or equal to a maximum value of a main frequency supported by the audio processing device. The number of microphone data to be processed in different application scenes is different, for example, more than 10 paths of microphone data need to be processed in an intelligent sound box or vehicle-mounted equipment. Assuming that the number of microphone data to be processed in an application scene of the terminal device is X, each IIS data line can transmit two paths of microphone data simultaneously, then N is equal to X/2N, so that the terminal device obtains an audio file by decoding, compressing and decompressing 2N X N paths of audio analog signals acquired by 2N X N paths of MIC.
Alternatively, N is equal to 4, N is equal to 2 or 4. That is, the terminal device may have 4 audio data lines; the terminal device can perform 2-frequency multiplication or 4-frequency multiplication expansion on the 4-path audio data line so as to obtain 8-path or 16-path audio data line.
For example, fig. 4 is a schematic diagram of an audio processing method provided in the embodiment of the present application, where the audio processing method shown in fig. 4 is described by taking a module device shown in fig. 2 as an example, that is, it is assumed that the module device shown in fig. 2 is an audio processing device, as shown in fig. 4, the audio processing device collects 16 audio analog signals through 16 microphones, such as MIC1 to MIC16, and decodes the 16 audio analog signals to obtain 8 audio digital signals, and as the audio processing module shown in fig. 2 has 4 audio data lines, the audio processing device needs to compress the 8 audio digital signals into 4 audio digital signals, inputs the 4 audio digital signals into the audio processing module through the 4 audio data lines, and decompresses the 4 audio digital signals through the audio processing module to obtain 16 audio analog signals; further, the 16-channel audio analog signal is processed to obtain an audio file. Therefore, in the audio processing method shown in fig. 4, under the condition that the audio processing module has a limited number of audio data lines, more paths of audio analog signals can be collected and processed to obtain audio files, so that the scene requirement of synchronous work of more paths of microphones can be met.
In an alternative embodiment, n may be greater than 2, i.e. the spreading factor n does not set a maximum limit in the case of hardware support of the modular device. Alternatively, if the hardware of the module device is limited, when n is not equal to a power integer of 2 (e.g., not equal to 2, 4, 8, 16, or 32, etc.), the discarding process may be performed during the data processing, that is, a portion of the audio analog signal is set to be null, so that n is equal to a power integer of 2.
For example, assuming that the module device shown in fig. 2 has a total of 12 MIC operations, i.e. 12 MIC operations need to be externally hung, since the two audio analog signals of the left and right channels correspond to one audio digital signal, the module device shown in fig. 2 needs 6 audio data lines for external connection of 12 MIC, so the expansion module only needs to expand the 4 audio data lines of the audio processing module into 6 audio data lines, that is, n is equal to 1.5. However, as shown in fig. 4, even after the audio analog signals of 12 MIC are compressed, 4 audio data lines are required to be input to the audio processing module, so 16 audio analog signals are required, but the audio analog signals of MIC13 to MIC14 are null, so the expansion module still needs to expand the 4 audio data lines of the audio processing module to 8 channels, i.e., n is equal to 2.
Referring to fig. 5, a schematic structural diagram of an audio processing apparatus according to an embodiment of the present application may be provided in a computer device, where the audio processing apparatus at least includes an acquisition module 501, a decoding processing module 502, and an audio processing module 503, where:
the acquisition module 501 is configured to acquire 2n×n paths of audio analog signals, where N is the number of paths of synchronous transmission audio data signals supported by the audio processing device, N is the spread spectrum multiple of the audio data line, and N are integers greater than 1;
the decoding processing module 502 is configured to perform decoding processing on the 2n×n audio analog signals to obtain n×n audio digital signals, where each audio digital signal corresponds to two audio analog signals of left and right dual channels;
the audio processing module 503 is configured to perform audio processing on the n×n audio digital signals to obtain an audio file.
Optionally, the audio processing module 503 is specifically configured to compress n×n audio digital signals to obtain N audio digital signals;
inputting the N paths of audio digital signals to an audio processing module;
decompressing the N paths of audio digital signals through an audio processing module to obtain 2N x N paths of audio analog signals;
and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file.
In an alternative embodiment, the audio processing module 503 performs audio processing on the n×n audio digital signals to obtain an audio file, which specifically is:
compressing the N-channel audio digital signals to obtain N-channel audio digital signals;
inputting the N paths of audio digital signals to an audio processing module, wherein the audio processing module is provided with N paths of audio data lines;
decompressing the N paths of audio digital signals through the audio processing module to obtain 2N-by-N paths of audio analog signals;
and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file.
In an alternative embodiment, the N is the maximum value of the number of paths of the synchronous transmission audio digital signal supported by the audio processing module;
the n is set based on an application scene of the audio processing device, and is greater than 1 and less than or equal to a maximum value of a main frequency supported by the audio processing device.
In an alternative embodiment, N is equal to 4 and N is equal to 2 or 4.
The application also provides a computer device comprising a transceiver, a memory, and a processor; a transceiver for receiving data, or transmitting data; a memory for storing a computer program; a processor for invoking a computer program to perform the steps of implementing an audio processing method as in any of the embodiments described above.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of an audio processing method of any of the above embodiments.
In the embodiments of the computer device and the computer readable storage medium provided in the present application, all technical features of each embodiment of the foregoing audio processing method are included, and the expansion and explanation contents of the description are substantially the same as those of each embodiment of the foregoing method, which are not repeated herein.
The present embodiments also provide a computer program product comprising computer program code which, when run on a computer, causes the computer to perform the method in the various possible implementations as above.
The embodiments also provide a chip including a memory for storing a computer program and a processor for calling and running the computer program from the memory, so that a device on which the chip is mounted performs the method in the above possible embodiments.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.
The units in the device of the embodiment of the application can be combined, divided and pruned according to actual needs.
In this application, the same or similar term concept, technical solution, and/or application scenario description will generally be described in detail only when first appearing, and when repeated later, for brevity, will not generally be repeated, and when understanding the content of the technical solution of the present application, etc., reference may be made to the previous related detailed description thereof for the same or similar term concept, technical solution, and/or application scenario description, etc., which are not described in detail later.
In this application, the descriptions of the embodiments are focused on, and the details or descriptions of one embodiment may be found in the related descriptions of other embodiments.
The technical features of the technical solutions of the present application may be arbitrarily combined, and for brevity of description, all possible combinations of the technical features in the above embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the present application.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as above, including several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to perform the method of each embodiment of the present application.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable modules. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disks, storage disks, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid State Disk (SSD)), among others.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.
Claims (9)
1. The module equipment is characterized by comprising an audio acquisition module, a decoding processing module, an expansion module and an audio processing module;
the audio processing module is connected with the expansion module through N paths of audio data lines;
the expansion module expands the N paths of audio data lines into N x N paths of audio data lines, and the N paths of audio data lines are connected with the decoding processing module, wherein the N and the N are integers larger than 1;
the decoding processing module comprises N N/2 decoders, and every two audio data lines in the N N audio data lines are connected with one decoder;
the audio acquisition module comprises 2n microphones MIC, and every four microphones are connected with a decoder.
2. The modular apparatus of claim 1, wherein the module is configured to,
the audio data line of the audio processing module is an integrated circuit built-in audio bus IIS data line, wherein each IIS data line is used for transmitting left and right double-channel audio data.
3. The modular device according to claim 1 or 2, wherein,
the N is the maximum value of the number of paths of synchronous transmission audio digital signals supported by the audio processing module;
and n is set based on the application scene of the module equipment, and is larger than 1 and smaller than or equal to the maximum value of the main frequency supported by the audio processing module.
4. The modular device according to claim 1 or 2, wherein,
the expansion module is a Field Programmable Gate Array (FPGA).
5. An audio processing method, applied to an audio processing device or a module of the audio processing device, the method comprising:
collecting 2N paths of audio analog signals, wherein N is the number of paths of synchronous transmission audio data signals supported by the audio processing equipment, N is the spread spectrum multiple of an audio data line, and N are integers larger than 1;
decoding the 2n×n channels of audio analog signals to obtain n×n channels of audio digital signals, wherein each channel of audio digital signal corresponds to two channels of audio analog signals of left and right double channels;
performing audio processing on the N-channel audio digital signals to obtain an audio file;
the audio processing is performed on the n×n audio digital signals to obtain an audio file, which includes:
compressing the N-channel audio digital signals to obtain N-channel audio digital signals;
inputting the N paths of audio digital signals to an audio processing module, wherein the audio processing module is provided with N paths of audio data lines;
decompressing the N paths of audio digital signals through the audio processing module to obtain 2N-by-N paths of audio analog signals;
and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file.
6. The method of claim 5, wherein the step of determining the position of the probe is performed,
the N is the maximum value of the number of paths of synchronous transmission audio digital signals supported by the audio processing module;
the n is set based on an application scene of the audio processing device, and is greater than 1 and less than or equal to a maximum value of a main frequency supported by the audio processing device.
7. An audio processing apparatus, comprising:
the acquisition module is used for acquiring 2N times of N paths of audio analog signals, wherein N is the number of paths of synchronous transmission audio data signals supported by the audio processing device, and N is the spread spectrum multiple of the audio data line;
the decoding processing module is used for decoding the 2N-channel audio analog signals to obtain N-channel audio digital signals, and each channel of audio digital signals corresponds to two channels of audio analog signals of left and right double channels;
the audio processing module is used for carrying out audio processing on the N-channel audio digital signals to obtain an audio file;
the audio processing module performs audio processing on the n×n audio digital signals to obtain an audio file, and includes:
compressing the N-channel audio digital signals to obtain N-channel audio digital signals;
inputting the N paths of audio digital signals to an audio processing module, wherein the audio processing module is provided with N paths of audio data lines;
decompressing the N paths of audio digital signals through the audio processing module to obtain 2N-by-N paths of audio analog signals;
and mixing or denoising the 2 n-channel audio analog signals to obtain an audio file.
8. A computer device comprising a transceiver, a memory, and a processor;
the transceiver is used for receiving data or transmitting data;
the memory is used for storing a computer program;
the processor being operative to invoke the computer program from the memory to perform the method of claim 5 or 6.
9. A computer readable storage medium, characterized in that the storage medium has stored therein a computer program which, when executed by a processor, causes the processor to perform the method according to claim 5 or 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111216104.2A CN113965853B (en) | 2021-10-19 | 2021-10-19 | Module device, audio processing method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111216104.2A CN113965853B (en) | 2021-10-19 | 2021-10-19 | Module device, audio processing method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113965853A CN113965853A (en) | 2022-01-21 |
| CN113965853B true CN113965853B (en) | 2024-01-05 |
Family
ID=79465361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111216104.2A Active CN113965853B (en) | 2021-10-19 | 2021-10-19 | Module device, audio processing method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113965853B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6084950A (en) * | 1999-02-05 | 2000-07-04 | Davox Corporation | Audio communications device adapter |
| JP2005055667A (en) * | 2003-08-04 | 2005-03-03 | Sony Corp | Audio processing device |
| JP2007318521A (en) * | 2006-05-26 | 2007-12-06 | Yamaha Corp | Sound emission/pickup apparatus |
| CN101194435A (en) * | 2005-06-10 | 2008-06-04 | 适应性频谱和信号校正股份有限公司 | Vectored DSL nesting |
| WO2011054592A1 (en) * | 2009-11-09 | 2011-05-12 | Robert Bosch Gmbh | Transmission unit for at least one mobile microphone module and microphone system having said transmission unit |
| CN103813237A (en) * | 2014-02-18 | 2014-05-21 | 厦门亿联网络技术股份有限公司 | Extensible pick-up with mute function and implementing method thereof |
| JP2014120839A (en) * | 2012-12-14 | 2014-06-30 | System In Frontier Inc | Microphone array device |
| JP2014158101A (en) * | 2013-02-14 | 2014-08-28 | Nikon Corp | Electronic apparatus |
| JP2017163466A (en) * | 2016-03-11 | 2017-09-14 | 株式会社リコー | Information processor and conference system |
| KR20170126205A (en) * | 2016-05-09 | 2017-11-17 | 한국해양대학교 산학협력단 | Method and Apparatus for Direction Finding of Marine Digital Sound Receptor using Phase Different |
| CN110085241A (en) * | 2019-04-28 | 2019-08-02 | 北京地平线机器人技术研发有限公司 | Data-encoding scheme, device, computer storage medium and data encoding apparatus |
| CN209994523U (en) * | 2019-08-05 | 2020-01-24 | 深圳市维度创新实业有限公司 | Conference room terminal equipment with multi-microphone array and touch screen control |
| US10652663B1 (en) * | 2019-04-30 | 2020-05-12 | Cisco Technology, Inc. | Endpoint device using the precedence effect to improve echo cancellation performance |
| CN211128154U (en) * | 2019-04-30 | 2020-07-28 | 北京声智科技有限公司 | Microphone array circuit |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4085924B2 (en) * | 2003-08-04 | 2008-05-14 | ソニー株式会社 | Audio processing device |
| US7515721B2 (en) * | 2004-02-09 | 2009-04-07 | Microsoft Corporation | Self-descriptive microphone array |
| JP4066197B2 (en) * | 2005-02-24 | 2008-03-26 | ソニー株式会社 | Microphone device |
| TWI390991B (en) * | 2008-11-05 | 2013-03-21 | Realtek Semiconductor Corp | Audio device and audio processing method |
| US9774949B2 (en) * | 2014-02-28 | 2017-09-26 | Texas Instruments Incorporated | Power control for multichannel signal processing circuit |
| US11510007B2 (en) * | 2020-02-17 | 2022-11-22 | Pra Audio Systems, Inc. | Microphone adapter for wireless audio systems |
-
2021
- 2021-10-19 CN CN202111216104.2A patent/CN113965853B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6084950A (en) * | 1999-02-05 | 2000-07-04 | Davox Corporation | Audio communications device adapter |
| JP2005055667A (en) * | 2003-08-04 | 2005-03-03 | Sony Corp | Audio processing device |
| CN101194435A (en) * | 2005-06-10 | 2008-06-04 | 适应性频谱和信号校正股份有限公司 | Vectored DSL nesting |
| JP2007318521A (en) * | 2006-05-26 | 2007-12-06 | Yamaha Corp | Sound emission/pickup apparatus |
| WO2011054592A1 (en) * | 2009-11-09 | 2011-05-12 | Robert Bosch Gmbh | Transmission unit for at least one mobile microphone module and microphone system having said transmission unit |
| JP2014120839A (en) * | 2012-12-14 | 2014-06-30 | System In Frontier Inc | Microphone array device |
| JP2014158101A (en) * | 2013-02-14 | 2014-08-28 | Nikon Corp | Electronic apparatus |
| CN103813237A (en) * | 2014-02-18 | 2014-05-21 | 厦门亿联网络技术股份有限公司 | Extensible pick-up with mute function and implementing method thereof |
| JP2017163466A (en) * | 2016-03-11 | 2017-09-14 | 株式会社リコー | Information processor and conference system |
| KR20170126205A (en) * | 2016-05-09 | 2017-11-17 | 한국해양대학교 산학협력단 | Method and Apparatus for Direction Finding of Marine Digital Sound Receptor using Phase Different |
| CN110085241A (en) * | 2019-04-28 | 2019-08-02 | 北京地平线机器人技术研发有限公司 | Data-encoding scheme, device, computer storage medium and data encoding apparatus |
| US10652663B1 (en) * | 2019-04-30 | 2020-05-12 | Cisco Technology, Inc. | Endpoint device using the precedence effect to improve echo cancellation performance |
| CN211128154U (en) * | 2019-04-30 | 2020-07-28 | 北京声智科技有限公司 | Microphone array circuit |
| CN209994523U (en) * | 2019-08-05 | 2020-01-24 | 深圳市维度创新实业有限公司 | Conference room terminal equipment with multi-microphone array and touch screen control |
Non-Patent Citations (4)
| Title |
|---|
| Design of Woreless Electronic Stethoscope Based on Zigbee;Ms.Kadan Patik D.D.;《Research Gate》;全文 * |
| F.Jabloun.A multi-microphone signal subspace approach for speech enhancement.《2001 IEEE International Conference on Acoustics ,Speech,and Signal Processing. Proceedings》.2002,全文. * |
| 基于FPGA的多路音频信号采集与传输***;赵兴海;《中国优秀硕士学位论文全文数据库-信息科技辑》;全文 * |
| 车载DSP设计原理及其在车载数字功放中的应用;赖国燕;《电声技术》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113965853A (en) | 2022-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7676374B2 (en) | Low complexity subband-domain filtering in the case of cascaded filter banks | |
| CN108076226B (en) | Method for adjusting call quality, mobile terminal and storage medium | |
| KR102410307B1 (en) | Coded hoa data frame representation taht includes non-differential gain values associated with channel signals of specific ones of the data frames of an hoa data frame representation | |
| CN110648680B (en) | Voice data processing method and device, electronic equipment and readable storage medium | |
| CN109817238A (en) | Audio signal sample device, acoustic signal processing method and device | |
| KR100804640B1 (en) | Subband synthesis filtering method and apparatus | |
| CN107168959A (en) | Interpretation method and translation system | |
| CN112202939A (en) | Method, device and storage medium for compressing and decompressing IP address and transmitting and receiving message | |
| US20220115027A1 (en) | Method and apparatus for decoding a bitstream including encoded higher order ambisonics representations | |
| CN113965853B (en) | Module device, audio processing method and related device | |
| US20160092492A1 (en) | Sharing initial dictionaries and huffman trees between multiple compressed blocks in lz-based compression algorithms | |
| CN106713972A (en) | Integrated broadcast control platform video content screen capturing method and integrated broadcast control platform video content screen capturing device | |
| KR102428425B1 (en) | Method for determining for the compression of an hoa data frame representation a lowest integer number of bits required for representing non-differential gain values | |
| WO2022012628A1 (en) | Multi-channel audio signal encoding/decoding method and device | |
| CN105159638A (en) | Data transmission method, data transmission system and portable display apparatus | |
| CN109286922B (en) | Bluetooth prompt tone processing method, system, readable storage medium and Bluetooth device | |
| EP2860728A1 (en) | Method and apparatus for encoding and for decoding directional side information | |
| CN111145793B (en) | Audio processing method and device | |
| CN113744744B (en) | Audio coding method, device, electronic equipment and storage medium | |
| CN1148004C (en) | Data compression/expansion on plurality of digital information signals | |
| CN112740708B (en) | Audio data transmission method and related device | |
| US20150256964A1 (en) | Virtual bluetooth device | |
| CN115631758B (en) | Audio signal processing method, apparatus, device and storage medium | |
| CN107680607B (en) | Signal compression method, signal decompression method and device thereof | |
| US20240136986A1 (en) | Driving circuit for audio power amplifier and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |