CN111432384B - Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function - Google Patents
Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function Download PDFInfo
- Publication number
- CN111432384B CN111432384B CN202010193028.7A CN202010193028A CN111432384B CN 111432384 B CN111432384 B CN 111432384B CN 202010193028 A CN202010193028 A CN 202010193028A CN 111432384 B CN111432384 B CN 111432384B
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- bluetooth
- array
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 90
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000004590 computer program Methods 0.000 claims abstract description 20
- 230000006835 compression Effects 0.000 claims abstract description 17
- 238000007906 compression Methods 0.000 claims abstract description 17
- 230000006870 function Effects 0.000 claims description 40
- 238000012545 processing Methods 0.000 claims description 37
- 238000009432 framing Methods 0.000 claims description 13
- 239000000725 suspension Substances 0.000 claims description 3
- 238000005457 optimization Methods 0.000 abstract description 3
- 238000009825 accumulation Methods 0.000 abstract description 2
- 239000013589 supplement Substances 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 8
- 239000000047 product Substances 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000013461 design Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 125000004122 cyclic group Chemical group 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000013518 transcription Methods 0.000 description 1
- 230000035897 transcription Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
- H04W28/065—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information using assembly or disassembly of packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/10—Flow control between communication endpoints
- H04W28/14—Flow control between communication endpoints using intermediate storage
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Mobile Radio Communication Systems (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a method, a device and equipment for transmitting large-data-volume audio Bluetooth in real time for equipment with a recording function, and correspondingly provides a computer readable storage medium and a computer program product. The invention is characterized in that from the perspective of audio transmission, audio with large data volume is segmented according to the limitation of Bluetooth transmission and the data format, the data accumulation degree is examined based on the compression ratio in a staged manner, and further, the follow-up operations of waiting for continuous data supplement or taking a certain amount of data for coding, transmission and the like are adopted, so that the mode is circularly reciprocated, and the data distribution optimization is carried out on the Bluetooth transmission layer, thereby being capable of effectively adapting to the requirements of specific equipment and scenes for the real-time transmission of audio with large data volume.
Description
Technical Field
The present invention relates to the field of data transmission technologies, and in particular, to a method, an apparatus, and a device for transmitting large data volume audio bluetooth in real time for a device having a recording function.
Background
At present, bluetooth transmission mainly aims at data with small data volume or non-real-time transmission, such as instruction transmission of a demonstrator, data interaction of an intelligent terminal and a PC, and the like.
In view of the continuous expansion of application scenes and corresponding extended service demands, the existing bluetooth transmission technology cannot be well adapted to the requirements of certain specific tasks, for example, but not limited to, certain meeting occasions need to synchronize continuous large-amount voice data recorded in real time to a slave end or a computing platform for online storage, recognition and transcription or delay-free translation, however, no targeted scheme for real-time large-data audio transmission by a device with a recording function through bluetooth is currently available.
Disclosure of Invention
The invention aims to provide a method, a device and equipment for transmitting audio data with large data volume in real time for equipment with a recording function, and correspondingly provides a computer readable storage medium and a computer program product, so that the transmission of the audio data with large data volume in real time in specific equipment and application scenes by Bluetooth technology can be realized.
The technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides a method for transmitting audio bluetooth with large data volume in real time for a device having a recording function, including:
recording audio data in real time;
continuously adding each received frame of audio data into an array created based on a preset compression ratio; each frame of audio data is obtained by framing received continuous audio according to the limit value of Bluetooth cache and the data format;
continuously checking whether the array achieves a preset data amount;
if not, suspending Bluetooth transmission to the rear end, and continuing to wait for the addition of the front end data;
if the data is reached, audio data with preset data quantity is taken for encoding, and Bluetooth transmission is carried out to the rear end.
In one possible implementation manner, the method further includes: after the audio data is taken and encoded, the array is subjected to byte reference processing.
In one possible implementation manner, the continuously adding each received frame of audio data to the array created based on the preset compression ratio specifically includes:
receiving audio data input by the front end in real time according to a preset time period;
storing the audio data acquired in each time period into the array;
audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the checking whether the array reaches a preset data amount includes:
according to a preset time interval, checking whether the array reaches a preset data amount or not at regular time;
and, the larger each frame of audio data obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
In a second aspect, the present invention provides a large data volume audio bluetooth real-time transmission apparatus for a device having a recording function, including:
the front-end recording module is used for recording the audio data in real time;
the array creation module is used for creating an array based on a preset compression ratio;
the data adding module is used for continuously adding each received frame of audio data into the array; each frame of audio data is obtained by framing received continuous audio according to the limit value of Bluetooth cache and the data format;
the data processing module comprises a data quantity checking unit, a pause unit and a code transmission unit;
the data volume checking unit is used for continuously checking whether the array achieves a preset data volume;
the suspension unit is used for suspending Bluetooth transmission to the rear end when the data quantity checking unit outputs no, and continuing to wait for the addition of the front end data;
and the coding transmission unit is used for taking audio data of preset data quantity to code when the data quantity checking unit outputs yes, and transmitting Bluetooth to the rear end.
In one possible implementation manner, the apparatus further includes: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is taken and encoded.
In one possible implementation manner, the data adding module is specifically configured to receive audio data collected in real time by the front end according to a preset time period; storing the audio data acquired in each time period into the array; audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the data amount checking unit is specifically configured to check, at regular intervals, whether the array reaches a preset data amount; and, the larger each frame of audio data obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
In a third aspect, the present invention provides a device having a recording function, comprising:
one or more processors, a memory, and one or more computer programs, the memory may employ a non-volatile storage medium, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the device, cause the device to perform the method as in the first aspect or any of the possible implementations of the first aspect.
In a fourth aspect, the present invention provides a computer readable storage medium having stored therein a computer program which when run on a computer causes the computer to perform the method as in the first aspect or any of the possible implementations of the first aspect.
In a fifth aspect, the invention also provides a computer program product for performing the method of the first aspect or any of the possible implementations of the first aspect, when the computer program product is executed by a computer.
In a possible design of the fifth aspect, the relevant program related to the product may be stored in whole or in part on a memory packaged with the processor, or may be stored in part or in whole on a storage medium not packaged with the processor.
The invention is characterized in that when the audio data with large data volume can not be transmitted in real time through Bluetooth, the constraint of a system layer is removed, the adjustment and the adaptation of the Bluetooth technology are avoided, the improvement schemes of the aspects are provided from the angle of audio transmission, particularly, the audio with large data volume is segmented according to the limitation of Bluetooth transmission and the data format, the data accumulation degree is examined based on the compression ratio in a staged manner, further, the follow-up operations of waiting for continuing to supplement data or taking a certain amount of data for coding, transmission and the like are adopted, the mode is cycled and repeated, and the data distribution optimization is carried out on the Bluetooth transmission layer, so that the invention can effectively adapt to the requirement of specific equipment and scenes for real-time transmission of the audio data with large data volume.
Drawings
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described with reference to the accompanying drawings, in which:
fig. 1 is a flowchart of an embodiment of a method for audio bluetooth real-time transmission of large data volume for a device with recording function according to the present invention;
fig. 2 is a block diagram of an embodiment of a large data volume audio bluetooth real-time transmission apparatus for a device with a recording function according to the present invention;
fig. 3 is a schematic diagram of an embodiment of a device with recording function provided by the present invention.
Detailed Description
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the invention.
Before the technical scheme of the invention is described, the following description is also needed:
firstly, the design of the invention initially has pertinence of related equipment and application environment, firstly (1) the process of continuously recording audio and transmitting the audio in real time is related, and the process of receiving and transmitting audio data from a front end, receiving and transmitting the audio data from the front end and receiving and storing the audio data from the front end to the terminal is required to be in a non-offline flowing state; secondly (2) the requirement of large-scale data transmission is further determined, namely the pertinence of the invention, namely the audio data involved in the technology implementation process is determined by the voice content not to be a small amount of data, in other words, the invention is more applicable to scenes containing a large amount of speaking content, such as conferences, news, classes, lectures and the like; moreover, (3) regarding transmission based on bluetooth technology, the present invention does not consider the scenario of long-distance wireless transmission such as WIFI, 4G/5G, etc., but rather designs a scheme for short-distance wireless transmission between devices and platforms in the specific scenario, of course, those skilled in the art can understand that the short-distance wireless transmission means not only includes bluetooth, but also can use the existing wireless 2.4G as a transmission medium, but is limited by the wireless 2.4G transmission rate, and after exceeding a certain distance, stability and consistency of audio transmission cannot be guaranteed, so that it is difficult to make audio data achieve near lossless requirements, according to which the present invention combines the foregoing audio real-time transmission and a large number of application environments, and defines that the transmission medium between the front end, slave end, terminal, etc. adopts bluetooth technology, and further provides a later introduced executable implementation scheme specifically for the transmission layer of bluetooth (hereinafter mentioned, in actual operation, the present invention can be applied to relatively complete and stable latest bluetooth low-power consumption bluetooth protocol, so that not only can be adapted to a far transmission distance, but also due to the characteristics of BLE, so that the low power consumption bluetooth protocol is generated in each end device; finally, (4) regarding the equipment, in view of the technical requirements of the application environment and the like, the equipment has specificity, has a generalized recording function on one hand, has a Bluetooth receiving and transmitting function on the other hand, and is suitable for speaking a large amount of contents in places such as conferences, lectures, interviews and the like by users; meanwhile, the device also needs to transmit the speaking content to the back end in real time so as to obtain an online processing effect, namely the device can not have strong operation capability and medium, and can synchronize a large amount of input audio data to a platform with reliable and strong operation capability at the back end for complex processing only by carrying out necessary and relatively simple processing and by the characteristic of real-time transmission; based on the foregoing, the present invention is more preferably directed to a device product that is relatively small in size, is convenient for a speaker to carry about, and is suitable for use in the aforementioned scene environment, such as, but not limited to, a portable recorder, a headset, a portable microphone, a slide presenter with a sound pickup unit and a bluetooth module, a manuscript page turner, a laser stylus, etc., further, the device may be a single-ended product directly associated with a computing platform, or may be a multi-ended product (such as, for example, a, the device itself is divided into a master end and a slave end, and is transmitted from the master end to the slave end through bluetooth, and is then transmitted with the computing platform through a preset medium), or b, may be a device used in one or more stages in a transmission chain, where the "having a recording function" in such a product scene may mean that a device in the first stage has an audio pickup function, and each device in the middle stage has at least a function of audio input by a front-end device.
Secondly, the specific technical problems mentioned in the background art can avoid the more complex processing thought, namely, the whole running system or the Bluetooth technology itself is not required to be improved, but the dilemma can be broken through only by making a simple and easy way from the data transmission layer, in other words, the invention considers that the Bluetooth cannot well transmit data with large data quantity in real time and is also related to the data distribution of the Bluetooth transmission, so that on the premise of the technical context, the following optimization embodiments for the data distribution of the transmission stage are provided. At least one data transmission scenario suitable for the present invention is described, where a device with a pickup device such as a microphone collects a lot of continuous voice information of a device user in real time, and performs audio encoding on the device through an MTK chip, and then sends the encoded audio data packet to a first BLE bluetooth module, where the first BLE bluetooth module sends the data packet to a second BLE bluetooth module after receiving the data packet, and the second BLE bluetooth module sends the data to a GD chip of a slave terminal or a computing platform such as a PC for storage, decoding, and identification. The service requirement can be realized based on an RTOS system, and two BLE Bluetooth modules are adopted for carrying out staged data transmission, namely the specific scene relates to a multi-platform module, so that the data transmission processing of multiple flow stages in the transmission process is realized. Of course, it will be appreciated by those skilled in the art that this scenario is merely illustrative and not limiting, and that the present invention is directed to a data allocation processing strategy that may be adapted in a similar manner to the bluetooth transmission stage described above, i.e. to direct the manner in which data is transmitted in various flow stages of the scenario described above.
Specifically, the present invention provides an embodiment of a method for transmitting audio bluetooth with large data volume in real time for a device with recording function, as shown in fig. 1, which may include:
s0, real-time recording of audio data;
as described above, the present invention is not limited to a specific device object, but it is clear that the device has a recording function, and in actual operation, the device necessarily has a recording part, for example, but not limited to, a microphone array, etc.; in particular, for the application scenario considered by the present invention, the audio data picked up by the recording unit may be a stream-like state that is accompanied by the speaking progress of the user of the device, presenting a continuous recording process and real-time transmission with the recording.
Step S1, creating an array based on a preset compression ratio;
the method for guiding the real-time transmission of a large amount of audio data through Bluetooth is provided in the present invention, and it should be noted that the following transmission method may not be limited to only local devices, and the following transmission strategy may be applied to any stage when the application scenario requires multi-stage real-time transmission of Bluetooth between multiple devices and multiple platforms. Returning to at least one specific implementation of the array creation mentioned in this step, for example, but not limited to, for PCM format audio, especially for the scene of applying ADPCM, in order to ensure better sound quality, the preset maximum compression ratio may be 4, then n× 4*2 (binaural), i.e. n×8 static arrays may be constructed in advance in an algorithm such as an MTK chip, where N is the size of each data frame, as will be described in detail later.
Step S2, continuously adding each frame of received audio data into the array, wherein each frame of audio data is obtained by framing the received continuous audio according to the limit value of a Bluetooth cache and a data format;
three points are needed to be specifically developed:
first, as previously described, the custom array may be pre-manufactured in advance, i.e., the operations to create the array may not be included in the processing phase of the real-time synchronous transmission. The present invention is not limited to the above-mentioned embodiments, and the custom array may be created in near real time based on data objects dynamically during the process of picking up audio and transmitting audio, that is, the process of creating an array for a specific device type, data format, etc. and the process of adding the front-end real-time picked-up audio to the array may occur simultaneously after the real-time recording of audio.
Secondly, the invention is to distribute guidance for real-time transmission of audio data with large data volume, so that the thought considers how to segment a large amount of input audio data under the premise of guaranteeing tone quality and timeliness, namely, each segmented frame of audio cannot lose information and cannot cause influence on transmission speed, accordingly, the basis of segmenting the input audio is to ensure that the limit value of Bluetooth cache is reached under the premise of knowing the data format, the data can be lost when the limit value is exceeded, and the output quantity is smaller when the limit value is not exceeded, so that delay is generated in the transmission speed. Taking an application scenario involving ADPCM format audio and BLE bluetooth as an example, the size of each frame N can be generally understood as a length of a BLE transmission message minus 7, which is specifically explained as follows: for example, BLE bluetooth 4.0 has a buffer limit of 170, since 2 bytes occupy before and after the message and the data starts from 0, while the binaural ADPCM has an 8-byte header, n=170-2-8+1=161; and the buffer limit for BLE bluetooth 2.0 is 20, then correspondingly n=11.
And thirdly, when data are specifically stored, the audio data input by the front end in real time can be received according to a preset time period, the audio data acquired in each time period are stored in the array, and the continuous data addition to the array is realized in the mode. For example, every 20ms, the audio is received from the front end and interrupted, and the audio received this time is stored in the array.
Step S3, continuously checking whether the array achieves a preset data size;
this data amount may be preset as a threshold for continuing the post-processing based on the actual requirements of the scene, for example, may be preferably set based on the compression ratio, and as described in the foregoing, it may be checked whether the array accumulates a data amount greater than or equal to n×4.
It should be noted that, as used herein, the continuous checking refers to a global cyclic checking state, and in actual operation, a time interval for each round of checking may be specifically designed for this checking step, that is, whether the array reaches a preset data amount is checked at regular time according to a preset time interval, where the time interval is obviously related to the size of a data frame, that is, the larger each frame of audio data obtained by framing, the smaller the time interval.
Continuing the foregoing, there are necessarily at least two possibilities to check the amount of accumulated data in the array:
(1) If the preset data amount is not reached, step S4 in fig. 1 is executed to suspend bluetooth transmission to the back end, and continue waiting for the front end data addition. That is, the front end waits for the array to be additionally complemented without performing subsequent processing operation.
(2) When the preset data amount is reached, step S5 in fig. 1 is executed, the audio data of the preset data amount is taken for encoding, and bluetooth transmission is performed to the back end. Based on the previous example, after reaching, the audio data of n×4 can be extracted from the array for encoding, and transmitted and decoded to the back end by using a separate Block. Each Block of, for example, dual channel ADPCM audio would be output back with an 8 byte header.
In summary, the present invention proposes the above embodiments and preferred solutions from the perspective of audio transmission, and in this way, instruct each module in the bluetooth transmission scenario to transmit a packet (data packet) in a cyclic manner, for example, perform the distribution of voice data at multiple ends in a block manner. Therefore, the requirements of data distribution for real time and large data volume are optimized on the Bluetooth transmission level, and the method can effectively adapt to specific equipment and scenes without losing data information and meet the technical requirements of timeliness.
In addition, in some possible implementations of the present invention, in order to improve audio quality, the process information is kept more complete, and the implementation may further include: after the audio data is taken and encoded, the array is subjected to byte reference processing. For example, but not limited to, by a standard frame compression algorithm or other common reference algorithm, the array is shifted to the left by n×4-4 bytes, that is, the data shifted to the left in this example is four bytes less than the read data, so that in order to ensure that decoding is error-free, for the implementation of adopting the reference processing, the subsequent decoding process needs to be guided, and this point needs to be noted, which is not limited and described in detail herein. The foregoing embodiments and the preferred solutions thereof have been verified that the packet loss rate of the transmitted data can reach 0.37% without any obstacle and at a transmission distance of 25 meters, which is far higher than the industry and industry standard, and it can be seen that the above solution of the present invention makes a prominent contribution to the field of the foregoing specific technical requirements, and those skilled in the art can implement real-time bluetooth transmission of a large amount of data for other documents, images, videos, etc. based on the foregoing technical implementation concept.
Finally, it should be noted that the foregoing embodiments are described with respect to audio data, but in actual operation, there may be mixed transmission while audio data and instruction data are transmitted, and the small data may include data transmission of small data signal amount, which is transmitted together with the audio data, for example, in the foregoing embodiments of the present invention, in other words, in the process of real-time transmission of large data amount audio data, the small data signal amount of sporadic variation is also included, which is not limited to the present invention.
Corresponding to the above embodiments and preferred solutions, the present invention further provides an embodiment of a large data volume audio bluetooth real-time transmission device for a device with a recording function, as shown in fig. 2, which may specifically include the following components:
the front-end recording module 0 is used for recording audio data in real time;
an array creation module 1, configured to create an array based on a preset compression ratio;
a data appending module 2, configured to append each received frame of audio data to the array continuously; each frame of audio data is obtained by framing received continuous audio according to the limit value of Bluetooth cache and the data format;
a data processing module 3 including a data amount checking unit 31, a suspending unit 32, and an encoding transmission unit 33;
the data amount checking unit 31 is configured to continuously check whether the array reaches a preset data amount;
the suspension unit 32 is configured to suspend bluetooth transmission to the back end and continue waiting for the front end data addition when the data amount checking unit outputs yes;
the code transmission unit 33 is configured to, when the data amount checking unit outputs no, take audio data of a preset data amount to perform coding, and perform bluetooth transmission to the back end.
In one possible implementation manner, the apparatus further includes: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is taken and encoded.
In one possible implementation manner, the data adding module is specifically configured to receive audio data input in real time by the front end according to a preset time period; storing the audio data acquired in each time period into the array; audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the data amount checking unit is specifically configured to check, at regular intervals, whether the array reaches a preset data amount; and, the larger each frame of audio data obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
It should be understood that the above division of the components of the audio bluetooth real-time transmission apparatus for large data volume with recording function device shown in fig. 2 is only a division of logic functions, and may be fully or partially integrated into one physical entity or may be physically separated. And these components may all be implemented in software in the form of a call through a processing element; or can be realized in hardware; it is also possible that part of the components are implemented in the form of software called by the processing element and part of the components are implemented in the form of hardware. For example, some of the above modules may be individually set up processing elements, or may be integrated in a chip of the electronic device. The implementation of the other components is similar. In addition, all or part of the components can be integrated together or can be independently realized. In implementation, each step of the above method or each component above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above components may be one or more integrated circuits configured to implement the above methods, such as: one or more specific integrated circuits (Application Specific Integrated Circuit; hereinafter ASIC), or one or more microprocessors (Digital Singnal Processor; hereinafter DSP), or one or more field programmable gate arrays (Field Programmable Gate Array; hereinafter FPGA), etc. For another example, these components may be integrated together and implemented in the form of a System-On-a-Chip (SOC).
In view of the foregoing examples and their preferred embodiments, those skilled in the art will appreciate that in practice the present invention is applicable to a variety of embodiments, and the present invention is schematically illustrated by the following carriers:
(1) A device with sound recording capability may include:
one or more processors, memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions, which when executed by the device, cause the device to perform the steps/functions of the foregoing embodiments or equivalent implementations.
Fig. 3 is a schematic structural diagram of an embodiment of the device with recording function according to the present invention, where the device may be an electronic device or a circuit device built in the electronic device. The electronic equipment can be a cloud server, a mobile terminal (mobile phone), a remote controller, a page turner, an intelligent screen, an unmanned aerial vehicle, an ICV, an intelligent (automobile) or vehicle-mounted equipment and the like. The embodiment is not limited to a specific form of the apparatus having the recording function.
As shown in fig. 3 in particular, the recording-enabled device 900 includes a processor 910 and a memory 930. Wherein the processor 910 and the memory 930 may communicate with each other via an internal connection, and transfer control and/or data signals, the memory 930 is configured to store a computer program, and the processor 910 is configured to call and execute the computer program from the memory 930. The processor 910 and the memory 930 may be combined into a single processing device, more commonly referred to as separate components, and the processor 910 is configured to execute program code stored in the memory 930 to perform the functions described above. In particular, the memory 930 may also be integrated within the processor 910 or may be separate from the processor 910.
In addition, in order to further improve the function of the apparatus 900 having a recording function, the apparatus 900 may further include one or more of an input unit 960, a display unit 970, an audio circuit 980, which may further include a speaker 982, a microphone 984, and the like, a camera 990, a sensor 901, and the like. Wherein the display unit 970 may include a display screen.
Further, the apparatus 900 with recording function may further include a power supply 950 for supplying power to various devices or circuits in the apparatus 900.
It should be appreciated that the apparatus 900 with recording function shown in fig. 3 can implement the respective processes of the method provided by the foregoing embodiment. The operations and/or functions of the various components in the device 900 may be respectively for implementing the corresponding flows in the method embodiments described above. Reference is specifically made to the foregoing descriptions of embodiments of methods, apparatuses and so forth, and detailed descriptions thereof are appropriately omitted for the purpose of avoiding redundancy.
It should be understood that the processor 910 in the device 900 with recording function shown in fig. 3 may be a system on a chip SOC, where the processor 910 may include a central processing unit (Central Processing Unit; hereinafter referred to as "CPU") and may further include other types of processors, for example: an image processor (Graphics Processing Unit; hereinafter referred to as GPU) or the like, as will be described in detail below.
In general, portions of the processors or processing units within the processor 910 may cooperate to implement the preceding method flows, and corresponding software programs for the portions of the processors or processing units may be stored in the memory 930.
(2) A readable storage medium having stored thereon a computer program or the above-mentioned means, which when executed, causes a computer to perform the steps/functions of the foregoing embodiments or equivalent implementations.
In several embodiments provided by the present invention, any of the functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, certain aspects of the present invention may be embodied in the form of a software product as described below, in essence, or as a part of, contributing to the prior art.
(3) A computer program product (which may comprise the apparatus described above) which, when run on a terminal device, causes the terminal device to perform the method of the foregoing embodiment or equivalent implementation for large data volume audio bluetooth real-time transmission with a recording enabled device.
From the above description of embodiments, it will be apparent to those skilled in the art that all or part of the steps of the above described methods may be implemented in software plus necessary general purpose hardware platforms. Based on such understanding, the above-described computer program product may include, but is not limited to, an APP; in connection with the foregoing, the device/terminal may be a computer device (e.g., a mobile phone, a PC terminal, a cloud platform, a server cluster, or a network communication device such as a media gateway, etc.). Moreover, the hardware structure of the computer device may further specifically include: at least one processor, at least one communication interface, at least one memory and at least one communication bus; the processor, the communication interface and the memory can all communicate with each other through a communication bus. The processor may be a central processing unit CPU, DSP, microcontroller or digital signal processor, and may further include a GPU, an embedded Neural network processor (Neural-network Process Units; hereinafter referred to as NPU) and an image signal processor (Image Signal Processing; hereinafter referred to as ISP), and the processor may further include an ASIC (application specific integrated circuit) or one or more integrated circuits configured to implement embodiments of the present invention, and in addition, the processor may have a function of operating one or more software programs, and the software programs may be stored in a storage medium such as a memory; and the aforementioned memory/storage medium may include: nonvolatile Memory (non-volatile Memory), such as a non-removable magnetic disk, a USB flash disk, a removable hard disk, an optical disk, and the like, and Read-Only Memory (ROM), random access Memory (Random Access Memory; RAM), and the like.
In the embodiments of the present invention, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relation of association objects, and indicates that there may be three kinds of relations, for example, a and/or B, and may indicate that a alone exists, a and B together, and B alone exists. Wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of the following" and the like means any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple.
Those of skill in the art will appreciate that the various modules, units, and method steps described in the embodiments disclosed herein can be implemented in electronic hardware, computer software, and combinations of electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
And, each embodiment in the specification is described in a progressive manner, and the same and similar parts of each embodiment are mutually referred to. In particular, for embodiments of the apparatus, device, etc., as they are substantially similar to method embodiments, the relevance may be found in part in the description of method embodiments. The above-described embodiments of apparatus, devices, etc. are merely illustrative, in which modules, units, etc. illustrated as separate components may or may not be physically separate, i.e., may be located in one place, or may be distributed across multiple places, e.g., nodes of a system network. In particular, some or all modules and units in the system can be selected according to actual needs to achieve the purpose of the embodiment scheme. Those skilled in the art will understand and practice the invention without undue burden.
The construction, features and effects of the present invention are described in detail according to the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention, and it should be understood that the technical features of the above embodiment and the preferred mode thereof can be reasonably combined and matched into various equivalent schemes by those skilled in the art without departing from or changing the design concept and technical effects of the present invention; therefore, the invention is not limited to the embodiments shown in the drawings, but is intended to be within the scope of the invention as long as changes made in the concept of the invention or modifications to the equivalent embodiments do not depart from the spirit of the invention as covered by the specification and drawings.
Claims (9)
1. A method for large data volume audio bluetooth real-time transmission of a device having a recording function, comprising:
recording audio data in real time;
continuously adding each received frame of audio data into an array created based on a preset compression ratio; each frame of audio data is obtained by framing received continuous audio according to the limit value of Bluetooth cache and the data format; the framing processing refers to splitting a large amount of input audio data before adding an array;
continuously checking whether the array achieves a preset data amount;
if not, suspending Bluetooth transmission to the rear end, and continuing to wait for the addition of the front end data;
if the data is reached, audio data with preset data quantity is taken for encoding, and Bluetooth transmission is carried out to the rear end.
2. The method for bluetooth real-time transmission of large data volume audio for a recording enabled device of claim 1, further comprising: after the audio data is taken and encoded, the array is subjected to byte reference processing.
3. The method for bluetooth real-time transmission of large data volume audio for a recording-enabled device according to claim 1, wherein continuously appending each received frame of audio data to an array created based on a preset compression ratio specifically comprises:
receiving audio data input by the front end in real time according to a preset time period;
storing the audio data acquired in each time period into the array;
audio data is continuously appended to the array in the manner described above.
4. The method for bluetooth real-time transmission of large data volume audio for a recording-enabled device according to claim 1, wherein said checking whether the array reaches a preset data volume comprises:
according to a preset time interval, checking whether the array reaches a preset data amount or not at regular time;
and, the larger each frame of audio data obtained by framing, the smaller the time interval.
5. The method for bluetooth real-time transmission of large data volume audio for a device having a recording function according to any one of claims 1 to 4, wherein the preset data volume is set based on the compression ratio.
6. A large data volume audio bluetooth real-time transmission device for equipment with a recording function, comprising:
the front-end recording module is used for recording the audio data in real time;
the array creation module is used for creating an array based on a preset compression ratio;
the data adding module is used for continuously adding each received frame of audio data into the array; each frame of audio data is obtained by framing received continuous audio according to the limit value of Bluetooth cache and the data format; the framing processing refers to splitting a large amount of input audio data before adding an array;
the data processing module comprises a data quantity checking unit, a pause unit and a code transmission unit;
the data volume checking unit is used for continuously checking whether the array achieves a preset data volume;
the suspension unit is used for suspending Bluetooth transmission to the rear end when the data quantity checking unit outputs no, and continuing to wait for the addition of the front end data;
and the coding transmission unit is used for taking audio data of preset data quantity to code when the data quantity checking unit outputs yes, and transmitting Bluetooth to the rear end.
7. The apparatus for bluetooth high data volume audio real time transmission with sound recording function according to claim 6, further comprising: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is taken and encoded.
8. An apparatus having a recording function, comprising:
one or more processors, memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by the device, cause the device to perform the method of mass audio bluetooth real-time transmission for a device with sound recording functionality according to any of claims 1-5.
9. A computer readable storage medium, wherein a computer program is stored in the computer readable storage medium, which when run on a computer causes the computer to perform the method for large data volume audio bluetooth real-time transmission for a device with a recording function according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010193028.7A CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010193028.7A CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111432384A CN111432384A (en) | 2020-07-17 |
| CN111432384B true CN111432384B (en) | 2023-05-09 |
Family
ID=71547550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010193028.7A Active CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111432384B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113342306B (en) * | 2021-06-18 | 2022-10-11 | 广州市保伦电子有限公司 | 2-path audio mixing method and processing terminal |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105405325A (en) * | 2015-12-22 | 2016-03-16 | 深圳市时尚德源文化传播有限公司 | Network teaching method and system |
| CN106603543A (en) * | 2016-12-22 | 2017-04-26 | 努比亚技术有限公司 | Corrected streaming media audio and video synchronizing method and apparatus |
| CN107040832A (en) * | 2017-04-22 | 2017-08-11 | 广州市比丽普电子有限公司 | A kind of handheld terminal formula microphone system based on Bluetooth technology |
| CN109150399A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Data transmission method, device, electronic equipment and computer-readable medium |
| CN109584889A (en) * | 2018-12-28 | 2019-04-05 | 秒针信息技术有限公司 | Audio frequency transmission method and device and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11259192B2 (en) * | 2017-09-29 | 2022-02-22 | Apple Inc. | Ultra-low latency audio over bluetooth |
| CN108882216A (en) * | 2018-08-17 | 2018-11-23 | 深圳市芯中芯科技有限公司 | A kind of audio data transmission method and system based on bluetooth BLE technology |
| CN109348464B (en) * | 2018-11-23 | 2021-08-17 | 深圳时空壶技术有限公司 | Data transmission method for low-power-consumption Bluetooth receiving end equipment and receiving end equipment |
| CN110189753B (en) * | 2019-05-28 | 2022-01-28 | 北京百度网讯科技有限公司 | Bluetooth sound box and control method, system and storage medium thereof |
| CN110225399B (en) * | 2019-06-19 | 2021-11-23 | 深圳市共进电子股份有限公司 | Streaming media processing method and device, computer equipment and storage medium |
-
2020
- 2020-03-18 CN CN202010193028.7A patent/CN111432384B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105405325A (en) * | 2015-12-22 | 2016-03-16 | 深圳市时尚德源文化传播有限公司 | Network teaching method and system |
| CN106603543A (en) * | 2016-12-22 | 2017-04-26 | 努比亚技术有限公司 | Corrected streaming media audio and video synchronizing method and apparatus |
| CN107040832A (en) * | 2017-04-22 | 2017-08-11 | 广州市比丽普电子有限公司 | A kind of handheld terminal formula microphone system based on Bluetooth technology |
| CN109150399A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Data transmission method, device, electronic equipment and computer-readable medium |
| CN109584889A (en) * | 2018-12-28 | 2019-04-05 | 秒针信息技术有限公司 | Audio frequency transmission method and device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111432384A (en) | 2020-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10938725B2 (en) | Load balancing multimedia conferencing system, device, and methods | |
| US11374995B2 (en) | Multimedia file processing | |
| US20160182600A1 (en) | Reducing requests for media segments in streaming of multimedia content | |
| CN109120687B (en) | Data packet transmitting method, device, system, equipment and storage medium | |
| US10360913B2 (en) | Speech recognition method, device and system based on artificial intelligence | |
| CN113285931B (en) | Streaming media transmission method, streaming media server and streaming media system | |
| CN112153415B (en) | Video transcoding method, device, equipment and storage medium | |
| CN109144463A (en) | Transfer control method, device and electronic equipment | |
| US20110196916A1 (en) | Client terminal, server, cloud computing system, and cloud computing method | |
| CN114006894A (en) | Data processing system, method, electronic device, and computer storage medium | |
| CN111432384B (en) | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function | |
| CN104202656A (en) | Segmented decoding method for scrambled network audio MP3 (moving picture experts group audio layer 3) streams | |
| CN110113298A (en) | Data transmission method, device, signal server and computer-readable medium | |
| CN111277580B (en) | Node data sending method, receiving method and transmission method | |
| CN111405293A (en) | Video transmission method and device | |
| WO2019217127A1 (en) | Client side data stream processing | |
| CN104469393B (en) | Obtain the method and system of high in the clouds simulator audio | |
| US20100076944A1 (en) | Multiprocessor systems for processing multimedia data and methods thereof | |
| CN109918325B (en) | Interface conversion bridge based on Avalon bus, interface conversion method and system | |
| CN113992493A (en) | Video processing method, system, device and storage medium | |
| CN106534137B (en) | Media stream transmission method and device | |
| KR20160087226A (en) | System for cloud streaming service, method of image cloud streaming service considering terminal performance and apparatus for the same | |
| CN115334053B (en) | Method for realizing associated screen projection in cloud conference and related products | |
| US20170269894A1 (en) | Fast keyboard for screen mirroring | |
| CN115361569B (en) | Dynamic frame screen projection method in cloud conference and related products |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |