CN111724804A - Method and apparatus for processing information - Google Patents
Method and apparatus for processing information Download PDFInfo
- Publication number
- CN111724804A CN111724804A CN202010605253.7A CN202010605253A CN111724804A CN 111724804 A CN111724804 A CN 111724804A CN 202010605253 A CN202010605253 A CN 202010605253A CN 111724804 A CN111724804 A CN 111724804A
- Authority
- CN
- China
- Prior art keywords
- time division
- division multiplexing
- audio signal
- vehicle
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0224—Processing in the time domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Abstract
The application discloses a method and a device for processing information, relates to the technical field of voice, and can be used for automatic driving or voice interaction scenes. One specific implementation scheme is as follows: acquiring an audio signal acquired by vehicle-mounted audio acquisition equipment; generating a time division multiplexing signal according to the obtained audio signal and a corresponding reference audio signal; storing the generated time division multiplexing signal into a preset data cache pool; and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool. According to the embodiment, the time division multiplexing signal is generated according to the audio signal and the corresponding reference audio signal, and the time division multiplexing signal is sent to the vehicle-mounted terminal for application, so that the integrity and the real-time performance of the reference audio signal relative to the audio signal collected by the vehicle-mounted audio collecting equipment are guaranteed, and the acoustic echo cancellation effect is favorably improved.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to the technical field of voice.
Background
With the rapid development of the artificial intelligence technology, the voice interaction is widely applied to the vehicle-mounted system, and the experience effect of the human-computer interaction is greatly improved. In the running process of the vehicle, the air flow noise, the engine noise, the broadcast sound emitted by a vehicle loudspeaker and other sounds of the running of the vehicle exist in the vehicle. This makes the audio frequency quality that the audio acquisition equipment in the car gathered relatively poor, very big influence speech recognition's degree of accuracy. In practice, one factor that greatly affects the quality of audio is acoustic echo, which is the echo caused by the sound played by a loudspeaker being picked up by a microphone. If the acoustic echo is to be cancelled, an echo reference signal needs to be acquired. The integrity and real-time performance of the echo reference signal are important factors affecting the effectiveness of acoustic echo cancellation.
Disclosure of Invention
The present disclosure provides a method, apparatus, device, and storage medium for processing information.
According to a first aspect of the present disclosure, an embodiment of the present disclosure provides a method for processing information, the method including: acquiring an audio signal acquired by vehicle-mounted audio acquisition equipment; generating a time division multiplexing signal according to the obtained audio signal and a corresponding reference audio signal; storing the generated time division multiplexing signal into a preset data cache pool; and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool.
According to a second aspect of the present disclosure, an embodiment of the present disclosure provides a method for processing information, including: reading the time division multiplexing signals in a preset data cache pool through a pre-established read data thread, and caching the read time division multiplexing signals in a linked list form; and presetting the time division multiplexing signals cached in the linked list through a pre-established data processing thread.
According to a third aspect of the present disclosure, an embodiment of the present disclosure provides an apparatus for processing information, the apparatus including: an acquisition unit configured to acquire an audio signal acquired by a vehicle-mounted audio acquisition device; a generating unit configured to generate a time division multiplexed signal from the acquired audio signal and a corresponding reference audio signal; a storage unit configured to store the generated time division multiplexing signal to a preset data buffer pool; and the processing unit is configured to send the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application, so that the vehicle-mounted terminal application performs preset processing on the time division multiplexing signals acquired from the data cache pool.
According to a fourth aspect of the present disclosure, an embodiment of the present disclosure provides an apparatus for processing information, including: the buffer subunit is configured to read the time division multiplexing signals in a preset data buffer pool through a pre-established read data thread, and buffer the read time division multiplexing signals in a form of a linked list; and the processing subunit is configured to perform preset processing on the time division multiplexing signals buffered in the linked list through a pre-created processing data thread.
According to a fifth aspect of the present disclosure, an embodiment of the present disclosure provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method according to any one of the first and second aspects.
According to a sixth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are configured to cause the computer to perform the method according to any one of the first and second aspects.
According to the technology of this application according to audio signal and the reference audio signal that corresponds generate the time division multiplex signal to with time division multiplex signal transmission to vehicle terminal application, thereby guaranteed for the audio signal of vehicle audio acquisition equipment collection, reference audio signal's integrality and real-time, thereby be favorable to promoting the effect of acoustics echo cancellation.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a flow diagram of one embodiment of a method for processing information according to the present application;
FIG. 2 is a schematic diagram of an application scenario of a method for processing information according to the present application;
FIG. 3 is a flow diagram of yet another embodiment of a method for processing information according to the present application;
FIG. 4 is a schematic block diagram illustrating one embodiment of an apparatus for processing information according to the present application;
FIG. 5 is a schematic block diagram of yet another embodiment of an apparatus for processing information according to the present application;
FIG. 6 is a block diagram of an electronic device for implementing a method for processing information according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Referring to FIG. 1, a flow 100 of one embodiment of a method for processing information in accordance with the present disclosure is shown. The method for processing information comprises the following steps:
and S101, acquiring an audio signal acquired by the vehicle-mounted audio acquisition equipment.
In the present embodiment, an execution subject of the method for processing information, for example, a processor of an in-vehicle terminal, may acquire an audio signal acquired by an in-vehicle audio acquisition device (for example, a microphone or a microphone array, etc.). In practice, the in-vehicle audio collecting device may collect voice information of a driver or a passenger in the vehicle, noise in the vehicle, acoustic echo caused by a speaker in the vehicle, and the like.
Generally, if a driver or a passenger in a vehicle is playing audio (e.g., playing music or playing a voice call, etc.) while a driver or a passenger in the vehicle is emitting a voice signal, echo interference is inevitable due to the existence of a signal reflection path. Based on the cause of Echo generation, echoes can be distinguished into Acoustic Echo (Acoustic Echo) and Line Echo (Line Echo). Here, the acoustic echo refers to an echo caused by a sound played by a speaker being picked up by a microphone.
S102, generating a time division multiplexing signal according to the acquired audio signal and the corresponding reference audio signal.
In this embodiment, the execution body may generate a Time Division Multiplexing (TDM) signal according to the acquired tone signal and the corresponding reference audio signal. As an example, the reference audio signal (or echo reference signal) corresponding to the acquired audio signal may refer to an audio signal played by an in-vehicle playing device (e.g., a speaker) when the in-vehicle audio collecting device collects the audio signal.
Here, TDM uses different time periods of the same physical connection to transmit different signals, and can also achieve the purpose of multiplexing. TDM is divided according to the time of transmission signal, so that different signals are transmitted in different time, and the whole transmission time is divided into a plurality of slots (TS), also called time slots, each Slot being occupied by a signal. TDM is to implement a circuit to transmit multiple signals by interleaving a portion of each signal in time. Only one signal is present at each brief moment on the circuit. It can be understood that the method of encoding, multiplexing, and the like, two signals, i.e., the audio signal and the reference audio signal, and generating the time division multiplexing signal is a well-known technology that is widely researched and applied, and is not described herein again.
And S103, storing the generated time division multiplexing signal into a preset data buffer pool.
In this embodiment, the execution body may store the time division multiplexing signal generated in S102 to a preset data buffer pool. Here, the data buffer pool may be a preset block of storage space, and the storage space may be used for storing the time division multiplexing signal. Because the vehicle-mounted audio acquisition equipment acquires the audio signals in real time, the time division multiplexing signals can be generated in real time, and in practice, the time division multiplexing signals generated in real time can be firstly cached in a data cache pool.
In some optional implementations of this embodiment, the size of the data cache pool may be determined by: and in response to the fact that the vehicle-mounted audio acquisition equipment comprises at least two acquired audio signals, setting the size of the data cache pool according to the number of the vehicle-mounted audio acquisition equipment acquiring the audio signals.
In this implementation, the size of the data cache pool can be set according to the number of the vehicle-mounted audio acquisition devices for acquiring audio signals in the vehicle. As an example, the size of the data buffer pool required for a single in-vehicle audio capture device may first be determined from the amount of data captured by the single in-vehicle audio capture device per unit time (e.g., per second). And then, when two or more vehicle-mounted audio acquisition devices are judged to acquire new audio numbers at the same time, the size of the data cache pool can be set according to the number of the vehicle-mounted audio acquisition devices for acquiring the audio and the size of the data cache pool required by the single vehicle-mounted audio acquisition device. For example, the product of the two may be determined as the size of the data cache pool. Through this implementation, can set up the size in data cache pond according to the on-vehicle audio acquisition equipment's of gathering audio information quantity in the car to avoided losing because the not enough data that leads to in data cache pond, guaranteed the integrality of data.
And S104, sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool.
In the present embodiment, the in-vehicle terminal may be installed with various in-vehicle terminal applications related to voice, for example, an instant messenger, a bluetooth in-vehicle phone, an input method application, and the like. In this way, the execution subject may transmit the time division multiplexing signal in the data buffer pool to the preset in-vehicle terminal application. In actual use, the vehicle-mounted terminal application installed on the vehicle-mounted terminal can acquire the audio signal by calling the audio acquisition interface preset in the vehicle-mounted terminal. In practice, the preset audio capture interfaces corresponding to different operating systems may not be the same. Taking an operating system of the vehicle-mounted terminal as an android system as an example, the preset audio acquisition interface may be an AudioRecord. In this embodiment, the generation of the time division multiplexing signal based on the audio signal and the reference audio signal can be realized by modifying the AudioRecord code, so that the vehicle-mounted terminal application can acquire the time division multiplexing signal by calling the audio acquisition interface. Here, the preset in-vehicle terminal application may refer to an in-vehicle terminal application calling a preset audio capture interface.
Here, after the execution main body transmits the time division multiplexing signal in the data buffer pool to the preset in-vehicle terminal application, the preset in-vehicle terminal application may perform a preset process on the time division multiplexing signal acquired from the data buffer pool. Specifically, the vehicle-mounted terminal application may perform corresponding processing on the time division multiplexing signal according to its own processing logic.
In some optional implementation manners of this embodiment, in S104, sending the time division multiplexing signal in the data cache pool to the preset vehicle-mounted terminal application may specifically be performed as follows: and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal for application by adopting a real-time transmission protocol.
In this implementation manner, the execution main body may adopt a real-time transport protocol to send the time division multiplexing signal in the data cache pool to a preset vehicle-mounted terminal application. The real-time property of data transmission can be ensured by sending data through a real-time transmission protocol.
With continued reference to fig. 2, fig. 2 is a schematic diagram of an application scenario of the method for processing information according to the present embodiment. In the application scenario of fig. 2, the in-vehicle terminal first acquires an audio signal 201 acquired by an in-vehicle audio acquisition device. After that, the in-vehicle terminal generates a time division multiplexing signal 203 according to the acquired audio signal 201 and the corresponding reference audio signal 202. Then, the in-vehicle terminal stores the generated time division multiplexing signal in a preset data buffer pool 204. And finally, sending the time division multiplexing signals in the data cache pool 204 to a preset vehicle-mounted terminal application, so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool.
According to the method provided by the embodiment of the disclosure, the time division multiplexing signal is generated according to the audio signal and the corresponding reference audio signal, and the time division multiplexing signal is sent to the vehicle-mounted terminal for application, so that the integrity and the real-time performance of the reference audio signal relative to the audio signal acquired by the vehicle-mounted audio acquisition equipment are ensured, and the effect of acoustic echo cancellation is favorably improved.
With further reference to FIG. 3, a flow 300 of yet another embodiment of a method for processing information is shown. The flow 300 of the method for processing information can be applied to vehicle-mounted terminal application, and comprises the following steps:
s301, reading the time division multiplexing signals in a preset data buffer pool through a pre-established read data thread, and buffering the read time division multiplexing signals in a linked list mode.
In this embodiment, an execution main body of the method for processing information, for example, a vehicle-mounted terminal application installed in a vehicle-mounted terminal, may read a time division multiplexing signal in a preset data buffer pool through a pre-created read data thread, and buffer the read time division multiplexing signal in a form of a linked list. Here, the data buffer pool may be a preset block of storage space, and the storage space may be used for storing the time division multiplexing signal. Because the vehicle-mounted audio acquisition equipment acquires the audio signals in real time, the time division multiplexing signals can be generated in real time, and in practice, the time division multiplexing signals generated in real time can be firstly cached in a data cache pool.
And S302, performing preset processing on the time division multiplexing signals cached in the linked list through a pre-established data processing thread.
In this embodiment, the vehicle-mounted terminal application may perform preset processing on the time division multiplexing signal buffered in the linked list through a pre-created processing data thread. Here, the preset process may be set according to actual needs.
In some optional implementation manners of this embodiment, the preset processing on the time division multiplexing signal buffered in the linked list in S302 may be specifically performed as follows:
first, an audio signal and a reference audio signal are resolved from an acquired time division multiplexed signal.
In this implementation, the in-vehicle terminal application may parse the audio signal and the reference audio signal from the acquired time division multiplexing signal. It can be understood that demultiplexing the time division multiplexed signal to obtain the audio signal and the reference audio signal is a well-known technology that is widely researched and applied, and will not be described herein.
Then, based on the analyzed reference audio signal, performing echo cancellation processing on the analyzed audio signal to obtain a processed audio signal after the echo cancellation processing.
In this implementation manner, the vehicle-mounted terminal application may perform echo cancellation processing on the analyzed audio signal based on the analyzed reference audio signal to obtain a processed audio signal after the echo cancellation processing. As an example, an AEC (Acoustic Echo canceller) may be employed for the Echo cancellation processing. AEC is based on the correlation between the loudspeaker signal and the multipath echo generated by it, establishes the speech model of the far-end signal, estimates the echo by using the speech model of the far-end signal, and continuously modifies the coefficient of the filter, so that the estimated value is closer to the real echo. Then, the echo estimation value is subtracted from the audio signal collected by the vehicle-mounted audio collecting device, so that the purpose of eliminating the echo is achieved, and the AEC also compares the audio signal collected by the vehicle-mounted audio collecting device with the past value of the loudspeaker, so that the acoustic echo of multiple reflections with prolonged delay is eliminated.
And finally, executing preset operation based on the processed audio signal.
In this implementation, the vehicle-mounted terminal application may execute a preset operation based on the processed audio signal obtained after the echo cancellation processing. Here, the preset operation may be related to the processing logic of the in-vehicle terminal application itself. As an example, taking a vehicle-mounted terminal application as a communication tool as an example, the communication tool may perform a noise reduction operation on the processed audio signal and then send the processed audio signal to an audio receiver. As another example, taking the in-vehicle terminal application as an input method application as an example, the input method application may perform a voice recognition operation on the processed audio signal, obtain text information corresponding to the processed audio signal, and display the text information. The vehicle-mounted terminal application can analyze the audio signal and the reference audio signal from the time division multiplexing signal and perform echo cancellation processing on the audio signal based on the reference audio signal so as to obtain the processed audio signal after the echo cancellation processing.
In the method provided by the above embodiment of the present disclosure, the vehicle-mounted terminal application processes the time division multiplexing signal in the data buffer pool by using two threads, namely a read data thread and a data processing thread. Therefore, the scheme described in this embodiment can adopt an asynchronous reading processing mode, so as to ensure that the time division multiplexing signal does not lose the signal under the condition of data overload, and ensure the integrity of the signal.
With further reference to fig. 4, as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of an apparatus for processing information, which corresponds to the method embodiment shown in fig. 1, and which is particularly applicable in various electronic devices.
As shown in fig. 4, the apparatus 400 for processing information of the present embodiment includes: an acquisition unit 401, a generation unit 402, a storage unit 403, and a processing unit 404. Wherein, the obtaining unit 401 is configured to obtain an audio signal collected by the vehicle-mounted audio collecting device; the generating unit 402 is configured to generate a time division multiplexed signal from the acquired audio signal and the corresponding reference audio signal; the storage unit 403 is configured to store the generated time division multiplexing signal into a preset data buffer pool; the processing unit 404 is configured to send the time division multiplexing signals in the data buffer pool to a preset vehicle-mounted terminal application, so that the vehicle-mounted terminal application performs preset processing on the time division multiplexing signals acquired from the data buffer pool.
In this embodiment, specific processes of the obtaining unit 401, the generating unit 402, the storing unit 403, and the processing unit 404 of the apparatus 400 for processing information and technical effects brought by the specific processes can refer to the descriptions of S101, S102, S103, and S104 in the corresponding embodiment of fig. 1, respectively, and are not described herein again.
In some optional implementations of this embodiment, the size of the data cache pool is determined by: and responding to the determined vehicle-mounted audio acquisition equipment comprising at least two acquired audio signals, and setting the size of the data cache pool according to the number of the vehicle-mounted audio acquisition equipment acquiring the audio signals.
In some optional implementations of this embodiment, the processing unit 404 is further configured to: and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal for application by adopting a real-time transmission protocol.
With further reference to fig. 5, as an implementation of the methods shown in the above figures, the present disclosure provides yet another embodiment of an apparatus for processing information, which corresponds to the method embodiment shown in fig. 3, and which is particularly applicable in various electronic devices.
As shown in fig. 5, the apparatus 500 for processing information of the present embodiment includes: a buffer subunit 501 and a processing subunit 502. The buffer subunit 501 is configured to read the time division multiplexing signals in a preset data buffer pool through a pre-created read data thread, and buffer the read time division multiplexing signals in a form of a linked list; the processing subunit 502 is configured to perform a predetermined processing on the time division multiplexing signals buffered in the linked list through a pre-created thread of processing data.
In this embodiment, for specific processing of the buffer sub-unit 501 and the processing sub-unit 502 of the apparatus 500 for processing information and technical effects brought by the processing sub-unit, reference may be made to the related descriptions of S301 and S302 in the corresponding embodiment of fig. 1, which are not described herein again.
In some optional implementations of this embodiment, the processing subunit 502 is further configured to parse out an audio signal and a reference audio signal from the obtained time division multiplexing signal; performing echo cancellation processing on the analyzed audio signal based on the analyzed reference audio signal to obtain a processed audio signal after the echo cancellation processing; and executing preset operation based on the processed audio signal.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 6, is a block diagram of an electronic device for a method of processing information according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.
The memory 602 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the methods for processing information provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method for processing information provided herein.
The memory 602, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the method for processing information in the embodiment of the present application (for example, the acquisition unit 401, the generation unit 402, the storage unit 403, and the processing unit 404 shown in fig. 4). The processor 601 executes various functional applications of the server and data processing by executing non-transitory software programs, instructions, and modules stored in the memory 602, that is, implements the method for processing information in the above-described method embodiments.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of an electronic device for processing information, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, which may be connected to electronic devices for processing information over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the method for processing information may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the electronic apparatus for processing the information, such as an input device like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, etc. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the time division multiplexing signal is generated according to the audio signal and the corresponding reference audio signal, and the time division multiplexing signal is sent to the vehicle-mounted terminal for application, so that the integrity and the real-time performance of the reference audio signal relative to the audio signal collected by the vehicle-mounted audio collecting equipment are guaranteed, and the effect of acoustic echo cancellation is favorably improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (12)
1. A method for processing information, comprising:
acquiring an audio signal acquired by vehicle-mounted audio acquisition equipment;
generating a time division multiplexing signal according to the obtained audio signal and a corresponding reference audio signal;
storing the generated time division multiplexing signal into a preset data cache pool;
and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool.
2. The method of claim 1, wherein the size of the data cache pool is determined by:
and in response to the fact that the vehicle-mounted audio acquisition equipment comprises at least two acquired audio signals, setting the size of the data cache pool according to the number of the vehicle-mounted audio acquisition equipment acquiring the audio signals.
3. The method according to claim 1, wherein the sending the time division multiplexing signals in the data buffer pool to a preset vehicle-mounted terminal application comprises:
and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal for application by adopting a real-time transmission protocol.
4. A method for processing information, comprising:
reading the time division multiplexing signals in a preset data cache pool through a pre-established read data thread, and caching the read time division multiplexing signals in a linked list form;
and presetting the time division multiplexing signals cached in the linked list through a pre-established data processing thread.
5. The method of claim 4, wherein the pre-setting the time division multiplexing signals buffered in the linked list comprises:
analyzing an audio signal and a reference audio signal from the acquired time division multiplexing signal;
performing echo cancellation processing on the analyzed audio signal based on the analyzed reference audio signal to obtain a processed audio signal after the echo cancellation processing;
and executing preset operation based on the processed audio signal.
6. An apparatus for processing information, comprising:
an acquisition unit configured to acquire an audio signal acquired by a vehicle-mounted audio acquisition device;
a generating unit configured to generate a time division multiplexed signal from the acquired audio signal and a corresponding reference audio signal;
a storage unit configured to store the generated time division multiplexing signal to a preset data buffer pool;
and the processing unit is configured to send the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal application so that the vehicle-mounted terminal application can perform preset processing on the time division multiplexing signals acquired from the data cache pool.
7. The apparatus of claim 6, wherein the size of the data cache pool is determined by:
and in response to the fact that the vehicle-mounted audio acquisition equipment comprises at least two acquired audio signals, setting the size of the data cache pool according to the number of the vehicle-mounted audio acquisition equipment acquiring the audio signals.
8. The apparatus of claim 6, wherein the processing unit is further configured to:
and sending the time division multiplexing signals in the data cache pool to a preset vehicle-mounted terminal for application by adopting a real-time transmission protocol.
9. An apparatus for processing information, comprising:
the buffer subunit is configured to read the time division multiplexing signals in a preset data buffer pool through a pre-established read data thread, and buffer the read time division multiplexing signals in a form of a linked list;
and the processing subunit is configured to perform preset processing on the time division multiplexing signals buffered in the linked list through a pre-created processing data thread.
10. The apparatus of claim 9, wherein the processing subunit is further configured to:
analyzing an audio signal and a reference audio signal from the acquired time division multiplexing signal;
performing echo cancellation processing on the analyzed audio signal based on the analyzed reference audio signal to obtain a processed audio signal after the echo cancellation processing;
and executing preset operation based on the processed audio signal.
11. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
12. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-5.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010605253.7A CN111724804A (en) | 2020-06-29 | 2020-06-29 | Method and apparatus for processing information |
| JP2021054163A JP2022006159A (en) | 2020-06-29 | 2021-03-26 | Method and device, electronic device, computer readable storage medium, and computer program to process information |
| KR1020210040642A KR20210042064A (en) | 2020-06-29 | 2021-03-29 | A method and a device for processing information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010605253.7A CN111724804A (en) | 2020-06-29 | 2020-06-29 | Method and apparatus for processing information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111724804A true CN111724804A (en) | 2020-09-29 |
Family
ID=72569563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010605253.7A Pending CN111724804A (en) | 2020-06-29 | 2020-06-29 | Method and apparatus for processing information |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP2022006159A (en) |
| KR (1) | KR20210042064A (en) |
| CN (1) | CN111724804A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113015149A (en) * | 2021-02-23 | 2021-06-22 | 深圳市鼎元智能科技有限公司 | Near field communication method and system |
| CN113421578A (en) * | 2021-06-02 | 2021-09-21 | 广州小鹏智慧出行科技有限公司 | Audio processing method and device, electronic equipment and storage medium |
| CN115474019A (en) * | 2022-05-24 | 2022-12-13 | 北京罗克维尔斯科技有限公司 | Video data processing method and device, vehicle, electronic equipment and storage medium |
| CN113421578B (en) * | 2021-06-02 | 2024-05-17 | 广州小鹏智慧出行科技有限公司 | Audio processing method, device, electronic equipment and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116340214B (en) * | 2023-02-28 | 2024-01-02 | 中科驭数（北京）科技有限公司 | Cache data storage and reading method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030103645A1 (en) * | 1995-05-08 | 2003-06-05 | Levy Kenneth L. | Integrating digital watermarks in multimedia content |
| US20050033586A1 (en) * | 2003-08-06 | 2005-02-10 | Savell Thomas C. | Method and device to process digital media streams |
| CN101826887A (en) * | 2009-03-05 | 2010-09-08 | 大唐移动通信设备有限公司 | Method and device for digital predistortion processing |
| CN104468991A (en) * | 2014-11-24 | 2015-03-25 | 广东欧珀移动通信有限公司 | Mobile terminal and voice frequency receiving and sending method thereof |
| CN107123430A (en) * | 2017-04-12 | 2017-09-01 | 广州视源电子科技股份有限公司 | Echo cancel method, device, meeting flat board and computer-readable storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7031330B1 (en) * | 1999-04-15 | 2006-04-18 | Marconi Intellectual Property (Ringfence), Inc. | Very wide memory TDM switching system |
| US20060047722A1 (en) * | 2004-09-01 | 2006-03-02 | Walker Glenn A | Metadata-based data storage in digital radio system |
| US7299076B2 (en) * | 2005-02-09 | 2007-11-20 | Bose Corporation | Vehicle communicating |
| US8787822B2 (en) * | 2012-09-07 | 2014-07-22 | Adori Labs | Entertainment system |
| KR102208477B1 (en) * | 2014-06-30 | 2021-01-27 | 삼성전자주식회사 | Operating Method For Microphones and Electronic Device supporting the same |
| KR102306798B1 (en) * | 2015-03-20 | 2021-09-30 | 삼성전자주식회사 | Method for cancelling echo and an electronic device thereof |
-
2020
- 2020-06-29 CN CN202010605253.7A patent/CN111724804A/en active Pending
-
2021
- 2021-03-26 JP JP2021054163A patent/JP2022006159A/en active Pending
- 2021-03-29 KR KR1020210040642A patent/KR20210042064A/en not_active Application Discontinuation
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030103645A1 (en) * | 1995-05-08 | 2003-06-05 | Levy Kenneth L. | Integrating digital watermarks in multimedia content |
| US20050033586A1 (en) * | 2003-08-06 | 2005-02-10 | Savell Thomas C. | Method and device to process digital media streams |
| CN101826887A (en) * | 2009-03-05 | 2010-09-08 | 大唐移动通信设备有限公司 | Method and device for digital predistortion processing |
| CN104468991A (en) * | 2014-11-24 | 2015-03-25 | 广东欧珀移动通信有限公司 | Mobile terminal and voice frequency receiving and sending method thereof |
| CN107123430A (en) * | 2017-04-12 | 2017-09-01 | 广州视源电子科技股份有限公司 | Echo cancel method, device, meeting flat board and computer-readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 马丁•德•普瑞克: "《异步传递方式 宽带ISDN技术 修订本》", 30 November 1999, 人民邮电出版社 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113015149A (en) * | 2021-02-23 | 2021-06-22 | 深圳市鼎元智能科技有限公司 | Near field communication method and system |
| CN113421578A (en) * | 2021-06-02 | 2021-09-21 | 广州小鹏智慧出行科技有限公司 | Audio processing method and device, electronic equipment and storage medium |
| CN113421578B (en) * | 2021-06-02 | 2024-05-17 | 广州小鹏智慧出行科技有限公司 | Audio processing method, device, electronic equipment and storage medium |
| CN115474019A (en) * | 2022-05-24 | 2022-12-13 | 北京罗克维尔斯科技有限公司 | Video data processing method and device, vehicle, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20210042064A (en) | 2021-04-16 |
| JP2022006159A (en) | 2022-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111724804A (en) | Method and apparatus for processing information | |
| CN111402868B (en) | Speech recognition method, device, electronic equipment and computer readable storage medium | |
| CN104113471A (en) | Information processing method and device during abnormal communicating junctions | |
| CN109147784A (en) | Voice interactive method, equipment and storage medium | |
| CN112634890B (en) | Method, device, equipment and storage medium for waking up playing equipment | |
| CN111724785A (en) | Voice control method, device and storage medium for small program | |
| WO2018226359A1 (en) | System and methods for audio pattern recognition | |
| EP3743915B1 (en) | Using structured audio output to detect playback and/or to adapt to misaligned playback in wireless speakers | |
| CN111755002B (en) | Speech recognition device, electronic apparatus, and speech recognition method | |
| CN111688580A (en) | Method and device for picking up sound by intelligent rearview mirror | |
| WO2019100475A1 (en) | Data transmission method, apparatus and device, and storage medium | |
| CN112071323A (en) | Method and device for acquiring false wake-up sample data and electronic equipment | |
| CN111966448A (en) | Audio transmission method and system | |
| CN110704012A (en) | Audio data processing method and device, electronic equipment and medium | |
| CN111383626A (en) | Vehicle-mounted voice interaction method, device, equipment and medium | |
| CN112382281B (en) | Voice recognition method, device, electronic equipment and readable storage medium | |
| CN111724805A (en) | Method and apparatus for processing information | |
| EP3923278A2 (en) | Method, apparatus, device, storage medium and program for determining displayed text recognized from speech | |
| CN109951729A (en) | Method and apparatus for handling data | |
| CN112233681A (en) | Method and device for determining mistakenly awakened corpus, electronic equipment and storage medium | |
| CN112581941A (en) | Audio recognition method and device, electronic equipment and storage medium | |
| CN113593619B (en) | Method, apparatus, device and medium for recording audio | |
| CN111726402A (en) | User behavior data processing method and device, electronic equipment and storage medium | |
| CN113593589B (en) | Echo time delay detection method and device and electronic equipment | |
| KR102436302B1 (en) | Negative delay time detection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211013 Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing Applicant after: Apollo Zhilian (Beijing) Technology Co.,Ltd. Address before: 2 / F, *** building, 10 Shangdi 10th Street, Haidian District, Beijing 100085 Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right |