CN112689872A

CN112689872A - Audio detection method, computer-readable storage medium and electronic device

Info

Publication number: CN112689872A
Application number: CN201880097551.0A
Authority: CN
Inventors: 马玉刚
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Priority date: 2018-11-21
Filing date: 2018-11-21
Publication date: 2021-04-20
Anticipated expiration: 2038-11-21
Also published as: CN112689872B; WO2020103008A1

Abstract

An audio detection method, comprising: when a detection instruction is obtained, obtaining an audio file according to the detection instruction; inputting the audio file into at least two processing units which are sequentially arranged for processing; matching the target data with prestored data each time the processing unit outputs the target data; and outputting abnormal information corresponding to the target data when the target data is not matched with the pre-stored data, wherein the abnormal information is used for prompting that a processing unit for outputting the target data is abnormal.

Description

Audio detection method, computer-readable storage medium and electronic device

Technical Field

The present application relates to the field of computer technologies, and in particular, to an audio detection method, a computer-readable storage medium, and an electronic device.

Background

When the electronic device plays the audio file, the electronic device needs to read, decode, and the like the audio file, and then plays and processes the sound corresponding to the audio file through the speaker. When the sound played by the loudspeaker is abnormal, such as silence during playing, noise during playing and the like, developers can determine an abnormal processing unit by reproducing the abnormal phenomenon and acquiring a corresponding log for analysis. However, the conventional technique has a problem of low processing efficiency.

Disclosure of Invention

Various embodiments according to the present application provide an audio detection method, a computer-readable storage medium, and an electronic device.

An audio detection method, comprising:

when a detection instruction is obtained, obtaining an audio file according to the detection instruction;

inputting the audio file into at least two processing units which are sequentially arranged for processing;

matching the target data with pre-stored data each time the processing unit outputs the target data; and

and when the target data is not matched with the pre-stored data, outputting abnormal information corresponding to the target data, wherein the abnormal information is used for prompting that a processing unit outputting the target data is abnormal.

One or more computer-readable storage media embodying computer-executable instructions that, when executed by one or more processors, cause the processors to:

An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to:

According to the audio detection method, the computer-readable storage medium and the electronic device, when the detection instruction is obtained, the audio file is obtained according to the detection instruction, the audio file is input to the at least two processing units which are sequentially arranged for processing, when each processing unit outputs target data, the target data is matched with pre-stored data, when the target data is not matched with the pre-stored data, abnormal information corresponding to the target data is output, and the abnormal information is used for prompting that the processing unit which outputs the target data is abnormal, so that the detection efficiency of the audio processing unit can be improved.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the application will be apparent from the description and drawings, and from the claims.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the technical solutions in the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a diagram of an exemplary audio detection method.

FIG. 2 is a flow diagram of a method for audio detection in one embodiment.

FIG. 3 is a flow diagram of processing an audio file by a processing unit in one embodiment.

FIG. 4 is a flow diagram of processing document data by a data processing unit in one embodiment.

FIG. 5 is a flow diagram of matching audio data with pre-stored data in one embodiment.

FIG. 6 is a flow diagram of a method for audio detection in one embodiment.

FIG. 7 is a block diagram of an audio detection device according to an embodiment.

Fig. 8 is a schematic diagram of an internal structure of an electronic device in one embodiment.

Fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, the first audio data may be referred to as second audio data, and similarly, the second audio data may be referred to as first audio data, without departing from the scope of the present application. The first audio data and the second audio data are both audio data, but they are not the same audio data.

FIG. 1 is a diagram of an exemplary audio detection method. As shown in fig. 1, the application environment includes an electronic device 110. The electronic device 110 may process the audio file and play the processed audio data through a speaker. Specifically, when the electronic device 110 acquires the detection instruction, the audio file is acquired according to the detection instruction, the audio file is input to at least two processing units arranged in sequence for processing, each time the processing unit outputs the target data, the target data is matched with the pre-stored data, and when the target data is not matched with the pre-stored data, the abnormal information corresponding to the target data is output, and the abnormal information is used for prompting that the processing unit outputting the target data is abnormal. It is understood that the electronic device 110 may be a mobile phone, a computer, a wearable device, etc., and is not limited thereto.

FIG. 2 is a flow diagram of a method for audio detection in one embodiment. The audio detection method in the present embodiment is described by taking the electronic device 110 in fig. 1 as an example. As shown in fig. 2, the audio detection method includes operations 202 to 208. Wherein:

in operation 202, when the detection instruction is acquired, the audio file is acquired according to the detection instruction.

The detection instruction can be generated by clicking a button on the display screen by a user, or generated by pressing a control on the touch screen by the user, or automatically generated by the electronic device, and the electronic device can acquire the detection instruction of the audio processing unit. The user may trigger the detection instruction when the sound played by the speaker of the electronic device is abnormal, for example, when the audio file is played without sound, noise occurs, or the played sound does not correspond to the audio file, the electronic device may obtain the detection instruction triggered by the user. An audio file refers to a file containing binary data of real audio. The audio file can be processed by the electronic equipment and played through a loudspeaker of the electronic equipment after the processing. In this embodiment of the application, the audio file acquired by the electronic device according to the detection instruction may be an audio file pre-stored by the electronic device, or may also be an audio file downloaded by the electronic device from a network, and the like, which is not limited thereto. The format of the Audio file may be various, such as mp3(Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3), wav (wave), mpeg (Moving Picture Experts Group) format, and the like. In one embodiment, the detection instruction may include an audio format, and the electronic device may pre-store audio files in different formats, so as to obtain a corresponding audio file according to the audio format included in the detection instruction.

In operation 204, the audio file is input to at least two processing units arranged in sequence for processing.

The processing unit refers to each unit in the electronic device that processes the audio file. When the electronic device receives a playing instruction of the audio file, the audio file can be input to at least two processing units which are sequentially arranged for processing, and the processed audio data can be played through a loudspeaker. Specifically, the processing unit may include an audio reading unit, a decoding unit, a signal conversion unit, and the like, without being limited thereto. Each processing unit may be implemented by a software program, a hardware module, or the like, and is not limited herein. The processing units corresponding to different application scenarios may be different. For example, when the electronic device needs to perform mixing processing on an audio file, the processing unit of the electronic device may further include a mixing unit. The electronic equipment can input the audio file into at least two processing units which are arranged in sequence for processing.

In operation 206, the target data is matched with the pre-stored data each time the processing unit outputs the target data.

When the electronic equipment inputs the audio file into at least two processing units which are sequentially arranged for processing, each processing unit processes the input data and outputs the processed target data. For example, when at least two processing units arranged in sequence are a file reading unit and a decoding unit, the file reading unit may read an audio file and output the read data as target data corresponding to the file reading unit; the decoding unit may perform decoding processing on the data output by the file reading unit, and output the data after the decoding processing as target data corresponding to the decoding unit.

The pre-stored data is data that the processing unit outputs in case of normal play of the audio file. The electronic device may pre-store pre-stored data corresponding to the audio file. Furthermore, the target data is matched with the pre-stored data each time the processing unit outputs the target data. The electronic equipment matches the target data with the pre-stored data, specifically, the electronic equipment can calculate the matching degree between the target data and the pre-stored data, when the matching degree exceeds a threshold value, the target data is judged to be matched with the pre-stored data, and when the matching degree does not exceed the threshold value, the target data is judged not to be matched with the pre-stored data. The calculation mode of the matching degree can adopt different calculation modes according to different target data, and the threshold value can be set according to actual requirements, which are not limited herein.

And in operation 208, when the target data does not match the pre-stored data, outputting exception information corresponding to the target data, wherein the exception information is used for prompting that a processing unit outputting the target data is abnormal.

The exception information corresponding to the target data is information for prompting an exception of the processing unit that outputs the target data. And when the target data is not matched with the pre-stored data, the electronic equipment outputs abnormal information corresponding to the target data. Specifically, when the target data does not match the pre-stored data, the electronic device may acquire a processing unit that outputs the target data, and generate abnormality information of the processing unit. The abnormal information may be displayed on a display screen of the electronic device, and specifically, may be displayed in the form of a pop-up window, a notification bar, or the like, but is not limited thereto.

In the embodiment provided by the application, when a detection instruction is acquired, an audio file is acquired according to the detection instruction, the audio file is input to at least two processing units which are sequentially arranged for processing, when the processing unit outputs target data each time, the target data is matched with pre-stored data, when the target data is not matched with the pre-stored data, abnormal information corresponding to the target data is output, and the abnormal information is used for prompting that the processing unit which outputs the target data is abnormal. After the audio file is input into the processing unit for processing, the target data output by the processing unit can be matched with the pre-stored data, so that whether the processing unit outputting the target data is abnormal or not is determined, the operation is simple, the abnormal processing unit is determined without manually analyzing the log of the abnormal audio playing, and the detection efficiency of the audio processing unit can be effectively improved.

In one embodiment, the provided audio detection method further comprises: and when the target data is not matched with the pre-stored data, finishing the operation of matching the target data with the pre-stored data every time the processing unit outputs the target data.

The electronic device may end the operation of matching the target data with the pre-stored data each time the processing unit outputs the target data when the target data does not match with the pre-stored data. For example, in the above example, the at least two processing units arranged in sequence include a file reading unit and a decoding unit, and when the electronic device detects that the target data output by the file reading unit does not match the pre-stored data, the electronic device outputs the abnormal information corresponding to the target data, that is, the information for prompting the file reading unit to be abnormal, and simultaneously ends the detection, that is, the operation of not matching the target data output by the decoding unit.

Generally, when the electronic device processes an audio file in a normal operation condition, the output of the previous processing unit is used as the input of the next processing unit. When the electronic device detects that the target data is not matched with the pre-stored data, the target data is abnormal data, and at this time, the target data is used as the input of the next processing unit, so that the target data output by the next processing unit is also abnormal inevitably and is not matched with the pre-stored data, therefore, under the condition that the target data is not matched with the pre-stored data, the electronic device finishes the operation of matching the target data with the pre-stored data when the processing unit outputs the target data every time, and the resource consumption of the electronic device can be saved.

In one embodiment, the process of matching the target data with the pre-stored data in the audio detection method further comprises: matching the target data with prestored data corresponding to a target processing unit outputting the target data; the audio detection method further comprises: when the target data is matched with the pre-stored data, the target data is used as the input of the next processing unit of the target processing unit; when the target data does not match the pre-stored data, the pre-stored data is used as an input of a next processing unit of the target processing unit.

The target processing unit refers to a processing unit that outputs target data. The pre-stored data is data output by each processing unit in the case where the audio file is normally played. The electronic device may pre-store pre-stored data corresponding to each processing unit. The electronic device matches the target data with pre-stored data corresponding to a target processing unit that outputs the target data. Specifically, when the processing unit outputs the target data, the electronic device acquires pre-stored data corresponding to the target processing unit which outputs the target data, and matches the target data with the pre-stored data.

Generally, when the electronic device processes an audio file in a normal operation condition, the output of the previous processing unit is used as the input of the next processing unit. The electronic device may take the target data as an input to a next processing unit of the target processing unit when the target data matches the pre-stored data. When the target data is not matched with the pre-stored data, the electronic equipment takes the pre-stored data as the input of the next processing unit of the target processing unit, namely the pre-stored data corresponding to the target processing unit is taken as the input of the next processing unit of the target processing unit, the accuracy of the input data of the next processing unit can be ensured, and then each processing unit in the audio processing process can be subjected to matching detection, the detection accuracy of the audio processing unit can be improved, and the condition that only the abnormal information of one processing unit is output under the condition that two or more processing units are abnormal is avoided.

In one embodiment, an audio detection method is provided, in which target data includes file data output by a file reading unit and audio data output by a data processing unit arranged in sequence; in the audio detection method, when the processing unit outputs the target data each time, the process of matching the target data with the pre-stored data comprises the following steps: outputting file data by the file reading unit every time, and matching the file data with prestored data; and outputting the audio data by the data processing unit every time, and matching the audio data with the pre-stored data.

The at least two processing units included in the electronic device may include a file reading unit and a data processing unit that are arranged in sequence. The number of the data processing units can be one or more. The target data output by the processing unit of the electronic device may include file data output by the file reading unit and audio data output by the data processing unit. The electronic equipment can match the file data with pre-stored file data when the file reading unit outputs the file data each time, wherein the pre-stored file data is pre-stored data corresponding to the file reading unit; and when the data processing unit outputs the audio data each time, matching the audio data with pre-stored audio data, wherein the pre-stored audio data is pre-stored data corresponding to the audio processing unit which outputs the audio data.

FIG. 3 is a flow diagram of processing an audio file by a processing unit in one embodiment. As shown in fig. 3, in an embodiment, a process of inputting an audio file into at least two processing units arranged in sequence for processing in an audio detection method is provided, which includes:

in operation 302, an audio file is read by a file reading unit.

The file reading unit is a unit for reading an audio file. The file reading unit may be implemented by a software program, or may be implemented by a hardware module, which is not limited herein. The electronic device may read the audio file through the file reading unit. Specifically, the electronic device may read a file name, a file size, a file type, or the like included in the audio file, and parse audio data included in the audio file.

In operation 304, when the reading is successful, the file data obtained by processing the audio file is output by the file reading unit, and the file data is used as the input of the data processing unit.

When the file reading unit successfully reads, the file reading unit can output file data obtained after the audio file is processed. The file data may include at least one of a file name, a file size, a file type, and audio data included in the file to which the audio file corresponds. The electronic device can match the output file data with the pre-stored data, and determine whether the file reading unit is abnormal according to the matching result. The electronic equipment can also acquire the file data output by the file reading unit as the input of the data processing unit when the reading is successful. Specifically, the electronic device may use audio data contained in the file data as input data to the data processing unit, wherein the audio data output by the file reading unit is undecoded data.

In one embodiment, when the reading is successful, the process of matching the file data with the pre-stored data in the audio detection method includes: detecting whether the file data is consistent with the pre-stored data; and when the file data is inconsistent with the pre-stored data, judging that the file data is not matched with the pre-stored data.

The electronic device may obtain pre-stored data corresponding to the file reading unit, and further detect whether the file data is consistent with the pre-stored data, and specifically, the electronic device may detect at least one of a file name, a file size, a file type, and audio data included in the file data. For example, the electronic device may detect whether audio data contained in a file is identical to pre-stored data, and when the audio data is binary data, the electronic device may detect whether the binary data is identical to binary data contained in the pre-stored data. And when the file data is inconsistent with the pre-stored data, the electronic equipment judges that the file data is not matched with the pre-stored data.

In operation 306, when the reading is unsuccessful, the exception information of the file reading unit is output.

And when the file reading unit fails to read the audio file, the electronic equipment outputs the abnormal information of the file reading unit. Specifically, the abnormality information may contain an abnormality type of the file reading unit. For example, in this embodiment, the abnormality cause of the file reading unit is that reading of the audio file is unsuccessful; when the file data is not matched with the pre-stored data, the abnormal reason of the file reading unit is an audio file reading error. Similarly, when the other data processing unit does not output the corresponding audio data, the electronic device may also output exception information that the data processing unit failed to process the audio data.

When the file reading unit successfully reads the audio file, the output file data is matched with the pre-stored data to determine whether the file reading unit is abnormal or not, the file data output by the file reading unit is used as the input of the data processing unit, and when the reading is unsuccessful, the abnormal information of the file reading unit is output, so that the corresponding abnormal information can be output when the file reading unit cannot read the audio file, and the accuracy of the abnormal detection of the audio processing unit can be improved.

FIG. 4 is a flow diagram of processing document data by a data processing unit in one embodiment. In one embodiment, a data processing unit in the provided audio detection method comprises a decoding unit, a mixing unit and a signal conversion unit which are arranged in sequence, wherein the audio data comprises first audio data, second audio data and third audio data; after the file data is used as the input of the data processing unit, the audio detection method further comprises the following steps:

in operation 402, the file data is decoded by the decoding unit, and the first audio data corresponding to the decoding unit is output.

The data processing unit used by the electronic device to process the audio data may include a decoding unit, a mixing unit, and a signal conversion unit arranged in sequence. Each data processing unit may be implemented by a software program, or may be implemented by hardware such as a chip. For example, the electronic device may implement the decoding process of the audio data by a decoding program, or may implement the decoding process of the audio data by a decoder; the electronic device may implement signal conversion of the audio data through a signal conversion chip such as a codec chip. The audio data output by the file reading unit is undecoded data, and the electronic equipment can decode the audio data contained in the file data through the decoding unit and output the audio data to obtain first audio data. The first audio data is PCM (Pulse Code Modulation) data, which is a Pulse sequence obtained by sampling and quantizing an analog signal. Furthermore, when the first audio data is matched with the pre-stored data corresponding to the decoding unit, the first audio data is used as the input of the sound mixing unit when the first audio data is matched with the pre-stored data corresponding to the decoding unit; and when the data is not matched, outputting the abnormal information of the decoding unit, and finishing the matching operation or performing the matching operation by taking the pre-stored data corresponding to the decoding unit as the input of the sound mixing unit.

In operation 404, the first audio data is mixed by the mixing unit, and the second audio data corresponding to the mixing unit is output.

The mixing unit may be used for at least one of a multi-channel audio data processing and a resampling process. Specifically, the mixing unit may output a plurality of different second audio data, may combine a plurality of input audio data into one second audio data, and may perform frequency conversion on the input audio data. For example, when the first audio data output by the decoding unit is 44.1kHz, the mixing unit may convert the first audio data into second audio data of 48kHz, and the like. The electronic equipment can perform sound mixing processing on the first audio data through the sound mixing unit and output the first audio data to obtain second audio data. Furthermore, when the second audio data is matched with the pre-stored data corresponding to the audio mixing unit, the second audio data is used as the input of the signal conversion unit when the second audio data is matched with the pre-stored data corresponding to the audio mixing unit; and when the data is not matched, outputting the abnormal information of the sound mixing unit, and finishing the matching operation or performing the matching operation by taking the pre-stored data corresponding to the sound mixing unit as the input of the signal conversion unit.

In operation 406, the second audio data is signal-converted by the signal conversion unit, and third audio data is output.

The signal conversion unit can convert the PCM data into an analog signal, so as to drive a loudspeaker to emit sound to play audio. The electronic device can perform signal conversion processing on the second audio data through the signal conversion unit and output the second audio data to obtain third audio data. Furthermore, when the third audio data is matched with the pre-stored data corresponding to the signal conversion unit, the third audio data is played through a loudspeaker when the third audio data is matched with the pre-stored data corresponding to the signal conversion unit; when the data are not matched, the abnormal information of the signal conversion unit is output, and the electronic equipment can play the pre-stored data corresponding to the signal conversion unit through a loudspeaker. Therefore, under the condition that the processing units are normal, the user can also determine whether the loudspeaker is abnormal through the sound played by the loudspeaker, and the accuracy of abnormality detection can be improved.

The electronic equipment inputs the audio file into the file reading unit, the decoding unit, the sound mixing unit and the signal conversion unit which are sequentially arranged for processing, when the processing unit outputs the audio data each time, the audio data is matched with the pre-stored data, whether the processing unit is abnormal or not is determined according to the matching result, and the detection efficiency of the processing unit can be improved. The processing unit included in the electronic device may be one or more of the processing units described above, and may also include other processing units, which are not limited herein.

FIG. 5 is a flow diagram of matching audio data with pre-stored data in one embodiment. In one embodiment, the provided audio detection method matches audio data with pre-stored data, including:

in operation 502, target spectrum information included in audio data is acquired.

The target spectrum information refers to spectrum information contained in the audio data. The information of tone, timbre, volume, etc. of the audio data can be analyzed based on the target spectrum information. The electronic device may acquire target spectrum information contained in the audio data.

In operation 504, the similarity between the target spectrum information and the pre-stored spectrum information included in the pre-stored data is detected.

The electronic device may detect a similarity between the target spectrum information and pre-stored spectrum information contained in the pre-stored data. Specifically, the electronic device performs similarity detection according to the waveform, amplitude, frequency, and the like included in the target spectrum information and the pre-stored spectrum information. The electronic device may further perform sampling detection on the target frequency spectrum information, that is, obtain a part of frequency spectrum information included in the target frequency spectrum information to perform similarity detection, and the specific sampling rule may be set according to an actual requirement, which is not limited herein.

In operation 506, when the similarity is lower than the similarity threshold, it is determined that the audio data does not match the pre-stored data.

The similarity threshold may be set according to actual requirements, and may be, for example, 80%, 88%, 90%, 95%, or the like, but is not limited thereto. When the similarity is greater than or equal to the similarity threshold, the electronic device may determine that the target data matches the pre-stored data; when the similarity is lower than the similarity threshold, the electronic equipment can judge that the audio data is not matched with the pre-stored data, and then output the abnormal information of the audio data, wherein the abnormal information is used for prompting that the processing unit for outputting the audio data is abnormal.

When each data processing unit outputs audio data, the similarity between target spectrum information contained in the audio data and pre-stored spectrum information is detected, when the similarity is lower than a similarity threshold value, the audio data is judged to be not matched with the pre-stored data, and then abnormal information of the audio data is input, so that the accuracy of audio detection can be improved.

In an embodiment, when the detection instruction is obtained, before the audio file is obtained according to the detection instruction, the audio detection method further includes: and generating a detection instruction when the time length from the last generation of the detection instruction exceeds the preset time length.

The preset time can be set according to actual requirements, and is not limited herein. For example, the preset time period may be 1 day, 10 days, 1 month, etc., but is not limited thereto. The electronic equipment can generate a detection instruction at regular time to detect the processing unit of the audio file. Specifically, the electronic device may detect a time length from the last time the detection instruction was generated, and generate the detection instruction when the time length exceeds a preset time length. The last generated detection instruction may be a detection instruction generated by user triggering.

When the time length from the last generation of the detection instruction exceeds the preset time length, the electronic equipment can generate the detection instruction, further obtain an audio file according to the detection instruction, input the audio file to at least two processing units which are sequentially arranged for processing, match target data output by the processing units with prestored data, and when the target data are not matched with the prestored data, output information for prompting the processing units which output the target data to be abnormal, so that the timeliness of the audio processing units can be improved, and the condition that the processing units are abnormally aggravated because a user does not detect the processing units when the processing units are abnormal inconspicuously is avoided.

FIG. 6 is a flow diagram of a method for audio detection in one embodiment. As shown in fig. 6, the specific operation of the audio detection method is as follows:

firstly, the electronic equipment acquires a detection instruction and acquires an audio file according to the detection instruction.

Then, the electronic device reads the audio file through the file reading unit to obtain output file data.

And then, the electronic equipment matches the file data with the pre-stored data, inputs the audio file into the decoding unit for processing when the file data is matched with the pre-stored data, outputs abnormal information of the file reading unit when the file data is not matched with the pre-stored data, and ends the detection.

Optionally, the electronic device processes the file data through a decoding unit to obtain the output first audio data.

And then, the electronic equipment matches the first audio data with the pre-stored audio data, inputs the first audio data into the sound mixing unit for processing when the first audio data is matched with the pre-stored audio data, outputs abnormal information of the decoding unit when the first audio data is not matched with the pre-stored audio data, and ends the detection.

Optionally, the electronic device processes the first audio data through the mixing unit to obtain output second audio data.

And then, the electronic equipment matches the second audio data with the pre-stored audio data, inputs the second audio data into the signal conversion unit for processing when the second audio data is matched with the pre-stored audio data, outputs abnormal information of the sound mixing unit when the second audio data is not matched with the pre-stored audio data, and ends the detection.

Optionally, the electronic device processes the first audio data through the signal conversion unit to obtain output third audio data.

And then, the electronic equipment matches the third audio data with the pre-stored audio data, when the third audio data is matched with the pre-stored audio data, the detection is finished, the third audio data can also be played through a loudspeaker, and when the third audio data is not matched with the pre-stored audio data, the abnormal information of the signal conversion unit is output, and the detection is finished.

FIG. 7 is a block diagram of an audio detection device according to an embodiment. As shown in fig. 7, the audio detection apparatus includes an obtaining module 702, a processing module 704, a matching module 706, and an output module 708, wherein:

an obtaining module 702, configured to obtain, when the detection instruction is obtained, the audio file according to the detection instruction.

And the processing module 704 is used for inputting the audio file to at least two processing units which are arranged in sequence for processing.

And a matching module 706, configured to match the target data with pre-stored data each time the processing unit outputs the target data.

And an output module 708, configured to output exception information corresponding to the target data when the target data is not matched with the pre-stored data, where the exception information is used to prompt that a processing unit outputting the target data is abnormal.

The audio detection device provided by the embodiment of the application is used for acquiring the audio file according to the detection instruction when the detection instruction is acquired, inputting the audio file into at least two processing units which are sequentially arranged for processing, matching the target data with the pre-stored data when each processing unit outputs the target data, outputting abnormal information corresponding to the target data when the target data is not matched with the pre-stored data, and prompting the processing unit which outputs the target data to be abnormal by the abnormal information, so that the detection efficiency of the audio processing unit can be improved.

In one embodiment, the matching module 706 is further configured to end the operation of matching the target data with the pre-stored data each time the processing unit outputs the target data when the target data does not match with the pre-stored data.

In one embodiment, the target data includes file data output by the file reading unit and audio data output by the data processing unit arranged in sequence; the matching module 706 can also be used for outputting file data in each file reading unit and matching the file data with pre-stored data; and outputting the file data by the file reading unit every time, and matching the file data with the pre-stored data.

In one embodiment, the processing module 704 may also be configured to read an audio file through a file reading unit; when the reading is successful, outputting file data obtained by processing the audio file through a file reading unit, and taking the file data as the input of a data processing unit; and outputting the abnormal information of the file reading unit when the reading is unsuccessful.

In one embodiment, the data processing unit includes a decoding unit, a mixing unit, and a signal conversion unit arranged in sequence, and the audio data includes first audio data, second audio data, and third audio data; the processing module 704 may be further configured to perform decoding processing on the file data through a decoding unit, and output first audio data corresponding to the decoding unit; performing sound mixing processing on the first audio data through a sound mixing unit, and outputting second audio data corresponding to the sound mixing unit; and performing signal conversion processing on the second audio data through a signal conversion unit, and outputting third audio data.

In one embodiment, the matching module 706 may be further configured to detect whether the file data is consistent with the pre-stored data; and when the file data is inconsistent with the pre-stored data, judging that the file data is not matched with the pre-stored data.

In one embodiment, the matching module 706 may be further configured to obtain target spectrum information included in the audio data; detecting the similarity between the target frequency spectrum information and pre-stored frequency spectrum information contained in pre-stored data; and when the similarity is lower than the similarity threshold value, judging that the audio data is not matched with the pre-stored data.

In one embodiment, the provided audio detection method further includes an instruction generating module 710, where the instruction generating module 710 is configured to generate the detection instruction when a time length from the last time of generating the detection instruction exceeds a preset time length.

In one embodiment, the matching module 706 may be further configured to match the target data with pre-stored data corresponding to a target processing unit outputting the target data; when the target data is matched with the pre-stored data, the target data is used as the input of the next processing unit of the target processing unit; when the target data does not match the pre-stored data, the pre-stored data is used as an input of a next processing unit of the target processing unit.

The division of each module in the audio detection apparatus is only used for illustration, and in other embodiments, the audio detection apparatus may be divided into different modules as needed to complete all or part of the functions of the audio detection apparatus.

Fig. 8 is a schematic diagram of an internal structure of an electronic device in one embodiment. As shown in fig. 8, the electronic device includes a processor and a memory connected by a system bus. Wherein, the processor is used for providing calculation and control capability and supporting the operation of the whole electronic equipment. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by a processor for implementing an audio detection method provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer programs in the non-volatile storage medium. The electronic device may be a mobile phone, a tablet computer, or a personal digital assistant or a wearable device, etc.

The embodiment of the application also provides a computer readable storage medium. On which a computer program is stored, characterized in that the computer program realizes the audio detection method as described above when executed by a processor.

The embodiment of the application also provides the electronic equipment. As shown in fig. 9, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, a wearable device, and the like, taking the electronic device as the mobile phone as an example:

fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 9, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, display unit 940, sensor 950, audio circuit 960, wireless fidelity (WiFi) module 970, processor 980, and power supply 990. Those skilled in the art will appreciate that the handset configuration shown in fig. 9 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The RF circuit 910 may be used for receiving and transmitting signals during information transmission or communication, and may receive downlink information of a base station and then process the downlink information to the processor 980; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.

The memory 920 may be used to store software programs and modules, and the processor 980 may execute various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the mobile phone, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone 900. Specifically, the input unit 930 may include a touch panel 931 and other input devices 932. The touch panel 931, which may also be referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 931 (e.g., a user operating the touch panel 931 or near the touch panel 931 by using a finger, a stylus, or any other suitable object or accessory), and drive the corresponding connection device according to a preset program. In one embodiment, the touch panel 931 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 980, and can receive and execute commands sent by the processor 980. In addition, the touch panel 931 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 930 may include other input devices 932 in addition to the touch panel 931. In particular, other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), and the like.

The display unit 940 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 940 may include a display panel 941. In one embodiment, the Display panel 941 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the touch panel 931 may overlay the display panel 941, and when the touch panel 931 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 980 to determine the type of touch event, and then the processor 980 provides a corresponding visual output on the display panel 941 according to the type of touch event. Although in fig. 9, the touch panel 931 and the display panel 941 are two independent components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 931 and the display panel 941 may be integrated to implement the input and output functions of the mobile phone.

Cell phone 900 may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 941 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 941 and/or backlight when the mobile phone is moved to the ear. The motion sensor can comprise an acceleration sensor, the acceleration sensor can detect the magnitude of acceleration in each direction, the magnitude and the direction of gravity can be detected when the mobile phone is static, and the motion sensor can be used for identifying the application of the gesture of the mobile phone (such as horizontal and vertical screen switching), the vibration identification related functions (such as pedometer and knocking) and the like; the mobile phone may be provided with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor.

Audio circuitry 960, speaker 961 and microphone 962 may provide an audio interface between a user and a cell phone. The audio circuit 960 may transmit the electrical signal converted from the received audio data to the speaker 961, and convert the electrical signal into a sound signal for output by the speaker 961; on the other hand, the microphone 962 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 960, and then outputs the audio data to the processor 980 for processing, and then the audio data can be transmitted to another mobile phone through the RF circuit 910, or the audio data can be output to the memory 920 for subsequent processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 970, and provides wireless broadband Internet access for the user. Although fig. 9 shows WiFi module 970, it is to be understood that it does not belong to the essential components of cell phone 900 and may be omitted as desired.

The processor 980 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the mobile phone. In one embodiment, processor 980 may include one or more processing units. In one embodiment, the processor 980 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, and the like; the modem processor handles primarily wireless communications. It will be appreciated that the modem processor may not be integrated into the processor 980.

The handset 900 also includes a power supply 990 (e.g., a battery) for supplying power to various components, which may preferably be logically connected to the processor 980 via a power management system, such that the power management system may be used to manage charging, discharging, and power consumption.

In one embodiment, the cell phone 900 may also include a camera, a bluetooth module, and the like.

In an embodiment of the present application, the electronic device includes a processor 980 that implements the audio detection method as described above when executing a computer program stored on a memory.

Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

An audio detection method, comprising:

when a detection instruction is obtained, obtaining an audio file according to the detection instruction;

inputting the audio file into at least two processing units which are sequentially arranged for processing;

matching the target data with pre-stored data each time the processing unit outputs the target data; and

and when the target data is not matched with the pre-stored data, outputting abnormal information corresponding to the target data, wherein the abnormal information is used for prompting that a processing unit outputting the target data is abnormal.
The method of claim 1, further comprising:

and when the target data is not matched with the pre-stored data, finishing the operation of matching the target data with the pre-stored data when the processing unit outputs the target data each time.
The method according to claim 1, wherein the target data includes document data output by a document reading unit and audio data output by a data processing unit arranged in sequence;

the matching of the target data with pre-stored data each time the processing unit outputs target data comprises:

outputting the file data by the file reading unit every time, and matching the file data with the prestored data; and

and outputting the audio data by the data processing unit every time, and matching the audio data with the pre-stored data.
The method of claim 3, wherein inputting the audio file into at least two processing units arranged in sequence for processing comprises:

reading the audio file through the file reading unit;

when the reading is successful, outputting the file data obtained by processing the audio file through the file reading unit, and taking the file data as the input of the data processing unit; and

and outputting the abnormal information of the file reading unit when the reading is unsuccessful.
The method according to claim 4, wherein the data processing unit comprises a decoding unit, a mixing unit and a signal conversion unit arranged in sequence, and the audio data comprises first audio data, second audio data and third audio data;

after the file data is used as the input of the data processing unit, the method further comprises the following steps:

decoding the file data through the decoding unit, and outputting first audio data corresponding to the decoding unit;

performing sound mixing processing on the first audio data through the sound mixing unit, and outputting second audio data corresponding to the sound mixing unit; and

and performing signal conversion processing on the second audio data through the signal conversion unit, and outputting the third audio data.
The method of claim 3, wherein matching the document data with the pre-stored data comprises:

detecting whether the file data is consistent with the pre-stored data; and

and when the file data is inconsistent with the pre-stored data, judging that the file data is not matched with the pre-stored data.
The method of claim 3, wherein matching the audio data with the pre-stored data comprises:

acquiring target frequency spectrum information contained in the audio data;

detecting the similarity between the target frequency spectrum information and prestored frequency spectrum information contained in the prestored data; and

and when the similarity is lower than a similarity threshold value, judging that the audio data is not matched with the pre-stored data.
The method according to claim 1, wherein when the detection instruction is obtained, before the audio file is obtained according to the detection instruction, further comprising:

and when the time length from the last generation of the detection instruction exceeds the preset time length, generating the detection instruction.
The method according to any one of claims 1 to 8, wherein said matching said target data with pre-stored data comprises:

matching the target data with prestored data corresponding to a target processing unit which outputs the target data;

the method further comprises the following steps:

when the target data is matched with the pre-stored data, taking the target data as the input of the next processing unit of the target processing unit; and

and when the target data is not matched with the pre-stored data, using the pre-stored data as the input of the next processing unit of the target processing unit.
One or more computer-readable storage media embodying computer-executable instructions that, when executed by one or more processors, cause the processors to:

when a detection instruction is obtained, obtaining an audio file according to the detection instruction;

inputting the audio file into at least two processing units which are sequentially arranged for processing;

matching the target data with pre-stored data each time the processing unit outputs the target data; and

and when the target data is not matched with the pre-stored data, outputting abnormal information corresponding to the target data, wherein the abnormal information is used for prompting that a processing unit outputting the target data is abnormal.
The computer-readable storage medium recited in claim 10, wherein the computer-executable instructions, when executed by one or more processors, cause the processors to:

and when the target data is not matched with the pre-stored data, finishing the operation of matching the target data with the pre-stored data when the processing unit outputs the target data each time.
The computer-readable storage medium according to claim 10, wherein the target data includes document data output by the document reading unit and audio data output by the data processing unit arranged in sequence; the processor executes the following operations when matching the target data with pre-stored data each time the processing unit outputs the target data:

outputting the file data by the file reading unit every time, and matching the file data with the prestored data; and

and outputting the audio data by the data processing unit every time, and matching the audio data with the pre-stored data.
The computer-readable storage medium of claim 12, wherein the processor, when executing the process of inputting the audio file to at least two processing units arranged in sequence, further executes the following operations:

reading the audio file through the file reading unit;

when the reading is successful, outputting the file data obtained by processing the audio file through the file reading unit, and taking the file data as the input of the data processing unit; and

and outputting the abnormal information of the file reading unit when the reading is unsuccessful.
The computer-readable storage medium of claim 13, wherein the data processing unit includes a decoding unit, a mixing unit, and a signal conversion unit, which are arranged in sequence, and the audio data includes first audio data, second audio data, and third audio data; after the processor executes the file data as the input of the data processing unit, the following operations are also executed:

decoding the file data through the decoding unit, and outputting first audio data corresponding to the decoding unit;

performing sound mixing processing on the first audio data through the sound mixing unit, and outputting second audio data corresponding to the sound mixing unit; and

and performing signal conversion processing on the second audio data through the signal conversion unit, and outputting the third audio data.
The computer-readable storage medium of claim 12, wherein the processor performs the matching of the document data with the pre-stored data by:

detecting whether the file data is consistent with the pre-stored data; and

and when the file data is inconsistent with the pre-stored data, judging that the file data is not matched with the pre-stored data.
The computer-readable storage medium of claim 12, wherein the processor performs the matching of the audio data with the pre-stored data by further performing the following:

acquiring target frequency spectrum information contained in the audio data;

detecting the similarity between the target frequency spectrum information and prestored frequency spectrum information contained in the prestored data; and

and when the similarity is lower than a similarity threshold value, judging that the audio data is not matched with the pre-stored data.
The computer-readable storage medium of claim 10, wherein the processor executes the following operations before, when the detection instruction is obtained, obtaining an audio file according to the detection instruction:

and when the time length from the last generation of the detection instruction exceeds the preset time length, generating the detection instruction.
The computer-readable storage medium according to any one of claims 10 to 17, wherein the processor performs the matching of the target data with pre-stored data by further performing the following operations:

matching the target data with prestored data corresponding to a target processing unit which outputs the target data;

when the target data is matched with the pre-stored data, taking the target data as the input of the next processing unit of the target processing unit; and

and when the target data is not matched with the pre-stored data, using the pre-stored data as the input of the next processing unit of the target processing unit.
An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to:

when a detection instruction is obtained, obtaining an audio file according to the detection instruction;

inputting the audio file into at least two processing units which are sequentially arranged for processing;

matching the target data with pre-stored data each time the processing unit outputs the target data; and

and when the target data is not matched with the pre-stored data, outputting abnormal information corresponding to the target data, wherein the abnormal information is used for prompting that a processing unit outputting the target data is abnormal.
The electronic device of claim 19, wherein the computer readable instructions, when executed by the processor, cause the processor to:

and when the target data is not matched with the pre-stored data, finishing the operation of matching the target data with the pre-stored data when the processing unit outputs the target data each time.
The electronic device according to claim 19, wherein the target data includes document data output by a document reading unit and audio data output by a data processing unit arranged in sequence; the processor executes the following operations when matching the target data with pre-stored data each time the processing unit outputs the target data:

outputting the file data by the file reading unit every time, and matching the file data with the prestored data; and

and outputting the audio data by the data processing unit every time, and matching the audio data with the pre-stored data.
The electronic device of claim 21, wherein the processor, when executing the inputting of the audio file to at least two processing units arranged in sequence for processing, further executes the following operations:

reading the audio file through the file reading unit;

when the reading is successful, outputting the file data obtained by processing the audio file through the file reading unit, and taking the file data as the input of the data processing unit; and

and outputting the abnormal information of the file reading unit when the reading is unsuccessful.
The electronic device according to claim 22, wherein the data processing unit includes a decoding unit, a mixing unit, and a signal conversion unit arranged in this order, and the audio data includes first audio data, second audio data, and third audio data; after the processor executes the file data as the input of the data processing unit, the following operations are also executed:

decoding the file data through the decoding unit, and outputting first audio data corresponding to the decoding unit;

performing sound mixing processing on the first audio data through the sound mixing unit, and outputting second audio data corresponding to the sound mixing unit; and

and performing signal conversion processing on the second audio data through the signal conversion unit, and outputting the third audio data.
The electronic device of claim 21, wherein the processor performs the matching of the document data with the pre-stored data by:

detecting whether the file data is consistent with the pre-stored data; and

and when the file data is inconsistent with the pre-stored data, judging that the file data is not matched with the pre-stored data.
The electronic device of claim 21, wherein the processor performs the matching of the audio data with the pre-stored data by:

acquiring target frequency spectrum information contained in the audio data;

detecting the similarity between the target frequency spectrum information and prestored frequency spectrum information contained in the prestored data; and

and when the similarity is lower than a similarity threshold value, judging that the audio data is not matched with the pre-stored data.
The electronic device of claim 19, wherein when the detection instruction is obtained, before the audio file is obtained according to the detection instruction, the processor further performs the following operations:

and when the time length from the last generation of the detection instruction exceeds the preset time length, generating the detection instruction.
The electronic device according to any one of claims 19 to 26, wherein the processor performs the matching of the target data with pre-stored data by further performing the following operations:

matching the target data with prestored data corresponding to a target processing unit which outputs the target data;

when the target data is matched with the pre-stored data, taking the target data as the input of the next processing unit of the target processing unit; and

and when the target data is not matched with the pre-stored data, using the pre-stored data as the input of the next processing unit of the target processing unit.