CN113689890A

CN113689890A - Method and device for converting multi-channel signal and storage medium

Info

Publication number: CN113689890A
Application number: CN202110907025.XA
Authority: CN
Inventors: 吕雪洋; 史润宇
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2021-08-09
Filing date: 2021-08-09
Publication date: 2021-11-23

Abstract

The present disclosure relates to a method, an apparatus and a storage medium for converting a multi-channel signal, wherein the method is applied to an electronic device comprising a plurality of audio output modules, and the method comprises: acquiring the number of sound channels of an input first audio signal; if the number of the sound channels of the first audio signal is not the preset number of the sound channels, converting the first audio signal into a second audio signal with the preset number of the sound channels; and outputting the audio signals of different sound channels of the second audio signal by using different audio output modules.

Description

Method and device for converting multi-channel signal and storage medium

Technical Field

The present disclosure relates to the field of signal processing technologies, and in particular, to a method and an apparatus for converting a multi-channel signal, and a storage medium.

Background

Most of the present handheld electronic devices are limited by the number of audio output modules, and can only support a two-channel format of stereo, even if the sound source is multi-channel audio, usually, the multi-channel audio refers to audio with more than two channels, for example, 5.1 multi-channel audio (i.e. 6-channel audio) refers to a surround sound system with 5 basic channels (including a left channel, a center channel, a right channel, a left surround channel and a right surround channel) and a Low Frequency Effects (LFE) channel; it is also necessary to compress the multi-channel audio into two-channel audio before playing.

With the increasing demand for sound quality of handheld electronic devices by users, electronic devices equipped with more than 2 audio output modules, such as tablet computers equipped with 4 audio output modules, have begun to appear. However, in practical applications, even if more than 2 audio output modules are configured in the electronic device, the audio processing unit of the electronic device only supports the stereo format, so that sound field deviation is likely to occur when multi-channel audio is played, audio quality is damaged, and user experience is reduced.

Disclosure of Invention

The disclosure provides a conversion method, a device and a storage medium of a multi-channel signal.

According to a first aspect of the embodiments of the present disclosure, there is provided a method for converting a multi-channel signal, applied to an electronic device including a plurality of audio output modules, including:

acquiring the number of sound channels of an input first audio signal;

if the number of the sound channels of the first audio signal is not the preset number of the sound channels, converting the first audio signal into a second audio signal with the preset number of the sound channels;

and outputting the audio signals of different sound channels of the second audio signal by using different audio output modules.

Optionally, the converting the first audio signal into the second audio signal with the preset number of channels includes:

determining a target conversion mode from preset channel conversion modes based on the number of the channels of the first audio signal;

and converting the first audio signal into the second audio signal based on the target conversion mode.

Optionally, the outputting, by different audio output modules, audio signals of different channels of the second audio signal includes:

separating the second audio signal into a plurality of audio signals of different channels;

determining the corresponding relation between the plurality of audio output modules and the audio signals of the plurality of different sound channels according to the positions of the plurality of audio output modules and the azimuth information contained in the audio signals of the plurality of different sound channels;

and outputting the audio signals of different sound channels of the second audio signal by using different audio output modules based on the corresponding relation.

Optionally, the method further comprises:

determining that the distribution condition information of the audio output modules does not meet a first preset condition, and performing distance compensation processing on the audio signals of different sound channels corresponding to the audio output modules; the sound image distance of the audio signal after the distance compensation processing is larger than that of the audio signal;

based on the corresponding relationship, outputting the audio signals of different channels of the second audio signal by using different audio output modules, including:

and outputting the audio signals after the distance compensation processing by utilizing different audio output modules based on the corresponding relation.

Optionally, the method further comprises:

determining whether the output performances of the plurality of audio output modules meet a second preset condition;

if the output performance of the audio output modules does not meet a second preset condition, modulating audio signals of different sound channels corresponding to the audio output modules; the output performance determined by the plurality of audio output modules based on the audio signals after modulation processing meets the second preset condition;

and outputting the audio signal after modulation processing by utilizing different audio output modules based on the corresponding relation.

Optionally, the output performance satisfies the second preset condition, including:

the error value among the frequency response curves of the plurality of audio output modules is smaller than a first preset value;

and/or the loudness difference among the plurality of audio output modules is smaller than a second preset value.

determining the plurality of audio output modules as a first type of audio output module and a second type of audio output module according to whether the working frequency ranges of the plurality of audio output modules completely cover the frequencies of the audio signals of the different sound channels; the working frequency range of the first type of audio output module does not completely cover the frequencies of the audio signals of the different sound channels;

performing frequency division processing on a first sound channel signal corresponding to the first type of audio output module to obtain a first frequency signal and a second frequency signal; the frequency of the first frequency signal is contained in the working frequency range of the first type of audio output module;

and outputting the first frequency signal by using the first type of audio output module, and outputting a corresponding second channel signal and the second frequency signal by using the second type of audio output module.

Optionally, the method further comprises:

determining a third type of audio output module from the second type of audio output module, wherein the position of the third type of audio output module in the first direction is the same as the position of the first type of audio output module in the first direction;

the outputting the first frequency signal by the first type of audio output module, and outputting the corresponding second channel signal and the second frequency signal by the second type of audio output module, includes:

outputting the first frequency signal by using a first class audio output module;

and outputting the corresponding second channel signal and the second frequency signal by using the third type of audio output module.

According to a second aspect of the embodiments of the present disclosure, there is provided a multi-channel signal conversion apparatus applied to an electronic device including a plurality of audio output modules, including:

the device comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring the number of sound channels of an input first audio signal;

the conversion module is used for converting the first audio signal into a second audio signal with the preset number of channels if the number of the channels of the first audio signal is not the preset number of the channels;

and the output module is used for outputting the audio signals of different sound channels of the second audio signal by using different audio output modules.

Optionally, the conversion module is configured to:

Optionally, the output module is configured to:

Optionally, the apparatus further comprises: a compensation module to:

the output module is configured to:

Optionally, the apparatus further comprises: a compensation module to:

if the output performance of the audio output modules does not meet a second preset condition, modulating audio signals of different sound channels corresponding to the audio output modules; and the output performance determined by the plurality of audio output modules based on the audio signals after modulation processing meets the second preset condition.

The output module is configured to:

Optionally, the output module is further configured to:

According to a third aspect of the embodiments of the present disclosure, there is provided a conversion apparatus of a multi-channel signal, including:

a processor;

a memory for storing executable instructions;

wherein the processor is configured to: when the executable instructions stored in the memory are executed, the steps in the method for converting a multi-channel signal according to the first aspect of the embodiments of the present disclosure are implemented.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a multi-channel signal conversion apparatus, enable the multi-channel signal conversion apparatus to perform the steps of the multi-channel signal conversion method according to the first aspect of the embodiments of the present disclosure.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

the embodiment of the disclosure converts the channel number of the first audio signal into the second audio signal with the preset channel number if the channel number of the first audio signal is not the preset channel number, so as to convert the first audio signal into the second audio signal capable of adapting to the electronic device, and output the audio signals of different channels of the second audio signal by using different audio output modules, thereby reducing the occurrence of sound image deviation as much as possible on the basis of adapting to the electronic device, improving the sound quality of the electronic device, and improving the use experience of users.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a first flowchart illustrating a method of converting a multi-channel signal according to an exemplary embodiment.

Fig. 2 is a flowchart illustrating a multi-channel signal conversion method according to an exemplary embodiment.

Fig. 3 is a diagram illustrating a mapping of a 6-channel signal to a 4-channel signal according to an exemplary embodiment.

Fig. 4 is a schematic diagram illustrating a distribution of locations of speakers in an electronic device according to an example embodiment.

Fig. 5 is a schematic flow chart illustrating a process of performing crossover processing on an audio signal corresponding to a speaker according to an exemplary embodiment.

Fig. 6 is a third flowchart illustrating a multi-channel signal conversion method according to an exemplary embodiment.

Fig. 7 is a schematic diagram illustrating a structure of a multi-channel signal conversion apparatus according to an exemplary embodiment.

Fig. 8 is a block diagram illustrating a conversion apparatus of a multi-channel signal according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In the related art, since electronic devices are all loudspeaker enclosures based on stereo, multi-channel audio signals with more than 2 channels are downmixed into stereo audio signals (i.e. two-channel audio signals), as shown in table 1, table 1 is a mapping table for converting multi-channel audio signals into two-channel audio signals.

TABLE 1 mapping table for converting a multichannel audio signal into a binaural audio signal

Multi-channel audio signal	Stereo audio signal
		Monophonic channel c	L＝c，R＝c
Two sound channels l, r	L＝l，R＝r
		Three channels l, r, c	L＝1/2+c/2，R＝r/2+c/2
Four sound channels l, r, ls, rs	L＝1/2+ls/2，R＝r/2+rs/2
		Five sound channels l, r, c, ls, rs	L＝(1+ls+c)/3，R＝(r+rs+c)/3
Six channels l, r, c, lfe, ls, rs	L＝(1+ls+c+lfe)/4，R＝(r+rs+c+lfe)/4

Wherein c is a center channel, l is a left channel, r is a right channel, ls is a left surround channel, rs is a right surround channel, and lfe is a subwoofer channel. The L is a left channel of the stereo audio signal, and the R is a right channel of the stereo audio signal.

However, as the user demands the electronic device to have higher sound quality, the number of speakers on the electronic device is gradually increased, and electronic devices including 4 speakers are beginning to appear. However, in the related art, for such 4-speaker electronic devices, which still play based on stereo speakers, when audio signals of 5.1 multiple channels (i.e. 6 channels) or more are played, a sound image deviation may occur, which degrades the user experience.

In view of this, the disclosed embodiments provide a method for converting a multi-channel signal. Fig. 1 is a flowchart illustrating a method for converting a multi-channel signal according to an exemplary embodiment, where the method includes:

step S101, acquiring the number of sound channels of an input first audio signal;

step S102, if the number of the sound channels of the first audio signal is not the preset number of the sound channels, converting the first audio signal into a second audio signal with the preset number of the sound channels;

step S103, outputting the audio signals of different channels of the second audio signal by using different audio output modules.

In the embodiment of the present disclosure, the method for converting a multichannel signal may be applied to an electronic device including a plurality of audio output modules, where the electronic device may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, or a vehicle-mounted terminal; the electronic device is provided with a player for playing audio, the player may be a player capable of playing audio, for example, an audio player, and a processing unit in a video player for playing audio is also within the protection scope of the present disclosure. .

In step S101, in a case where a first audio signal input to the electronic apparatus is determined, detecting a number of channels in the first audio signal;

illustratively, the number of channels included in the first audio signal may be determined according to the audio track information by acquiring the audio track information of the first audio signal.

In step S102, the number of the preset channels may be determined according to the number of audio output modules included in the electronic device, where the number of the preset channels is less than or equal to the number of the audio output modules included in the electronic device.

In some embodiments, the number of preset channels may be the number of audio output modules included in the electronic device.

After the number of the channels of the first audio signal is obtained, determining whether the number of the channels of the first audio signal is the preset number of the channels, and if the number of the channels of the first audio signal is not the preset number of the channels, converting the first audio signal to obtain a second audio signal with the preset number of the channels. The number of channels of the first audio signal other than the preset number of channels herein includes: the number of channels of the first audio signal is less than the number of preset channels, or the number of channels of the first audio signal is greater than the number of preset channels.

In some embodiments, the preset number of channels may be: the number of audio output modules included in the electronic device that outputs the audio signal, or the number of available audio output modules that the electronic device that outputs the audio signal can currently use to output audio.

Illustratively, the preset number of channels may be 2, 4, 6, or 8, etc.

In other embodiments, the preset number of channels may include: a first number of channels and a second number of channels; the first channel number may be the number of audio output modules included in the electronic device, and the second channel number is smaller than the first channel number. Illustratively, the second channel number may be 2, 4, or 6, etc.

The method comprises the following steps:

acquiring a residual electric quantity value of the electronic equipment;

if the remaining electric quantity value of the electronic device is larger than the electric quantity threshold value, determining whether the number of the sound channels of the first audio signal is the first number of the sound channels, and if the number of the sound channels of the first audio signal is not the first number of the sound channels, converting the first audio signal to obtain a second audio signal with the first number of the sound channels.

If the residual electric quantity value of the electronic equipment is smaller than the electric quantity threshold value, determining whether the number of the sound channels of the first audio signal is larger than or equal to the number of the second sound channels;

if the number of the sound channels of the first audio signal is larger than or equal to the number of the second sound channels, outputting the first audio signal;

if the number of the sound channels of the first audio signal is smaller than the number of the second sound channels, the first audio signal can be converted to obtain a second audio signal with the second number of the sound channels.

Here, the second channel number may be a fixed value set by default of the electronic apparatus, or may be a fixed value set in advance by the user.

The method and the device have the advantages that the residual electric quantity value of the electronic equipment is considered, and when the residual electric quantity value of the electronic equipment is smaller than the electric quantity threshold value, the residual electric quantity value of the electronic equipment can be considered to be lower; at this time, the service life of the electronic device is often more concerned, and because the power consumption of outputting the audio by using all the audio output modules in the electronic device is high, when the remaining electric quantity value of the electronic device is low, the situation that the electronic device is powered off and shut down in a short time is easy to occur.

Thus, when the remaining amount of power of the electronic device is less than the power threshold, for example, the remaining amount of power of the electronic device is less than 20% of the total power; the number of the sound channels of the first audio signal is compared with the number of the second sound channels, if the number of the sound channels of the first audio signal is not the number of the second sound channels, the first audio signal can be converted to obtain the second audio signal with the number of the second sound channels, and therefore the audio output effect can be guaranteed under the condition that the electronic equipment has long standby time.

In step S103, based on the second audio signals with the preset number of channels, a corresponding audio output module is allocated to each channel, so that different audio output modules output audio signals of different channels of the second audio signals.

The embodiment of the disclosure converts the first audio signals with multiple channels into the second audio signals with the preset number of channels, and then allocates different audio output modules for the audio signals with different channels in the second audio signals, so that when the second audio signals are output through the electronic device, the different audio output modules output the audio signals with the corresponding channels, and the audio output effect is improved. If the number of the preset channels is 4 or 8, if the number of the channels of the first audio signal is less than the number of the preset channels, the conversion from the low-channel audio signal to the multi-channel audio signal is realized, and the surround sound effect of the audio is improved through the output of the multi-channel audio signal.

Optionally, the converting the first audio signal into the second audio signal with the preset number of channels in step S102 includes:

In the embodiment of the present disclosure, the preset channel conversion manner may be used to indicate a mapping relationship between the first audio signal and the second audio signal with a plurality of different channel numbers.

It can be understood that, the number of preset channels of the second audio signal is different, and the channel conversion manner of converting the multi-channel first audio signal into the second audio signal is also different. Moreover, the second audio signals with the same preset number of channels can also correspond to a plurality of channel conversion modes.

The channel conversion method may be set according to actual requirements. The embodiment of the present disclosure shows a preset channel conversion manner, where the preset channel conversion manner is used to indicate a mapping relationship between a plurality of first audio signals with different channel numbers and a 4-channel second audio signal, as shown in table 2, table 2 is a mapping relationship table of a multi-channel first audio signal and a 4-channel second audio signal.

TABLE 2 mapping relationship Table

Sound channel of first audio signal	Sound channel of second audio signal
		Monophonic channel c	L＝c，R＝c，LS＝c，RS＝c
Two sound channels l, r	L＝l，R＝r，LS＝l，RS＝r
		Three channels l, r, c	L＝1/2+c/2，R＝r/2+c/2，LS＝1/2，RS＝r/2
Four sound channels l, r, ls, rs	L＝1，R＝r，LS＝ls，RS＝rs
		Five sound channels l, r, c, ls, rs	L＝1+c/4，R＝r+c/4，LS＝ls，RS＝rs
Six channels l, r, c, lfe, ls, rs	L＝1+c/2+lfe/4，R＝r+c/2+lfe/4，LS＝ls+lfe/4，RS＝rs+lfe/4

Wherein c is a center channel, l is a left channel, r is a right channel, ls is a left surround channel, rs is a right surround channel, and lfe is a subwoofer channel. The L is a left channel of the second audio signal, and the R is a right channel of the second audio signal; the LS is a left surround channel of the second audio signal; the RS is a right surround channel of the second audio signal.

According to the number of the sound channels of the first audio signal, determining a target conversion mode corresponding to the number of the sound channels for searching the first audio signal from the preset plurality of sound channel conversion modes; and converting the first audio signal into the second audio signal according to the target conversion mode.

For example, if the first audio signal is a 6-channel audio signal, i.e., the first audio signal includes a left channel L, a right channel R, a center channel c, a left surround channel LS, a right surround channel RS, and a low-emphasis channel lfe, the second audio signal is a 4-channel audio signal, i.e., the second audio signal includes a left channel L, a right channel R, a left surround channel LS, and a right surround channel RS.

Determining a target conversion mode based on a plurality of preset channel conversion modes, wherein the target conversion mode is to firstly distribute a left channel L, a right channel R, a left surround channel LS and a right surround channel RS of the first audio signal to a left channel L, a right channel R, a left surround channel LS and a right surround channel RS of the second audio signal; then, averagely distributing the center channel c to the left channel L and the right channel R of the second audio signal; and projecting the bass to lfe for average distribution to the left channel L, the right channel R, the left surround channel LS and the right surround channel RS of the second audio signal, and determining that the left channel L of the second audio signal is L + c/2+ lfe/4, the right channel is R + c/2+ lfe/4, the left surround channel is LS + lfe/4 and the right surround channel is RS + lfe/4 based on the target conversion mode.

Optionally, the outputting, by using different audio output modules, audio signals of different channels of the second audio signal in step S103 includes:

In the embodiment of the disclosure, since the second audio signal includes audio signals of a predetermined number of channels, and the audio signals of different channels are independent from each other, the second audio signal can be separated into audio signals of a plurality of different channels according to the channels.

It should be noted that, the second audio signal can be separated into audio signals of a plurality of different channels by using the prior art, which is not described herein again.

After audio signals of a plurality of different sound channels are obtained, determining the corresponding relation between the plurality of audio output modules and the audio signals of the plurality of different sound channels according to azimuth information contained in the audio signals of the plurality of different sound channels and the positions of the plurality of audio output modules on the electronic equipment; and distributing an audio output module for the audio signal of each channel based on the corresponding relation.

It should be noted that, according to the matching between the orientation information included in the audio signals of the plurality of different channels and the positions of the plurality of audio output modules on the electronic device, the correspondence between the plurality of audio output modules and the audio signals of the plurality of different channels is determined, so as to reduce the occurrence of acoustic image confusion.

It can be understood that, since the audio signals of different channels refer to the audio signals that are acquired or played back at different spatial positions during recording or playing, the audio signals of different channels contain different orientation information. For example, the azimuth information of the left channel audio signal and the azimuth information of the right channel audio signal are different.

For example, the electronic device includes 4 speakers, which are an upper left speaker, an upper right speaker, a lower left speaker, and a lower right speaker. The second audio signal contains the audio signal of left channel L, right channel R, left surround channel LS and right surround channel RS, can be based on the corresponding relation between the audio signal of different speakers and different channels, make the upper left corner speaker output the audio signal of left channel L, the upper right corner speaker outputs the audio signal of right channel R, the lower left corner speaker outputs the audio signal of left surround channel LS, the lower right corner speaker outputs the audio signal of right surround channel RS, thereby reach the broadcast effect that the four-tone surrounds, promote user's auditory sensation.

In some embodiments, two audio output modules symmetrically distributed about a central axis of the device may be combined into a sound channel set according to the distribution positions of the audio output modules, for example, two audio output modules symmetrically distributed on the device are combined into an audio output module for outputting a left channel of audio and an audio output module for outputting a right channel of audio, so as to improve the sound output effect.

If the distribution position of the audio output module on the equipment is asymmetric, at the moment, the audio output effect of symmetric distribution can be realized through the setting of audio parameters. How to set up specifically, in some embodiments, the method further comprises:

In the embodiment of the disclosure, the distribution status information may be used to indicate a distribution status of the plurality of audio output modules on the electronic device. The first preset condition may be set according to actual requirements, for example, the first preset condition may be that the distances between the plurality of audio output modules and the center point of the electronic device are equal.

It should be noted that, in order to achieve a better playing effect, after a first audio signal of multiple channels is converted into a second audio signal of a preset number of channels, corresponding adjustment processing needs to be performed on the second audio signal, so that the adjusted second audio signal can be adapted to the hardware environment of multiple speakers of the electronic device.

If the distribution status information indicates that the position distribution of the audio output modules does not meet the first preset condition, distance compensation processing can be performed on the audio signals of different sound channels corresponding to the audio output modules according to the position information of the audio output modules.

It can be understood that the different positions of the audio output modules on the electronic device will directly affect the balance degree, sound field depth, etc. of the audio output by the audio output modules. For example, if distances between the left speaker and the right speaker in the electronic device are different from a center point of the electronic device, when the electronic device is used to play audio, a distance difference exists between the left speaker and the right speaker with respect to an ear of a user, and a transmission distance of a left channel audio signal output by the left speaker is different from a transmission distance of a right channel audio signal output by the right speaker, which affects a playing effect of the audio, and may not achieve a stereo effect.

However, the position of the audio output module in the electronic device is usually fixed, and the playing effect cannot be improved by adjusting the position of the audio output module. In this regard, in the embodiment of the present disclosure, when the position distribution of the plurality of audio output modules does not satisfy the first preset condition, the distance compensation processing may be performed on the audio signals of different channels corresponding to the plurality of audio output modules, so as to expand the sound image distance between the audio signals of different channels.

In the disclosed embodiments, the distance compensation process may include, but is not limited to: the crosstalk between the audio signals of different sound channels corresponding to the plurality of audio output modules is eliminated through the filtering component, so that the sound image distance of the audio signals of different sound channels is enlarged.

And inputting the audio signals of different sound channels subjected to distance compensation to the corresponding audio output modules, so that the difference between the sound image distances of the audio signals output by the audio output modules is smaller than a preset value, and the condition of poor audio playing effect caused by unreasonable position distribution of the audio output modules of the electronic equipment is reduced.

Optionally, the first preset condition includes:

the position distribution of the plurality of audio output modules indicated by the distribution condition information meets the position symmetry condition.

In this disclosure, the position symmetry condition may be that any pair of audio output modules in the plurality of audio output modules are symmetrically disposed on two sides of the electronic device.

It can be understood that, if at least one pair of audio output modules is not symmetrically disposed on two sides of the electronic device, distances between the pair of audio output modules and a center point of the electronic device are different, and accordingly, transmission distances of audio signals output by the pair of audio output modules are different, which is likely to cause sound image deviation.

For example, if the distribution status information indicates that the positions of the audio output modules on the electronic device are distributed in a rectangular shape, it is inevitable that any pair of audio output modules in the audio output modules are symmetrically arranged on two sides of the electronic device, and therefore the position distribution of the audio output modules meets the position symmetry condition.

For another example, if the distribution status information indicates that the positions of the audio output modules on the electronic device are distributed in a trapezoid, and at least one group of audio output modules is located in the audio output modules asymmetrically, the position distribution of the audio output modules does not satisfy the position symmetry condition, and it is necessary to perform distance compensation processing on the audio signals of different channels output by the audio output modules. And inputting the audio signals of different sound channels subjected to distance compensation to the corresponding audio output modules, so that the difference between sound image distances of the audio signals output by the plurality of audio output modules is smaller than a preset value.

Optionally, the method further comprises:

In an embodiment of the disclosure, the output performance of the plurality of audio output modules may include: and the plurality of audio output modules comprise parameters such as sensitivity, distortion degree, frequency response curve, loudness and/or rated impedance.

And determining whether the output performances of the plurality of audio output modules have large differences or not by determining whether the output performances of the plurality of audio output modules meet a second preset condition or not. It can be understood that, when two audio output modules with different output performance are used, the difference of the user's hearing senses may be larger even if the same audio is played.

Here, the second preset condition may be determined according to the acquired specific parameter of the output performance of the plurality of audio output modules.

In some embodiments, it may be determined whether the output performance of the plurality of audio output modules satisfies a second preset condition based on the frequency response curves and/or loudness of the plurality of audio output modules.

It should be noted that the frequency response curve refers to an increase or an attenuation of the sound pressure generated by the audio output module with the change of the frequency when an audio signal output at a constant voltage is connected to the audio system, and is used for describing the associated change of the sound pressure and the frequency. The frequency response curve can reflect the frequency response of the audio output module to the input audio signal in the full frequency band. It can be understood that the difference of the characteristics of the different audio output modules can be reflected to a greater extent according to the difference between the frequency response curves of the different audio output modules.

The loudness is subjective feeling of human ears on the sound intensity, is not consistent with the actual intensity of objective sound, and is related to the sound pressure ratio of the sound under different intensities; for audio with the same sound intensity, if the frequencies are different, the loudness is also different. According to the loudness difference value between different audio output modules, the difference between the output performances of different audio output modules can be reflected.

If the output performance of the plurality of audio output modules does not satisfy the second preset condition, that is, the difference between the output performance of the plurality of audio output modules is large, in order to compensate the output performance difference between the plurality of audio output modules of the electronic device, the output performance of the plurality of audio output modules when outputting the audio signals after modulation processing satisfies the second preset condition by modulating the audio signals of different sound channels corresponding to the plurality of audio output modules.

Here, the modulation process includes, but is not limited to: equalization processing, dynamic gain control processing, or gain control processing is performed based on the equalizer.

For example, the frequency response curves and/or loudness of the audio signals of different channels corresponding to the multiple audio output modules may be modulated by a dynamic gain control method, so that the frequency response curves and/or loudness of the audio signals of different channels satisfy a second preset condition.

In the embodiment of the present disclosure, the first preset value and the second preset value may be set according to actual requirements.

The output performance of the plurality of audio output modules includes: frequency response curves and/or loudness of the plurality of audio output modules.

The error values between the frequency response curves when the audio output modules output the audio signals after modulation processing are smaller than a first preset value, and/or the error values between the loudness when the audio output modules output the audio signals after modulation processing are smaller than a second preset value, so that the situation of sound field deviation caused by inconsistent output performance of the audio output modules in the electronic equipment is reduced, and the use experience of a user is improved.

In the embodiment of the disclosure, in consideration of the possible difference of the frequency range of the playable audio of each audio output module in the electronic device, for example, the audio output modules may be divided into a high frequency output module, a low frequency output module, a full frequency band output module, and the like according to the different supportable operating frequency ranges of the audio output modules.

In order to reduce the problem of low sound quality caused by the working frequency range which can be supported by the audio output modules in the electronic device, the embodiments of the present disclosure may determine whether the working frequency ranges of the plurality of audio output modules completely cover the frequencies of the audio signals of the different channels, and if the working frequency ranges of the audio output modules do not completely cover the frequencies of the audio signals, respectively determine the plurality of audio output modules as a first type of audio output module whose working range does not completely cover the frequencies of the audio signals and a second type of audio output module whose working range can completely cover the frequencies of the audio signals.

And acquiring a first sound channel signal corresponding to the first type of audio output module, and performing frequency division processing on the first sound channel signal to respectively obtain a first frequency signal and a second frequency signal, wherein the first frequency signal is a signal of which the frequency in the first sound channel signal is contained in the working frequency range of the first type of audio output module. The second frequency signal is a signal of the first sound channel signal, the frequency of which is not included in the working frequency range of the first type of audio output module.

It should be noted that, the frequency division processing method in the prior art may be used to perform frequency division on the first channel signal to obtain a first frequency signal and a second frequency signal, which is not described herein again.

After the first sound channel signal is divided into a first frequency signal and a second frequency signal, the first frequency signal can be output by using the first type of audio output module, and the second frequency signal is output by using the second type of audio output module, so that the condition that the working frequency range of the audio output module cannot support the first sound channel signal exists in the electronic equipment, and the sound channel information of the audio signal cannot be lost.

Optionally, the method further comprises:

In the embodiment of the present disclosure, the first direction may be a horizontal direction, for example, for the electronic device including 4 speakers, if the upper left speaker is the first type of audio output module, the lower left speaker having the same horizontal position as the upper left speaker may be determined as the third type of audio output module.

After a third type of audio output module is determined, outputting the first frequency signal by using the first type of audio output module, and outputting a second channel signal and a second frequency signal corresponding to the third type of audio output module by using the third type of audio output module; because the third type audio output module and the first type audio output module have the same position in the first direction, the sound images of all the sound channels in the audio signal can be restored to the maximum extent.

The present disclosure also provides the following embodiments:

fig. 2 is a flowchart illustrating a second method for converting a multi-channel signal according to an exemplary embodiment, the method including:

step S201, acquiring the number of sound channels of an input first audio signal;

in this example, a first audio signal input by an electronic device is acquired and the number of channels contained in the first audio signal is determined.

It should be noted that the electronic device is an electronic device including a plurality of audio output modules; the audio output module may be a speaker, and in this example, the electronic device is an electronic device including 4 speakers.

Step S202, if the number of the sound channels of the first audio signal is not the preset number of the sound channels, determining a target conversion mode from a plurality of preset sound channel conversion modes based on the number of the sound channels of the first audio signal; converting the first audio signal into a second audio signal based on the target conversion mode;

here, the number of preset channels may be set according to actual conditions, and in this example, the number of preset channels may be determined according to the number of audio output modules included in the electronic device, that is, the number of preset channels may be 4.

The preset sound channel conversion mode can be set according to actual requirements.

In some embodiments, the second audio signal may be separated into audio signals of different channels; determining the corresponding relation between the plurality of audio output modules and the audio signals of the plurality of different sound channels according to the positions of the plurality of audio output modules and the azimuth information contained in the audio signals of the plurality of different sound channels; and inputting the audio signals of different channels of the second audio signal into the plurality of audio output modules based on the corresponding relation.

Illustratively, taking the first audio signal as a 6-channel audio signal and the second audio signal as a 4-channel audio signal as an example, the first audio signal is converted into the second audio signal. Fig. 3 is a diagram illustrating a mapping of a 6-channel signal to a 4-channel signal according to an exemplary embodiment. As shown in fig. 3, the left channel i, the right channel R, the left surround channel ls, and the right surround channel rs in the first audio signal are mapped to an upper left speaker L1, an upper right speaker R1, a lower left speaker L2, and a lower right speaker R2 of the electronic device. Equally distributing the center channel c of the first audio signal to the upper left speaker L1 and the upper right speaker R1 of the electronic device; the subwoofer channel lfe of the first audio signal is equally distributed to the upper left loudspeaker L1, the upper right loudspeaker R1, the lower left loudspeaker L2 and the lower right loudspeaker R2 of the electronic device, resulting in a second audio signal comprising 4 channels.

Step S203, determining whether the distribution state information of the plurality of audio output modules meets a first preset condition, and if the distribution state information of the plurality of audio output modules does not meet the first preset condition, performing distance compensation processing on the audio signals of different sound channels corresponding to the plurality of audio output modules; the sound image distance of the audio signal after the distance compensation processing is larger than that of the audio signal;

here, the first preset condition includes: the position distribution of the plurality of audio output modules indicated by the distribution condition information meets the position symmetry condition.

It should be noted that, if the position distribution of the plurality of audio output modules does not satisfy the position symmetry condition, the sound image may deviate when the electronic device outputs the second audio signal; however, the positions of the audio output modules in the electronic device are usually fixed and are not easy to move; in order to reduce the occurrence of sound image deviation, the hardware environment of the audio output module in the electronic device needs to be adapted.

In this example, after the first audio signal is converted into a 4-channel second audio signal, the distribution state information of the multiple speakers is obtained, and if the distribution state information indicates that the distance between the two upper speakers and the distance between the two lower speakers in the electronic device are not consistent, that is, the position symmetry condition is not satisfied, it is necessary to perform distance compensation processing on the audio signals of different channels corresponding to the multiple speakers according to the specific positions of the multiple speakers.

Exemplarily, as shown in fig. 4, fig. 4 is a schematic diagram illustrating a distribution of positions of speakers in an electronic device according to an exemplary embodiment. Wherein the distance between the lower left corner speaker L2 and the lower right corner speaker R2 in the electronic device is smaller than the distance between the upper left corner speaker L1 and the upper right corner speaker R1. The audio signals of the left surround channel ls and the right surround channel rs corresponding to the lower left corner speaker L2 and the lower right corner speaker R2 can be distance compensated by adding a compensation module, so that the listening distance of the lower left corner speaker L2 and the lower right corner speaker R2 is expanded.

Step S204, determining whether the output performance of the plurality of audio output modules meets a second preset condition, and if the output performance of the plurality of audio output modules does not meet the second preset condition, modulating the audio signals of different sound channels corresponding to the plurality of audio output modules; the output performance determined by the plurality of audio output modules based on the audio signals after modulation processing meets the second preset condition;

here, the output performance of the plurality of audio output modules may include: and the frequency response curve and the loudness of the audio output module.

The output performance satisfies the second preset condition, including:

Here, the first preset value and the second preset value may be set according to actual conditions.

In this example, in order to match the inconsistency of the output performance among the multiple speakers of the electronic device, the audio signal corresponding to each speaker may be modulated to ensure that the frequency response curves and loudness determined by the multiple speakers based on the modulated audio signals of different channels are very close, so that the multiple speakers may not have the feeling that only one side speaker is playing audio when playing the second audio signal.

Step S205, determining the plurality of audio output modules as a first type of audio output module and a second type of audio output module according to whether the working frequency ranges of the plurality of audio output modules completely cover the frequencies of the audio signals of the different sound channels; the working frequency range of the first type of audio output module does not completely cover the frequencies of the audio signals of the different sound channels;

it should be noted that, because the operating frequency ranges of different speakers of the electronic device may be different, and the frequencies of the audio signals of different channels of the second audio signal after the distance compensation processing and/or the modulation processing are the same, if the operating frequency range of a certain speaker cannot completely cover the frequencies of the audio signals of different channels, the speaker may lose part of the frequency information of the audio signal when playing the corresponding audio signal.

In this example, the first type of audio output module may be a speaker without low-frequency playing capability in the electronic device; the second type of audio output module can be a loudspeaker with low-frequency playing capability in the electronic equipment.

Step S206, performing frequency division processing on a first sound channel signal corresponding to the first class of audio output module to obtain a first frequency signal and a second frequency signal, wherein the frequency of the first frequency signal is included in the working frequency range of the first class of audio output module;

in this example, the first frequency signal may be a high frequency audio signal; the second frequency signal may be a low frequency audio signal.

The frequency division processing can be carried out on the audio signal of the sound channel corresponding to the loudspeaker without the low-frequency playing capability in the electronic equipment, and the audio signal is divided into a high-frequency audio signal and a low-frequency audio signal.

Step S207, determining a third type of audio output module from the second type of audio output module, wherein the position of the third type of audio output module in the first direction is the same as the position of the first type of audio output module in the first direction; outputting the first frequency signal by using a first class audio output module; and outputting the corresponding second channel signal and the second frequency signal by using the third type of audio output module.

Here, the first direction may be a horizontal direction, for example, if the first type of audio output module is an upper left speaker, the third type of audio output module is a lower left speaker; and if the first type of audio output module is the upper right corner loudspeaker, the third type of audio output module is the lower right corner loudspeaker.

In this example, the high-frequency audio signal obtained by frequency division can be retained, and the low-frequency audio signal can be input to a speaker having a low-frequency playing capability for playing, so that the sound image of each channel can be restored to the maximum extent without losing the channel information and the frequency information.

Illustratively, as shown in fig. 5, fig. 5 is a schematic flow chart illustrating a process of dividing an audio signal corresponding to a speaker according to an exemplary embodiment. The upper left speaker L1 has no low-frequency playing capability, and may perform frequency division processing on the left channel signal L corresponding to the upper left speaker L1 to obtain a low-frequency audio signal L _ low and a high-frequency audio signal L _ high; and performing superposition processing on the high-frequency audio signal L _ high and the left surround channel ls signal corresponding to the lower left corner loudspeaker L2, outputting the audio signal after superposition processing through the lower left corner loudspeaker L2, and outputting a low-frequency audio signal L _ low through the upper left corner loudspeaker L1.

In the following, the present example further provides a method for converting a multi-channel signal, which is applied to an electronic device including 4 speakers, as shown in fig. 6, fig. 6 is a third schematic flowchart of a method for converting a multi-channel signal according to an exemplary embodiment, and specifically:

step S301, format information of the input source audio file;

step S302, determining whether the source audio file is a 4-channel audio file based on the format information of the source audio file;

step S303, if the source audio file is not a 4-channel audio file, performing 4-channel mapping on the source audio file; if the source audio file is a 4-channel audio file, executing step S304;

step S304, obtaining an audio file of 4 channels;

step S305, determining whether the positions of the 4 loudspeakers in the electronic equipment are symmetrical or not and whether the output performances of the 4 loudspeakers are consistent or not;

step S306, if the positions of the 4 loudspeakers are not symmetrical and/or the output performances of the 4 loudspeakers are not consistent, carrying out loudspeaker compensation processing on the 4-channel audio file; if the positions of the 4 speakers are symmetrical and the output performances of the 4 speakers are consistent, executing step S307;

step S307, obtaining a 4-channel audio file after hardware adaptation is carried out on the electronic equipment;

and step S308, outputting the 4-channel audio file by using the electronic equipment.

The embodiment of the disclosure also provides a conversion device of the multichannel signal. Fig. 7 is a schematic structural diagram of an apparatus for converting a multi-channel signal according to an exemplary embodiment, as shown in fig. 7, the apparatus for converting a multi-channel signal is applied to an electronic device including a plurality of audio output modules, and the apparatus 100 for converting a multi-channel signal includes:

an obtaining module 101, configured to obtain the number of channels of an input first audio signal;

a conversion module 102, configured to convert the first audio signal into a second audio signal with a preset number of channels if the number of channels of the first audio signal is not the preset number of channels;

and the output module 103 is configured to output audio signals of different channels of the second audio signal by using different audio output modules.

Optionally, the converting module 102 is configured to:

Optionally, the output module 103 is configured to:

Optionally, the apparatus further comprises: a compensation module 104 to:

determining whether the distribution condition information of the plurality of audio output modules meets a first preset condition;

if the distribution condition information of the audio output modules does not meet a first preset condition, distance compensation processing is carried out on the audio signals of different sound channels corresponding to the audio output modules; the sound image distance of the audio signal after the distance compensation processing is larger than that of the audio signal;

the output module 103 is configured to:

Optionally, the first preset condition includes:

Optionally, the apparatus further comprises: a compensation module 104 to:

The output module 103 is configured to:

Optionally, the output module 103 is further configured to:

Fig. 8 is a block diagram illustrating a conversion apparatus of a multi-channel signal according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a mobile computer, etc.

Referring to fig. 8, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for converting a multi-channel signal, applied to an electronic device including a plurality of audio output modules, includes:

acquiring the number of sound channels of an input first audio signal;

2. The method according to claim 1, wherein said converting the first audio signal into the second audio signal with the preset number of channels comprises:

3. The method of claim 1, wherein outputting audio signals of different channels of the second audio signal using different audio output modules comprises:

4. The method of claim 3, further comprising:

5. The method of claim 3, further comprising:

6. The method according to claim 5, wherein the output performance satisfies the second preset condition, which includes:

7. The method of claim 3, wherein outputting audio signals of different channels of the second audio signal using different audio output modules comprises:

8. The method of claim 7, further comprising:

9. An apparatus for converting a multi-channel signal, applied to an electronic device including a plurality of audio output modules, comprising:

10. An apparatus for converting a multi-channel signal, comprising:

a processor;

a memory for storing executable instructions;

wherein the processor is configured to: the method of converting a multi-channel signal according to any one of claims 1 to 8 is implemented when executable instructions stored in the memory are executed.

11. A non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a multi-channel signal conversion apparatus, enable the multi-channel signal conversion apparatus to perform the multi-channel signal conversion method of any one of claims 1 to 8.