CN110428802B

CN110428802B - Sound reverberation method, device, computer equipment and computer storage medium

Info

Publication number: CN110428802B
Application number: CN201910735961.XA
Authority: CN
Inventors: 刘佳泽; 王宇飞
Original assignee: Guangzhou Kugou Computer Technology Co Ltd
Current assignee: Guangzhou Kugou Computer Technology Co Ltd
Priority date: 2019-08-09
Filing date: 2019-08-09
Publication date: 2023-08-08
Anticipated expiration: 2039-08-09
Also published as: CN110428802A

Abstract

The application discloses a sound reverberation method, a sound reverberation device, computer equipment and a computer storage medium, and belongs to the technical field of computers. The method comprises the following steps: establishing a room model, wherein the room model comprises a plurality of objects, each object is provided with an acoustic wave transfer function, the acoustic wave transfer function is used for representing influence parameters of the objects on acoustic waves, and the influence parameters at least comprise reflection parameters and attenuation parameters; determining a sound source and a receiving end; when the sound source outputs sound waves, the sound waves are input into sound wave transfer functions of the plurality of objects according to transfer paths of the sound waves among the plurality of objects; and adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain the reverberation sound wave. Different reverberation sound waves can be obtained by changing the sound wave transfer function to adjust the room model, the problem that the sound reverberation effect cannot be changed by adjusting the room acoustic model in the prior art, and the applicability is poor is solved, and the effect of good applicability of the sound reverberation method is achieved.

Description

Sound reverberation method, device, computer equipment and computer storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a sound reverberation method, a sound reverberation device, a computer device, and a computer storage medium.

Background

The reverberation of sound refers to the fact that when sound waves are transmitted, the sound waves are reflected by obstacles when encountering obstacles, the sound waves are reflected and absorbed for many times, and the sound continuation phenomenon still exists after the sound source stops sounding is called as reverberation. At present, audio digital signal processing technology is often used in the fields of song production, movie soundtrack post production and the like to form digital reverberation effects of sound.

In the prior art, a room acoustic model is built in advance, finite length unit impulse response (English: finite Impulse Response FIR) operation is carried out on the audio input into a room, and the sound reverberation effect obtained through the operation is the target audio.

In carrying out the present application, the inventors have found that the prior art has at least the following problems:

in the method, one room acoustic model only corresponds to one sound reverberation effect, and the sound reverberation effect cannot be changed by adjusting the room acoustic model, so that the applicability is poor.

Disclosure of Invention

The embodiment of the application provides a sound reverberation method, a sound reverberation device, computer equipment and a computer storage medium, which can solve the problem that in the prior art, the sound reverberation effect cannot be changed by adjusting an acoustic model of a room, so that the applicability is poor. The technical scheme is as follows:

In one aspect, there is provided a sound reverberation method comprising:

establishing a room model, wherein the room model comprises a plurality of objects, each object has an acoustic wave transfer function, and the acoustic wave transfer function is used for representing influence parameters of the objects on acoustic waves, and the influence parameters at least comprise reflection parameters and attenuation parameters;

determining a sound source and a receiving end;

inputting the sound waves into the sound wave transfer functions of the plurality of objects according to the transfer paths of the sound waves among the plurality of objects when the sound source outputs the sound waves;

and adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain a reverberation sound wave.

Optionally, the influencing parameter further comprises at least one of a frequency offset parameter and a transmission parameter of the sound wave.

Optionally, the inputting the sound wave into the sound wave transfer function of the plurality of objects according to the transfer path of the sound wave between the plurality of objects includes:

after the sound waves are input into the sound wave transfer function of any object, determining whether the amplitude of the output sound waves is smaller than a preset threshold value;

stopping continuous transmission of the output sound wave when the output sound wave is smaller than the preset threshold value;

When the output sound wave is not smaller than the preset threshold value, determining the propagation direction of the output sound wave;

and inputting the output sound wave into a sound wave transfer function of a next object in the plurality of objects according to the propagation direction.

Optionally, before the building of the room model, the method further includes:

obtaining model configuration parameters;

the building of the room model comprises the following steps:

and establishing the room model according to the model configuration parameters.

Optionally, after the building of the room model, the method further includes:

obtaining model adjustment parameters;

and adjusting the room model according to the model adjustment parameters.

In another aspect, there is provided a sound reverberation apparatus including:

a modeling module configured to build a room model, the room model comprising a plurality of objects, each object having an acoustic wave transfer function for characterizing an influence parameter of the object on an acoustic wave, the influence parameter comprising at least a reflection parameter and an attenuation parameter;

the determining module is used for determining a sound source and a receiving end;

an output module configured to input an acoustic wave into an acoustic wave transfer function of the plurality of objects according to a transfer path of the acoustic wave between the plurality of objects when the acoustic source outputs the acoustic wave;

And the receiving module is configured to add each sound wave passing through the receiving end at the same time according to the time sequence to obtain a reverberation sound wave.

Optionally, in the output module, the inputting the sound wave into the sound wave transfer function of the plurality of objects according to the transfer paths of the sound wave between the plurality of objects includes:

the judging submodule is used for determining whether the amplitude of the output sound wave is smaller than a preset threshold value after the sound wave is input into the sound wave transfer function of any object;

Optionally, the apparatus further includes:

an acquisition module configured to acquire model configuration parameters;

the modeling module includes:

Optionally, after the building of the room model, the apparatus further includes:

and the adjusting module is configured to acquire model adjusting parameters and adjust the room model according to the model adjusting parameters.

In one aspect, a computer device is provided, the computer device including a processor and a memory having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement the sound reverberation method described above.

In one aspect, a computer storage medium having instructions stored therein that, when executed on a computer, cause the computer to perform the sound reverberation method described above is provided.

The beneficial effects that technical scheme that this application embodiment provided brought are:

establishing a room model, wherein the room model comprises a plurality of objects, each object has an acoustic wave transfer function, and the acoustic wave transfer function is used for representing influence parameters of the objects on acoustic waves, and the influence parameters at least comprise reflection parameters and attenuation parameters; determining a sound source and a receiving end; when the sound source outputs sound waves, the sound waves are input into sound wave transfer functions of the plurality of objects according to transfer paths of the sound waves among the plurality of objects; and adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain the reverberation sound wave. The room model can be adjusted by changing the acoustic transfer function, so that different reverberation acoustic waves can be obtained, the problem that the sound reverberation effect cannot be changed by adjusting the room acoustic model in the prior art, and the applicability is poor is solved, and the effect of the sound reverberation method with good applicability is achieved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a method for sound reverberation provided by embodiments of the present application;

FIG. 2 is a flow chart of another method of sound reverberation provided by embodiments of the present application;

FIG. 3 is a schematic view of the construction of the room model in the embodiment shown in FIG. 2;

FIG. 4 is a sub-step flow chart of step 205;

FIG. 5 is a schematic view of another room model provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of an acoustic reverberation device according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a server according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Specific embodiments of the present invention have been shown by way of the above drawings and will be described in more detail below. The drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but rather to illustrate the inventive concepts to those skilled in the art by reference to the specific embodiments.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the embodiments of the present invention will be described in further detail with reference to the accompanying drawings.

Early common sound reverberation techniques included delayed echo techniques, which were simple in algorithm but poor in reverberation effect.

The current common reverberation technology comprises a multi-all-pass combined filter technology and a finite-length pulse feedback technology, wherein the multi-all-pass combined filter technology refers to superposition of a plurality of all-pass filters and combined filters, and can generate delay time and attenuation proportion with different lengths for sound signals with different frequencies. The algorithm of the technology has moderate complexity, and the reverberation effect is better and widely applied. However, this approach uses recursive filters that can cause the algorithm system to be unstable and poor directional processing of the sound.

The reverberation effect of the finite length pulse feedback technology is lifelike and the used finite length unit impulse response filter is more stable. However, the preset room acoustic model of the method corresponds to only one reverberation effect, and more reverberation sound waves cannot be obtained by fine tuning the room model, so that the method has higher manufacturing cost and poorer directivity processing of sound.

The present application provides a sound reverberation method, a sound reverberation device, a computer device, and a computer storage medium, which can solve the above problems.

Fig. 1 is a flowchart of a method for sound reverberation provided in an embodiment of the present application, and as shown in fig. 1, an implementation process of the sound reverberation method provided in an embodiment of the present application may include the following steps:

and 101, building a room model. The room model includes a plurality of objects, each object having an acoustic wave transfer function for characterizing an influence parameter of the object on the acoustic wave, the influence parameter including at least a reflection parameter and an attenuation parameter.

Step 102, determining a sound source and a receiving end.

Step 103, when the sound source outputs sound waves, the sound waves are input into the sound wave transfer functions of the plurality of objects according to the transfer paths of the sound waves between the plurality of objects.

And 104, adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain a reverberation sound wave.

In summary, according to the sound reverberation method provided by the embodiment of the present invention, a room model is established, where the room model includes a plurality of objects, each object has a sound wave transfer function, and the sound wave transfer function is used to characterize the influence parameters of the object on the sound wave, where the influence parameters include at least a reflection parameter and an attenuation parameter; determining a sound source and a receiving end; when the sound source outputs sound waves, the sound waves are input into sound wave transfer functions of the plurality of objects according to transfer paths of the sound waves among the plurality of objects; and adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain the reverberation sound wave. The room model can be adjusted by changing the acoustic transfer function, so that different reverberation acoustic waves can be obtained, the problem that the sound reverberation effect cannot be changed by adjusting the room acoustic model in the prior art, and the applicability is poor is solved, and the effect of the sound reverberation method with good applicability is achieved.

Fig. 2 is a flowchart of another method for sound reverberation provided in an embodiment of the present application, and as shown in fig. 2, an implementation procedure of the sound reverberation method provided in an embodiment of the present application may include the following steps:

step 201, obtaining model configuration parameters.

The model configuration parameters may be parameters input by a user for setting a room model, and the parameters may include various parameters for describing physical characteristics of a room model, and may include, for example, a sound source, a location of a receiving end, a type of an object in the model, a number of objects, a location of the object, a material of the object, and other parameters. The sound source may be a device capable of emitting sound waves. The sound waves emitted by the sound source can comprise direct waves and reflected waves, wherein the direct waves are sound waves which directly reach the receiving end after being emitted from the sound source, and the reflected waves are sound waves which reach the receiving end after being emitted from the sound source and reflected (can be primary reflection or multiple reflections) on the object. The receiving end refers to a device capable of receiving sound waves, and can also be a virtual person or other carriers capable of receiving sound waves. The location of the receiving end is the specific spatial coordinates of the receiving end in the model. For example, the receiving end may be located at a spatial center of the room model, where a spatial coordinate of the spatial center is a model configuration parameter. The receiving end may also be located at other positions in the room model, and embodiments of the present invention are not limited in this regard.

In addition, the model configuration parameters may also include a selection of an option about a room model preset in the execution body of the embodiment of the present invention, where the option may include one or more preset room models, one or more preset objects, and the like, and the embodiment of the present invention is not limited.

Wherein the object is an object in a room model that can affect sound waves, which can include reflection, transmission, attenuation, frequency offset, and the like. Illustratively, the walls within the room model may reflect sound waves, and thus the wall is one of the plurality of objects. A room model may have multiple objects that reflect sound waves, such as walls, tables, sofas, etc. The more complete the parameter description of the object, the more realistic the obtained sound reverberation effect. Thus, the realism of the reverberation effect of the sound can be improved by perfecting other model configuration parameters within the room model. By way of example, the propagation speed of sound waves in the room model (which may be set directly or indirectly by setting parameters such as air humidity, temperature, etc.) and the like may be set. The embodiments of the present invention are not limited herein.

Model configuration parameters may be determined and entered by a user. The embodiment of the invention can be applied to a terminal or a server, and a user can input model configuration parameters to the terminal or the server so as to establish a room model. And 202, building a room model according to the model configuration parameters.

The model configuration parameters entered by the user may be referenced when building the room model. When the model configuration parameters include the various parameters described above for describing the physical characteristics of one room model, the room model may be built based on these parameters, and when the model configuration parameters include a user selection of preset options regarding the room model, the room model may be built based on the selection and the preset options regarding the room model.

Fig. 3 is a schematic structural diagram of a room model according to an embodiment of the present application. The room model 30 is built according to the model configuration parameters obtained in step 201. The room model 30 includes a receiving end 31, a sound source 33, and a plurality of objects including walls 321, sofas 322, beds 323, tea tables 324, dining tables 326, dining chairs 325, and wardrobe 327. Wherein the position of the sound source 33 is not a fixed position, it can be set in the model configuration parameters. It should be noted that, the room model 30 is only an exemplary room model, and the embodiment of the present invention does not limit the structure of the room model.

Each object has an acoustic wave transfer function for characterizing an influence parameter of the object on the acoustic wave, the influence parameter comprising at least a reflection parameter and an attenuation parameter, and further comprising at least one of a frequency shift parameter and a transmission parameter of the acoustic wave. For example, the material of each object may be different, and the reflection parameter and the attenuation parameter of the acoustic wave may be different from each other, so that each object may have an acoustic wave transfer function corresponding to its own parameter. Parameters of a common material may be obtained by performing acoustic measurements on the material.

The reflection parameter may be used to determine the reflection angle of an acoustic wave that is output after the acoustic wave passes through the acoustic wave transfer function at a certain angle of incidence. For example, a normal line perpendicular to the reflection surface may be established on the reflection surface of the object reflected sound wave, an angle between the normal line and the sound wave directed to the reflection surface is an incident angle, an angle between the sound wave reflected from the reflection surface and the normal line is a reflection angle, the reflection angle may be equal to the incident angle, and the exit angle of the sound wave may be obtained by determining the incident angle. In addition, the sound wave may be reflected on the reflecting surface of the object in other manners, for example, a reflection manner not conforming to a physical rule may be included, and the reflection manner may be preset or included in the model configuration parameter, which is not limited in the embodiment of the present invention. By means of this reflection angle, a spatial path of one acoustic transfer function to another (one object to another object) can be established. The spatial path may be used to indicate that sound waves output by the sound wave transfer function a (e.g., one wall surface) will enter the sound wave transfer function B (e.g., another wall surface).

The attenuation parameter may include a degree of attenuation of the amplitude of the acoustic wave after the acoustic wave passes through the acoustic wave transfer function.

The frequency offset parameter may include a change in the frequency of the acoustic wave after the acoustic wave passes through the acoustic wave transfer function.

The transmission parameter may include the transmittance of the acoustic wave after the acoustic wave passes through the acoustic wave transfer function.

The more complex the acoustic transfer function, the more realistic the simulation of the environment, and the better the resulting sound mixing effect. For example, if the reflection object of the acoustic wave is glass, parameters included in the simple acoustic wave transfer function are a reflection parameter, an attenuation parameter, and a frequency offset parameter, if a better sound mixing effect is desired, the setting of the influence parameter may be more complicated, and the attenuation degree corresponding to waves with different frequencies may be considered.

In the embodiment of the invention, the related sound waves can be all audio signal samples.

And 203, acquiring model adjustment parameters, and adjusting the room model according to the model adjustment parameters.

In the room model, each object has an acoustic wave transfer function corresponding to the object, and by adjusting the acoustic wave transfer function, the object corresponding to the acoustic wave transfer function in the room model can be adjusted. After adding or subtracting the objects in the room model, the transmission path of the sound wave in the room model is changed, and the obtained reverberation sound wave is further different. Changing the influencing parameters in the acoustic wave transfer function may also change the configuration of the room model, illustratively changing the temperature and humidity in the room model, the propagation speed of the acoustic wave in the room model changing. The finite length pulse feedback technology in the related technology obtains a complete room model through operation, and the room model cannot be changed. In the embodiment of the application, different room models can be obtained by changing the acoustic transfer function.

Steps 201 to 203 are steps of building a room model.

Step 204, determining the sound source and the receiving end.

The information of the sound source and the receiving end can be included in the model configuration parameters or the model adjustment parameters, and also can be included in preset information of the execution subject in the embodiment of the present invention.

Step 205, when the sound source outputs sound waves, the sound waves are input into the sound wave transfer functions of the plurality of objects according to the transfer paths of the sound waves between the plurality of objects.

The sound wave transmission path is determined by the sound wave transmission speed and the reflection angle of the sound wave, the propagation speed of the sound wave is different under the air environments of different objects, different temperatures, humidity and the like, and the reflection angle of the sound wave is calculated by the normal line and the incidence angle of the sound wave, so that when the incidence angle of the sound wave on the objects is different, the reflection angle of the sound wave is also different.

As shown in fig. 4, step 205 may include the following steps:

step 2051, after the acoustic wave is input into the acoustic wave transfer function of any object, determining whether the amplitude of the output acoustic wave is smaller than a preset threshold.

And judging whether the sound wave is to continue to be transmitted or not by using the preset threshold value. The preset threshold is a range value set in advance, and the preset threshold range may be set based on a vibration frequency that is not received by the ear of the person, and may be a range value close to 0, which is not limited herein.

Step 2052, stopping continuous transmission of the output sound wave when the output sound wave is smaller than the preset threshold value.

And stopping the sound wave from entering the next sound wave transfer function when the sound wave amplitude passing through the sound wave transfer function is smaller than a preset threshold value set in advance, namely stopping the continuous transmission of the output sound wave.

Step 2053, determining a propagation direction of the output sound wave when the output sound wave is not less than a preset threshold.

When the amplitude of the sound wave passing through the sound wave transfer function is not in the preset threshold range, the propagation direction of the sound wave is determined according to the reflection angle of the last sound wave transfer function of the sound wave.

Step 2054, inputting the output sound wave into the sound wave transfer function of the next object of the plurality of objects according to the propagation direction.

After the propagation direction of the sound wave is determined according to the reflection angle determined by the last sound wave transfer function, the next sound wave transfer function corresponding to the direction of the sound wave is found in the sound wave transfer functions, the sound wave is input into the next sound wave transfer function, and then the amplitude of the sound wave output by the next sound wave transfer function is judged, and the propagation can be stopped until the amplitude of the sound wave is smaller than a preset threshold value which is set in advance.

And 206, adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain a reverberant sound wave.

After the sound source outputs sound waves, recording each sound wave reaching the receiving end according to time sequence, and adding the sound waves reaching the receiving end at the same time to obtain audio signal sampling of the reverberation sound wave taking time as a shaft. By way of example, the speed of sound wave propagation in space is 340m/s, and the time required for the sound wave to be transmitted to the receiving end in air can be obtained by the speed and the space coordinates of the receiving end. After all the sound waves stop transmitting, the sound waves arriving at the receiving end at the same time are added (including the direct wave and the reflected wave arriving at the same time) by using linear addition, and the obtained result is the final reverberation sound wave.

Steps 205 and 206 are steps of acquiring a reverberant sound wave according to a room model.

As shown in fig. 5, it is a schematic structural diagram of another room model adjusted based on the room model shown in fig. 3. The user may obtain a reverberant sound wave different from the reverberant sound wave obtained by the room model shown in fig. 3 by changing the position of the sound source 53 or by reducing the sound wave transfer function, subtracting the table and dining chair in the room model shown in fig. 3, where the propagation of the sound wave in the room model changes. The method does not need to reestablish a complete room model, a plurality of different reverberation sound waves can be obtained by changing a certain object in the room model, and finally, the sound waves reaching the receiving end at the same time are added by using linear addition, so that the calculation amount and the calculation difficulty are reduced, and the requirement on system hardware can be reduced. The cost is saved, and the working efficiency is improved. And the directionality of the acoustic wave transmission can be controlled by changing the parameters of the object.

Fig. 6 is a schematic structural diagram of an acoustic reverberation device according to an embodiment of the present application, and as shown in fig. 6, the device 600 includes:

the modeling module 601, the modeling module 601 is configured to build a room model comprising a plurality of objects, each object having an acoustic wave transfer function for characterizing influence parameters of the object on the acoustic wave, the influence parameters comprising at least a reflection parameter and an attenuation parameter.

A determining module 602, configured to determine a sound source and a receiving end;

and an output module 603, the output module 603 being configured to input the sound wave into the sound wave transfer functions of the plurality of objects according to the transfer paths of the sound wave between the plurality of objects when the sound source outputs the sound wave.

The receiving module 604, the receiving module 604 is configured to add each sound wave passing through the receiving end at the same time in time sequence, so as to obtain a reverberant sound wave.

Optionally, the influencing parameter further comprises at least one of a frequency shift parameter and a transmission parameter of the sound wave.

Optionally, in the output module 603, according to a transmission path of the sound wave between the plurality of objects, inputting the sound wave into a sound wave transfer function of the plurality of objects includes:

the judging submodule 6031 is used for determining whether the amplitude of the output sound wave is smaller than a preset threshold value after the sound wave is input into the sound wave transfer function of any object;

stopping continuous transmission of the output sound wave when the output sound wave is smaller than a preset threshold value;

when the output sound wave is not smaller than a preset threshold value, determining the propagation direction of the output sound wave;

the output sound wave is input to a sound wave transfer function of a next object of the plurality of objects according to the propagation direction.

Optionally, the apparatus 600 further includes:

The acquisition module 605, the acquisition module 605 is configured to acquire model configuration parameters;

a modeling module 601, comprising: and establishing the room model according to the model configuration parameters.

Optionally, after building the room model, the apparatus 600 further includes: the adjustment module 606 is configured to obtain model adjustment parameters, and adjust the room model according to the model adjustment parameters.

In summary, according to the sound reverberation device provided by the embodiment of the present invention, a room model is established, where the room model includes a plurality of objects, each object has a sound wave transfer function, and the sound wave transfer function is used to characterize an influence parameter of the object on a sound wave, where the influence parameter includes at least a reflection parameter and an attenuation parameter; determining a sound source and a receiving end; when the sound source outputs sound waves, the sound waves are input into sound wave transfer functions of the plurality of objects according to transfer paths of the sound waves among the plurality of objects; and adding each sound wave passing through the receiving end at the same time according to the time sequence to obtain the reverberation sound wave. The room model can be adjusted by changing the acoustic transfer function, so that different reverberation acoustic waves can be obtained, the problem that the sound reverberation effect cannot be changed by adjusting the room acoustic model in the prior art, and the applicability is poor is solved, and the effect of the sound reverberation method with good applicability is achieved.

Fig. 7 is a schematic structural diagram of a server according to an embodiment of the present invention. The server may be used to perform the sound reverberation method provided by the above embodiments. Specifically, the present invention relates to a method for manufacturing a semiconductor device.

The server 700 includes a central processing unit (in english: central Processing Unit, abbreviated as CPU) 701, a system Memory 704 including a random access Memory (in english: random Access Memory, abbreviated as RAM) 702 and a Read Only Memory (in english: ROM) 703, and a system bus 705 connecting the system Memory 704 and the central processing unit 701. The server 700 also includes a basic input/output system (I/O system) 706, which helps to transfer information between various devices within the computer, and a mass storage device 707 for storing an operating system 713, application programs 714, and other program modules 715.

The basic input/output system 706 includes a display 708 for displaying information and an input device 709, such as a mouse, keyboard, or the like, for a user to input information. Wherein both the display 708 and the input device 709 are coupled to the central processing unit 701 through an input output controller 710 coupled to the system bus 705. The basic input/output system 706 may also include an input/output controller 710 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, the input output controller 710 also provides output to a display screen, a printer, or other type of output device.

The mass storage device 707 is connected to the central processing unit 701 through a mass storage controller (not shown) connected to the system bus 705. The mass storage device 707 and its associated computer readable media provide non-volatile storage for the server 700. That is, the mass storage device 707 may include a computer readable medium (not shown) such as a hard disk or CD-ROM (Compact Disc Read-Only Memory) drive.

Computer readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory, charged erasable programmable read-only memory), flash memory or other solid state memory technology, CD-ROM, DVD (Digital Versatile Disc, digital versatile disk) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will recognize that computer storage media are not limited to the ones described above. The system memory 704 and mass storage device 707 described above may be collectively referred to as memory.

According to various embodiments of the invention, the server 700 may also operate by a remote computer connected to the network through a network, such as the Internet. I.e., server 700 may be connected to network 712 through a network interface unit 711 coupled to system bus 705, or other types of networks or remote computer systems (not shown) may be coupled using network interface unit 711.

The memory also includes one or more programs, one or more programs stored in the memory and configured to be executed by the CPU.

Fig. 8 shows a block diagram of a terminal 800 provided in an exemplary embodiment of the present application, which may be used to perform the sound reverberation method provided in the above-described embodiments. The terminal 800 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. The terminal 800 may also be referred to by other names as user terminal, portable terminal, laptop terminal, desktop terminal, etc.

In general, the terminal 800 includes: a processor 801 and a memory 802.

Processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 801 may be implemented in hardware in at least one of a DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array) or PLA (Programmable Logic Array ). The processor 801 may also include a main processor, which is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 801 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and rendering of content required to be displayed by the display screen. In some embodiments, the processor 801 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.

Memory 802 may include one or more computer-readable storage media, which may be non-transitory. Memory 802 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 802 is used to store at least one instruction for execution by processor 801 to implement the sound reverberation method provided by the method embodiments herein.

In some embodiments, the terminal 800 may further optionally include: a peripheral interface 803, and at least one peripheral. The processor 801, the memory 802, and the peripheral interface 803 may be connected by a bus or signal line. Individual peripheral devices may be connected to the peripheral device interface 803 by buses, signal lines, or a circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 804, a display 805, a camera assembly 806, audio circuitry 807, a positioning assembly 808, or a power supply 809.

Peripheral interface 803 may be used to connect at least one Input/Output (I/O) related peripheral to processor 801 and memory 802. In some embodiments, processor 801, memory 802, and peripheral interface 803 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 801, the memory 802, and the peripheral interface 803 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 804 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 804 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 804 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 804 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuitry 804 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the world wide web, metropolitan area networks, intranets, generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuitry 804 may also include NFC (Near Field Communication ) related circuitry, which is not limited in this application.

The display 805 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 805 is a touch display, the display 805 also has the ability to collect touch signals at or above the surface of the display 805. The touch signal may be input as a control signal to the processor 801 for processing. At this time, the display 805 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, the display 805 may be one, providing a front panel of the terminal 800; in other embodiments, the display 805 may be at least two, respectively disposed on different surfaces of the terminal 800 or in a folded design; in still other embodiments, the display 805 may be a flexible display disposed on a curved surface or a folded surface of the terminal 800. Even more, the display 805 may be arranged in an irregular pattern other than rectangular, i.e., a shaped screen. The display 805 may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.

The camera assembly 806 is used to capture images or video. Optionally, the camera assembly 806 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.

Audio circuitry 807 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, inputting the electric signals to the processor 801 for processing, or inputting the electric signals to the radio frequency circuit 804 for voice communication. For stereo acquisition or noise reduction purposes, a plurality of microphones may be respectively disposed at different portions of the terminal 800. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, audio circuit 807 may also include a headphone jack.

The location component 808 is utilized to locate the current geographic location of the terminal 800 to enable navigation or LBS (Location Based Service, location-based services). The positioning component 808 may be a positioning component based on the United states GPS (Global Positioning System ), the Beidou system of China, or the Galileo system of Russia.

A power supply 809 is used to power the various components in the terminal 800. The power supply 809 may be an alternating current, direct current, disposable battery, or rechargeable battery. When the power supply 809 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the terminal 800 also includes one or more sensors 810. The one or more sensors 810 include, but are not limited to: acceleration sensor 811, gyroscope sensor 812, pressure sensor 813, fingerprint sensor 814, optical sensor 815, and proximity sensor 816.

The acceleration sensor 811 can detect the magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 800. For example, the acceleration sensor 811 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 801 may control the touch display screen 805 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal acquired by the acceleration sensor 811. Acceleration sensor 811 may also be used for the acquisition of motion data of a game or user.

The gyro sensor 812 may detect a body direction and a rotation angle of the terminal 800, and the gyro sensor 812 may collect a 3D motion of the user to the terminal 800 in cooperation with the acceleration sensor 811. The processor 801 may implement the following functions based on the data collected by the gyro sensor 812: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.

The pressure sensor 813 may be disposed at a side frame of the terminal 800 and/or at a lower layer of the touch display 805. When the pressure sensor 813 is disposed on a side frame of the terminal 800, a grip signal of the terminal 800 by a user may be detected, and the processor 801 performs left-right hand recognition or shortcut operation according to the grip signal collected by the pressure sensor 813. When the pressure sensor 813 is disposed at the lower layer of the touch display screen 805, the processor 801 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 805. The operability controls include at least one of a button control, a scroll bar control, an icon control, or a menu control.

The fingerprint sensor 814 is used to collect a fingerprint of a user, and the processor 801 identifies the identity of the user based on the fingerprint collected by the fingerprint sensor 814, or the fingerprint sensor 814 identifies the identity of the user based on the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 801 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 814 may be provided on the front, back, or side of the terminal 800. When a physical key or vendor Logo is provided on the terminal 800, the fingerprint sensor 814 may be integrated with the physical key or vendor Logo.

The optical sensor 815 is used to collect the ambient light intensity. In one embodiment, the processor 801 may control the display brightness of the touch display screen 805 based on the intensity of ambient light collected by the optical sensor 815. Specifically, when the intensity of the ambient light is high, the display brightness of the touch display screen 805 is turned up; when the ambient light intensity is low, the display brightness of the touch display screen 805 is turned down. In another embodiment, the processor 801 may also dynamically adjust the shooting parameters of the camera module 806 based on the ambient light intensity collected by the optical sensor 815.

A proximity sensor 816, also referred to as a distance sensor, is typically provided on the front panel of the terminal 800. The proximity sensor 816 is used to collect the distance between the user and the front of the terminal 800. In one embodiment, when the proximity sensor 816 detects that the distance between the user and the front of the terminal 800 gradually decreases, the processor 801 controls the touch display 805 to switch from the bright screen state to the off screen state; when the proximity sensor 816 detects that the distance between the user and the front surface of the terminal 800 gradually increases, the processor 801 controls the touch display 805 to switch from the off-screen state to the on-screen state.

Those skilled in the art will appreciate that the structure shown in fig. 8 is not limiting and that more or fewer components than shown may be included or certain components may be combined or a different arrangement of components may be employed.

The application also provides a computer device comprising a processor and a memory, wherein at least one instruction, at least one section of program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one section of program, the code set or instruction set is loaded and executed by the processor to realize the sound reverberation method.

The present application also provides a computer-readable storage medium having instructions stored therein, which are executed by the sound reverberation apparatus to cause the sound reverberation apparatus to implement the sound reverberation method provided by the above embodiments.

The foregoing description of the preferred embodiments is provided for the purpose of illustration only and is not intended to limit the invention to the particular embodiments disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Claims

1. A method of sound reverberation, the method comprising:

obtaining model configuration parameters including parameters describing physical characteristics of a room model, the parameters including at least one of: the method comprises the steps of sound source, receiving end positions, object types, object numbers, object positions and object materials in a model, wherein the receiving end positions are space coordinates of the receiving end in the room model;

Establishing the room model according to the model configuration parameters, wherein the room model comprises a plurality of objects, each object is provided with an acoustic wave transfer function, the acoustic wave transfer function is used for representing influence parameters of the objects on acoustic waves, the influence parameters at least comprise reflection parameters and attenuation parameters, the objects are objects which influence the acoustic waves in the room model, and the influence parameters also comprise at least one of frequency offset parameters and transmission parameters of the acoustic waves;

determining a sound source and a receiving end;

2. The method of claim 1, wherein inputting the acoustic wave into the acoustic wave transfer function of the plurality of objects according to the transfer path of the acoustic wave between the plurality of objects comprises:

after the sound wave is input into the sound wave transfer function of any object, determining whether the amplitude of the output sound wave is smaller than a preset threshold value;

3. The method of claim 1, wherein after the building of the room model, the method further comprises:

obtaining model adjustment parameters;

and adjusting the room model according to the model adjustment parameters.

4. A sound reverberation device, the device comprising:

a modeling module, the modeling module comprising:

an acquisition module configured to acquire model configuration parameters including parameters to describe physical characteristics of a room model, the parameters including at least one of: the method comprises the steps of sound source, receiving end positions, object types, object numbers, object positions and object materials in a model, wherein the receiving end positions are space coordinates of the receiving end in the room model;

The modeling module is used for building the room model according to the model configuration parameters, the room model comprises a plurality of objects, each object is provided with an acoustic wave transfer function, the acoustic wave transfer function is used for representing influence parameters of the objects on acoustic waves, the influence parameters at least comprise reflection parameters and attenuation parameters, the objects are objects which influence the acoustic waves in the room model, and the influence parameters also comprise at least one of frequency offset parameters and transmission parameters of the acoustic waves;

5. The apparatus of claim 4, wherein said inputting the acoustic wave into the acoustic wave transfer function of the plurality of objects according to the transfer path of the acoustic wave between the plurality of objects in the output module comprises:

6. The apparatus of claim 4, wherein after the building of the room model, the apparatus further comprises:

7. A computer device comprising a processor and a memory having stored therein at least one instruction, at least one program, code set, or instruction set that is loaded and executed by the processor to implement the sound reverberation method of any one of claims 1 to 3.

8. A computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the sound reverberation method of any one of claims 1 to 3.