KR101993585B1 - Apparatus realtime dividing sound source and acoustic apparatus - Google Patents

Apparatus realtime dividing sound source and acoustic apparatus Download PDF

Info

Publication number
KR101993585B1
KR101993585B1 KR1020170113732A KR20170113732A KR101993585B1 KR 101993585 B1 KR101993585 B1 KR 101993585B1 KR 1020170113732 A KR1020170113732 A KR 1020170113732A KR 20170113732 A KR20170113732 A KR 20170113732A KR 101993585 B1 KR101993585 B1 KR 101993585B1
Authority
KR
South Korea
Prior art keywords
sound source
channel
channel sound
unit
source signal
Prior art date
Application number
KR1020170113732A
Other languages
Korean (ko)
Other versions
KR20190027398A (en
Inventor
이종화
김양한
박준영
김완중
김환
Original Assignee
주식회사 에스큐그리고
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 에스큐그리고 filed Critical 주식회사 에스큐그리고
Priority to KR1020170113732A priority Critical patent/KR101993585B1/en
Priority to PCT/KR2018/009949 priority patent/WO2019050206A1/en
Publication of KR20190027398A publication Critical patent/KR20190027398A/en
Application granted granted Critical
Publication of KR101993585B1 publication Critical patent/KR101993585B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)

Abstract

The present invention relates to a sound source separation device and a sound device, and more particularly, to a real-time sound source separation device and a sound device capable of real-time separation of an input stereo sound source signal into a plurality of channel sound source signals.
A sound source separation apparatus according to an embodiment of the present invention includes: a receiver for receiving a stereo sound source signal including a first channel sound source signal and a second channel sound source signal; And a multi-channel generator for generating at least three channel sound source signals in real time based on the stereo sound source signals received from the receiver.

Description

[0001] APPARATUS REALTIME DIVIDING SOUND SOURCE AND ACOUSTIC APPARATUS [0002]

The present invention relates to a sound source separation device and a sound device, and more particularly, to a real-time sound source separation device and a sound device capable of real-time separation of an input stereo sound source signal into a plurality of channel sound source signals.

A sound device refers to a device that converts various sound source signals into sound waves and outputs them. The acoustic device may include, for example, a device for listening to voice or music, or a device for measuring or exploring using acoustic such as an echo sounder or a fish finder.

Conventionally, most of the sound apparatus simply amplifies and outputs the input stereo sound signal.

Although the external stereo sound source signal is composed of two channel sound source signals, since each sound source signal of the channel has already recorded the instrument sound and the vocal sound, only a specific sound, for example, vocal sound It is impossible to separate it.

However, recently there have been several attempts to isolate a particular sound from an externally supplied stereo source signal. Specifically, an example of an attempt to separate a specific sound from a stereo sound source signal using frequency analysis (FFT) or channel correlation analysis is disclosed in (Patent Document 1). However, frequency analysis and channel correlation analysis have a disadvantage in that they can not be performed in real time because of the large amount of process computation.

KR 10-2016-0072130 A

SUMMARY OF THE INVENTION The present invention provides a real-time sound source separation device and a sound device capable of real-time separation of a stereo sound source signal into at least three or more channel sound source signals.

The present invention also provides a real-time sound source separation apparatus and a sound apparatus that can process a stereo sound source signal to provide a predetermined spatial feeling to a listener.

Also, the present invention provides a real-time sound source separation device and a sound device in which a listener can directly control the spatial sense through an external terminal device.

The present invention also provides a real-time sound source separation device and a sound device in which a listener can directly control the spatial feeling through a user input unit provided therein.

A real-time sound source separation apparatus according to an embodiment of the present invention includes: a receiver for receiving a stereo sound source signal including a first channel sound source signal and a second channel sound source signal; And a multi-channel generator for generating at least three channel sound source signals in real time based on the stereo sound source signals received from the receiver.

Here, the multi-channel generator generates a modified first channel sound source signal by summing the first channel sound source signal amplified by the first amplification degree and the second channel sound source signal amplified by the second amplification degree, A method of generating a center channel sound source signal by summing a one-channel sound source signal and a second channel sound source signal, amplifying the second channel sound source signal with the first amplification degree, amplifying the first channel sound source signal with the second amplification degree Thereby generating a modified second channel sound source signal.

Here, the absolute value of the first amplification factor may be greater than the absolute value of the second amplification factor.

Here, the first amplification degree may be 2, and the second amplification degree may be -1.

The position adjusting unit may further include a position adjusting unit that receives the channel sound source signals generated by the multi-channel generating unit and receives a position control signal from the terminal device, and the position adjusting unit adjusts the position When the channel sound source signals processed by the position adjustment unit are outputted through the sound output device, the channel sound source signals are generated in predetermined spaces corresponding to the position control signal, It can be recognized by the listener as if it occurred.

A user input unit for generating a position control signal corresponding to a user input; And a position adjusting unit for receiving the channel sound source signals generated by the multi-channel generating unit and receiving a position control signal from the user input unit, wherein the position adjusting unit adjusts the position When the channel sound source signals processed by the position adjustment unit are outputted through the sound output device, the channel sound source signals are generated in predetermined spaces corresponding to the position control signal, It can be recognized by the listener as if it occurred.

Here, the user input unit may include a display unit having a screen for displaying predetermined information provided from the position adjustment unit, and the predetermined information may include position information of virtual speakers corresponding to the predetermined spaces have.

Here, the user input unit may be an adjustment switch for adjusting positions of virtual speakers corresponding to the predetermined spaces.

According to an embodiment of the present invention, there is provided an audio apparatus including a stereo sound source signal including a first channel sound source signal and a second channel sound source signal, and generating at least three channel sound source signals in real time based on the received stereo sound source signal A real time sound source separation unit; And at least one of an amplifier for amplifying the channel sound source signals generated by the real-time sound source separation unit and a speaker unit for converting the channel sound source signals generated by the real-time sound source separation unit into sound waves, .

Here, the real-time sound source separation unit may generate a modified first channel sound source signal by summing the first channel sound source signal amplified by the first amplification degree and the second channel sound source signal amplified by the second amplification degree, A method of generating a center channel sound source signal by summing a one-channel sound source signal and a second channel sound source signal, amplifying the second channel sound source signal with the first amplification degree, amplifying the first channel sound source signal with the second amplification degree Thereby generating a modified second channel sound source signal.

Here, the absolute value of the first amplification factor may be greater than the absolute value of the second amplification factor.

Here, the first amplification degree may be 2, and the second amplification degree may be -1.

And a position adjustment unit connected between the real-time sound source separation unit and the sound output unit, for receiving the channel sound source signals generated by the real-time sound source separation unit and receiving a position control signal from the terminal, The position adjustment unit processes the channel sound source signals generated by the real-time sound source separation unit based on the position control signal, and when the channel sound source signals processed by the position adjustment unit are output through the sound output unit, It can be recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the control signal.

A user input unit for generating a position control signal corresponding to a user input; And a position adjustment unit, connected between the real-time sound source separation unit and the sound output unit, for receiving the channel sound source signals generated by the real-time sound source separation unit and receiving a position control signal from the user input unit The position adjustment unit processes the channel sound source signals generated by the real-time sound source separation unit based on the position control signal, and when the channel sound source signals processed by the position adjustment unit are output through the sound output unit, It can be recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the control signal.

The user input unit may include a display unit having a screen for displaying predetermined information provided from the position adjustment unit, and the predetermined information may include position information of virtual speakers corresponding to the predetermined spaces.

The user input unit may be an adjustment switch for adjusting positions of virtual speakers corresponding to the predetermined spaces.

The use of the real-time sound source separation apparatus and the sound apparatus according to the embodiments of the present invention has an advantage in that the stereo sound source signal can be separated in real time into at least three or more channel sound source signals.

In addition, there is an advantage that a predetermined spatial feeling can be provided to the listener by processing the stereo sound source signal.

In addition, there is an advantage that the listener can directly control the sense of space through the terminal device located outside the audio equipment.

Further, there is an advantage that the listener can directly control the spatial feeling through the user input unit provided in the audio equipment.

1 is a block diagram of a sound source separation apparatus 100 according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining a process in which the multi-channel generating unit 130 shown in FIG. 1 generates three channel sound source signals from a stereo sound source signal in real time.
3 is a block diagram of a sound source separation apparatus 100 'according to another embodiment of the present invention.
FIG. 4 is a view showing a screen 3350a of the terminal device 3000 shown in FIG.
FIG. 5 is a block diagram of the sound output apparatus 190 of FIG. 3 when the channel sound source signals processed by the position adjustment unit 150 of the sound source separation apparatus 100 'are outputted through the sound output apparatus 190, P2, and P3, respectively.
FIG. 6 is a view for explaining a sound effect of the sound source separation apparatus 100 'shown in FIG.
7 is a block diagram of a sound source separation apparatus 100 '' according to another embodiment of the present invention.
FIG. 8 is a view showing a screen 735a of the user input unit 170 shown in FIG.
9 is a block diagram of an audio equipment 1000 according to an embodiment of the present invention.
10 is a block diagram of an acoustic device 1000 'according to another embodiment of the present invention.
11 is a block diagram of a sound device 1000 '' according to another embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of example, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with one embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

1 is a block diagram of a sound source separation apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 1, a sound source separation apparatus 100 according to an embodiment of the present invention can process a received stereo sound source signal to generate a plurality of channel sound source signals in real time. The generated plurality of channel sound source signals may be output through an audio output device (not shown) connected to the sound source separation device 100.

The sound source separation apparatus 100 according to the embodiment of the present invention is mounted on a stereo sound source signal input terminal of a conventional general sound output apparatus (not shown), separates stereo sound source signals input from the outside in real time, (Not shown).

Referring to FIG. 1, a sound source separation apparatus 100 according to an embodiment includes a reception unit 110 and a multi-channel generation unit 130.

The receiving unit 110 receives the stereo sound source signal. The stereo sound source signal includes at least two or more channel sound source signals. The two channel sound source signals may be left channel sound source signals and right channel sound source signals. The receiving unit 110 may be a wireless interface such as a Bluetooth receiver, or may be an interface for a wired connection.

The multi-channel generating unit 130 processes the stereo sound source signals received by the receiving unit 110 to generate a plurality of channel sound sources. Here, the plurality of channel sound source signals may be at least three or more. The multi-channel generating unit 130 may generate three or more channel sound source signals in real time. Hereinafter, an example in which the multi-channel generating unit 130 generates three channel sound source signals from a stereo sound source signal will be described in detail with reference to FIG.

FIG. 2 is a diagram for explaining a process in which the multi-channel generating unit 130 shown in FIG. 1 generates three channel sound source signals from a stereo sound source signal in real time.

The multi-channel generating unit 130 receives the first channel sound source signal L and the second channel sound source signal R of the stereo sound source signal and generates three channel sound source signals L_new, Center, R_new. Here, the first channel sound source signal L may be a left channel sound source signal of a two channel stereo sound source signal, and the second channel sound source signal R may be a right channel sound source signal of a two channel stereo sound source signal.

The three channel sound source signals generated by the multi-channel generating unit 130 may include a modified first channel sound source signal L_new, a center channel sound source signal Center, and a modified second channel sound source signal R_new have. In FIG. 2, three channel sound source signals are newly generated, but the present invention is not limited thereto. For example, four or more channel sound source signals may be generated.

The multichannel generating unit 130 generates a modified first channel sound source signal L_new by summing the first channel sound source signal L amplified by the first amplification degree and the second channel sound source signal R amplified by the second amplification degree, ). Here, the absolute value of the first amplification degree is larger than the absolute value of the second amplification degree.

2, the multi-channel generator 130 multiplies the first channel sound source signal L by two times (2L) and the second channel sound source signal R by -1 times (-R) Thereby generating a modified first channel sound source signal L_new. Here, the first amplification degree for amplifying the first channel sound source signal L is not limited to two. For example, the first amplification degree for amplifying the first channel sound source signal L may vary depending on the design. In addition, the second amplification degree for amplifying the second channel sound source signal R is not limited to -1. For example, the second amplification for amplifying the second channel sound source signal R may vary depending on the design.

The multi-channel generating unit 130 generates a center channel sound source signal (Center) by adding the first channel sound source signal L and the second channel sound source signal R to each other.

The multi-channel generating unit 130 generates a second channel sound source signal R_new by summing the second channel sound source signal R amplified by the first amplification degree and the first channel sound source signal L amplified by the second amplification degree, ). Here, the absolute value of the first amplification degree is larger than the absolute value of the second amplification degree.

2, the multi-channel generator 130 multiplies the second channel sound source signal R by two times (2R) and the first channel sound source signal L by -1 times (-L) And generates a modified second channel sound source signal R_new. Here, the first amplification degree for amplifying the second channel sound source signal R is not limited to 2, and the second amplification degree for amplifying the first channel sound source signal L is not limited to -1. Depending on the design, the amplification ratio can be changed.

The above example assumes that the first channel sound source signal L and the second channel sound source signal R are respectively generated by the following sound sources. In the following equation, l is a sound source component located on the left side, c is a sound source component located in the center, and r is a sound source component located on the right side.

L = l + c / 2

R = r + c / 2

In this case, if the first amplification degree is 2 and the second amplification degree is -1, the output signal is as follows.

L_new = 2l - r + c / 2

Center = l + r + c

R_new = 2r - l + c / 2

That is, the left sound source component 1 is emphasized in the modified first channel sound source signal L_new, and the right sound source component r is emphasized in the modified second channel sound source signal R_new. The first amplification degree and the second amplification degree can be appropriately adjusted according to the number and position of the sound source component.

As described above, the multi-channel generating unit 130 generates three or more new channel sound source signals (L_new, Center, R_new) through two simple operations of amplifying and summing the input two-channel stereo sound source signal with a predetermined amplification degree There is an advantage that one center channel sound source signal and two modified channel sound source signals can be generated in real time from a two channel stereo sound source signal.

The center channel sound source signal Center includes the first channel sound source signal L and the second channel sound source signal R plus the first channel sound source signal L and the second channel sound source signal R ), The magnitude of a particular sound already included in each, for example a vocal sound, is doubled. Accordingly, there is an advantage that the vocal sound can be felt to a larger audience as compared with when the stereo sound source signal is emitted through an audio output device (not shown) without any processing.

3 is a block diagram of a sound source separation apparatus 100 'according to another embodiment of the present invention.

Referring to FIG. 3, a sound source separation apparatus 100 'according to another embodiment includes a reception unit 110, a multi-channel generation unit 130, and a position adjustment unit 150. Here, the receiving unit 110 and the multi-channel generating unit 130 are the same as the receiving unit 110 and the multi-channel generating unit 130 shown in FIG. 1 and FIG. 2, respectively.

The position adjustment unit 150 receives a position control signal from an external terminal 3000 that is physically separate from the sound source separation apparatus 100 '. The position control signal may be received by the sound source separation apparatus 100 'via wired or wireless communication. To this end, the sound source separation apparatus 100 'may further include a communication unit (not shown) for receiving and processing a position control signal from the terminal device 3000.

The terminal 3000 may be a portable terminal such as a smart phone and a tablet PC. The terminal 3000 may include a display unit including a touch screen, a processor, a memory unit, and an interface unit. The terminal device 3000 may be provided with an app for controlling the sound source separation device 100 '. When the app is executed by the user of the terminal 3000, the position of each virtual speaker of the plurality of channel sound sources generated by the multi-channel generator 130 may be displayed on the display unit of the terminal 3000 have. For example, referring to FIG. 4, the display unit of the terminal 3000 includes a screen 3350a, and a plurality of channel sound sources, which are generated by the multi-channel generating unit 130, The speakers S1, S2, and S3 may be displayed. The user of the terminal device 3000 can move the position of the virtual speakers S1, S2, S3 displayed on the screen 3350a through the touch function of the touch screen. The app generates a position control signal including position information of the virtual speakers S1, S2, and S3, and transmits the generated position control signal to the sound source separation device 100 'through the terminal device 3000 .

Meanwhile, the terminal device 3000 may provide a stereo sound source signal to the sound source separation device 100 '. In this case, the terminal 3000 may further include a tone generator (not shown).

3, the position adjustment unit 150 receives a plurality of channel sound source signals output from the multi-channel generation unit 130. [ The plurality of channel sound source signals to be received may be at least three or more.

The position adjusting unit 150 processes a plurality of channel sound source signals received from the multi-channel generating unit 130 based on a position control signal from the terminal device 3000. The processing of a plurality of channel sound source signals means that when each processed sound source signal is outputted through an audio output device (not shown), the listener feels as if each channel sound source signal is generated at a predetermined position in a predetermined space It may mean filtering each channel sound source signal with a predetermined coefficient. Here, the preset predetermined space is determined by the position control signal received from the terminal device 3000.

FIG. 5 is a block diagram of the sound output apparatus 190 of FIG. 3 when the channel sound source signals processed by the position adjustment unit 150 of the sound source separation apparatus 100 'are outputted through the sound output apparatus 190, P2, and P3, respectively.

As shown in FIG. 5, the first virtual speaker, in which the position control signal from the terminal device 3000 is felt as if the center channel sound source signal (Center) of FIG. 2 is generated, is located on the front side of the sound output device 190 The second virtual speaker located at the first position P1 and feeling as if the first channel sound source signal R_new of Figure 2 is generated is located at the second position P2 adjacent to the right side of the sound output apparatus 190, It is assumed that the third virtual speaker in which the second channel sound source signal L_new of FIG. 2 is sensed is located at the third position P3 adjacent to the left side of the sound output apparatus 190.

Under this assumption, the position adjustment unit 150 adjusts the position of the center channel sound source (Center) as if the center channel sound source signal (Center) is emitted at the first position P1, because the position control signal received from the terminal device 3000, And processes the first channel sound source signal R_new as if the sound of the first channel sound source signal R_new modified at the second position P2 were radiated and at the third position P3 And processes the second channel sound source signal R_new as the sound of the modified second channel sound source signal L_new is radiated.

A detailed process of processing the center channel sound source signal Center, the modified first channel sound source signal R_new, and the modified second channel sound source signal L_new will now be described in detail.

The position adjustment unit 150 may calculate a transfer function between the channel sound source signal input to each speaker of the sound output apparatus 190 and the sound pressure output from each of the positions P1, P2, and P3. The transfer function represents the characteristic of the space in which the listener is located, and may be stored in a memory (not shown) of the sound source separation apparatus 100 'after actual measurement. The transfer function of each of the positions P1, P2, and P3 may be generated by the number of speakers included in the sound output apparatus 190 and may be expressed as a function of frequency. In addition, after transfer functions are measured at some positions and stored in a memory (not shown) of the acoustic device 100 ', a transfer function of an arbitrary position between some of the positions is generated by interpolating the transfer functions of the certain positions It is possible.

Next, the position adjusting unit 150 adjusts the position of each channel sound source signal by using a previously calculated transfer function so as to sound the sound of each channel sound source signal at each position P1, P2, P3 Calculate the coefficient.

In calculating the coefficient, it is desirable to determine a coefficient such that the sound pressure level at the position is higher than the sound pressure level in the region other than the position. More specifically, it is possible to calculate a coefficient that maximizes the ratio of the acoustic potential energy density at the position to the sum of the energies of the individual sound sources. Here, although a single frequency is described, it can be understood that when a plurality of frequencies are used, the sound source for each frequency is determined.

The coefficient may be a coefficient for converting the magnitude and phase of each channel sound source signal. For example, a coefficient for converting the magnitude of the sound output from the i-th (where i is a natural number) speaker of the sound output apparatus 190 is a magnitude of a transfer function vector of all speakers for the position, The second speaker may be a value obtained by dividing the magnitude of the transfer function of the ith speaker. The coefficient for converting the phase difference of the channel sound source signal input to the i-th speaker can be obtained by, for example, complex declination of the transfer function of the i-th speaker.

When the coefficients are calculated, the position adjustment unit 150 may filter each channel sound source signal with a determined coefficient to generate a sound source signal for each speaker input to each speaker of the sound output apparatus 190. The generated sound source signal for each speaker is converted into a sound wave through the sound output device 190 so that the listener feels as if the sound of the corresponding channel sound source signal is generated at each position.

FIG. 6 is a view for explaining a sound effect of the sound source separation apparatus 100 'shown in FIG.

Referring to FIG. 6, when each channel sound source signal processed by the position adjustment unit 150 shown in FIG. 3 is outputted through the sound output apparatus 190 shown in FIG. 5, It is felt that the sound of the vocal V is generated in the first position P1 and the sound of the drum B1 of the band is generated in the second position P2 shown in Fig. It can be felt that the sound of the guitar (B2) of the band is generated at the third position (P3).

3 has the advantage of the sound source separating apparatus 100 shown in FIG. 1, and the external sound source separating apparatus 100 'shown in FIG. 3 not only has the advantage of the sound source separating apparatus 100 shown in FIG. 1, There is an advantage in that the virtual position to be generated can be adjusted and the listener has the advantage of feeling the spatial feeling of the sound outputted through the sound output device 190. [ In addition, a listener may obtain the same effect as listening to a vocal sound at a specific position in a normal stereo sound source.

7 is a block diagram of a sound source separation apparatus 100 '' according to another embodiment of the present invention.

7, the sound source separation apparatus 100 '' according to another embodiment includes a receiving unit 110, a multi-channel generating unit 130, a position adjusting unit 150, and a user input unit 170 . The receiving unit 110, the multi-channel generating unit 130 and the position adjusting unit 150 except for the user input unit 170 include the receiving unit 110, the multi-channel generating unit 130, and the position adjusting unit 150 shown in FIG. (150), a specific description is replaced with the one described above.

The sound source separation apparatus 100 '' according to yet another embodiment includes a user input unit 170. The user input unit 170 generates a position control signal corresponding to a user input, and outputs the generated position control signal to the position adjustment unit 150.

The user input unit 170 may include a display device for visually outputting predetermined information provided from the position adjusting unit 150. [

For example, the user input unit 170 may include a display unit (not shown). The display unit (not shown) may include a screen 735a for displaying predetermined information provided from the position adjustment unit 150, as shown in FIG. The display unit (not shown) may be mounted on the housing or the cover of the sound source separation apparatus 100 ", and may be installed such that the screen 735a is exposed to the outside. On the screen 735a, predetermined information provided from the position adjustment unit 150 can be displayed. For example, when a plurality of channel sound source signals generated by the multi-channel sound generating unit 130 are output through an audio output apparatus (not shown), the predetermined information may be generated when each channel sound source signals are generated S2, and S3, which are sensed by the virtual speakers S1, S2, and S3. Here, the predetermined information may further include volume information of each of the virtual speakers S1, S2, and S3.

The user drags the first virtual speaker S1, which is one of the virtual speakers S1, S2, S3 corresponding to a plurality of channel sound source signals displayed on the screen 735a, (S1) can be moved. Of course, it is natural that the second virtual speaker S2 and the third virtual speaker S3 can also be moved. A position control signal corresponding to the movement of the first virtual speaker S1 is generated in the user input unit 170 and the user input unit 170 can output the generated position control signal to the position adjustment unit 150 in real time. Here, the first virtual speaker S1 corresponds to the first position P1 shown in Fig. 5, the second virtual speaker S2 corresponds to the second position P2 shown in Fig. 5, The virtual speaker S3 may correspond to the third position P3 shown in Fig.

In addition, the user input unit 170 may be an adjustment switch (not shown) for adjusting the position of a virtual speaker for each of a plurality of channel sound source signals generated by the multi-channel generator 130. For example, the adjustment switch may be a rotary switch or a toggle switch. An adjustment switch (not shown) may be provided for each of the plurality of channel sound source signals. The user can adjust the position of the virtual speaker of the corresponding channel sound source signal by adjusting one or a plurality of control switches, as shown in Fig. The user input unit 170 may generate a position control signal corresponding to an operation of the adjustment switch and transmit the generated position control signal to the position adjustment unit 150 in real time.

7 does not only have the advantages of the sound source separation apparatus 100 shown in FIG. 1, but also has the advantages of the user input unit 170 'provided in the sound source separation apparatus 100' ' ), The listener has the advantage of adjusting the position of the virtual speaker of each channel sound source signal, and the listener has the advantage of feeling the spatial feeling of the sound outputted through the sound output device (not shown). In addition, a listener may obtain the same effect as listening to a vocal sound at a specific position in a normal stereo sound source.

9 is a block diagram of an audio equipment 1000 according to an embodiment of the present invention.

Referring to FIG. 9, the audio equipment 1000 according to an embodiment of the present invention can process a stereo sound source signal to generate a multi-channel sound source signal in real time. By outputting the generated multi-channel sound source signal to the sound output through the sound output apparatus 300, the user can feel an enhenced sound rather than hear the input stereo sound source signal through the sound output apparatus 300 .

Referring to FIG. 9, an audio apparatus 1000 according to an embodiment includes a sound source separation unit 100 and an audio output unit 300.

The sound source separation unit 100 is the sound source separation apparatus 100 shown in FIG. Therefore, the description of the sound source separation unit 100 is replaced with the description of the sound source separation apparatus 100 described above with reference to FIG.

The audio equipment 1000 includes an audio output unit 300. The sound output unit 300 may include an amplifier 310 for amplifying a plurality of channel sound source signals output from the sound source separation unit 100. The sound output unit 300 may include a speaker unit 330 that converts a plurality of channel sound source signals output from the sound source separation unit 100 into sound waves and outputs the sound waves. Also, the sound output unit 300 may include both the amplifier 310 and the speaker unit 330. Here, the speaker unit 330 includes one or a plurality of speakers.

Since the sound apparatus 1000 shown in FIG. 9 includes the sound source separation unit 100, three or more new channel sound source signals L_new, Center, R_new can be generated in real time and output in real time through the sound output unit 300. [ That is, the audio apparatus 1000 shown in FIG. 9 has an advantage that it can generate and output one center channel sound source signal and two modified channel sound source signals in real time from a two-channel stereo sound source signal.

The center channel sound source signal Center includes the first channel sound source signal L and the second channel sound source signal R plus the first channel sound source signal L and the second channel sound source signal R ), The magnitude of a particular sound already included in each, for example a vocal sound, is doubled. Accordingly, there is an advantage that the vocal sound can be felt to a larger audience as compared with when the stereo sound source signal is emitted through the sound output unit 300 without any processing.

Although not shown in FIG. 9, the sound device 1000 may further include components included in a conventional general sound device. For example, an AUX terminal, a USB terminal, or a connection unit (not shown) for performing wire / wireless communication such as Bluetooth. A stereo sound source signal may be input from the outside to the audio equipment 1000 through a connection unit (not shown). The display unit may further include an adjusting unit for adjusting the volume of the sound output through the speaker unit 330 and a display unit for displaying the power state of the audio device 1000, .

10 is a block diagram of an acoustic device 1000 'according to another embodiment of the present invention.

Referring to FIG. 10, an acoustic device 1000 'according to another embodiment includes a sound source separation unit 100, a position adjustment unit 500, and an acoustic output unit 300. Here, the sound source separating unit 100 is the same as the sound source separating unit 100 shown in FIG. 9, and a detailed description thereof will be replaced with the one described above.

The position adjustment unit 500 receives a position control signal from an external terminal 3000 that is physically separate from the audio equipment 1000 '. The position control signal may be received by the acoustic device 1000 'via wired or wireless. To this end, the acoustic device 1000 'may further include a communication unit (not shown) for receiving and processing a position control signal from the terminal device 3000.

The terminal 3000 may be a portable terminal such as a smart phone and a tablet PC. The terminal 3000 may include a display unit including a touch screen, a processor, a memory unit, and an interface unit. The terminal device 3000 may be provided with an app for controlling the sound device 1000 '. When the app is executed by the user of the terminal device 3000, the position of each virtual speaker of the plurality of channel sound source signals generated by the sound source separation unit 100 may be displayed on the display unit of the terminal device 3000 .

Meanwhile, the terminal device 3000 may provide a stereo sound source signal to the audio device 1000 '. In this case, the terminal 3000 may further include a tone generator (not shown).

The position adjustment unit 500 receives a plurality of channel sound source signals output from the sound source separation unit 100. The plurality of channel sound source signals to be received may be at least three or more.

The position adjustment unit 500 processes a plurality of channel sound source signals received from the sound source separation unit 100 based on a position control signal from the terminal device 3000. The processing of a plurality of channel sound source signals means that when each processed sound source signal is outputted through the sound output unit 300, the sound source signal is generated at a predetermined position in a predetermined space, Means processing a channel sound source signal. Here, the preset predetermined space is determined by the position control signal received from the terminal device 3000.

For example, as shown in FIG. 5, the first virtual speaker, in which the position control signal from the terminal 3000 is generated and the sound of the center channel sound source signal (Center) of FIG. 2 is generated, The second virtual speaker, which is located at the first position P1 on the front side and on which the sound of the first channel sound source signal R_new of FIG. 2 is generated, is located at the second position P2 adjacent to the right side of the speaker 190 And the third virtual speaker, in which the sound of the second channel sound source signal L_new of FIG. 2 is generated, is located at the third position P3.

Under this assumption, the position adjustment unit 500 determines the position of the center channel sound source signal (Center) as if the sound of the center channel sound source signal (Center) was radiated at the first position (P1) Processes the first channel sound source signal R_new as if the sound of the first channel sound source signal R_new modified in the second position P2 is radiated and processes the first channel sound source signal R_new in the third position P3, And processes the second channel sound source signal R_new as the sound of the two channel sound source signal L_new is radiated.

A detailed process of processing the center channel sound source signal Center, the first channel sound source signal R_new, and the second channel sound source signal L_new will be described in detail below.

The position adjustment unit 500 may calculate a transfer function between the sound source signal input to each speaker of the speaker unit 330 of the sound output unit 300 and the sound pressure output from each of the positions P1, P2, and P3. The transfer function represents the characteristics of the space in which the listener is located, and may be stored in a memory (not shown) of the audio device 1000 'after actual measurement. The transfer function of each of the positions P1, P2, and P3 may be generated by the number of speakers included in the speaker unit 330 and may be expressed as a function of frequency. In addition, after transfer function is measured at some positions and stored in a memory (not shown) of the acoustic device 1000 ', a transfer function of an arbitrary position between some of the positions is generated by interpolating the transfer functions of the certain positions It is possible.

Next, the position adjustment unit 500 calculates a coefficient for converting each channel sound source signal by using a previously calculated transfer function so that sound sounds as if it is reproduced at each of the positions P1, P2, and P3.

In calculating the coefficient, it is desirable to determine a coefficient such that the sound pressure level at the position is higher than the sound pressure level in the region other than the position. More specifically, it is possible to calculate a coefficient that maximizes the ratio of the acoustic potential energy density at the position to the sum of the energies of the individual sound sources. Here, although a single frequency is described, it can be understood that when a plurality of frequencies are used, the sound source for each frequency is determined.

The coefficient may be a coefficient for converting the magnitude and phase of each channel sound source signal. For example, a coefficient for converting the magnitude of the sound output from the i-th speaker (where i is a natural number) of the speaker unit 330 is a magnitude of a transfer function vector of all speakers for the position, i < th > speaker. The coefficient for converting the phase difference of the sound source signal input to the i-th speaker can be obtained, for example, by declining the complex number of the transfer function of the i-th speaker.

When the coefficients are calculated, the position adjusting unit 500 may filter each channel sound source signal with a determined coefficient to generate a sound source signal for each speaker input to each speaker of the speaker unit 330. The generated sound source signal for each speaker is converted into a sound wave through the speaker unit 330 so that the listener feels as if the sound of the corresponding channel sound source signal is generated at each position.

When each channel sound source signal processed by the position adjustment unit 500 shown in FIG. 10 is output through the speaker unit 330, the listener selects the position of the vocal (V) in the first position P1 shown in FIG. The sound of the band B1 of the band is felt at the second position P2 shown in Fig. 5 and the other b2 of the band at the third position P3 shown in Fig. 5 ) Can be perceived as being generated.

10 does not only have the advantage of the audio device 1000 shown in FIG. 9, but also allows the listener to receive the virtual speaker 300 of each channel sound source signal through the external terminal 300 There is an advantage in that the listener can feel the spatial feeling of the sound outputted through the speaker unit 330. In addition, In addition, a listener may obtain the same effect as listening to a vocal sound at a specific position in a normal stereo sound source.

11 is a block diagram of a sound device 1000 '' according to another embodiment of the present invention.

11, an acoustic device 1000 '' according to another embodiment includes a sound source separation unit 100, a user input unit 700, a position adjustment unit 500, and an acoustic output unit 300 . Here, the sound source separation unit 100, the position adjustment unit 500, and the sound output unit 300 except for the user input unit 700 include the sound source separation unit 100, the position adjustment unit 500, Is the same as the output unit 300, and a specific description thereof is replaced with the one described above.

The acoustic device 1000 " according to yet another embodiment includes a user input 700. The user input unit 700 generates a position control signal corresponding to the user input and outputs the generated position control signal to the position adjustment unit 500.

The user input unit 700 may include a display device for visually outputting predetermined information provided from the position adjusting unit 500.

For example, the user input unit 700 may include a display unit (not shown). The display unit (not shown) may include a screen 735a for displaying predetermined information provided from the position adjusting unit 500, as shown in FIG. The display unit (not shown) may be mounted on the housing or the cover of the audio equipment 1000 '' and may be installed such that the screen 735a is exposed to the outside. On the screen 735a, predetermined information provided from the position adjusting unit 500 can be displayed. The predetermined information may include relative position information of the virtual speakers S1, S2, and S3 corresponding to a plurality of channel sound sources output from the sound source separation unit 100, for example. In addition, the predetermined information may further include volume information of each of the virtual speakers S1, S2, and S3.

The user drags the first virtual speaker S1, which is one of the virtual speakers S1, S2, S3 for each of a plurality of channel sound source signals displayed on the screen 735a, and then drags the first virtual speaker S1 to a predetermined position Can be moved. Of course, it is natural that the second virtual speaker S2 and the third virtual speaker S3 can also be moved. A position control signal as the first virtual speaker S1 moves is generated in the user input unit 700 and the user input unit 700 can output the generated position control signal to the position adjustment unit 500 in real time. Here, the first virtual speaker S1 corresponds to the first position P1 shown in Fig. 5, the second virtual speaker S2 corresponds to the second position P2 shown in Fig. 5, The virtual speaker S3 may correspond to the third position P3 shown in Fig.

The user input unit 700 may be an adjustment switch (not shown) for adjusting a position of a virtual speaker according to a plurality of channel sound source signals generated by the sound source separation unit 100. For example, the adjustment switch may be a rotary switch or a toggle switch. An adjustment switch (not shown) may be provided for each of the plurality of channel sound source signals. The user can adjust the position of the virtual speaker of the corresponding channel sound source signal by adjusting one or a plurality of control switches, as shown in Fig. The user input unit 700 may generate a position control signal according to the operation of the adjustment switch and transmit the generated position control signal to the position adjustment unit 500 in real time.

11 has the advantage of the sound apparatus 1000 shown in Fig. 9, and also has the advantage of being able to receive the sound through the user input unit 700 provided in the sound apparatus 1000 " The listener has an advantage in that the position of the virtual speaker of each channel sound source signal can be adjusted, and the listener has the advantage of feeling the spatial feeling of the sound output through the speaker unit 330. In addition, a listener may obtain the same effect as listening to a vocal sound at a specific position in a normal stereo sound source.

The features, structures, effects and the like described in the embodiments are included in one embodiment of the present invention and are not necessarily limited to only one embodiment. Furthermore, the features, structures, effects and the like illustrated in the embodiments can be combined and modified by other persons skilled in the art to which the embodiments belong. Therefore, it should be understood that the present invention is not limited to these combinations and modifications.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of illustration, It can be seen that various modifications and applications are possible. For example, each component specifically shown in the embodiments can be modified and implemented. It is to be understood that all changes and modifications that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

100, 100 ', 100'': Sound source separation device
110: Multi-channel generating unit
130: user input section
150: Position adjustment unit
1000, 1000 ', 1000'': Sounder
100: sound source separation unit
300: sound output unit
310: Amplifier
330: Speaker
500: Position adjustment unit
700: user input
3000: Terminal machine

Claims (16)

A receiver for receiving a stereo sound source signal including a first channel sound source signal and a second channel sound source signal; And
And a multi-channel generator for generating at least three channel sound source signals in real time based on the stereo sound source signals received from the receiver,
The multi-
Generating a modified first channel sound source signal by summing the first channel sound source signal amplified by the first amplification degree and the second channel sound source signal amplified by the second amplification degree,
Generating a center channel sound source signal by summing the first channel sound source signal and the second channel sound source signal,
A second channel sound source signal obtained by amplifying the second channel sound source signal by the first amplification degree and amplifying the first channel sound source signal by the second amplification degree,
Wherein the absolute value of the first amplification factor is greater than the absolute value of the second amplification factor,
Real time sound source separation device.
delete delete The method according to claim 1,
Wherein the first amplification degree is 2 and the second amplification degree is -1.
The method according to claim 1 or 4,
And a position adjuster for receiving the channel sound source signals generated by the multi-channel generator and receiving a position control signal from the terminal,
Wherein the position adjustment unit processes the channel sound source signals generated by the multi-channel generation unit based on the position control signal,
Wherein when the channel sound source signals processed by the position adjustment unit are outputted through the sound output device, the channel sound source signals are recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the position control signal.
The method according to claim 1 or 4,
A user input for generating a position control signal corresponding to a user input; And
And a position adjusting unit for receiving the channel sound source signals generated by the multi-channel generating unit and receiving a position control signal from the user input unit,
Wherein the position adjustment unit processes the channel sound source signals generated by the multi-channel generation unit based on the position control signal,
Wherein when the channel sound source signals processed by the position adjustment unit are outputted through the sound output device, the channel sound source signals are recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the position control signal.
The method according to claim 6,
Wherein the user input unit includes a display unit having a screen for displaying predetermined information provided from the position adjustment unit,
Wherein the predetermined information includes position information of virtual speakers corresponding to the predetermined spaces.
The method according to claim 6,
Wherein the user input unit is an adjustment switch for adjusting a position of virtual speakers corresponding to the predetermined spaces.
A real time sound source separation unit for receiving a stereo sound source signal including a first channel sound source signal and a second channel sound source signal and generating at least three channel sound source signals in real time based on the received stereo sound source signal; And
A sound output unit including at least one of an amplifier for amplifying the channel sound source signals generated by the real-time sound source separation unit and a speaker unit for converting the channel sound source signals generated by the real-time sound source separation unit into sound waves and outputting the sound source signals; / RTI >
Wherein the real-
Generating a modified first channel sound source signal by summing the first channel sound source signal amplified by the first amplification degree and the second channel sound source signal amplified by the second amplification degree,
Generating a center channel sound source signal by summing the first channel sound source signal and the second channel sound source signal,
A second channel sound source signal obtained by amplifying the second channel sound source signal by the first amplification degree and amplifying the first channel sound source signal by the second amplification degree,
Wherein the absolute value of the first amplification factor is greater than the absolute value of the second amplification factor,
Acoustic equipment.
delete delete 10. The method of claim 9,
Wherein the first amplification degree is 2 and the second amplification degree is -1.
The method according to claim 9 or 12,
And a position adjustment unit connected between the real time sound source separation unit and the sound output unit and receiving the channel sound source signals generated by the real time sound source separation unit and receiving a position control signal from the terminal,
Wherein the position adjustment unit processes the channel sound source signals generated by the real-time sound source separation unit based on the position control signal,
Wherein when the channel sound source signals processed by the position adjustment unit are outputted through the sound output unit, the sound source signals are recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the position control signal.
The method according to claim 9 or 12,
A user input for generating a position control signal corresponding to a user input; And
And a position adjustment unit connected between the real time sound source separation unit and the sound output unit and receiving the channel sound source signals generated by the real time sound source separation unit and receiving a position control signal from the user input unit,
Wherein the position adjustment unit processes the channel sound source signals generated by the real-time sound source separation unit based on the position control signal,
Wherein when the channel sound source signals processed by the position adjustment unit are outputted through the sound output unit, the sound source signals are recognized by the listener as if the channel sound source signals are generated in predetermined spaces corresponding to the position control signal.
15. The method of claim 14,
Wherein the user input unit includes a display unit having a screen for displaying predetermined information provided from the position adjustment unit,
Wherein the predetermined information includes position information of virtual speakers corresponding to the predetermined spaces.
15. The method of claim 14,
Wherein the user input unit is an adjustment switch for adjusting a position of virtual speakers corresponding to the predetermined spaces.
KR1020170113732A 2017-09-06 2017-09-06 Apparatus realtime dividing sound source and acoustic apparatus KR101993585B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020170113732A KR101993585B1 (en) 2017-09-06 2017-09-06 Apparatus realtime dividing sound source and acoustic apparatus
PCT/KR2018/009949 WO2019050206A1 (en) 2017-09-06 2018-08-29 Sound source separation device and audio equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020170113732A KR101993585B1 (en) 2017-09-06 2017-09-06 Apparatus realtime dividing sound source and acoustic apparatus

Publications (2)

Publication Number Publication Date
KR20190027398A KR20190027398A (en) 2019-03-15
KR101993585B1 true KR101993585B1 (en) 2019-06-28

Family

ID=65635357

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170113732A KR101993585B1 (en) 2017-09-06 2017-09-06 Apparatus realtime dividing sound source and acoustic apparatus

Country Status (2)

Country Link
KR (1) KR101993585B1 (en)
WO (1) WO2019050206A1 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR970003148Y1 (en) * 1993-12-18 1997-04-12 삼성전자 주식회사 An apparatus for regenerating super stereo sound
JP2004364239A (en) * 2003-10-15 2004-12-24 Fujitsu Ten Ltd Acoustic apparatus
KR101690252B1 (en) * 2009-12-23 2016-12-27 삼성전자주식회사 Signal processing method and apparatus
US9681249B2 (en) * 2013-04-26 2017-06-13 Sony Corporation Sound processing apparatus and method, and program
JP2016536855A (en) 2013-10-02 2016-11-24 ストーミングスイス・ゲゼルシャフト・ミト・ベシュレンクテル・ハフツング Method and apparatus for downmixing multichannel signals and upmixing downmix signals
KR20150117797A (en) * 2014-04-11 2015-10-21 하수호 Method and Apparatus for Providing 3D Stereophonic Sound

Also Published As

Publication number Publication date
WO2019050206A1 (en) 2019-03-14
KR20190027398A (en) 2019-03-15

Similar Documents

Publication Publication Date Title
Baumgarte et al. Binaural cue coding-Part I: Psychoacoustic fundamentals and design principles
US20190139530A1 (en) Audio scene apparatus
US10555108B2 (en) Filter generation device, method for generating filter, and program
KR101764175B1 (en) Method and apparatus for reproducing stereophonic sound
US20080298597A1 (en) Spatial Sound Zooming
JP2007135046A (en) Sound signal processor, sound signal processing method and program
US20200213702A1 (en) Signal processing device, signal processing method, and program
CN112806030B (en) Method and apparatus for processing spatial audio signals
JP4840421B2 (en) Audio signal processing apparatus, audio signal processing method, and program
KR20130133242A (en) Apparatus and method for decomposing an input signal using downmixer
WO2006004099A1 (en) Reverberation adjusting apparatus, reverberation correcting method, and sound reproducing system
US10264387B2 (en) Out-of-head localization processing apparatus and out-of-head localization processing method
JP6613078B2 (en) Signal processing apparatus and control method thereof
EP2484127B1 (en) Method, computer program and apparatus for processing audio signals
WO2018193163A1 (en) Enhancing loudspeaker playback using a spatial extent processed audio signal
JP7232546B2 (en) Acoustic signal encoding method, acoustic signal decoding method, program, encoding device, audio system, and decoding device
JP2022536169A (en) Sound field rendering
KR101993585B1 (en) Apparatus realtime dividing sound source and acoustic apparatus
CN110268722B (en) Filter generation device and filter generation method
JP2016134769A (en) Audio signal processor
CN109688531B (en) Method for acquiring high-sound-quality audio conversion information, electronic device and recording medium
WO2018193160A1 (en) Ambience generation for spatial audio mixing featuring use of original and extended signal
JP2016134767A (en) Audio signal processor
JP5743003B2 (en) Wavefront synthesis signal conversion apparatus and wavefront synthesis signal conversion method
JP5590169B2 (en) Wavefront synthesis signal conversion apparatus and wavefront synthesis signal conversion method

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right