CN1023052C - Sound imaging system for video game - Google Patents

Abstract

Game software 10 includes sound positioning information that uses speakers 26, 28 to give the player the impression that the sound is emanating from a location other than the actual speaker locations. A sound processor 220 receives monaural signals in response to sound positioning information from software 10 so each monaural signal is divided into two signals, one of which being passed through a transfer function to produce two-channel outputs having differential phase and amplitude adjusted on a frequency dependent basis. Each sound location needs a different relationship using different transfer functions, each embodied by adjusting a digital filter in response to positioning information.

Description

Sound imaging system for video game

The present invention is about the human-computer dialogue electronic game machine in general, more specifically says so about so a kind of device, and it utilizes the sound localization information that is arranged in the game shows, and is suitable for the electronic game machine system owing to it has utilized sound localization information.

At present, the human-computer dialogue electronic game machine has been that people are familiar with and usual things very much, and in fact everyone is not that to have started to play a kind of electronic game machine be exactly to have seen others play.Utilize the television receiver or the televimonitor of the routine that family has just can play video game at home, electronic game machine also can be played under the arcade situation, and each game machine has its TV screen and apparatus for reproducing sound in this case.

In general, although the human-computer dialogue electronic game machine is becoming very complicated aspect the video demonstration, the audio-frequency unit of game machine is also not really flourishing.For this reason, advise adopting a sound image (Sound imaging) system, for example transferred assignee's No. 239981 patent application descriptions of the U.S. and disclosed the sort of system.For reference in this disclosure of mentioning above-mentioned patent application.Disclosed a system in that application case, can have been controlled by the sound position that two loud speakers placed apart produce, the position of this sound source seems another point outside the loud speaker physical location concerning the hearer.It is done in such a way that promptly uses the forwarding function that drives by rule of thumb that a plurality of monophonic input signals are worked.The dual track output signal is produced by each forwarding function, and each output signal has the out of phase and the amplitude relation of frequency dependence, and dual track output is provided after the dual track output signal is added up.In the continuous frequency range of audible spectrum, phase place and amplitude are separate regulation.Forwarding function can realize with a digital filter, and in general, one of position needs that each of sounding separated are forwarding function independently.Use this sound positioning system will increase audio programs widely, this programme content moves with the human-computer dialogue electronic game machine.In any case, the interconnection of each subsystem of electronic game machine and alternative some existing subsystem have become a problem with the visible system that a commercialization is provided.

Purpose of the present invention provides a Sound Processor Unit will for exactly the electronic game machine system, it is handled the monophony output of the audio frequency synthesizer in the game machine according to the sound localization information of game software, so that give such image of player, promptly sound is from loud speaker physical location place in addition.

According to one aspect of the present invention, the monophonic sound tone signal generally is to be produced by the audio frequency synthesizer, this audio frequency synthesizer is received CPU by the CPU bus, said monophonic sound tone signal is delivered to Sound Processor Unit, the sound localization information that this Sound Processor Unit also receives the game machine program material and provided by said CPU bus, therefore, handle according to sound localization information by the monophonic signal that said synthesizer produces, so that produce the dual track voice signal according to the predetermined forwarding function that is included in the Sound Processor Unit, have the out of phase and the amplitude relation of frequency dependence between the dual track voice signal.Predetermined forwarding function can realize with a digital filter, and in general, one of sound position needs that each separates are forwarding function independently.Value at the forwarding function of audible spectrum produces by rule of thumb.The dual track voice signal addition that each monophonic input signal is produced just produces dual track output.In addition, the audio frequency synthesizer that separates can be received this CPU by the CPU bus of serial or parallel port or expansion with Sound Processor Unit.For example, Sound Processor Unit and audio frequency synthesizer can be arranged in the hand-held control unit, the acoustic information that is included in so in the game card can be delivered to audio frequency synthesizer and Sound Processor Unit by CPU with a serial port, to produce the dual track voice signal.

Fig. 1 shows personal-machine dialogue electronic game machine system, and according to one embodiment of the present of invention, it adopts a Sound Processor Unit, so that produce the dual track voice signal by monophonic signal and the sound localization information that is included in the game card.

Fig. 2 expresses the block diagram of Fig. 1 system in more detail.

Fig. 3 is the block diagram structure of an electronic game machine, and according to one embodiment of the present of invention, wherein Sound Processor Unit and audio frequency synthesizer are arranged in the handheld control unit, so that produce the dual track voice signal according to the sound localization information of game card.

Fig. 4 represents the block diagram according to an embodiment of Sound Processor Unit of the present invention.

Fig. 5 represents another embodiment according to Sound Processor Unit of the present invention.

Fig. 6 represents the block diagram that links together according to the many Sound Processor Units of one embodiment of the present of invention.

Fig. 7 represents the block diagram that the many Sound Processor Units according to an alternative embodiment of the invention such as Fig. 5 connect together.

As shown in Figure 1, game card 10 inserts in the notch 12 that forms on the electronic game machine elementary cell 14 usually.In the system of Fig. 1, game card 10 comprises sound localization information, and its allow to be used the principle of above-mentioned patent application and with the typical sound programme content of instruction (cues) form of sound synthesizer, generally all includes sound synthesizer.

About this sound localization information, should be noted that at first game card can comprise three kinds of acoustic informations.At first, some game card provides the static sound relevant with the background environment of playing, perhaps when the musical sound that can comprise synthesizer regeneration when playing games.Some game card also can comprise dynamic voice, and they are relevant with the concrete image on the video frequency discriminator.For example, when shown image when being relevant with thunderstorm, this dynamic voice can comprise thunder.At last, some video game card also can provide the dynamic voice that is produced by player's action, and for example, the player can use button, produces the sound of shooting such as 16 or the joystick 18 on player's control unit 20.Sometimes equip two remote control unit, general such unit is identical, second remote control unit shown in 20 among Fig. 1 ', have button 16 ' and joystick 18 '.

Therefore as can be seen, on the typical gaming card, can obtain three kinds of different sound at least.However, according to the processing and the instruction of the present invention of the relevant sound image of above-mentioned patent application, all three kinds of alternative sounds can be controlled with respect to the position that the hearer occurred.In other words, in the embodiment in figure 1, suppose that video-frequency monitor 24 has the loud speaker of left and right acoustic channels, be respectively 26 and 28, and monitor 24 joins by cable 30 and electronic game machine elementary cell 14, be positioned at elementary cell 14 or player's control unit 20 so, after this sound localization information processing from game card 10 to this Sound Processor Unit (not drawing Fig. 1), when this voice output, for example the player in video-frequency monitor 24 fronts can obtain such image, be sound is that position from video-frequency monitor 24 back is issued to left speaker 26 or right loud speaker 28, perhaps be actually and send after one's death the player.The vision signal of game machine is also supplied with monitor 24 by cable 30.

When the player does not wish loud speaker 26,28 with video-frequency monitor 24, but when wishing to use earphone, so, just earphone 32 usefulness cables 34 are received in the socket of video game machine elementary cell 14.When plugging in the earphone after 32, just cut off the audio signal of monitor loudspeaker 26,28, sound will be reset by earphone 32, and it is also according to existing the sound localization information in the game card 10 to provide the sound image to the hearer at first.

According to another aspect of the present invention, player's control unit 20 also can be provided with loud speaker separately, and shown in symbol 35, and sound is by loud speaker 35 rather than the loudspeaker plays by video-frequency monitor.

The details of Fig. 2 presentation graphs 1 system, wherein CPU (CPU) 120 joins by cpu bus 300 and audio frequency synthesizer 180 and Sound Processor Unit 220.Therefore, can transmission on cpu bus 300 concurrently to the order of synthesizer 180 and instruction, and also the sound localization information of game card 10 also can be sent to Sound Processor Unit 220 on the cpu bus 300 by CPU120.The output of synthesizer 180 can be a line, if output is multiplexed, perhaps output can be many lines 200, and every line is represented a specific monophonic sound tone signal.These monophonic sound tone signal are sent to Sound Processor Unit 220, and in Sound Processor Unit, signal will pass through digital filter.Typically, cpu bus 300 is also received one or more serial ports, and shown in 320, it is used to connect video-frequency monitor and similar equipment.

The dual track voice signal of Sound Processor Unit 220 outputs is delivered to suitable loud speaker 26,28 respectively.These output signals also can be delivered to earphone and any other external loudspeaker.It should be noted that as if only manage dual track output is meant stereophonic signal, but do not need so here, because stereophonic signal does not have the out of phase and the amplitude relation of the frequency dependence of the binaural signal that produces as this embodiment of the present invention.

Fig. 3 represents an alternative embodiment of the invention, wherein uses the Sound Processor Unit that is included in the sound localization information in the game card 10 to be arranged in the shell 400, and this shell comprises handheld control unit 20.When the cpu bus in the elementary cell of existing electronic game machine can not be expanded, this embodiment was useful, made that must carry out the serial or parallel port to control unit 14 connects.

Sound Processor Unit 220 and new external audio synthesizer 420 all are arranged in the shell identical with control unit 14, and these unit are got in touch by serial or parallel port and the CPU120 that receives the CPU bus.Specifically, the multiple conductor cable 500 of control unit 14 is received serial or parallel port 540, and it is connected with cpu bus 300.Except the external audio synthesizer 420 and Sound Processor Unit 220 that separate, because the restriction of the data rate that the serial or parallel port between synthesizer 420 and game card 10 and the CPU120 connects, therefore used a memory 460 to keep the audio program information of game card 10, be convenient to use after the microcontroller 480, this microcontroller is used to control the transmission to the acoustic information of audio frequency synthesizer 420.Sound localization information is delivered to Sound Processor Unit 220 by microcontroller 480, and is controlled by CPU120 according to the operation of recreation.

Fig. 4 represents an embodiment, wherein has only a traffic filter 60 and four gain adjusting circuits 62,64,66 and 68 just can produce to be enough to a lot of forwarding functions of the sound image that left position, right position and all centre positions are provided.Specifically, filter 60 has the forwarding function at so-called 3 o'clock or 9 o'clock, it is it can produce 3 o'clock or 9 o'clock at this sound position position, then, the Control Parameter that response is also delivered to input 70,72,74,76 respectively from game card is controlled four gain adjusting circuits 62,64,66,68, so that the centre position is provided.In fact, the embodiment of Fig. 4 is that a positive left side or positive right position are mixed with a phasing signal with changing, and so that the centre position to be provided, this mixing is carried out in adder or mixer unit 78 and 80.

Example as an operation, wherein this sound localization is in positive left position, i.e. 9 o'clock, the gain of fader 62 is transfused to end 70 signal and adjusts to zero then, the gain of fader 64 is transfused to the signal of end 72 and is transferred to its maximum, the gain of fader 66 is transfused to the signal of end 74 and is transferred to its maximum, and the gain of fader 68 is transfused to the signal set to zero of end 76.Sound roughly to be forwarded to the position of left speaker or transducer from positive left position, just use the gain set to zero of the signal of input 74 fader 66.Forward right loud speaker to from left speaker, just the signal of usefulness input 72 arrives zero with the change in gain of fader 64, and with the signal of input 76 its maximum is transferred in the gain of fader 68.In other words, the adjusting of these faders makes and has the left side and the R channel that equate basically by the sound stereophonic signal of a standard seemingly.To forward sound to positive right position i.e. 3 o'clock from right speaker so, just the gain of fader 62 be changed to maximum gain with the signal of input 70.

Another embodiment of Fig. 5 presentation graphs 4 embodiment.The embodiment of Fig. 5 adopted two 3/9 o'clock filter 90,92 and as the adder among Fig. 4 78,80.Also be provided with fader 94 at input, directly deliver to adder 80 at the same monophonic input signal of terminal 42 by second fader 96, and do not carry out any adjusting to filter 90.Similarly, same monophonic input signal is also delivered to adder 78 by fader 98 with directly and not carrying out any adjusting.The input of second filter 92 is provided with the output of fader 100, the second filters 92 and delivers to adder 80, and adder 80 is gone back the output of receiver regulator 96.In addition, response is from game card and be added to the gain that Control Parameter on the circuit 102,104,106,108 is regulated fader 94,96,98,100 respectively, just can mix positive left or positive right position between a positive left side and positive right position.

According to the sound localization processor of initiative of the present invention, no matter can obtain several monophonic input signals, Sound Processor Unit also only provides two output signals.According to the present invention, each audio signal that is produced by the audio frequency synthesizer can have its processor, and therefore, some signal can be located a plurality of points.For example shown in Figure 6, arrange a plurality of input channels, respectively each signal is handled according to its Control Parameter.Multichannel output is added up and is formed a left side and R channel then.More particularly, such as the input 110 that is added to the first sound localization processor 112, this location processor is such as implementing by Fig. 4 or Fig. 5 from a monophonic sound tone signal of electronic game machine audio frequency synthesizer.Sound localization processor 112 also receives positional control parameters at input 114, and this parameter determines whether want and to what extent relocate with respect to this loud speaker in this monophonic sound tone signal of input 110.Sound Processor Unit 112 produces a left channel signals on circuit 116, and produces a right-channel signals on circuit 118, and left channel signals is delivered to first adder 121, and right-channel signals is delivered to second adder 122.All provide a sound localization processor identical for the monophonic input signal of each separation with sound localization processor 112.For example, second monophonic signal is added to input 124, and 126 of inputs receive (N-1) monophonic input signal, and input 128 receives the N monophonic input signals, it can be produce by the audio frequency synthesizer or from other sound source.As first sound channel, in the monophonic sound tone signal of input 128 such as being added to sound localization processor 130, it produces a corresponding L channel output and delivers to adder 121 on circuit 132, and adder 122 is delivered in the output of generation R channel on circuit 134, in addition, be used to control the location from the signal that game card shown in Figure 1 is used on the relevant input 136 of the visual Control Parameter of locating of sound.Each sound localization processor between first Sound Processor Unit 112 and last sound localization processor 130 produces a corresponding left side and R channel output signal, delivers to adder 121 and 122 respectively.Then, all input signals of adder 121 combinations also produce left channel signals on terminal 44, and similarly, adder 122 makes up all input signals and provides R channel output at terminal 46.Certainly should understand that each sound localization processor among Fig. 6 can be any one processor among above-mentioned a plurality of embodiment.

Embodiment shown in Figure 6 comprises so-called one group of complete positioning function, certain high efficiency, but in any case, because it has a large amount of sound localization devices, thus relatively more expensive, and also it also comprises digital filter in certain embodiments, therefore expensive more.On the other hand, it only needs two adders, and adder and digital filter are more relatively cheap.Therefore, the present invention provides another embodiment again, as shown in Figure 7, also has only one group of locator and since only need two 3/9 o'clock forwarding function, so than cheap many of the embodiment of Fig. 6.

Consult Fig. 7 then, represented only to use two 3/9 o'clock filter 140 an and multichannel locator of 142, but be to use many adder and the faders more relatively cheap than filter.More particularly, in first sound channel, monophonic signal is added to input 144, and delivers to signal adder 148 by first fader 146, and its output is filter 140 the input of the one 3/9 o'clock.The output of filter 140 is added to another signal adder 150.Monophonic signal on the input 144 is also delivered to second fader 152, and its output is added to another signal adder 154.Same input signal also is added to the 3rd fader 156, and adder 158 is delivered in its output, and this input signal delivers to the 4th fader 160, and it has an output to deliver to the 4th input summer 162.The system of this arrangement and Fig. 5 is similar a bit.The embodiment of Fig. 7 can regard a kind of special circumstances of Fig. 5 embodiment as in fact.Wherein before two 3/9 o'clock filters, be provided with many adders.On input 164, second monophonic signal is delivered to fader 166, and its output is delivered to adder 148, the second monophonic input signals and also delivered to fader 168, and adder 154 is delivered in its output; Fader 170, adder 158 is delivered in its output; Fader 172, adder 162 is delivered in its output.This embodiment can provide any amount of sound channel input, and last sound channel input is in this example received on the terminal 174, represents with sound channel N input.Four faders 176,178,180,182 are also delivered in signal input on the signal input part 174, and adder 148,154,158 and 162 is delivered in their output respectively.Indicated as figure, 3/9 o'clock filter 140 is delivered in the output of adder 148, output signal adder 150 is delivered in its output, and output signal adder 184 is delivered in the output of adder 154, output signal adder 150 is also delivered in the output of adder 158, the 2 3/9 o'clock filter 142 is delivered in the output of adder 162, and output signal adder 184 is also delivered in its output.Therefore, output signal adder 150 and 184 is providing left channel signals and providing right-channel signals on output 46 respectively on the output 44.

The embodiment of Fig. 7 and the embodiment of Fig. 6 are compared, be easy to find out that circuit cost has reduced, irrelevant because it only needs two filters with input sound channel quantity, and in the embodiment of Fig. 6, each input sound channel needs a filter at least.

Claims (13)

1, a kind of human-computer dialogue electronic game machine system, be used for a pair of loud speaker at this electronic game machine is provided the sound image of playback, this electronic game machine uses a CPU in elementary cell and comprises Visual Display Data, voice data one independently game card, and player's control unit; This system comprises:

The CPU bus that is connected with CPU;

With the audio synthesizer that the CPU bus is connected, be used for according to the voice data generation monophonic audio signal of exporting and deliver to the CPU bus from game card by CPU;

It is characterized in that:

The sound localization data are inserted in the game card, and

Receive the acoustic processing apparatus of CPU bus and said audio frequency synthesizer arrangement, the sound localization data that are used to respond CPU are handled each said monophonic audio signal that said audio frequency synthesizer arrangement produces, and comprise the forwarding function that carries out work by monophonic audio signal, so that produce the dual track voice signal, have the out of phase and the amplitude of frequency dependence between this dual track voice signal, it is right that said binaural signal is sent to loud speaker.

2, according to the human-computer dialogue electronic game machine system of claim 1, wherein said game operation platform comprises a shell and a parallel bus, and said sound localization processing unit is arranged in the said shell and receives said parallel bus.

3, according to the human-computer dialogue electronic game machine system of claim 2, also comprise the CPU bus expansion that is connected to CPU, said sound synthesizer device and said acoustic processing apparatus are received CPU by said CPU bus expansion.

4, according to the human-computer dialogue electronic game machine system of claim 2, wherein the CPU bus is received a serial data port with CPU, said control unit is switched on, be used for getting in touch by said serial data port and CPU, wherein said control unit comprises the shell with said external voice synthesizer arrangement, and said acoustic processing apparatus is contained in the said shell.

5, human-computer dialogue electronic game machine system according to claim 4, a microcontroller and a memory also are set in said control unit shell, they are connected with said serial data port, therefore said memory is stored by all voice datas of microcontroller reception game card, then, said microcontroller receives the order of said CPU, the said voice data of having stored is delivered to said sound synthesizer device from said memory, and said sound localization data are offered said acoustic processing apparatus, said Sound Processor Unit produces said dual track voice signal from the monophonic sound tone signal of said sound synthesizer device output.

6, according to the human-computer dialogue electronic game machine system of claim 1, wherein Sound Processor Unit comprises:

The device that the said audio signal of said audio frequency synthesizer is divided into two identical monophonic signals;

Basically be in the audible spectrum scope, an audio signal in above-mentioned two audio signals is being carried out the phase shift of frequency dependence and the filter of amplitude adjusted;

First group of fader, the said sound localization data that it receives said two audio signals and responds said game card produce corresponding gain-adjusted signal;

Second group of fader, each fader receives the output signal of said filter, and the said sound localization information that responds said game card produces corresponding gain-adjusted signal; And

First and second signal adder means, each signal adder means is used for the corresponding output signal addition with each fader of said first group and second group fader, and produce corresponding summation output signal, deliver to the corresponding loud speaker of loud speaker centering again.

7, according to the human-computer dialogue electronic game machine system of claim 6, wherein said first group of fader comprises two signal attenuators, and the sound localization information of each signal attenuator response game card selectively produces maximum gain or least gain.

8, according to the human-computer dialogue electronic game machine system of claim 6, wherein said second group of fader comprises two signal attenuators, and the sound localization information of each signal attenuator response game card selectively produces maximum gain or least gain.

9, according to the human-computer dialogue electronic game machine system of claim 1, wherein Sound Processor Unit comprises:

A plurality of faders, each fader receives the audio signal of audio frequency synthesizer, and the sound localization information of response game card regulates the gain of this signal, produces corresponding gain-adjusted output signal;

First and second phase shifts and amplitude regulation arrangement, each adjusting device receives the output signal of the gain-adjusted of fader selected in said a plurality of fader, to produce corresponding output signal, basically be in the audible spectrum scope, output signal has the predetermined phase shift and the amplitude adjusted of frequency dependence; And

First and second adders, each signal adder means receives the output signal of corresponding output of said first and second phase shifts and amplitude regulation arrangement and the fader except that said selected fader, and to deliver to said loud speaker respectively right to produce the corresponding first and second summation output signals.

10, according to the human-computer dialogue electronic game machine system of claim 1, wherein said processor comprises:

A plurality of phase shifts and amplitude regulation arrangement, each adjusting device receives a corresponding audio signal of audio frequency synthesizer, separate this audio signal, and the sound localization information of response game card selectively moves this phase place and this amplitude of adjusting to the audio signal of a separation at least, to produce first and second output signals, these signals have the different phase shifts and the amplitude adjusted of frequency dependence; And

First and second signal adder means, each signal adder means receive corresponding first and second output signals of each adjusting device in said a plurality of phase shift and the amplitude regulation arrangement, and producing corresponding summation signals, to deliver to loud speaker right.

11, according to the human-computer dialogue electronic game machine system of claim 10, wherein each said phase shift and amplitude regulation arrangement comprise:

The device that the audio signal of audio frequency synthesizer is divided into two identical audio signals;

Filter apparatus is being in the audible spectrum scope basically, a signal of said two identical audio signals is carried out the phase shift and the amplitude adjusted of frequency dependence;

First group of fader receives said two identical audio signals, and the said sound localization data that respond said game card produce corresponding gain-adjusted signal;

Second group of fader, each fader receives the output signal of said filter apparatus, and the said sound localization data that respond said game card produce corresponding gain-adjusted signal; And

Third and fourth signal adder means, each signal adder means is with the corresponding output signal addition of each fader in said first group and the second group of fader, and produce corresponding summation output signal, and deliver to a corresponding signal adder means in said first and second signal adder means.

12, according to the human-computer dialogue electronic game machine system of claim 10, wherein each said phase shift and amplitude regulation arrangement comprise a plurality of faders, each fader receives the audio signal of audio frequency synthesizer, and the sound localization data of response game card regulate its signal gain, and produce the output signal of corresponding gain-adjusted;

First and second phase shifts and amplitude regulation arrangement, each adjusting device receives the output signal of the gain-adjusted of adjuster selected in said a plurality of fader, to produce corresponding output signal, basically be in the audible spectrum scope, these output signals have the predetermined phase shift and the amplitude adjusted of frequency dependence;

Third and fourth signal adder means, each signal adder means receives the corresponding output of the first and second phase displacement regulating devices and the output signal of the fader except that said selected fader, to produce the corresponding first and second summation output signals, deliver to said first and second signal adder means respectively.

13, according to the human-computer dialogue electronic game machine system of claim 1, wherein this Sound Processor Unit comprises:

A plurality of four fader groups, a corresponding audio signal in a plurality of audio signals of each fader reception audio frequency synthesizer in every group, and the gain of sound localization information conditioning signal of response game card, and produce the output signal of corresponding gain-adjusted;

The first, second, third and the 4th signal adder means, each signal adder means receive the output signal of corresponding fader in every group, and produce corresponding summation signals thus;

First phase shift and amplitude regulation arrangement receive the said summation signals of said first signal adder means, and produce the output signal of first phase shift and amplitude adjusted;

Second phase shift and amplitude regulation arrangement receive the said summation signals of said the 4th signal adder means, and produce the output signal of second phase shift and amplitude adjusted;

The 5th signal adder means, receive said phase shift and the output signal of amplitude adjusted and the summation signals of said the 3rd signal adder means of said first phase shift and amplitude regulation arrangement, and produce an output, deliver to a loud speaker of this loud speaker centering thus; And

The 6th signal adder means, receive said phase shift and the output signal of amplitude adjusted and the summation signals of said secondary signal adder of said second phase shift and amplitude regulation arrangement, and produce an output, deliver to another loud speaker of this loud speaker centering thus.

Images