CN106535060B - A kind of pick-up control method, audio frequency playing method and device - Google Patents
A kind of pick-up control method, audio frequency playing method and device Download PDFInfo
- Publication number
- CN106535060B CN106535060B CN201510583338.9A CN201510583338A CN106535060B CN 106535060 B CN106535060 B CN 106535060B CN 201510583338 A CN201510583338 A CN 201510583338A CN 106535060 B CN106535060 B CN 106535060B
- Authority
- CN
- China
- Prior art keywords
- audio
- user
- sound
- information
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Stereophonic System (AREA)
Abstract
The invention discloses a kind of pick-up control method, audio frequency playing method and devices, in pickup, carry out user's simulation, determine sound pick-up and the location information of source of sound relative analog user;Determine the first audio frequency parameter;First audio frequency parameter is for characterizing the time difference information that the audio reaches the analog subscriber or so ear from the sound pick-up;It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;When carrying out audio broadcasting, user current location information is obtained;First audio-frequency information is parsed, the audio signal of sound pick-up acquisition, the location information and the first audio frequency parameter of the sound pick-up relative analog user are obtained;The audio play parameter that above- mentioned information based on acquisition adjusts the audio signal carries out audio broadcasting.
Description
Technical field
The present invention relates to a kind of multimedia technology field more particularly to pick-up control method, audio frequency playing method and devices.
Background technology
With being constantly progressive for multimedia technology, user increasingly cannot be satisfied the sound quality damage that low bit rate audio coding is brought
It loses, and pursues high code check, high-fidelity, stereosonic audio frequency effect.
The characteristics of human ear can perceive the generations such as level difference, time difference, phase difference is utilized in existing stereo equipment,
So that user generates sense of space direction to the audio heard, however, since existing stereo equipment is when carrying out audio broadcasting
It is not aware that the specific location of user, stereophonic effect can not be restored well.
Therefore it provides the technical solution that a kind of pickup control and audio play, can carry out user's simulation in pickup, and
Physical location according to user carries out audio broadcasting, realizes that best sound field is rebuild, improves user experience, it has also become urgently to be resolved hurrily
Problem.
Invention content
In view of this, an embodiment of the present invention is intended to provide a kind of pick-up control method, audio frequency playing method and device, it can
User's simulation is carried out in pickup, and is played according to the physical location of user control audio, realizes that best sound field is rebuild, improves and use
It experiences at family.
In order to achieve the above objectives, the technical solution of the embodiment of the present invention is realized in:
An embodiment of the present invention provides a kind of pick-up control method, the method includes:
User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;First sound
Frequency parameter is for characterizing the time difference information that the audio reaches the analog subscriber or so ear from the sound pick-up;
It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain
First audio-frequency information;First audio-frequency information carries the location information of the sound pick-up relative analog user and first sound
Frequency parameter.
In said program, the location information based on the sound pick-up and source of sound relative analog user determines the first audio
Parameter includes:
It determines the second audio frequency parameter, and is based on second audio frequency parameter, the sound pick-up and source of sound relative analog user
Location information determine the first audio frequency parameter;Wherein, second audio frequency parameter is for characterizing audio from sound source position to described
The time difference information of the left and right ear of analog subscriber.
In said program, it is described collected audio signal is handled to obtain the first audio-frequency information include:
Collected audio signal is converted into digital audio and video signals, the position based on the sound pick-up relative analog user
Information and first audio frequency parameter encode the digital audio and video signals to obtain the first audio-frequency information, so that described first
Audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter.
It is described that collected audio signal is handled after obtaining the first audio-frequency information in said program, the side
Method further includes:
It sends first audio-frequency information or first audio-frequency information is stored as audio file.
The embodiment of the present invention additionally provides a kind of audio frequency playing method, obtains the first audio-frequency information, the first audio letter
Breath carries the location information and the first audio frequency parameter of sound pick-up relative analog user;First audio frequency parameter is for characterizing audio
The time difference information of the analog subscriber or so ear is reached from the sound pick-up;The method further includes:
Audio play instruction is received, user current location information is obtained according to the audio play instruction;
First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up relative analog are obtained
The location information of user and the first audio frequency parameter;
Relative position information based on user current location information, sound pick-up and analog subscriber and first audio ginseng
Number, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In said program, the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file.
It is described to include according to audio play instruction acquisition user current location information in said program:
User is positioned according to the audio play instruction, obtains user current location information;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe
Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction
Breath.
In said program, the relative position letter based on the user current location information, sound pick-up and analog subscriber
Breath and first audio frequency parameter, the audio play parameter progress audio broadcasting for adjusting the audio signal include:
Relative position information based on the user current location information, sound pick-up and analog subscriber and first audio
The audio play parameter of the audio signal is adjusted in parameter, and plays the audio signal after being adjusted, so as to play
Audio signal to reach user or so the time difference of ear identical as the value of the first audio frequency parameter;Wherein, the audio plays
Parameter is used to characterize the characteristic of the audio signal.
The embodiment of the present invention additionally provides a kind of pickup control device, and described device includes:First determining module, second are really
Cover half block and control module;
First determining module for carrying out user's simulation, and determines sound pick-up and the position of source of sound relative analog user
Confidence ceases;
Second determining module, for determining based on the location information of the sound pick-up and source of sound relative analog user
One audio frequency parameter;First audio frequency parameter reaches the analog subscriber or so ear for characterizing the audio from the sound pick-up
Time difference information;
The control module carries out audio signal sample for controlling the sound pick-up to source of sound, and to collected sound
Frequency signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the position of the sound pick-up relative analog user
Confidence ceases and first audio frequency parameter.
In said program, second determining module is specifically used for determining the second audio frequency parameter, and is based on second sound
The location information of frequency parameter, the sound pick-up and source of sound relative analog user determines the first audio frequency parameter;Wherein, second sound
Frequency parameter is used to characterize the time difference information of left and right ear of the audio from sound source position to the analog subscriber.
In said program, the control module, specifically for collected audio signal is converted into digital audio and video signals,
Location information and first audio frequency parameter based on the sound pick-up relative analog user carry out the digital audio and video signals
Coding obtains the first audio-frequency information, so that first audio-frequency information carries the location information of the sound pick-up relative analog user
And first audio frequency parameter.
In said program, described device further includes sending module, for sending first audio-frequency information or by described
One audio-frequency information is stored as audio file.
The embodiment of the present invention additionally provides a kind of audio playing apparatus, and described device includes:Acquisition module, receiving module,
Parsing module and processing module;
The acquisition module, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up relative analog
The location information of user and the first audio frequency parameter;First audio frequency parameter is for characterizing audio from described in sound pick-up arrival
The time difference information of analog subscriber or so ear;
The receiving module obtains user's present bit for receiving audio play instruction according to the audio play instruction
Confidence ceases;
The parsing module obtains audio signal, the institute of the sound pick-up acquisition for parsing first audio-frequency information
State the location information and the first audio frequency parameter of sound pick-up relative analog user;
The processing module is used for the relative position information based on user current location information, sound pick-up and analog subscriber
And first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In said program, the acquisition module is specifically used for receiving the first audio-frequency information or read in current audio file
The first audio-frequency information.
In said program, the receiving module is obtained specifically for being positioned to user according to the audio play instruction
Take family current location information;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe
Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction
Breath.
In said program, the processing module is specifically used for being based on the user current location information, sound pick-up and simulation
The audio play parameter of the audio signal is adjusted in the relative position information of user and first audio frequency parameter, and broadcasts
The audio signal after being adjusted is put, so that the audio signal played reaches user or so the time difference of ear and first audio
The value of parameter is identical;Wherein, the audio play parameter is used to characterize the characteristic of the audio signal.
Pick-up control method, audio frequency playing method and the device that the embodiment of the present invention is provided carry out user in pickup
Simulation, and determine sound pick-up and the location information of source of sound relative analog user;It is used based on the sound pick-up and source of sound relative analog
The location information at family determines the first audio frequency parameter;First audio frequency parameter is for characterizing audio from described in sound pick-up arrival
The time difference information of analog subscriber or so ear;It controls the sound pick-up and audio signal sample is carried out to source of sound, and to collecting
Audio signal handled to obtain the first audio-frequency information;First audio-frequency information carries the sound pick-up relative analog user
Location information and first audio frequency parameter;When carrying out audio broadcasting, user's present bit is obtained according to audio play instruction
Confidence ceases;It parses first audio-frequency information, obtains the audio signal of sound pick-up acquisition, the sound pick-up relative analog user
Location information and the first audio frequency parameter;Relative position information based on user current location information, sound pick-up and analog subscriber and
First audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting;In this way, by carrying out user
Simulation determines that the relative position information and audio of user and sound pick-up when user is in best sound field reach institute from the sound pick-up
The time difference information of analog subscriber or so ear is stated, and audio signal is adjusted based on the relative position information and time difference information
Audio play parameter, to realize that best sound field is rebuild, improves user experience.
Description of the drawings
Fig. 1 is pick-up control method flow diagram of the embodiment of the present invention;
Fig. 2 is that user of the embodiment of the present invention simulates schematic diagram;
Fig. 3 is audio frequency playing method flow diagram of the embodiment of the present invention;
Fig. 4 is that audio of the embodiment of the present invention plays schematic diagram of a scenario;
Fig. 5 is pickup control device composed structure schematic diagram of the embodiment of the present invention;
Fig. 6 is audio playing apparatus composed structure schematic diagram of the embodiment of the present invention.
Specific implementation mode
In embodiments of the present invention, in pickup, user's simulation is carried out, and determine sound pick-up and source of sound relative analog user
Location information;The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;Described
One audio frequency parameter is for characterizing the time difference information that audio reaches the analog subscriber or so ear from the sound pick-up;Control institute
It states sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain the first audio-frequency information;
First audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;Carry out
When audio plays, user current location information is obtained according to audio play instruction;First audio-frequency information is parsed, pickup is obtained
The audio signal of device acquisition, the location information and the first audio frequency parameter of the sound pick-up relative analog user;It is current based on user
Location information, the relative position information of sound pick-up and analog subscriber and first audio frequency parameter, adjust the audio signal
Audio play parameter carries out audio broadcasting;The audio play parameter is used to characterize the characteristic of the audio signal.
Embodiment one
Fig. 1 show one pick-up control method flow diagram of the embodiment of the present invention, as shown in Figure 1, the embodiment of the present invention
Pick-up control method includes:
Step 101:User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
Here, the sound pick-up at least one, in one embodiment, there are two the sound pick-ups, two sound pick-ups it
Between distance can empirically be worth and set;
Source of sound when carrying out audio collection at least one, but when the source of sound when carrying out audio collection has multiple, institute
The location information for stating source of sound relative analog user is the location information of the crucial sounding point relative analog user in multiple sources of sound, if
When in the multiple source of sound without key sounding point, the position of the source of sound relative analog user is empirically worth determination.
In one embodiment, the progress user, which simulates, includes:
Pickup control device carries out user's simulation according to the position relationship of preset analog subscriber and sound pick-up, so that described
Analog subscriber is in best sound field, and then hears that effect is the most true stereo;Wherein, the preset analog subscriber with
The position relationship of sound pick-up can empirically be worth determination, such as:When sound pick-up there are two when, analog subscriber is located at two sound pick-ups
Perpendicular bisector on and away from sound pick-up vertical range be three meters of place, be illustrated in figure 2 user and simulate schematic diagram.
Further, the determining sound pick-up and the location information of source of sound relative analog user include:
Using the position for carrying out the analog subscriber after user's simulation as reference position, determine current sound pick-up and source of sound relative to
The relative position information of the reference position is sound pick-up and the location information of source of sound relative analog user;
In embodiments of the present invention, the sound pick-up includes two, respectively sound pick-up 1 and sound pick-up 2, it is assumed that simulation is used
The position at family is coordinate origin (0,0), then the coordinate position of analog subscriber or so ear respectively (t, 0), (- t, 0), sound pick-up 1,
The position of 2 relative analog users is respectively (- x, y), (x, y), and the position of source of sound relative analog user is (p, q), such as Fig. 2 institutes
Show;Wherein, t values can empirically be worth and be set.
Step 102:The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;
Here, first audio frequency parameter reaches the analog subscriber or so ear for characterizing audio from the sound pick-up
Time difference information;
In order to ensure that the analog subscriber is in best sound field, that is, hears best stereo of effect, need to ensure audio
The time difference that the analog subscriber or so ear is reached from the sound source position reaches institute from source of sound with audio through the sound pick-up
The time difference for stating analog subscriber or so ear is identical;In embodiments of the present invention, it is Δ to enable first audio frequency parameter, based on picking up
Sound device 2 can be obtained according to Fig. 2:(n-m)/v=(e+c)/v+ Δs-(b+d)/v can be obtained due to d=e:Δ=(n-m+b-c)/v;
(1), wherein n, m are respectively distance of the source of sound to the analog subscriber or so ear, and d is sound pick-up 1 to the distance of user's auris dextra, e
It is sound pick-up 2 to the distance of the left ear of user, b, c are respectively distance of the source of sound to sound pick-up 1,2, and v is voice transmission speed;I.e.:
The first audio frequency parameter value can be obtained according to (2) formula, i.e. audio reaches the analog subscriber or so ear from the sound pick-up
Time difference, and sound field rebuild, i.e., when the audio collected being played out, audio quilt of the audio as a certain sound channel
Audio playing apparatus plays, and need to only ensure that audio reaches the time difference of user or so ear and audio from institute from audio playing apparatus
State sound pick-up reach the analog subscriber or so ear time difference it is identical, user can hear best stereo of effect.
Step 103:It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is carried out
Processing obtains the first audio-frequency information;
Here, it is described collected audio signal is handled to obtain the first audio-frequency information include:
Collected audio signal is converted into digital audio and video signals, the position based on the sound pick-up relative analog user
Information and first audio frequency parameter encode the digital audio and video signals to obtain the first audio-frequency information, so that described first
Audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;
Wherein, it is described collected audio signal is converted into digital audio and video signals after, the method can also include:
Denoising is filtered to transformed digital audio and video signals, to improve audio quality.
In one embodiment, after this step, the method further includes:Send first audio-frequency information or by described
One audio-frequency information is stored as audio file;
Wherein, transmission first audio-frequency information includes:Pickup control device is by first audio-frequency information with code
The form of stream is sent to audio playing apparatus, so that the audio playing apparatus plays after handling it;Therefore, the pickup control
Device processed can be both individually present, and can also be integrated with the audio playing apparatus;
It is described first audio-frequency information is stored as audio file to include:First audio-frequency information is burned onto record
Disk generates audio file;Or first audio-frequency information is stored in the form of audio file to memory;The memory
It can be mobile memory.
Embodiment two
Fig. 3 is audio frequency playing method flow diagram of the embodiment of the present invention, as shown in figure 3, audio of the embodiment of the present invention is broadcast
The method of putting includes:
Step 300:Obtain the first audio-frequency information;
Here, first audio-frequency information is to be obtained after pickup control device handles collected audio signal
Audio-frequency information;First audio-frequency information carries the location information and the first audio frequency parameter of sound pick-up relative analog user;It is described
First audio frequency parameter is for characterizing the time difference information that audio reaches the analog subscriber or so ear from the sound pick-up.
In one embodiment, the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file;
Wherein, the first audio-frequency information of the reception includes:Receive the first sound that pickup control device is sent in the form of code stream
Frequency information;Correspondingly, after audio playing apparatus receives first audio-frequency information, the method can also include:The sound
First audio-frequency information that the storage of frequency playing device receives;In this way, the follow-up audio playing apparatus is repeatable to play the sound
Frequency is received without repeating;
The first audio-frequency information in the reading current audio file includes:It directly reads memory or records and stored in disk
First audio-frequency information existing in the form of audio file.
Step 301:Audio play instruction is received, user current location information is obtained according to the audio play instruction;
Here, the audio play instruction can be key command or the phonetic order etc. that user sends;
It is described to include according to audio play instruction acquisition user current location information:
User is positioned according to the audio play instruction, obtains user current location information;Such as:The audio
Play instruction is phonetic order, can be based on phase difference to sound source, i.e. user positions;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe
Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction
Breath.
Step 302:First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up are obtained
The location information of relative analog user and the first audio frequency parameter;
Here, since pickup control device has been mixed into the pickup when handling the audio signal that sound pick-up acquires
The location information and the first audio frequency parameter of device relative analog user to get to first audio-frequency information carry sound pick-up it is opposite
The location information of analog subscriber and the first audio frequency parameter, therefore, audio playing apparatus can by decoding first audio-frequency information
To obtain the audio signal of the sound pick-up acquisition, the location information of the sound pick-up relative analog user and the first audio ginseng
Number.
Step 303:Relative position information based on user current location information, sound pick-up and analog subscriber and described first
Audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting;
Here, the audio play parameter is used to characterize the characteristic of the audio signal, such as:Phase, frequency, loudness etc..
In one embodiment, this step specifically includes:Based on the user current location information, sound pick-up and analog subscriber
Relative position information and first audio frequency parameter audio play parameter of the audio signal is adjusted, and play into
Audio signal after row adjusting, so that the audio signal played reaches user or so the time difference of ear and first audio frequency parameter
Value it is identical;
Audio playing apparatus of the present invention includes at least two players, because for stereo sound field, at least
Need the player of two separate channels;
In embodiments of the present invention, the audio playing apparatus includes two players, respectively player 1 and player
2, as shown in figure 4, being based on player 2, according to the relative position information of sound pick-up and analog subscriber, the position of analog subscriber is enabled to sit
It is designated as (0,0), the position coordinates of the relatively described analog subscriber of the player 2 are (x, y), due in practical applications, playing
Device 1 between player 2 at a distance from it is not necessarily equal at a distance from sound pick-up 2 with sound pick-up 1, therefore, enable player 1 relatively described
The position coordinates of analog subscriber are (i, j), and the position coordinates for the relatively described analog subscriber of ear of assuming active user or so be (-
W ,-f), (- z ,-f);
Since the time difference that the audio signal of broadcasting reaches user or so ear need to be identical as the value of the first audio frequency parameter,
Analog subscriber or so the time difference of ear to be reached from sound pick-up identical with audio when carrying out user's simulation;Based on player 2, when broadcasting
Put device 1 between player 2 at a distance from it is equal at a distance from sound pick-up 2 with sound pick-up 1 when, player 1 is relative to analog subscriber
Position coordinates are (- x, y), therefore, Δ=g/v+ Δs1- h/v, wherein g is distance of the player 2 to the left ear of user, and h is to play
Device 1 to user's auris dextra distance;And then
It adjusts player 2 and carries out the slow Δ of audio Playout delay1;
When at a distance from player 1 is between player 2 with sound pick-up 1 and unequal at a distance from sound pick-up 2, i.e. player 1
When coordinate position is different from the coordinate position of sound pick-up 1, it is equivalent to audio when carrying out user's simulation and reaches simulation use from sound pick-up
The time difference of family or so ear is changed, and then obtains, Δ+e/v-d '/v=g/v+ Δs2- h/v, i.e. Δ2=Δ+e/v-d '/v-g/
V+h/v,
It adjusts player 2 and carries out the slow Δ of audio Playout delay2。
It should be noted that the calculating of the embodiment of the present invention is all based on player 2, and optionally, the calculation based on player 1
Method is identical.
Embodiment three
Fig. 5 is pickup control device composed structure schematic diagram of the embodiment of the present invention;As shown in figure 5, the embodiment of the present invention is picked up
Sound control device includes:First determining module 51, the second determining module 52 and control module 53;
First determining module 51 for carrying out user's simulation, and determines sound pick-up and source of sound relative analog user
Location information;
Second determining module 52, for being determined based on the sound pick-up and the location information of source of sound relative analog user
First audio frequency parameter;First audio frequency parameter reaches described analog subscriber or so for characterizing the audio from the sound pick-up
The time difference information of ear;
The control module 53 carries out audio signal sample for controlling the sound pick-up to source of sound, and to collected
Audio signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the sound pick-up relative analog user's
Location information and first audio frequency parameter;
Here, the sound pick-up at least one, in one embodiment, there are two the sound pick-ups, two sound pick-ups it
Between distance can empirically be worth and set;
Source of sound when carrying out audio collection at least one, but when the source of sound when carrying out audio collection has multiple, institute
The location information for stating source of sound relative analog user is the location information of the crucial sounding point relative analog user in multiple sources of sound, if
When in the multiple source of sound without key sounding point, the position of the source of sound relative analog user is empirically worth determination.
In one embodiment, first determining module 51 is specifically used for according to preset analog subscriber and sound pick-up
Position relationship carries out user's simulation, so that the analog subscriber is in best sound field, and then hears that effect is the most really stood
Body sound;Wherein, the position relationship of the preset analog subscriber and sound pick-up can empirically be worth determination, such as:Work as sound pick-up
There are two when, analog subscriber be located on the perpendicular bisector of two sound pick-ups and be three meters away from sound pick-up vertical range place, such as Fig. 2
It show user and simulates schematic diagram.
In one embodiment, first determining module 51, specifically for carry out the analog subscriber after user's simulation
Position is reference position, determine current sound pick-up and source of sound relative to the reference position relative position information be sound pick-up and
The location information of source of sound relative analog user;
In embodiments of the present invention, the sound pick-up includes two, respectively sound pick-up 1 and sound pick-up 2, it is assumed that simulation is used
The position at family is coordinate origin (0,0), then the coordinate position of analog subscriber or so ear respectively (t, 0), (- t, 0), sound pick-up 1,
The position of 2 relative analog users is respectively (- x, y), (x, y), and the position of source of sound relative analog user is (p, q), such as Fig. 2 institutes
Show;Wherein, t values can empirically be worth and be set.
In one embodiment, second determining module 52 is specifically used for determining the second audio frequency parameter, and based on described the
The location information of two audio frequency parameters, the sound pick-up and source of sound relative analog user determines the first audio frequency parameter;Wherein, described
Two audio frequency parameters are used to characterize the time difference information of left and right ear of the audio from sound source position to the analog subscriber;
In order to ensure that the analog subscriber is in best sound field, that is, hears best stereo of effect, need to ensure audio
The time difference that the analog subscriber or so ear is reached from the sound source position reaches institute from source of sound with audio through the sound pick-up
The time difference for stating analog subscriber or so ear is identical;In embodiments of the present invention, it is Δ to enable first audio frequency parameter, based on picking up
Sound device 2 can be obtained according to Fig. 2:(n-m)/v=(e+c)/v+ Δs-(b+d)/v can be obtained due to d=e:Δ=(n-m+b-c)/v;
(1), wherein n, m are respectively distance of the source of sound to the analog subscriber or so ear, and d is sound pick-up 1 to the distance of user's auris dextra, e
It is sound pick-up 2 to the distance of the left ear of user, b, c are respectively distance of the source of sound to sound pick-up 1,2, and v is voice transmission speed;I.e.:
The first audio frequency parameter value can be obtained according to (2) formula, i.e. audio reaches the analog subscriber or so ear from the sound pick-up
Time difference, and sound field rebuild, i.e., when the audio collected being played out, audio quilt of the audio as a certain sound channel
Audio playing apparatus plays, and need to only ensure that audio reaches the time difference of user or so ear and audio from institute from audio playing apparatus
State sound pick-up reach the analog subscriber or so ear time difference it is identical, user can hear best stereo of effect.
In one embodiment, the control module 53, specifically for collected audio signal is converted into digital audio
Signal, location information and first audio frequency parameter based on the sound pick-up relative analog user are to the digital audio and video signals
It is encoded to obtain the first audio-frequency information, so that first audio-frequency information carries the position of the sound pick-up relative analog user
Information and first audio frequency parameter.
Further, the control module 53 is additionally operable to be filtered denoising to transformed digital audio and video signals,
To improve audio quality.
In one embodiment, described device further includes sending module 54, for sending first audio-frequency information or by institute
It states the first audio-frequency information and is stored as audio file.
In one embodiment, the sending module 54 is specifically used for sending out first audio-frequency information in the form of code stream
It send to audio playing apparatus, so that the audio playing apparatus plays after handling it;
And for first audio-frequency information to be burned onto record disk, generate audio file;Or by first audio
Information is stored in the form of audio file to memory.
It should be noted that pickup control device described in the embodiment of the present invention can be both individually present, it also can be with the audio
Playing device integrates.
Example IV
Fig. 6 is audio playing apparatus composed structure schematic diagram of the embodiment of the present invention;As shown in fig. 6, sound of the embodiment of the present invention
Frequency playing device includes:Acquisition module 61, receiving module 62, parsing module 63 and processing module 64;
The acquisition module 61, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up with respect to mould
The location information and the first audio frequency parameter of quasi- user;First audio frequency parameter reaches institute for characterizing audio from the sound pick-up
State the time difference information of analog subscriber or so ear;
It is current to obtain user for receiving audio play instruction according to the audio play instruction for the receiving module 62
Location information;
The parsing module 63, for parsing first audio-frequency information, obtain the sound pick-up acquisition audio signal,
The location information and the first audio frequency parameter of the sound pick-up relative analog user;
The processing module 64, for the relative position letter based on user current location information, sound pick-up and analog subscriber
Breath and first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In one embodiment, the acquisition module 61 is specifically used for receiving the first audio-frequency information or reads present video text
The first audio-frequency information in part.
Further, the acquisition module 61 is specifically used for receiving pickup control device is sent in the form of code stream first
Audio-frequency information stores first audio-frequency information, or directly reads memory or record the shape with audio file stored in disk
First audio-frequency information existing for formula.
In one embodiment, the receiving module 62, specifically for determining user according to the audio play instruction
Position obtains user current location information;Such as:The audio play instruction is phonetic order, and the receiving module 62 is based on phase
Potential difference positions sound source, i.e. user;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe
Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction
Breath;
Here, the audio play instruction can be key command or the phonetic order etc. that user sends.
In one embodiment, described device further includes player 65, correspondingly, the processing module 64, is specifically used for base
In the relative position information of the user current location information, sound pick-up and analog subscriber and first audio frequency parameter to described
The audio play parameter of audio signal is adjusted, and plays the audio signal after being adjusted by player 65, so as to broadcast
It is identical as the value of the first audio frequency parameter that the audio signal put reaches user or so the time difference of ear;Wherein, the audio is broadcast
Put characteristic of the parameter for characterizing the audio signal;
Here, the characteristic of the audio signal can be phase, frequency, loudness etc..
Audio playing apparatus of the present invention includes at least two players, because for stereo sound field, at least
Need the player of two separate channels;
In embodiments of the present invention, the audio playing apparatus includes two players, respectively player 1 and player
2, as shown in figure 4, being based on player 2, according to the relative position information of sound pick-up and analog subscriber, the position of analog subscriber is enabled to sit
It is designated as (0,0), the position coordinates of the relatively described analog subscriber of the player 2 are (x, y), due in practical applications, playing
Device 1 between player 2 at a distance from it is not necessarily equal at a distance from sound pick-up 2 with sound pick-up 1, therefore, enable player 1 relatively described
The position coordinates of analog subscriber are (i, j), and the position coordinates for the relatively described analog subscriber of ear of assuming active user or so be (-
W ,-f), (- z ,-f);
Since the time difference that the audio signal of broadcasting reaches user or so ear need to be identical as the value of the first audio frequency parameter,
Analog subscriber or so the time difference of ear to be reached from sound pick-up identical with audio when carrying out user's simulation;Based on player 2, when broadcasting
Put device 1 between player 2 at a distance from it is equal at a distance from sound pick-up 2 with sound pick-up 1 when, player 1 is relative to analog subscriber
Position coordinates are (- x, y), therefore, Δ=g/v+ Δs1- h/v, wherein g is distance of the player 2 to the left ear of user, and h is to play
Device 1 to user's auris dextra distance;And then:
I.e. Δ is calculated according to above-mentioned formula in the processing module 641, and control player 2 and carry out audio Playout delay
Slow Δ1;
When at a distance from player 1 is between player 2 with sound pick-up 1 and unequal at a distance from sound pick-up 2, i.e. player 1
When coordinate position is different from the coordinate position of sound pick-up 1, it is equivalent to audio when carrying out user's simulation and reaches simulation use from sound pick-up
The time difference of family or so ear is changed, and then obtains, Δ+e/v-d '/v=g/v+ Δs2- h/v, i.e. Δ2=Δ+e/v-d '/v-g/
V+h/v,
I.e. Δ is calculated according to above-mentioned formula in the processing module 642, and control player 2 and carry out audio Playout delay
Slow Δ2。
It should be noted that the calculating of processing module 64 described in the embodiment of the present invention is all based on player 2, optionally,
Algorithm based on player 1 is identical;In practical applications, the audio playing apparatus can be stereo set, such as speaker;
In embodiments of the present invention, the first determining module 51 in the pickup control device, the second determining module, control
Module 53 and sending module 54, the acquisition module 61, receiving module 62, parsing module 63 in the audio playing apparatus and processing
Module 64 can be by the central processing unit (CPU, Central Processing Unit) or digital signal in terminal or server
Processor (DSP, Digital Signal Processor) or field programmable gate array (FPGA, Field
Programmable Gate Array) or integrated circuit (ASIC, Application Specific Integrated
Circuit it) realizes.
The above, only present pre-ferred embodiments, are not intended to limit the scope of the present invention.
Claims (16)
1. a kind of pick-up control method, which is characterized in that the method includes:
User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;The first audio ginseng
Number reaches the time difference information of the analog subscriber or so ear for characterizing audio from the sound pick-up;
It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain first
Audio-frequency information;First audio-frequency information carries the location information and first audio ginseng of the sound pick-up relative analog user
Number;
Wherein, the time difference of left and right ear of the audio from sound source position to the analog subscriber and the first audio frequency parameter phase
Together.
2. method according to claim 1, which is characterized in that described based on the sound pick-up and source of sound relative analog user
Location information determines that the first audio frequency parameter includes:
Determine the second audio frequency parameter, and based on the position of second audio frequency parameter, the sound pick-up and source of sound relative analog user
Confidence breath determines the first audio frequency parameter;Wherein, second audio frequency parameter is for characterizing audio from sound source position to the simulation
The time difference information of the left and right ear of user.
3. method according to claim 1 or claim 2, which is characterized in that described to be handled to obtain to collected audio signal
First audio-frequency information includes:
Collected audio signal is converted into digital audio and video signals, the location information based on the sound pick-up relative analog user
And first audio frequency parameter encodes the digital audio and video signals to obtain the first audio-frequency information, so that first audio
Information carries the location information of the sound pick-up relative analog user and first audio frequency parameter.
4. method according to claim 1 or claim 2, which is characterized in that described to be handled to obtain to collected audio signal
After first audio-frequency information, the method further includes:
It sends first audio-frequency information or first audio-frequency information is stored as audio file.
5. a kind of audio frequency playing method, which is characterized in that obtain the first audio-frequency information, first audio-frequency information carries sound pick-up
The location information of relative analog user and the first audio frequency parameter;First audio frequency parameter is for characterizing audio from the sound pick-up
Reach the time difference information of the analog subscriber or so ear;The method further includes:
Audio play instruction is received, user current location information is obtained according to the audio play instruction;
First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up relative analog user are obtained
Location information and the first audio frequency parameter;
Relative position information based on user current location information, sound pick-up and analog subscriber and first audio frequency parameter are adjusted
The audio play parameter for saving the audio signal carries out audio broadcasting so that the audio signal of broadcasting reach user or so ear when
Between difference it is identical as first audio frequency parameter.
6. method according to claim 5, which is characterized in that the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file.
7. according to claim 5 or 6 the methods, which is characterized in that described to work as according to audio play instruction acquisition user
Front position information includes:
User is positioned according to the audio play instruction, obtains user current location information;
Alternatively, being parsed to the audio play instruction, user current location information in the audio play instruction is extracted;
Alternatively, according to the audio play instruction using the location information of the analog subscriber as user current location information.
8. according to claim 5 or 6 the methods, which is characterized in that described based on the user current location information, sound pick-up
Relative position information with analog subscriber and first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out
Audio plays:
Relative position information based on the user current location information, sound pick-up and analog subscriber and first audio frequency parameter
The audio play parameter of the audio signal is adjusted, and plays the audio signal after being adjusted, so that the sound played
It is identical as the value of the first audio frequency parameter that frequency signal reaches user or so the time difference of ear;Wherein, the audio play parameter
Characteristic for characterizing the audio signal.
9. a kind of pickup control device, which is characterized in that described device includes:First determining module, the second determining module and control
Molding block;
First determining module for carrying out user's simulation, and determines sound pick-up and the position letter of source of sound relative analog user
Breath;
Second determining module, for determining the first sound based on the location information of the sound pick-up and source of sound relative analog user
Frequency parameter;First audio frequency parameter is for characterizing the time difference that audio reaches the analog subscriber or so ear from the sound pick-up
Value information;
The control module carries out audio signal sample to source of sound for controlling the sound pick-up, and believes collected audio
It number is handled to obtain the first audio-frequency information;First audio-frequency information carries the position letter of the sound pick-up relative analog user
Breath and first audio frequency parameter;
Wherein, the time difference of left and right ear of the audio from sound source position to the analog subscriber and the first audio frequency parameter phase
Together.
10. device according to claim 9, which is characterized in that second determining module is specifically used for determining the second audio
Parameter, and the first sound is determined based on the location information of second audio frequency parameter, the sound pick-up and source of sound relative analog user
Frequency parameter;Wherein, second audio frequency parameter be used for characterize left and right ear of the audio from sound source position to the analog subscriber when
Between difference information.
11. according to claim 9 or 10 described devices, which is characterized in that the control module is specifically used for collected sound
Frequency signal is converted into digital audio and video signals, the location information based on the sound pick-up relative analog user and first audio ginseng
It is several that the digital audio and video signals are encoded to obtain the first audio-frequency information, so that first audio-frequency information carries the pickup
The location information of device relative analog user and first audio frequency parameter.
12. according to claim 9 or 10 described devices, which is characterized in that described device further includes sending module, for sending
It states the first audio-frequency information or first audio-frequency information is stored as audio file.
13. a kind of audio playing apparatus, which is characterized in that described device includes:Acquisition module, receiving module, parsing module and
Processing module;
The acquisition module, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up relative analog user
Location information and the first audio frequency parameter;First audio frequency parameter reaches the simulation for characterizing audio from the sound pick-up
The time difference information of user or so ear;
The receiving module obtains user current location letter for receiving audio play instruction according to the audio play instruction
Breath;
The parsing module obtains the audio signal of the sound pick-up acquisition, described picks up for parsing first audio-frequency information
The location information and the first audio frequency parameter of sound device relative analog user;
The processing module is used for the relative position information based on user current location information, sound pick-up and analog subscriber and institute
The first audio frequency parameter is stated, the audio play parameter for adjusting the audio signal carries out audio broadcasting so that the audio signal of broadcasting
It is identical as first audio frequency parameter to reach user or so the time difference of ear.
14. according to claim 13 described device, which is characterized in that the acquisition module is specifically used for receiving the first audio letter
The first audio-frequency information in breath or reading current audio file.
15. according to claim 13 or 14 described devices, which is characterized in that the receiving module is specifically used for according to the sound
Frequency play instruction positions user, obtains user current location information;
Alternatively, being parsed to the audio play instruction, user current location information in the audio play instruction is extracted;
Alternatively, according to the audio play instruction using the location information of the analog subscriber as user current location information.
16. according to claim 13 or 14 described devices, which is characterized in that the processing module is specifically used for being based on the use
Family current location information, the relative position information of sound pick-up and analog subscriber and first audio frequency parameter are to the audio signal
Audio play parameter be adjusted, and play be adjusted after audio signal so that play audio signal reach user
The time difference of left and right ear is identical as the value of the first audio frequency parameter;Wherein, the audio play parameter is for characterizing the sound
The characteristic of frequency signal.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510583338.9A CN106535060B (en) | 2015-09-14 | 2015-09-14 | A kind of pick-up control method, audio frequency playing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510583338.9A CN106535060B (en) | 2015-09-14 | 2015-09-14 | A kind of pick-up control method, audio frequency playing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106535060A CN106535060A (en) | 2017-03-22 |
CN106535060B true CN106535060B (en) | 2018-08-10 |
Family
ID=58349036
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510583338.9A Active CN106535060B (en) | 2015-09-14 | 2015-09-14 | A kind of pick-up control method, audio frequency playing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106535060B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106954125A (en) * | 2017-03-29 | 2017-07-14 | 联想(北京)有限公司 | Information processing method and audio frequency apparatus |
CN107968974A (en) * | 2017-12-07 | 2018-04-27 | 北京小米移动软件有限公司 | Microphone control method, system, microphone and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1991011079A1 (en) * | 1990-01-19 | 1991-07-25 | Sony Corporation | Apparatus for reproducing acoustic signals |
CN101583064A (en) * | 2009-06-26 | 2009-11-18 | 电子科技大学 | Micro audio directional loudspeaker with three dimension soundeffect |
CN102804806A (en) * | 2009-06-23 | 2012-11-28 | 诺基亚公司 | Method and apparatus for processing audio signals |
CN103796150A (en) * | 2012-10-30 | 2014-05-14 | 华为技术有限公司 | Processing method, device and system of audio signals |
CN104125524A (en) * | 2013-04-23 | 2014-10-29 | 华为技术有限公司 | Sound effect adjustment method, apparatus and devices |
-
2015
- 2015-09-14 CN CN201510583338.9A patent/CN106535060B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1991011079A1 (en) * | 1990-01-19 | 1991-07-25 | Sony Corporation | Apparatus for reproducing acoustic signals |
CN102804806A (en) * | 2009-06-23 | 2012-11-28 | 诺基亚公司 | Method and apparatus for processing audio signals |
CN101583064A (en) * | 2009-06-26 | 2009-11-18 | 电子科技大学 | Micro audio directional loudspeaker with three dimension soundeffect |
CN103796150A (en) * | 2012-10-30 | 2014-05-14 | 华为技术有限公司 | Processing method, device and system of audio signals |
CN104125524A (en) * | 2013-04-23 | 2014-10-29 | 华为技术有限公司 | Sound effect adjustment method, apparatus and devices |
Also Published As
Publication number | Publication date |
---|---|
CN106535060A (en) | 2017-03-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6883636B2 (en) | Metadata for ducking control | |
KR101844388B1 (en) | Systems and methods for delivery of personalized audio | |
US20130003981A1 (en) | Calibration of Headphones to Improve Accuracy of Recorded Audio Content | |
CN106535059B (en) | Rebuild stereosonic method and speaker and position information processing method and sound pick-up | |
EP2926572A1 (en) | Collaborative sound system | |
CN104981869A (en) | Signaling audio rendering information in a bitstream | |
US9756437B2 (en) | System and method for transmitting environmental acoustical information in digital audio signals | |
CN103618986A (en) | Sound source acoustic image body extracting method and device in 3D space | |
KR20160061315A (en) | Method for processing of sound signals | |
US9373335B2 (en) | Processing audio objects in principal and supplementary encoded audio signals | |
CN106535060B (en) | A kind of pick-up control method, audio frequency playing method and device | |
CN109117110B (en) | Data processing method and device for dynamic voice fusion | |
CN103347199A (en) | Method and system for voice frequency live broadcast | |
CN105392088A (en) | Wireless connection sound system | |
CN104506588B (en) | A kind of method and device for the mobile rehearsal for realizing band | |
JP6988889B2 (en) | Voice processing device and voice processing method | |
CN112346694B (en) | Display device | |
CN208861661U (en) | A kind of audio collecting device | |
CN104200827B (en) | Method and device for obtaining internet audio file | |
CN105979468A (en) | Audio frequency processing method and device | |
JP6321514B2 (en) | Audio output control apparatus and audio output control method | |
CN108932953A (en) | A kind of audio balance function determines method, audio equalizing method and equipment | |
KR102534802B1 (en) | Multi-channel binaural recording and dynamic playback | |
JP6564489B2 (en) | Acoustic signal processing device | |
CN104952456A (en) | Voice processing method and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |