CN109448740A - Processing method, device and the voice system of voice audio - Google Patents
Processing method, device and the voice system of voice audio Download PDFInfo
- Publication number
- CN109448740A CN109448740A CN201811549257.7A CN201811549257A CN109448740A CN 109448740 A CN109448740 A CN 109448740A CN 201811549257 A CN201811549257 A CN 201811549257A CN 109448740 A CN109448740 A CN 109448740A
- Authority
- CN
- China
- Prior art keywords
- target
- plug
- audio data
- memory
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 49
- 238000012545 processing Methods 0.000 claims abstract description 71
- 238000000034 method Methods 0.000 claims abstract description 51
- 230000000694 effects Effects 0.000 claims abstract description 48
- 238000003860 storage Methods 0.000 claims description 36
- 230000005540 biological transmission Effects 0.000 claims description 20
- 230000004044 response Effects 0.000 claims description 7
- 238000013480 data collection Methods 0.000 claims 1
- 230000008878 coupling Effects 0.000 abstract description 16
- 238000010168 coupling process Methods 0.000 abstract description 16
- 238000005859 coupling reaction Methods 0.000 abstract description 16
- 238000005516 engineering process Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 15
- 230000008569 process Effects 0.000 description 13
- 238000004590 computer program Methods 0.000 description 9
- 230000003993 interaction Effects 0.000 description 9
- 125000004122 cyclic group Chemical group 0.000 description 5
- 230000018109 developmental process Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- FGUUSXIOTUKUDN-IBGZPJMESA-N C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 Chemical compound C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 FGUUSXIOTUKUDN-IBGZPJMESA-N 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/85—Providing additional services to players
- A63F13/87—Communicating with other players during game play, e.g. by e-mail or chat
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K15/00—Acoustics not otherwise provided for
- G10K15/08—Arrangements for producing a reverberation or echo sound
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
Abstract
This application discloses processing method, device and the voice systems of a kind of voice audio.This method comprises: obtaining the audio data sets that the corresponding server-side of target application is sent;In the case where target plug-in is in initiate mode, audio data sets are sent to target plug-in;The target data set to be played that target plug-in is sent is obtained, target data set is combined into target plug-in and carries out audio effect processing to audio data sets according to the business datum of target application and generate.By the application, solve the problems, such as that voice system in the related technology and the coupling of game itself are too strong.
Description
Technical field
This application involves sound effect of game processing technology fields, processing method, dress in particular to a kind of voice audio
It sets and voice system.
Background technique
More people's real-time voice systems refer to that multiple users carry out the exchange of remote online real-time voice using computer equipment
A set of software systems.In real-time voice system, user A acquires equipment by microphone etc., collects the voice of oneself, passes through
Network transmission gives the other users of the same voice flow, and other users are played back by loudspeaker apparatus, can hear the language of A
Sound.Meanwhile user A also can uppick other people speech.The typical application scenarios of one of more people's real-time voices are RPG trips
It plays, is exchanged between game user by voice, reach co-operating purpose.
And it is directed to the more complicated game application of scene, in order to promote the experience of user, interactive voice needs to combine game
Interior scene is to carry out certain audio effect processing.For example, voice attenuating, base based on the distance between game role
Echo effect in scene of game, the change of voice effect based on game role demand.
It realizes the real-time voice effect in above-mentioned example, needs to handle voice data, that is, add required voice
Audio.Conventionally, as same audio source is not identical in the different sound effects for playing end, therefore sound effect is handled
It does not carry out at the source of sound end of acquisition voice, but is carried out at the broadcasting end for receiving voice, specifically, existing real-time voice effect
Processing method be: the data-interface that carries out data transmission is set for voice system, to receive operation layer (such as: game service)
The business datum of offer, and then voice system is enabled to be processed according to business datum to audio data, generate addition audio
Audio data afterwards.
And above-mentioned processing method will lead to the too strong technical problem of coupling of voice system and game itself, and for should
Currently no effective solution has been proposed for technical problem.
Summary of the invention
The main purpose of the application is to provide processing method, device and the voice system of a kind of voice audio, with solution
Certainly voice system and the too strong problem of the coupling of game itself in the related technology.
To achieve the goals above, according to the one aspect of the application, a kind of processing method of voice audio is provided.It should
Method includes: the audio data sets for obtaining the corresponding server-side of target application and sending;Initiate mode is in target plug-in
In the case of, the audio data sets are sent to the target plug-in;Obtain the mesh to be played that the target plug-in is sent
Data acquisition system is marked, the target data set is combined into the target plug-in according to the business datum of the target application to the audio
Data acquisition system carries out audio effect processing and generates.
Optionally, the method also includes: in the case where the target plug-in is in dead status, by the server-side
The audio data sets of transmission are determined as data acquisition system to be played.
It is optionally, described that the audio data sets are sent to the target plug-in includes: by the audio data set
Conjunction is stored in target memory, and the audio data sets are read from the target memory for the target plug-in;
It is described obtain the target data set to be played that the target plug-in generates include: read from the target memory described in
Target data set, wherein the target data set is combined into the target plug-in and generates simultaneously according to the audio data sets
The data acquisition system being stored in the target memory.
Optionally, the described audio data sets are stored in target memory includes: to obtain the target storage
The access authority of the write area of device;After getting the access authority of write area of the target memory, by the audio number
It is stored in the write area of the target memory according to set, wherein the access authority of the write area of the target memory exists
Any time authorizes unique object;The target data set for reading the target plug-in from the target memory and generating
It include: the access authority that every preset time period obtains the read area of the target memory;Getting the target storage
After the access claim of the read area of device, target data set is read from the read area of the target memory, wherein the target
The access authority of the read area of memory authorizes unique object at any time.
Optionally, after the audio data sets are sent to the target plug-in, the method also includes: it determines
Handling duration of the target plug-in to each audio data in the audio data sets;According to each audio data
Handling duration, it is determined whether there are handling duration be greater than preset threshold target audio data;There are the target audios
In the case where data, the target plug-in for deactivating the processing target audio data is determined.
Optionally, the method also includes: determine enable specified target plug-in in the case where, generate and enable instruction simultaneously
Obtain the access authority of the write area of the target memory;Access authority in the write area for getting the target memory
Afterwards, enabling instruction is stored in the target memory, is getting the mesh for the specified target plug-in
It marks the access authority of the read area of memory and enters initiate mode when reading enabling instruction;Determine deactivate it is specified
In the case where target plug-in, the access authority for deactivating the write area for instructing and obtaining the target memory is generated;It is getting
After the access claim of the write area of the target memory, the deactivated instruction is stored in the target memory, is used for
The specified target plug-in is getting the access authority of the read area of the target memory and is reading the deactivated finger
Enter dead status when enabling.
To achieve the goals above, according to the one aspect of the application, a kind of processing method of voice audio is provided.It should
Method includes: that voice system obtains the audio data sets that the corresponding server-side of target application is sent;It is in and opens in target plug-in
In the case where with state, the audio data sets are sent to the target plug-in by the voice system;The target plug-in
The audio data sets are received, and the received audio data sets are carried out according to the business datum of the target application
Audio effect processing obtains target data set merging and is sent to the voice system;Voice system receives the target data set, and
It is data acquisition system to be played by the target data set cooperation.
Optionally, it includes: the voice that the audio data sets are sent to the target plug-in by the voice system
System every preset time period obtains the access authority of the write area of target memory;And institute is got in the voice system
After the access claim for stating the write area of target memory, the audio data sets are stored in the write-in of the target memory
Area;It includes: that the target plug-in every preset time period obtains the mesh that the target plug-in, which receives the audio data sets,
Mark the access authority of the write area of memory;And the visit of the write area of the target memory is got in the target plug-in
After asking claim, the audio data sets stored in the write area of the target memory, the write-in of the target memory are read
The access authority in area authorizes unique object at any time;The target data set is sent to institute's predicate by the target plug-in
System for electrical teaching includes: the access authority that the target plug-in every preset time period obtains the read area of target memory;And
After the target plug-in gets the access authority of the read area of the target memory, the target data set is stored in
The read area of the target memory;The voice system receive the target data set include: the voice system every
Preset time period obtains the access authority of the read area of the target storage;And the mesh is got in the voice system
After the access authority for marking the read area of memory, the target data set stored in the read area of the target memory is read,
The access authority of the read area of the target memory authorizes unique object at any time.
Optionally, in the case where the target plug-in is multiple, the method also includes: if the voice system is sent
Instruction is enabled to specified target plug-in, then the appointed target plug-in responds the enabling instruction, into initiate mode;
If the voice system, which is sent, deactivates instruction to specified target plug-in, the appointed target plug-in response is described to be deactivated
Instruction, into dead status;In the case where the target plug-in is in dead status, the voice system sends server-side
Audio data sets be determined as data acquisition system to be played.
To achieve the goals above, according to the another aspect of the application, a kind of voice system is provided.The voice system packet
It includes: first acquisition unit, the audio data sets sent for obtaining the corresponding server-side of target application;Transmission unit is used for
In the case where target plug-in is in initiate mode, the audio data sets are sent to the target plug-in;Second obtains
Unit, the target data set to be played sent for obtaining the target plug-in, the target data set are combined into the mesh
Mark plug-in unit carries out audio effect processing to the audio data sets according to the business datum of the target application and generates.
To achieve the goals above, according to the another aspect of the application, a kind of processing unit of voice audio is provided.It should
Device includes: voice system, the audio data sets sent for obtaining the corresponding server-side of target application, and in target plug-in
In the case where initiate mode, the audio data sets are stored in target memory, to obtain the target plug-in
The target data set to be played generated;Target plug-in, for reading the audio data sets stored in target memory, and
Audio effect processing is carried out to the audio data sets based on the business datum of target application, obtains target data set, and by institute
It states target data set and is sent to the voice system.
To achieve the goals above, according to the another aspect of the application, a kind of storage medium, the storage medium are provided
Program including storage, wherein described program executes the processing method of voice audio described in above-mentioned any one.
To achieve the goals above, according to the another aspect of the application, a kind of processor is provided, the processor is used for
Run program, wherein described program executes the processing method of voice audio described in above-mentioned any one when running.
By the application, using following steps: obtaining the audio data sets that the corresponding server-side of target application is sent;?
In the case that target plug-in is in initiate mode, the audio data sets are sent to the target plug-in;Obtain the mesh
The target data set to be played that plug-in unit is sent is marked, the target data set is combined into the target plug-in and answers according to the target
Business datum carries out audio effect processing to the audio data sets and generates, and solves voice system in the related technology and trip
The too strong technical problem of the coupling of opera script body.And then reaches and realized the premise that audio data sets are carried out with audio effect processing
Under, also realize the strong coupling technical effect reduced between voice system and target application (such as game application).
Detailed description of the invention
The attached drawing constituted part of this application is used to provide further understanding of the present application, the schematic reality of the application
Example and its explanation are applied for explaining the application, is not constituted an undue limitation on the present application.In the accompanying drawings:
Fig. 1 is the schematic diagram of the processing method of voice audio in the prior art;
Fig. 2 is the flow diagram of the processing method of voice audio provided by the embodiments of the present application;
Fig. 3 is the flow diagram of the processing method of another voice audio provided by the embodiments of the present application;
Fig. 4 is the flow diagram of the processing method of another voice audio provided by the embodiments of the present application;
Fig. 5 is the flow diagram of the processing method of another voice audio provided by the embodiments of the present application;
Fig. 6 is the flow diagram of the processing method of another voice audio provided by the embodiments of the present application;
Fig. 7 is the structural schematic diagram of voice system provided by the embodiments of the present application;And
Fig. 8 is the structural schematic diagram of voice device provided by the embodiments of the present application.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only
The embodiment of the application a part, instead of all the embodiments.Based on the embodiment in the application, ordinary skill people
Member's every other embodiment obtained without making creative work, all should belong to the model of the application protection
It encloses.
It should be noted that the description and claims of this application and term " first " in above-mentioned attached drawing, "
Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way
Data be interchangeable under appropriate circumstances, so as to embodiments herein described herein.In addition, term " includes " and " tool
Have " and their any deformation, it is intended that cover it is non-exclusive include, for example, containing a series of steps or units
Process, method, system, product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include without clear
Other step or units listing to Chu or intrinsic for these process, methods, product or equipment.
The technical issues of the application is solved in order to facilitate understanding below carries out technical problem caused by the prior art
Careful analysis:
Firstly, real-time voice system is to work in a game as the role of a subsystem, function is relatively only
It is vertical.At the beginning of game service is set up, acquisition voice flow is usually executed by game service control voice system and plays voice flow
Etc. functions, to realize normal real-time voice function in game play, i.e., there is no game services inside voice system
Data, content relevant to game service will not be handled.At this point, the game service of the voice system and iteratively faster is not
Together, the function and performance of the voice system are relatively stable.
And game industry is in follow-up developments, as shown in Figure 1, voice audio is tightly combined with game service scene.This
When, voice system needs exposed interface to game service, and business is allowed to provide game data, voice system combination game data and language
Sound data are handled.Similarly, when game service needs to modify the realization of audio, attenuation coefficient is such as modified, it is necessary to corresponding
The audio effect processing in voice system is modified, to will lead to audio system unstable at this point, frequently modifying to voice system, is easy
The abnormal conditions such as delay machine occur, the unstable situation for ultimately causing entire game system occurs.
Secondly, real-time voice system is usually, a function is versatile, portable degree is high, plug and play system,
Its positioning is the function system of a technicality.The basic function of the voice system includes acquisition, broadcasting, audio mixing, the record of sound
Sound, mute, acquisition control, shielding voice etc., can be used at the beginning of game service is set up in most of game system.And
The audio of game service customization, it is strong with associativity the characteristics of game itself, it is low with voice system basic function correlation.Therefore will
The business tine of game itself, which is placed in voice system, to be realized, the versatility of voice system is destroyed, so that voice system is difficult to
Multiplexing.
Finally, development of games work and voice system development are undertaken by different developers, therefore by game sheet
The business tine of body, which is placed in voice system, to be realized, can be unfavorable for sharing out the work and help one another, code permission control etc..In addition, the reality of game
When voice system be not necessarily to be developed by development of games group, it may be possible to access third party offer sound bank.In this case, it repairs
The realization for changing voice audio can become very difficult.
Based on above-mentioned the technical problems existing in the prior art, according to an embodiment of the present application, a kind of voice sound is provided
The processing method of effect.
Fig. 2 is the flow chart according to the processing method of the voice audio of the embodiment of the present application.As shown in Fig. 2, this method packet
Include following steps:
Step S102 obtains the audio data sets that the corresponding server-side of target application is sent.
Audio data sets are sent to target plug-in in the case where target plug-in is in initiate mode by step S104.
Step S106, obtains the target data set to be played that target plug-in is sent, and target data set is combined into target and inserts
Part carries out audio effect processing to audio data sets according to the business datum of target application and generates.
The processing method of voice audio provided by the embodiments of the present application is sent by obtaining the corresponding server-side of target application
Audio data sets;In the case where target plug-in is in initiate mode, audio data sets are sent to target plug-in;It obtains
The target data set to be played for taking target plug-in to send, target data set are combined into target plug-in according to the business of target application
Data carry out audio effect processing to audio data sets and generate, and solve the coupling of voice system and game itself in the related technology
The too strong technical problem of property.
That is, voice system itself does not carry out at audio audio data sets further according to the business datum of target application
Reason, but in the case where target plug-in is in initiate mode, audio data sets are sent to the target plug-in being independently arranged
In, mesh is generated to audio data sets progress audio effect processing to obtain target plug-in according to according to the business datum of target application
Mark data acquisition system.At this point, i.e. realize to audio data sets carry out audio effect processing, while also achieve reduce voice system with
Coupling between target application (such as game application).
In turn, when technical staff is iterated processing to game service again in technical solution provided herein, then
Without being iterated to voice system, it is only necessary to modify the related data in target plug-in, greatly reduce technical staff
Work load, improve the stability and versatility of voice system.
It should be noted that: in the processing method of voice audio provided by the embodiments of the present application, method can also be wrapped
It includes: in the case where target plug-in is in dead status, the audio data sets that server-side is sent being determined as number to be played
According to set.
That is, the processing method of voice audio provided by the embodiments of the present application, is in the feelings of initiate mode in target plug-in
Under condition, audio data sets are sent to target plug-in, to obtain the target data set to be played of target plug-in transmission;
In the case where target plug-in is in dead status, the audio data sets that server-side is sent are determined as data set to be played
It closes.That is, if target plug-in is in initiate mode, target plug-in is enabled to carry out audio effect processing to the audio data sets, obtain to
The target data set of broadcasting, if target plug-in is in dead status, the directly specified audio data set received be combined into
The data acquisition system of broadcasting no longer carries out audio effect processing to the audio data at this time.
At this point, showing in the processing method of voice audio provided by the embodiments of the present application, the operation of target plug-in and language
The operation of system for electrical teaching is mutually indepedent, does not depend on mutually.And in the case where target plug-in is in dead status, voice system still may be used
With independent operating, the function that normal real-time voice plays is realized, reached the versatility for guaranteeing voice system, and guarantee voice
System can still play the technical effect of real-time voice in the case where target plug-in is in dead status.
Firstly, in above-mentioned steps S104 and S106 transmission and obtaining step be illustrated:
Optionally, in the processing method of voice audio provided by the embodiments of the present application, audio data sets are sent to
Target plug-in includes: that audio data sets are stored in target memory, is read from target memory for target plug-in
Audio data sets;Obtaining the target data set to be played that target plug-in generates includes: that mesh is read from target memory
Mark data acquisition system, wherein target data set is combined into target plug-in and generates according to audio data sets and be stored in target storage
Data acquisition system in device.
That is, the data interaction between voice system and target plug-in can be achieved by target memory.At this point,
In the case where target plug-in is in initiate mode, the data for needing to be sent to target plug-in are stored in target and deposited by voice system
In reservoir, need to be sent to number in target plug-in so that target plug-in can read voice system from the target memory
According to.Similarly, the data for needing to be sent to voice system can be also stored in target memory by target plug-in, so as to voice system
Target plug-in can be read from the target memory needs to be sent to data in voice system.
Further, in order to guarantee to carry out normal data interaction between voice system and target plug-in, in the application reality
In the processing method for applying the voice audio of example offer, it includes: acquisition target that audio data sets, which are stored in target memory,
The access authority of the write area of memory;After the access authority for the write area for getting target memory, by audio data set
Conjunction is stored in the write area of target memory, wherein the access authority of the write area of target memory is authorized at any time
Unique object;It includes: that every preset time period obtains that the target data set that target plug-in generates is read from target memory
The access authority of the read area of target memory;After the access claim for the read area for getting target memory, deposited from target
The read area of reservoir reads target data set, wherein the access authority of the read area of target memory is authorized at any time
Unique object.
It illustrates, the case where in order to avoid voice system and target plug-in while being written and read, leading to data exception
Occur, that is, when avoiding voice system that data-message is written in target memory, target plug-in reads the data-message simultaneously, leads
The case where data-message for causing target plug-in to read out is unexpected message generation.In voice audio provided by the embodiments of the present application
Processing method in, although target memory can leave voice system and target plug-in be read out storage operation, mesh
Write area/memory block access authority in mark memory only authorizes unique object, and target plug-in and voice at any time
System only in the case where obtaining access authority, could execute storage or read operation to target memory.
It should be understood that in the processing method of voice audio provided by the embodiments of the present application, voice system and target
Plug-in unit realizes following technical effect by target memory to carry out data interaction: 1, target plug-in and voice system pass through finger
Fixed protocol format carries out delivery of audio data, therefore coupling is low, maintains the closure of voice system;2, voice system with
Data transmitting is carried out between target plug-in by way of target memory, and is accessed using global system lock limitation resource,
Improve data transmission security.
Wherein, write area/memory block access authority in above-mentioned global system lock as target memory is when any
Quarter only authorizes unique object, and target plug-in and voice system could deposit target only in the case where obtaining access authority
Reservoir executes storage or read operation.
In addition, there is delay machine in target plug-in when carrying out audio effect processing to certain audio datas in order to avoid target plug-in
The case where occur, in the processing method of voice audio provided by the embodiments of the present application, audio data sets are being sent to mesh
After marking plug-in unit, method further include: determine target plug-in to the handling duration of each audio data in audio data sets;According to
According to the handling duration of each audio data, it is determined whether there are the target audio data that handling duration is greater than preset threshold;It is depositing
In the case where target audio data, the target plug-in of deactivated processing target audio data is determined.
And in an optional example, before the target plug-in for determining deactivated processing target audio data, this method
Further include: reboot process is carried out to the target plug-in of processing target audio data, if the target plug-in is restarted unsuccessfully, deactivates place
Manage the target plug-in of target audio data.
Optionally, in the processing method of voice audio provided by the embodiments of the present application, method further include: enabled determining
In the case where specified target plug-in, the access authority for enabling the write area for instructing and obtaining target memory is generated;It is obtaining
To after the access authority of the write area of target memory, instruction will be enabled and be stored in target memory, for specified target
Plug-in unit the read area for getting target memory access authority and read enabling instruction when enter initiate mode;In determination
In the case where deactivating specified target plug-in, the access authority for deactivating the write area for instructing and obtaining target memory is generated;?
After getting the access claim of the write area of target memory, deactivated instruction is stored in target memory, for specified
Target plug-in the read area for getting target memory access authority and read deactivate instruction when enter dead status,
In, above-mentioned specified target plug-in can be multiple.
It should be understood that the above-mentioned determining target plug-in that enables includes following scene: user sends the specified target of enabling and inserts
The instruction of part, and since the duration of target plug-in processing audio data is more than preset threshold, the target plug-in is caused to be restarted
Scene.It includes following scene that above-mentioned determination, which deactivates target plug-in, and user sends the instruction for deactivating specified target plug-in, Yi Jiyou
The duration of audio data is handled more than the scene in preset threshold, the target plug-in being caused to be deactivated/restart in target plug-in.
In an optional example, in the case where determining the target plug-in for enabling and specifying, voice system can also be enabled
One subprocess so that the specified target plug-in enabled is run in the subprocess, and then reaches target plug-in independent operating and exists
In the subprocess that voice system enables, it is not take up the technical effect that voice system carries out resource.
It should also be emphasized that: in the processing method of voice audio provided by the embodiments of the present application, voice system and mesh
Carry out when stop and start instruction interaction yet by target memory between mark plug-in unit, and then ensure that following technical effect: 1, mesh
It marks plug-in unit and voice system and delivery of audio data is carried out by specified protocol format, therefore coupling is low, maintains voice system
The closure of system;2, data transmitting is carried out between voice system and target plug-in by way of target memory, and is used
Global system lock limitation resource access, improves data transmission security;3, voice system can enable multiple specified simultaneously
Target plug-in, to have a possibility that voice system selects some target plug-in to carry out audio effect processing to audio data, in turn
Improve the flexibility of target plug-in operation.
In addition, in the processing method of voice audio provided by the embodiments of the present application, as shown in figure 3, in audio data set
In the case that each audio data in conjunction is a voice flow, by audio data sets be sent to target plug-in include: by
Every voice flow in audio data sets is respectively sent in the specified target plug-in of every voice flow, only for target plug-in
Vertical carries out audio effect processing to received language stream.It, can be with to reach voice system in the case where receiving a plurality of voice flow
Each voice flow is distributed to different pinpoint target plug-in units respectively, different target plug-ins is made independently to load a plurality of voice
Stream, wherein since target plug-in is mutually indepedent, the audio effect processing of voice flow is also mutually indepedent, is independent of each other.
Finally, it should be noted that obtaining target in the processing method of voice audio provided by the embodiments of the present application
After the target data set to be played that plug-in unit is sent, method further include: to multiple in the target data set got
Target data carries out stereo process, and plays the target data by stereo process.
In addition, according to an embodiment of the present application, additionally providing a kind of processing method of voice audio.
Fig. 4 is the flow chart according to the processing method of the voice audio of the embodiment of the present application.As shown in figure 4, this method packet
Include following steps:
Step S202, voice system obtain the audio data sets that the corresponding server-side of target application is sent.
Step S204, in the case where target plug-in is in initiate mode, audio data sets are sent to by voice system
Target plug-in.
Step S206, target plug-in receive audio data sets, and according to the business datum of target application to received sound
Frequency data acquisition system carries out audio effect processing, obtains target data set merging and is sent to voice system.
Step S208, voice system receive target data set, and are data set to be played by target data set cooperation
It closes.
The processing method of voice audio provided by the embodiments of the present application obtains the corresponding clothes of target application by voice system
The audio data sets that business end is sent;In the case where target plug-in is in initiate mode, voice system is by audio data sets
It is sent to target plug-in;Target plug-in receives audio data sets, and according to the business datum of target application to received audio
Data acquisition system carries out audio effect processing, obtains target data set merging and is sent to voice system;Voice system receives target data set
It closes, and is data acquisition system to be played by target data set cooperation, solve voice system in the related technology and game itself
The too strong technical problem of coupling.
That is, voice system itself does not carry out at audio audio data sets further according to the business datum of target application
Reason, but in the case where target plug-in is in initiate mode, audio data sets are sent to the target plug-in being independently arranged
In, mesh is generated to audio data sets progress audio effect processing to obtain target plug-in according to according to the business datum of target application
Mark data acquisition system.At this point, i.e. realize to audio data sets carry out audio effect processing, while also achieve reduce voice system with
Coupling between target application (such as game application).
In turn, when technical staff is iterated processing to game service again in technical solution provided herein, then
Without being iterated to voice system, it is only necessary to modify the related data in target plug-in, greatly reduce technical staff
Work load, improve the stability and versatility of voice system.
It should be understood that in the processing method of voice audio provided by the embodiments of the present application, before step S202,
I.e. before the audio data sets that voice system obtains that the corresponding server-side of target application is sent, audio is sent for voice system
There is still a need for acquire the audio data sets for the server of data acquisition system.Collection of server audio data sets are illustrated below
Illustrate:
Target application corresponds to multiple client, wherein the client for opening voice collecting mode is that language sends client.
At this point, voice, which sends client, acquires audio data, and coded treatment is carried out to be sent to server-side to the audio data.
In an optional example, voice sends client and audio data is sent to server-side, can be by following
Mode is realized:
Step a, voice send client by modes such as access http interfaces, to obtain the address ip and end of server-side
Mouthful, and then establish and the connecting link of server-side, wherein after connecting link is successfully established, voice send client also to
Server-side sends authentication information, and link connection state is kept if being proved to be successful, if verifying is unsuccessful to cut off the connection
Link.
Step b, the upper-layer service that voice sends client opens voice collecting function by control module, at this point, voice
It sends client to be acquired user speech using hardware devices such as microphones, to obtain audio data.
Step c, voice, which sends client and is filtered, encode to collected audio data etc., to be handled, wherein is being carried out
When sampling, filtering processing, the common format of audio data is PCM, when carrying out coded treatment to PCM data, commonly uses processing side
Formula is by PCM data compressed encoding into the audio format of suitable network transmission, such as AAC, OPUS etc..
Step d, voice sends client and is packaged to the audio data after coding, and passes through the connection chain of above-mentioned foundation
Road is sent to server-side, wherein can be to the encapsulation process of audio data, using user informations such as timestamp, uuid as sound
The head of frequency evidence, and then internet message frame is packaged into be sent to server-side.
It should be understood that above-mentioned voice collecting function open in the case where, above-mentioned acquisition, filtering, coding, encapsulation,
The processes such as transmission constantly repeat.
It should be noted that: server-side receives multiple voices and sends the audio data that client is sent, at this point, server-side
According to the corresponding user information of audio data, multiple audio numbers for being sent to destination client locating for voice system are extracted
According to, and multiple audio data is combined into audio data sets and is sent to destination client.
For example, multiple users set up a speech channel, and carry out voice communication in the speech audio, at this point,
The client of multiple users sends audio data to server-side respectively, and server-side then receives the audio number of multiple client transmission
According to, and the corresponding audio data of other clients is sent to phonetic incepting client (such as destination client).
Further, in the processing method of voice audio provided by the embodiments of the present application, to voice system in step S102
System obtains the specific steps for the audio data sets that the corresponding server-side of target application is sent, and is illustrated:
In an optional example, destination client locating for voice system receives the audio data set that server-side is sent
Conjunction can be accomplished by the following way:
Step e, destination client is by modes such as access http interfaces, to obtain the address ip and port of server-side, into
And build on the connecting link of server-side, wherein after connecting link is successfully established, destination client is also sent to server-side
Authentication information keeps link connection state if being proved to be successful, if verifying is unsuccessful to cut off the connecting link.
Step f, destination client receive multiple internet message frames of server-side transmission by network module, wherein
After receiving multiple internet message frames, it is also necessary to be decoded processing to each internet message frame, be disappeared with obtaining each network
The user information and audio data for including in breath frame, wherein audio data and user information correspond.
Further, the case where voice system gets the audio data sets that the corresponding server-side of target application is sent
Under, and in the case that target plug-in is in initiate mode, the data interaction between voice system and target plug-in is explained
Illustrate:
In the case where target plug-in is in initiate mode, voice system and target plug-in are then carried out by target memory
Audio data interaction, shown in four kinds of situations specific as follows:
It includes: voice system every preset time period that audio data sets are sent to target plug-in by one, voice system
Obtain the access authority of the write area of target memory;And the access of the write area of target memory is got in voice system
After claim, audio data sets are stored in the write area of target memory.
Secondly, target plug-in receive audio data sets include: target plug-in every preset time period obtain target storage
The access authority of the write area of device;And after target plug-in gets the access claim of the write area of target memory, read
The audio data sets stored in the write area of target memory.
Thirdly, target data set is sent to voice system includes: target plug-in every preset time period to target plug-in
Obtain the access authority of the read area of target memory;And the access of the read area of target memory is got in target plug-in
After permission, target data set is stored in the read area of target memory.
Four, it includes: that voice system every preset time period obtains target storage that voice system, which receives target data set,
The access authority of the read area in area;And after the access authority that voice system gets the read area of target memory, read
The target data set stored in the read area of target memory.
It is emphasized that: the message format communicated between voice system and target plug-in can be as shown in Figure 5, wherein
Cmd is type of message;Size is the byte number of current message body;Data is to hold itself in current message body, wherein type of message
Comprising data-message and control message two types, audio data and target data type of message are data-message;Deactivate instruction
It is control message with instruction message type is enabled.
In addition, the message format communicated between voice system and target plug-in, and it is divided into the cyclic annular storage information of description
The data content (data) of header contents (header) and cyclic annular storage information, specifically as shown in fig. 6, header contents include: table
Show the part head of current cyclic annular storage initial position, indicate current cyclic annular storing data byte-sized the part size and
Indicate that the part total of maximum number of byte can be written in cyclic annular storage;Data content (date) is exactly voice system and target plug-in
Between the data itself that need to transmit, wherein when the data for needing to transmit between voice system and target plug-in have been more than ring-type
When the tail portion of storage, then continued to write to from the head of ring-type storage.
It should be understood that the feelings that above-mentioned technical proposal is easy to appear voice system and target plug-in while being written and read
Reading and writing data exception can occur in such cases for condition, that is, when data-message is written in voice system in target memory, mesh
Mark plug-in unit reads the data-message simultaneously, and the data-message that target plug-in is read out at this time is unexpected message.
In order to avoid above situation generation, the access authority of the write area of target memory is authorized unique right at any time
As similarly, the access authority of the read area of target memory is also only to authorize unique object at any time.That is, in audio
A mutual exclusion is added in the program that system and target plug-in are written and read in the write area of target memory, read area
Global system lock, only takes a side of access authority (lock), just can writing according to the access authority access target memory
Enter area/read area.
In addition, the interaction content between target plug-in and voice system further includes stop and start instruction, i.e., it is more in target plug-in
In the case where a, voice system and target plug-in then carry out stop and start instruction interaction by target memory, and two kinds specific as follows
Shown in situation:
If one, voice system, which are sent, enables instruction to specified target plug-in, appointed target plug-in response is opened
With instruction, into initiate mode.
If secondly, voice system send and deactivate instruction to specified target plug-in, appointed target plug-in response stops
With instruction, into dead status.
It should be understood that in the case where target plug-in is in dead status, sound that voice system sends server-side
Frequency data acquisition system is determined as data acquisition system to be played.
It should be noted that step shown in the flowchart of the accompanying drawings can be in such as a group of computer-executable instructions
It is executed in computer system, although also, logical order is shown in flow charts, and it in some cases, can be with not
The sequence being same as herein executes shown or described step.
The embodiment of the present application also provides a kind of processing methods of voice audio, it should be noted that the embodiment of the present application
Voice system can be used for executing the processing method that voice audio is used for provided by the embodiment of the present application.Below to the application
The voice system that embodiment provides is introduced.
Fig. 7 is the schematic diagram according to the voice system of the embodiment of the present application.As shown in fig. 7, the voice system includes: first
Acquiring unit 71, transmission unit 73 and second acquisition unit 75.
First acquisition unit 71, the audio data sets sent for obtaining the corresponding server-side of target application;
Transmission unit 73, in the case where target plug-in is in initiate mode, audio data sets to be sent to mesh
Mark plug-in unit;
Second acquisition unit 75, for obtaining the target data set to be played of target plug-in transmission, target data set
Target plug-in is combined into carry out audio effect processing to audio data sets according to the business datum of target application and generate.
Optionally, in voice system provided by the embodiments of the present application, system further include: the first determination unit is used for
In the case that target plug-in is in dead status, the audio data sets that server-side is sent are determined as data set to be played
It closes.
Optionally, in voice system provided by the embodiments of the present application, transmission unit includes: memory module, is used for sound
Frequency data acquisition system is stored in target memory, and audio data sets are read from target memory for target plug-in;Second
Acquiring unit includes: read module, for reading target data set from target memory, wherein target data set is combined into
Target plug-in generates according to audio data sets and is stored in the data acquisition system in target memory.
Optionally, in voice system provided by the embodiments of the present application, memory module includes: the first acquisition submodule, is used
Access authority in the write area for obtaining target memory;Sub-module stored, in the write area for getting target memory
Access authority after, audio data sets are stored in the write area of target memory, wherein the write area of target memory
Access authority authorize unique object at any time;Read module includes: the second acquisition submodule, for every preset time
The access authority of the read area of section acquisition target memory;Reading submodule, in the read area for getting target memory
Access claim after, from the read area of target memory read target data set, wherein the visit of the read area of target memory
Ask that permission authorizes unique object at any time.
Optionally, in voice system provided by the embodiments of the present application, audio data sets are being sent to target plug-in
Later, voice system further include: the second determination unit, for determining target plug-in to each audio number in audio data sets
According to handling duration;Third determination unit, for the handling duration according to each audio data, it is determined whether there are handling durations
Greater than the target audio data of preset threshold;4th determination unit, for there are target audio data, determination to stop
With the target plug-in of processing target audio data.
Optionally, in voice system provided by the embodiments of the present application, voice system further include: the first generation unit is used
In in the case where determining the target plug-in for enabling and specifying, generation enables the access for instructing and obtaining the write area of target memory
Permission;First storage unit is stored in for after the access authority for the write area for getting target memory, will enable instruction
In target memory, opened for specified target plug-in in the access authority for the read area for getting target memory and reading
Enter initiate mode when with instruction;Second generation unit, in the case where determining the target plug-in for deactivating and specifying, generation to stop
With the access authority for the write area for instructing and obtaining target memory;Second storage unit, for getting target memory
Write area access claim after, by it is deactivated instruction be stored in target memory, got for specified target plug-in
The access authority of the read area of target memory and read deactivate instruction when enter dead status.
Voice system provided by the embodiments of the present application, by first acquisition unit, for obtaining the corresponding clothes of target application
The audio data sets that business end is sent;Transmission unit is used in the case where target plug-in is in initiate mode, by audio data
Set is sent to target plug-in;Second acquisition unit, for obtaining the target data set to be played of target plug-in transmission, mesh
Mark data acquisition system is that target plug-in carries out audio effect processing to audio data sets according to the business datum of target application and generates, and is solved
It has determined voice system in the related technology and the too strong technical problem of the coupling of game itself.
That is, voice system itself does not carry out at audio audio data sets further according to the business datum of target application
Reason, but in the case where target plug-in is in initiate mode, audio data sets are sent to the target plug-in being independently arranged
In, mesh is generated to audio data sets progress audio effect processing to obtain target plug-in according to according to the business datum of target application
Mark data acquisition system.At this point, i.e. realize to audio data sets carry out audio effect processing, while also achieve reduce voice system with
Coupling between target application (such as game application).
In turn, when technical staff is iterated processing to game service again in technical solution provided herein, then
Without being iterated to voice system, it is only necessary to modify the related data in target plug-in, greatly reduce technical staff
Work load, improve the stability and versatility of voice system.
The embodiment of the present application also provides a kind of processing methods of voice audio, it should be noted that the embodiment of the present application
The processing unit of voice audio can be used for executing the processing method that voice audio is used for provided by the embodiment of the present application.With
Under the processing unit of voice audio provided by the embodiments of the present application is introduced.
Fig. 8 is the schematic diagram according to the processing unit of the voice audio of the embodiment of the present application.As shown in figure 8, the voice sound
The processing unit of effect includes: voice system and target plug-in.
Voice system, the audio data sets sent for obtaining the corresponding server-side of target application, and in target plug-in
In the case where initiate mode, audio data sets are stored in target memory, with obtain target plug-in generation to
The target data set of broadcasting;
Target plug-in, for reading the audio data sets stored in target memory, and the business based on target application
Data carry out audio effect processing to audio data sets, obtain target data set, and target data set is sent to voice system
System.
The processing unit of voice audio provided by the embodiments of the present application, by voice system, for obtaining target application pair
The audio data sets that the server-side answered is sent, and in the case where target plug-in is in initiate mode, by audio data sets
It is stored in target memory, to obtain the target data set to be played of target plug-in generation;Target plug-in, for reading
The audio data sets stored in target memory, and audio is carried out to audio data sets based on the business datum of target application
Processing, obtains target data set, and target data set is sent to voice system, solves voice system in the related technology
The too strong technical problem with the coupling of game itself.
That is, voice system itself does not carry out at audio audio data sets further according to the business datum of target application
Reason, but in the case where target plug-in is in initiate mode, audio data sets are sent to the target plug-in being independently arranged
In, mesh is generated to audio data sets progress audio effect processing to obtain target plug-in according to according to the business datum of target application
Mark data acquisition system.At this point, i.e. realize to audio data sets carry out audio effect processing, while also achieve reduce voice system with
Coupling between target application (such as game application).
In turn, when technical staff is iterated processing to game service again in technical solution provided herein, then
Without being iterated to voice system, it is only necessary to modify the related data in target plug-in, greatly reduce technical staff
Work load, improve the stability and versatility of voice system.
Optionally, in the processing unit of voice audio provided by the embodiments of the present application, voice system includes that following son is single
Member: first obtains subelement, and the access authority of the write area of target memory is obtained for every preset time period;First storage
After the access claim of the write area for getting target memory in voice system, audio data sets are stored for subelement
In the write area of target memory.
Optionally, in the processing unit of voice audio provided by the embodiments of the present application, voice system includes that following son is single
Member: second obtains subelement, and the access authority of the write area of target memory is obtained for every preset time period;First reads
Subelement after the access claim of the write area for getting target memory in target plug-in, reads writing for target memory
Enter the audio data sets stored in area.
In addition, target plug-in further includes that following son is single in the processing unit of voice audio provided by the embodiments of the present application
Member: first obtains subelement, and the access authority of the write area of target memory is obtained for every preset time period;Second storage
After the access authority of the read area for getting target memory in target plug-in, target data set is stored for subelement
In the read area of target memory.
In addition, voice system further includes that following son is single in the processing unit of voice audio provided by the embodiments of the present application
Member: second obtains subelement, and the access authority of the write area of target memory is obtained for every preset time period;Second reads
Subelement after the access authority of the read area for getting target memory in voice system, reads the reading of target memory
The target data set stored in area is taken,
Wherein, the access authority of the write area of target memory authorizes unique object at any time;Target memory
The access authority of read area authorizes unique object at any time.
It optionally, is multiple feelings in target plug-in in the processing unit of voice audio provided by the embodiments of the present application
Under condition, if voice system, which is sent, enables instruction to specified target plug-in, appointed target plug-in response enables instruction, into
Enter initiate mode;If voice system, which is sent, deactivates instruction to specified target plug-in, appointed target plug-in response is deactivated
Instruction, into dead status.
Optionally, it in the processing unit of voice audio provided by the embodiments of the present application, is in target plug-in and deactivates shape
In the case where state, the audio data sets that server-side is sent for being determined as data acquisition system to be played by voice system.
In addition, as shown in figure 8, voice system can also include following module: network module, for establishing company with server-side
Chain link road, and transmit audio data;Acquisition hardware, for acquiring the voice data of user;Audio coding module, for acquisition
The language data arrived carries out coded treatment;Audio decoder module, for being decoded processing to the audio data that server-side is transmitted;
Target plug-in management module deactivates/enabling processing, and the read/write from target memory for carrying out to target plug-in
Data-message, to reach the technical purpose for carrying out data interaction with target plug-in;Mix module, for number of targets to be played
According to progress stereo process;Hardware is played, for playing data to be played.
The processing unit of the voice audio includes processor and memory, and above-mentioned voice system and target plug-in etc. are made
In memory for program unit storage, above procedure unit stored in memory is executed by processor to realize accordingly
Function.
Include kernel in processor, is gone in memory to transfer corresponding program unit by kernel.Kernel can be set one
Or more, it is asked by adjusting kernel parameter to handle the technology that voice system is too strong with the coupling of game itself in the related technology
Topic.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/
Or the forms such as Nonvolatile memory, if read-only memory (ROM) or flash memory (flash RAM), memory include that at least one is deposited
Store up chip.
The embodiment of the invention provides a kind of storage mediums, are stored thereon with program, real when which is executed by processor
The processing method of the voice audio of existing any one of the above.
The embodiment of the invention provides a kind of processor, the processor is for running program, wherein described program operation
The processing method of the voice audio of Shi Zhihang any one of the above.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/
Or the forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable Jie
The example of matter.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including element
There is also other identical elements in process, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product.
Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application
Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code
The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
The above is only embodiments herein, are not intended to limit this application.To those skilled in the art,
Various changes and changes are possible in this application.It is all within the spirit and principles of the present application made by any modification, equivalent replacement,
Improve etc., it should be included within the scope of the claims of this application.
Claims (13)
1. a kind of processing method of voice audio characterized by comprising
Obtain the audio data sets that the corresponding server-side of target application is sent;
In the case where target plug-in is in initiate mode, the audio data sets are sent to the target plug-in;
The target data set to be played that the target plug-in is sent is obtained, the target data set is combined into the target plug-in
Audio effect processing is carried out to the audio data sets according to the business datum of the target application and is generated.
2. the method according to claim 1, wherein the method also includes:
In the case where the target plug-in is in dead status, by the audio data sets that the server-side is sent be determined as to
The data acquisition system of broadcasting.
3. the method according to claim 1, wherein
It is described that the audio data sets are sent to the target plug-in includes: that the audio data sets are stored in target
In memory, the audio data sets are read from the target memory for the target plug-in;
The target data set to be played for obtaining the target plug-in generation includes: to read from the target memory
The target data set, wherein the target data set is combined into the target plug-in and gives birth to according to the audio data sets
At and the data acquisition system that is stored in the target memory.
4. according to the method described in claim 3, it is characterized in that,
The described audio data sets are stored in target memory includes: the write area for obtaining the target memory
Access authority;After getting the access authority of write area of the target memory, the audio data sets are stored in
In the write area of the target memory, wherein the access authority of the write area of the target memory is authorized at any time
Unique object;
The target data set that the target plug-in generation is read from the target memory includes: every preset time
Section obtains the access authority of the read area of the target memory;In the access right for the read area for getting the target memory
Xiang Hou reads target data set from the read area of the target memory, wherein the visit of the read area of the target memory
Ask that permission authorizes unique object at any time.
5. according to the method described in claim 3, it is characterized in that, being inserted the audio data sets are sent to the target
After part, the method also includes:
Determine the target plug-in to the handling duration of each audio data in the audio data sets;
Handling duration according to each audio data, it is determined whether there are the target audios that handling duration is greater than preset threshold
Data;
There are the target audio data, the target plug-in for deactivating the processing target audio data is determined.
6. according to the method described in claim 5, it is characterized in that, the method also includes:
In the case where determining the target plug-in for enabling and specifying, the write area for enabling and instructing and obtain the target memory is generated
Access authority;After getting the access authority of write area of the target memory, enabling instruction is stored in institute
State in target memory, for the specified target plug-in the read area for getting the target memory access authority
And enter initiate mode when reading enabling instruction;
In the case where determining the target plug-in for deactivating and specifying, the write area for deactivating and instructing and obtain the target memory is generated
Access authority;After getting the access claim of the write area of the target memory, the deactivated instruction is stored in institute
State in target memory, for the specified target plug-in the read area for getting the target memory access authority
And enter dead status when reading the deactivated instruction.
7. a kind of processing method of voice audio, which is characterized in that the treating method comprises:
Voice system obtains the audio data sets that the corresponding server-side of target application is sent;
In the case where target plug-in is in initiate mode, the audio data sets are sent to the mesh by the voice system
Mark plug-in unit;
The target plug-in receives the audio data sets, and according to the business datum of the target application to received described
Audio data sets carry out audio effect processing, obtain target data set merging and are sent to the voice system;
Voice system receives the target data set, and is data acquisition system to be played by the target data set cooperation.
8. the method according to the description of claim 7 is characterized in that
It includes: the voice system every default that the audio data sets are sent to the target plug-in by the voice system
Period obtains the access authority of the write area of target memory;And the target memory is got in the voice system
Write area access claim after, the audio data sets are stored in the write area of the target memory;
It includes: that the target plug-in every preset time period obtains the mesh that the target plug-in, which receives the audio data sets,
Mark the access authority of the write area of memory;And the visit of the write area of the target memory is got in the target plug-in
After asking claim, the audio data sets stored in the write area of the target memory, the write-in of the target memory are read
The access authority in area authorizes unique object at any time;
It includes: the target plug-in every default that the target data set is sent to the voice system by the target plug-in
Period obtains the access authority of the read area of target memory;And the target memory is got in the target plug-in
Read area access authority after, the target data set is stored in the read area of the target memory;
It includes: that the voice system every preset time period obtains the mesh that the voice system, which receives the target data set,
Mark the access authority of the read area of memory block;And the visit of the read area of the target memory is got in the voice system
After asking permission, the target data set stored in the read area of the target memory, the reading of the target memory are read
The access authority in area authorizes unique object at any time.
9. the method according to the description of claim 7 is characterized in that the target plug-in be it is multiple in the case where, the side
Method further include:
If the voice system, which is sent, enables instruction to specified target plug-in, described in the appointed target plug-in response
Instruction is enabled, into initiate mode;
If the voice system, which is sent, deactivates instruction to specified target plug-in, described in the appointed target plug-in response
Instruction is deactivated, into dead status;
In the case where the target plug-in is in dead status, audio data sets that the voice system sends server-side
It is determined as data acquisition system to be played.
10. a kind of voice system characterized by comprising
First acquisition unit, the audio data sets sent for obtaining the corresponding server-side of target application;
Transmission unit, for the audio data sets being sent to described in the case where target plug-in is in initiate mode
Target plug-in;
Second acquisition unit, the target data set to be played sent for obtaining the target plug-in, the target data
Collection be combined into the target plug-in audio effect processing carried out to the audio data sets according to the business datum of the target application and
It generates.
11. a kind of processing unit of voice audio characterized by comprising
Voice system, the audio data sets sent for obtaining the corresponding server-side of target application, and be in target plug-in
In the case where initiate mode, the audio data sets are stored in target memory, are generated with obtaining the target plug-in
Target data set to be played;
Target plug-in, for reading the audio data sets stored in target memory, and the business datum based on target application
Audio effect processing is carried out to the audio data sets, obtains target data set, and the target data set is sent to institute
Predicate system for electrical teaching.
12. a kind of processor, which is characterized in that the processor is for running program, wherein right of execution when described program is run
Benefit require any one of 1 to 6 described in voice audio processing method, or, described program run when perform claim require 7 to
The processing method of voice audio described in any one of 9.
13. a kind of storage medium, which is characterized in that the storage medium includes the program of storage, wherein described program right of execution
Benefit require any one of 1 to 6 described in voice audio processing method, or, described program perform claim require 7 to 9 in appoint
The processing method of voice audio described in meaning one.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811549257.7A CN109448740B (en) | 2018-12-18 | 2018-12-18 | Voice sound effect processing method and device and voice system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811549257.7A CN109448740B (en) | 2018-12-18 | 2018-12-18 | Voice sound effect processing method and device and voice system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109448740A true CN109448740A (en) | 2019-03-08 |
CN109448740B CN109448740B (en) | 2022-05-27 |
Family
ID=65558795
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811549257.7A Active CN109448740B (en) | 2018-12-18 | 2018-12-18 | Voice sound effect processing method and device and voice system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109448740B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112839239A (en) * | 2020-12-30 | 2021-05-25 | 广州虎牙科技有限公司 | Audio and video processing method and device and server |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105824598A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Sound effect management method and mobile terminal |
CN106328149A (en) * | 2016-08-22 | 2017-01-11 | 腾讯科技(深圳)有限公司 | Mixed sound processing method and related equipment |
CN106658155A (en) * | 2016-12-29 | 2017-05-10 | 深圳Tcl数字技术有限公司 | Method and device for switching and playing of player |
WO2017129130A1 (en) * | 2016-01-29 | 2017-08-03 | 腾讯科技(深圳)有限公司 | Audio processing method, server, user equipment, and system |
CN107911361A (en) * | 2017-11-14 | 2018-04-13 | 网易(杭州)网络有限公司 | Support voice management method, apparatus, terminal device and the storage medium of more sessions |
CN108184170A (en) * | 2017-11-27 | 2018-06-19 | 北京奇艺世纪科技有限公司 | A kind of data processing method and device |
CN108234790A (en) * | 2018-01-10 | 2018-06-29 | 网易(杭州)网络有限公司 | Multi-person speech communication method, apparatus, terminal device and storage medium |
CN108305603A (en) * | 2017-10-20 | 2018-07-20 | 腾讯科技(深圳)有限公司 | Sound effect treatment method and its equipment, storage medium, server, sound terminal |
CN108462895A (en) * | 2017-02-21 | 2018-08-28 | 阿里巴巴集团控股有限公司 | Sound effect treatment method, device and machine readable media |
CN108848106A (en) * | 2018-06-30 | 2018-11-20 | 武汉斗鱼网络科技有限公司 | Customized data method, device and readable storage medium storing program for executing are transmitted by audio stream |
-
2018
- 2018-12-18 CN CN201811549257.7A patent/CN109448740B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017129130A1 (en) * | 2016-01-29 | 2017-08-03 | 腾讯科技(深圳)有限公司 | Audio processing method, server, user equipment, and system |
CN105824598A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Sound effect management method and mobile terminal |
CN106328149A (en) * | 2016-08-22 | 2017-01-11 | 腾讯科技(深圳)有限公司 | Mixed sound processing method and related equipment |
CN106658155A (en) * | 2016-12-29 | 2017-05-10 | 深圳Tcl数字技术有限公司 | Method and device for switching and playing of player |
CN108462895A (en) * | 2017-02-21 | 2018-08-28 | 阿里巴巴集团控股有限公司 | Sound effect treatment method, device and machine readable media |
CN108305603A (en) * | 2017-10-20 | 2018-07-20 | 腾讯科技(深圳)有限公司 | Sound effect treatment method and its equipment, storage medium, server, sound terminal |
CN107911361A (en) * | 2017-11-14 | 2018-04-13 | 网易(杭州)网络有限公司 | Support voice management method, apparatus, terminal device and the storage medium of more sessions |
CN108184170A (en) * | 2017-11-27 | 2018-06-19 | 北京奇艺世纪科技有限公司 | A kind of data processing method and device |
CN108234790A (en) * | 2018-01-10 | 2018-06-29 | 网易(杭州)网络有限公司 | Multi-person speech communication method, apparatus, terminal device and storage medium |
CN108848106A (en) * | 2018-06-30 | 2018-11-20 | 武汉斗鱼网络科技有限公司 | Customized data method, device and readable storage medium storing program for executing are transmitted by audio stream |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112839239A (en) * | 2020-12-30 | 2021-05-25 | 广州虎牙科技有限公司 | Audio and video processing method and device and server |
Also Published As
Publication number | Publication date |
---|---|
CN109448740B (en) | 2022-05-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112132292A (en) | Block chain-based longitudinal federated learning data processing method, device and system | |
CN108738006A (en) | Data transmission method based on bluetooth and device | |
CN112131298B (en) | Data conversion method and device based on block chain | |
CN111967610A (en) | Block chain-based federal learning incentive method, device, equipment and storage medium | |
CN108471434A (en) | A kind of correlating method, device, electronic equipment and the system of equipment and account | |
CN108959864A (en) | Funcall authentication, the method and apparatus of calling function and authority information method for building up | |
CN108833578A (en) | The method and relevant device of duplex communication are carried out based on FIFO name pipeline | |
TW202101350A (en) | Method and device for cross-chain transmission of authenticable message based on processing module | |
CN107301028B (en) | Audio data processing method and device based on multi-person remote call | |
CN107613409A (en) | The processing method and processing device of multi-medium data | |
CN109309866A (en) | Image processing method and device, storage medium | |
CN109688416A (en) | Cut-in method and network direct broadcasting system between network direct broadcasting | |
US20220020395A1 (en) | Audio data processing method, electronic device, and storage medium | |
CN107517238A (en) | A kind of smart machine control method, device and equipment for Internet of Things | |
CN109547172A (en) | Data transmission method, system and data transmitting equipment, data receiver | |
CN110602338B (en) | Audio processing method, device, system, storage medium and equipment | |
CN103731339B (en) | Online multimedia resource share method in digital living network alliance system and system | |
CN109448740A (en) | Processing method, device and the voice system of voice audio | |
CN106992973A (en) | The method and system of rights management are carried out to user terminal function | |
CN109905387A (en) | A kind of data processing method and device | |
CN108737355A (en) | Streaming media playing based on user bandwidth | |
CN109146473B (en) | DAPP evaluation data processing method and device and electronic equipment | |
CN110515910A (en) | Data processing method, device and computer readable storage medium between heterogeneous system | |
CN110209888A (en) | The storage method and device of interface requests | |
CN103166913B (en) | The method for recording of encrypted media streams and switch control device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |