CN109032555A - Method and device for processing audio data in screen projection, storage medium and electronic equipment - Google Patents
Method and device for processing audio data in screen projection, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN109032555A CN109032555A CN201810737582.XA CN201810737582A CN109032555A CN 109032555 A CN109032555 A CN 109032555A CN 201810737582 A CN201810737582 A CN 201810737582A CN 109032555 A CN109032555 A CN 109032555A
- Authority
- CN
- China
- Prior art keywords
- audio
- equipment
- playback equipment
- audio data
- audio playback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012545 processing Methods 0.000 title claims abstract description 31
- 230000002093 peripheral effect Effects 0.000 claims description 18
- 238000003672 processing method Methods 0.000 claims description 18
- 230000004044 response Effects 0.000 claims description 12
- 230000001960 triggered effect Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000005055 memory storage Effects 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 7
- 230000005611 electricity Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000009434 installation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method and a device for processing audio data in screen projection, a storage medium and electronic equipment, wherein the method comprises the following steps: operating a virtual audio playing device; setting the virtual audio playing device as a default audio playing device, wherein the default audio playing device is used for playing audio data; and responding to a screen projection instruction, capturing the audio data and screen projection content, and sending the audio data and the screen projection content to a receiving end to enable the receiving end to play the audio data and the screen projection content. The screen projection method aims at solving the problems that in the existing screen projection technology, audio and sound are mixed, and the screen projection effect is poor.
Description
Technical field
The present invention relates to computer fields, more particularly to throw screen sound intermediate frequency data processing method, device, storage medium and electricity
Sub- equipment.
Background technique
With the development of science and technology, either personal or enterprise, is owned by multiple electronic equipments, since user is to these electricity
The demand of sub- equipment is different, and the function of distinct electronic apparatuses is different, under certain specific occasions, needs an electricity
Audio data and/or screen data on sub- equipment (commonly referred to as sending ending equipment) screen project another electronics and set
On standby (commonly referred to as receiving device), the above process, which is referred to as, throws screen.In existing throwing screen scheme, when on sending ending equipment
In the case that operation has audio-video document, receiving device can be carried out audio data by the physical audio playback equipment of local terminal
It plays, meanwhile, sending ending equipment, which can also capture audio data and be sent to receiving end, to be played out, and user can hear sending ending equipment
The sound issued with receiving device, sometimes due to the problem of audio data transmission speed, may cause sending ending equipment with
Between receiving device there is delay in sounding, mix audio sound, and it is poor to throw screen effect.
Summary of the invention
In order to solve in existing throwing screen technology, audio sound mixes, and throws the poor technical problem of screen effect, and the present invention is implemented
Example, which provides, throws screen sound intermediate frequency data processing method, device, storage medium and electronic equipment.
According to the first aspect of the invention, a kind of throwing screen sound intermediate frequency data processing method is proposed, the method includes steps
It is rapid:
Run virtual audio playback equipment；
Default audio playback equipment is set by the virtual audio playback equipment, the default audio playback equipment is used for
Playing audio-fequency data；
In response to throwing screen instruction, capturing the audio data and throwing screen content, the audio data is appended the throwing and is shielded
Content is sent to receiving end, so that receiving end playing audio data and the throwing shield content.
In some instances, before the operation virtual audio playback equipment, further includes:
Whether detection transmitting terminal is equipped with virtual audio playback equipment；
If transmitting terminal does not install virtual audio playback equipment, virtual audio playback equipment is installed.
In some instances, described to set default audio playback equipment for the virtual audio playback equipment, capture institute
State audio data, comprising:
The first api interface is called, audio data is passed to the virtual audio playback equipment, so that physical audio broadcasting is set
It is standby to obtain the audio data；
The second api interface is written in the audio data that virtual audio playback equipment will acquire；
Second api interface is called to capture the audio data.
In some instances, described to set default audio playback equipment for the virtual audio playback equipment, it is receiving
It is executed after playing the instruction of audio to receiving end.
In some instances, the method also includes steps:
If receiving the instruction that transmitting terminal plays audio, default audio is set by the physical audio playback equipment of transmitting terminal
Screen content is thrown in playback equipment, capture, and throwing screen content is sent to receiving end, the audio data is not sent to reception
End.
In some instances, the receiving end plays the instruction of audio, in the playback interface quilt for receiving end of displaying
It is executed when triggering；
The transmitting terminal plays the instruction of audio, the execution when showing that the playback interface for transmitting terminal is triggered.
According to the second aspect of the invention, it proposes another throw and shields sound intermediate frequency data processing method, the method includes
Step:
Receive the audio data and throw screen content that transmitting terminal is sent；
By local terminal physical audio playback equipment playing audio data and throw screen content, wherein the audio data exists
Transmitting terminal is played by virtual audio playback equipment, so that the physical audio playback equipment of the transmitting terminal can not obtain the audio
Data.
According to the third aspect of the invention we, a kind of throwing screen sound intermediate frequency data processing equipment is proposed, comprising:
Processing module, for running virtual audio playback equipment；Default sound is set by the virtual audio playback equipment
Frequency playback equipment, the default audio playback equipment are used for playing audio-fequency data；
Communication module, for being instructed in response to throwing screen, capturing the audio data and throwing screen content, by the audio data
It is appended the throwing screen content and is sent to receiving end, so that receiving end playing audio data and the throwing shield content.According to this
The fourth aspect of invention proposes another throw and shields sound intermediate frequency data processing equipment, comprising:
Communication module, for receiving the audio data of transmitting terminal transmission and throwing screen content；
Processing module, for by local terminal physical audio playback equipment playing audio data and throwing screen content, wherein institute
It states audio data to be played in transmitting terminal by virtual audio playback equipment, so that the physical audio playback equipment of the transmitting terminal can not
Obtain the audio data.
According to the fifth aspect of the invention, propose a kind of electronic equipment, the electronic equipment include: sending ending equipment or
Peripheral hardware throws screen equipment, and the electronic equipment includes:
Processor；
The memory of storage processor executable instruction；Wherein, the processor is coupled in the memory, for reading
The program instruction of the memory storage, and in response, it executes and throws screen as described in any one as described in above-mentioned first aspect
Operation in sound intermediate frequency data processing method.
According to the sixth aspect of the invention, a kind of Intelligent flat is proposed, comprising:
Processor；
The memory of storage processor executable instruction；Wherein, the processor is coupled in the memory, for reading
The program instruction of the memory storage, and in response, execute the throwing screen sound intermediate frequency data processing side as described in second aspect
Operation in method.
According to the seventh aspect of the invention, a kind of computer readable storage medium is proposed, program is stored thereon with, the journey
Sequence is executed by processor as thrown at screen sound intermediate frequency data as described in any one of above-mentioned first aspect present invention and second aspect
Operation in reason method.
The present invention is set as default sound by running virtual playback equipment in transmitting terminal, by the virtual audio playback equipment
Frequency playback equipment, so that audio data is passed to default audio playback equipment and plays out, and the physical audio of sending ending equipment is broadcast
It puts equipment and does not receive the audio data；And also capture the audio data and throw screen content, by the audio data and
It throws screen content and is sent to receiving end, for receiving end playing audio data and throw screen content, broadcast so that possessing physical audio
Put equipment sending ending equipment can not sounding only by receiving device playing audio data efficiently solve existing throwing screen
Sending ending equipment and receiving device the problem of sounding bring sound mixes simultaneously in scheme；And do not increase the investment of hardware,
It is at low cost.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is that one shown in an exemplary embodiment of the invention throws the schematic diagram for shielding scene；
Fig. 2 a is that one shown in an exemplary embodiment of the invention throws the part process for shielding sound intermediate frequency data processing method
Figure；
Fig. 2 b is that one shown in an exemplary embodiment of the invention throws the schematic diagram for shielding sound intermediate frequency data processing method；
Fig. 3 is the interface schematic diagram of a sending ending equipment shown in an exemplary embodiment of the invention；
Fig. 4 is the part process of another throwing screen sound intermediate frequency data processing method shown in an exemplary embodiment of the invention
Figure；
Fig. 5 a is the interface schematic diagram of another sending ending equipment shown in an exemplary embodiment of the invention；
Fig. 5 b is that another part for throwing screen sound intermediate frequency data processing method shown in an exemplary embodiment of the invention is flowed
Cheng Tu；
Fig. 6 is that one shown in an exemplary embodiment of the invention throws the structural block diagram for shielding sound intermediate frequency data processing equipment；
Fig. 7 is the structural frames of another throwing screen sound intermediate frequency data processing equipment shown in an exemplary embodiment of the invention
Figure；
Fig. 8 is the structural frames of another throwing screen sound intermediate frequency data processing equipment shown in an exemplary embodiment of the invention
Figure；
Fig. 9 is the structural block diagram of an electronic equipment shown in an exemplary embodiment of the invention；
Figure 10 is the structural block diagram of an Intelligent flat shown in an exemplary embodiment of the invention.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
The example of device and method being described in detail in claims, some aspects of the invention are consistent.
It is only to be not intended to limit the invention merely for for the purpose of describing particular embodiments in terminology used in the present invention.
It is also intended in the present invention and the "an" of singular used in the attached claims, " described " and "the" including majority
Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps
It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the present invention
A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from
In the case where the scope of the invention, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination ".
Referring to Fig.1, the schematic diagram of screen scene, sending ending equipment 120 are thrown for one shown in exemplary of the embodiment of the present invention
Connection can be established between receiving device 110 by way of wirelessly or non-wirelessly or the physics of sending ending equipment 120 connects
Mouth can connect peripheral hardware throw screen equipment 140, peripheral hardware throw screen equipment 140 by way of wirelessly or non-wirelessly with receiving device 110
Between establish connection.When operation has audio file on sending ending equipment 120, sending ending equipment 120 passes through the physics sound of itself
Audio electrical signal is converted into audio voice signals and made a sound by frequency playback equipment.Sending ending equipment 120 or peripheral hardware throw screen equipment 140
On can run one for throw shield program, throwings screen program is used for after starting to throw screen, the audio of acquisition transmitting terminal broadcasting
Data, and the audio data is sent to receiving device 110, so that the physical audio playback equipment of receiving end is by audio-frequency electric
Signal is converted into audio voice signals and makes a sound.User 130 can pass through the sound of control 120 playing audio-fequency data of sending ending equipment
Size is measured, to control and receive volume when 110 playing audio-fequency data of end equipment.So being used in existing throwing screen scheme
Family can hear the sound that sending ending equipment and receiving device are issued, sometimes due to the problem of audio data transmission speed, it can
Sounding between sending ending equipment and receiving device can be caused to there is delay, mix audio sound, it is poor to throw screen effect.
The sending ending equipment and receiving device that the embodiment of the present invention proposes can be with audio playing function and processing
The electronic equipment of the electronic equipment of function can be teaching plate, smart television, desktop computer, laptop and plate electricity
Brain etc..The present invention is not intended to limit the type of sending ending equipment and receiving device.The peripheral hardware that the embodiment of the present invention proposes is thrown screen and is set
Standby to be connected by external interface with sending ending equipment, the peripheral hardware, which throws screen equipment, can have store function and processing function
Energy.
In order to solve the above technical problem, the present invention provides a kind of throwings to shield sound intermediate frequency data processing scheme, referring to Fig. 2 a, is
The partial process view of throwing screen sound intermediate frequency data processing method shown in an exemplary embodiment of the invention, the method can be applied
In transmitting terminal, the transmitting terminal can be integrated with sending ending equipment or peripheral hardware throws the functional module that screen equipment is used to throw screen, institute
Stating functional module can be throwing screen program, and part steps are as follows:
S210: operation virtual audio playback equipment；
S220: default audio playback equipment is set by the virtual audio playback equipment, the default audio broadcasting is set
It is ready for use on playing audio-fequency data；
S230:, will be described in audio data accompanying in response to throwing screen instruction, capturing the audio data and throwing screen content
It throws screen content and is sent to receiving end, so that receiving end playing audio data and the throwing shield content.
The virtual audio playback equipment that the embodiment of the present invention proposes is a virtual physical audio playing program, such as
Virtual speaker, virtual audio or virtual earphone etc..
The physical audio playback equipment that the embodiment of the present invention proposes is loudspeaker, sound equipment or earphone etc., the embodiment of the present invention
Physical audio playback equipment " broadcasting " audio data of it is proposed indicates: physical audio playback equipment is by the telecommunications of the audio data
It number is converted to the acoustical signal of audio data, so that equipment sounding where physical audio playback equipment.With physical audio playback equipment
" broadcasting " audio data is different, and virtual audio playback equipment " broadcasting " audio data that the embodiment of the present invention proposes indicates: virtual
Audio-frequence player device obtains the audio data, so that the physical audio playback equipment of the equipment where virtual audio playback equipment
(broadcasting) described audio data can not be obtained, so the electric signal of the audio data will not be converted to acoustical signal, so that empty
Equipment where quasi- audio-frequence player device will not make a sound.
" the throwing screen instruction " that the embodiment of the present invention proposes is triggered when can trigger " throwing screen " interface in user, the interface
Including the control shown on interface and physical button etc., in some instances, the throwing screen instruction throws screen equipment and hair in peripheral hardware
Sending end equipment triggers when connecting, and in some instances, peripheral hardware is thrown screen equipment and connect with transmitting terminal, and user triggers when throwing screen interface
Triggering, such as peripheral hardware are thrown and are provided with physical button on screen equipment, and user triggers throwing screen instruction when pressing the physical button, this
When start throw screen.It should be noted that in some instances, the step S220 can be held after " throwing screen instruction " is triggered
Row.
" the throwing screen content " that the embodiment of the present invention proposes includes some or all of displaying picture on sending ending equipment screen,
It can be picture or video.It should be noted that after the receiving end receives the throwing screen content, on the receiving device
It plays throwing screen content and specifically may is that throwings is shielded content and shown in a manner of full frame or wicket by receiving end and receiving
On the screen of end equipment.
Specifically, in one example, referring to Fig.1, the peripheral hardware is thrown and is stored with throwing screen program and virtual on screen equipment 140
Audio-frequence player device driver etc. runs institute when the peripheral hardware, which throws screen equipment 140, accesses the sending ending equipment for the first time
State throwing screen program, throwings screen program by the virtual audio playback equipment driver be mounted on peripheral hardware throwing screen equipment 140 or
On sending ending equipment 120, when the virtual audio playback equipment driver is installed, a virtual audio playback equipment is created.Hair
Sending end equipment starts after throwing screen, in conjunction with Fig. 2 b, 241 playing audio-fequency data of audio playing program of transmitting terminal 240, and by audio
Data are passed to driver of sound card 242, and transmitting terminal 240 utilizes the first api interface (example for throwing screen 245 call operation system of program
In son, first api interface can be the interface of portcles), the equipment for playing audio is switched to virtual audio and is played
Equipment 243 (sets default audio playback equipment for the virtual audio playback equipment), the virtual audio playback equipment
After 243 get the audio data, by the audio data be written to the second api interface (in an example, described second
Api interface can be Core Audio API) so that sending ending equipment physical audio playback equipment 244 (such as: loudspeaker or
External speaker) audio data can not be got, since transmitting terminal can not be by physical audio playback equipment 244 by audio data
Electric signal is converted to the acoustical signal of audio data, so sending ending equipment can not sounding.Then transmitting terminal 240 utilizes throwing screen program
245 call second api interface (Core Audio API), capture the audio data, finally will using throwing screen program 245
The audio data is sent to receiving end 250, so that receiving end playing audio data.
The present invention is set as default sound by running virtual playback equipment in transmitting terminal, by the virtual audio playback equipment
Frequency playback equipment, so that audio data is passed to default audio playback equipment and plays out, and the physical audio of sending ending equipment is broadcast
It puts equipment and does not receive the audio data；And the audio data is also captured, the audio data is sent to receiving end,
For receiving end playing audio data so that possess physics audio-frequence player device sending ending equipment can not sounding, only by
Receiving device playing audio data efficiently solves in existing throwing screen scheme sending ending equipment and receiving device simultaneously
The problem of sounding bring sound mixes；And do not increase the investment of hardware, it is at low cost.
Further, in some instances, after the throwing screen program operation of transmitting terminal, it can detecte whether transmitting terminal is equipped with void
Quasi- audio-frequence player device directly runs virtual audio playback equipment if transmitting terminal is equipped with virtual audio playback equipment；If sending
Virtual audio playback equipment is not installed at end, then installs virtual audio playback equipment, after virtual audio playback equipment is installed successfully,
Run the virtual audio playback equipment.
Specifically, the peripheral hardware, which is thrown in screen equipment 140, can store a virtual audio driver, described in conjunction with Fig. 1
Virtual audio driver is for creating virtual audio playback equipment, after peripheral hardware throwing screen equipment is connect with transmitting terminal, transmitting terminal
Whether detection transmitting terminal is equipped with virtual audio playback equipment, if being equipped with, the virtual audio playback equipment is run, if not pacifying
Dress will then be stored in the virtual audio driver in peripheral hardware throwing screen equipment in transmitting terminal, run the virtual audio driving journey
Sequence, virtual audio driver then create and run virtual audio playback equipment.
In some instances, it can show that the broadcasting for virtual audio playback equipment connects on the interface of sending ending equipment
The playback interface of mouth and physical audio playback equipment, for selection by the user, the playback interface can be available subscribers triggering
Some visual options, such as control.Referring to Fig. 3, selection window 310 can be shown on the interface of sending ending equipment 300,
The window 310 includes the broadcasting control of the play control 311 and physical audio playback equipment for virtual audio playback equipment
Part 312；
When the play control 311 of virtual audio playback equipment is triggered, transmitting terminal receives virtual audio playback equipment and broadcasts
The instruction of playback frequency sets default playback equipment for the virtual audio playback equipment after starting to throw screen；Work as physical audio
The play control 312 of playback equipment is triggered, and transmitting terminal receives the instruction that physical audio playback equipment plays audio, is starting
After throwing screen, default playback equipment is set by the physical audio playback equipment；The default audio playback equipment is for playing
Audio data.
Fig. 3 the embodiment described, user can select the broadcasting of sending ending equipment playing audio-fequency data according to actual needs
Equipment, user experience are good.
It is the part stream of the throwing screen sound intermediate frequency data processing method shown in another exemplary embodiment of the present invention referring to Fig. 4
Cheng Tu, the method are applied to transmitting terminal, and the part steps of the method are as follows:
S410: operation virtual audio playback equipment.
S420: if receiving the instruction that receiving end plays audio, default sound is set by the virtual audio playback equipment
Frequency playback equipment, the default audio playback equipment are used for playing audio-fequency data, capture audio data and throw screen content, by audio
Data and throwing screen content are sent to receiving end.
S430: if receiving the instruction that transmitting terminal plays audio, default sound is set by the physical audio playback equipment
Screen content is thrown in frequency playback equipment, capture, and throwing screen content is sent to receiving end, audio data is not sent to receiving end.
Specifically, can show the playback interface for receiving end on the interface of sending ending equipment, and it is directed to transmitting terminal
Playback interface, the playback interface can be available subscribers triggering some visual options, such as control.In an example
In, such as shown in Figure 5 a, show there is window 510 on the interface 500 of transmitting terminal, which includes the broadcasting control for receiving end
Part 511 and play control 512 for transmitting terminal；
When the play control 511 for receiving end is triggered, transmitting terminal can receive the instruction that receiving end plays audio,
Start after throwing screen, transmitting terminal can set the virtual audio playback equipment to default audio playback equipment, the default sound
Frequency playback equipment is used for playing audio-fequency data, and captures audio, video data, and audio, video data is sent to receiving end；In this way, only
Receiving device by receiving audio data makes a sound.
When the play control 512 of transmitting terminal is triggered, transmitting terminal receives the instruction that transmitting terminal plays audio, starts to throw
After screen, transmitting terminal can set default audio playback equipment, such as loudspeaker or earphone for the physical audio playback equipment,
Transmitting terminal can not capture audio data.In this way, only being made a sound by sending ending equipment.
By Fig. 4 and Fig. 5 a the embodiment described, it can solve sending ending equipment and receiving end in existing throwing screen scheme and set
Standby the problem of sounding bring sound mixes simultaneously；Do not increase the investment of hardware, it is at low cost；And to user to select, so that with
Family can be according to the equipment of selection sounding the case where actual environment or sending ending equipment and receiving device, and user experience is good.
Referring to Fig. 5 b, shield sound intermediate frequency data processing method for another throw provided in an embodiment of the present invention, the method can
To be applied to receiving end, the method includes the steps:
S520: the audio data and throw screen content that transmitting terminal is sent are received；
S530: by local terminal physical audio playback equipment playing audio data and screen content is thrown, wherein the audio number
Played according in transmitting terminal by virtual audio playback equipment so that the physical audio playback equipment of the transmitting terminal can not obtain it is described
Audio data.
It should be noted that the concrete methods of realizing of each step of method described in Fig. 5 b can refer to aforementioned implementation
Example, details are not described herein.
In addition, the description of above-mentioned each step, can be implemented as software, hardware or its form combined, for example, ability
Field technique personnel can implement these as the form of software code, can be that can be realized the corresponding logic function of the step
Computer executable instructions.When it is realized in the form of software, the executable instruction be can store in memory, and
It is executed by the processor in equipment.
Corresponding with the aforementioned throwing screen embodiment of sound intermediate frequency data processing method, the present invention also provides throw to shield middle pitch frequency
According to the embodiment of processing unit, console device and electronic equipment.
It is thrown in screen referring to Fig. 6 for a kind of frame diagram for throwing screen sound intermediate frequency data processing equipment that the embodiment of the present invention proposes
Audio-frequency data processing device 600 includes:
The virtual audio playback equipment is set as defaulting by processing module 610 for running virtual audio playback equipment
Audio-frequence player device, the default audio playback equipment are used for playing audio-fequency data；
Communication module 620, for being instructed in response to throwing screen, capturing the audio data and throwing screen content, by the audio
Data are appended the throwing screen content and are sent to receiving end, so that receiving end playing audio data and the throwing shield content.
In some instances, before the operation virtual audio playback equipment, processing module 610 is also used to detect transmitting terminal
Whether virtual audio playback equipment is installed；If transmitting terminal does not install virtual audio playback equipment, installation virtual audio broadcasting is set
It is standby.
In some instances, processing module 610 is specifically used for:
The first api interface is called, audio data is passed to the virtual audio playback equipment, so that physical audio broadcasting is set
It is standby to obtain audio data；
The second api interface is written in the audio data that virtual audio playback equipment will acquire；Second api interface is called to catch
Obtain the audio data.
In some instances, described to set default audio playback equipment for the virtual audio playback equipment, it is receiving
It is executed after playing the instruction of audio to receiving end.
Screen is thrown referring to Fig. 7 for another frame diagram for throwing screen sound intermediate frequency data processing equipment that the embodiment of the present invention proposes
Sound intermediate frequency data processing equipment 700 includes:
Processing module 710, for running virtual audio playback equipment；
Selecting module 720 sets the virtual audio playback equipment if playing the instruction of audio for receiving receiving end
It is set to default audio playback equipment, capture audio, video data and throws screen content, the audio data is appended the throwing and shields content
It is sent to receiving end；
Communication module 730 sets the physical audio playback equipment if playing the instruction of audio for receiving transmitting terminal
It is set to default audio playback equipment, screen content is thrown in capture, and throwing screen content is sent to receiving end, audio data is not sent
To receiving end.
In some instances, the receiving end plays the instruction of audio, in the playback interface quilt for receiving end of displaying
It is sent when triggering；The transmitting terminal plays the instruction of audio, the transmission when showing that the playback interface for transmitting terminal is triggered.
Screen is thrown referring to Fig. 8 for another frame diagram for throwing screen sound intermediate frequency data processing equipment that the embodiment of the present invention proposes
Sound intermediate frequency data processing equipment 800 includes:
Communication module 810, for receiving the audio data of transmitting terminal transmission and throwing screen data；
Processing module 820, for shielding data by local terminal physical audio playback equipment playing audio data and the throwing,
Wherein, the audio data is played in transmitting terminal by virtual audio playback equipment, so that the physical audio of the transmitting terminal plays
Equipment can not obtain the audio data.
The embodiment for the throwing screen sound intermediate frequency data processing equipment that Fig. 6 and Fig. 7 of the present invention are proposed can be applied in electricity
In sub- equipment.Installation practice can also be realized by software realization by way of hardware or software and hardware combining.With
For software realization, as the device on a logical meaning, being will be non-volatile by the processor of client device where it
Property memory in corresponding computer program instructions be read into memory operation formed.For hardware view, such as Fig. 9 institute
Show, for the embodiment of the present application propose a kind of hardware structure diagram, in addition to processor shown in Fig. 9, memory, network interface and
Except nonvolatile memory, the client device in embodiment where device may be used also generally according to the actual functional capability of the equipment
To include other hardware, this is repeated no more.The processor is used to carry out:
Run virtual audio playback equipment；
Default audio playback equipment is set by the virtual audio playback equipment, the default audio playback equipment is used for
Playing audio-fequency data；
In response to throwing screen instruction, capturing the audio data and throwing screen content, the audio data is appended the throwing and is shielded
Content is sent to receiving end, so that receiving end playing audio data and the throwing shield content.
It should be noted that the electronic equipment can be sending ending equipment, it is also possible to be connected with sending ending equipment
Peripheral hardware throws screen equipment.
Referring to Figure 10, propose that a kind of one embodiment schematic diagram of Intelligent flat, device described in Fig. 8 are implemented for the present invention
Example can also be realized by software realization by way of hardware or software and hardware combining.Taking software implementation as an example, as
Device on one logical meaning is by the processor of client device where it by meter corresponding in nonvolatile memory
Calculation machine program instruction is read into memory what operation was formed.For hardware view, as shown in Figure 10, mentioned for the embodiment of the present application
A kind of hardware structure diagram out, other than processor shown in Fig. 10, memory, network interface and nonvolatile memory,
Client device in embodiment where device can also include other hardware, to this generally according to the actual functional capability of the equipment
It repeats no more.The processor is used to carry out:
Receive the audio data and throw screen content that transmitting terminal is sent；
Content is shielded by local terminal physical audio playback equipment playing audio data and the throwing, wherein the audio number
Played according in transmitting terminal by virtual audio playback equipment so that the physical audio playback equipment of the transmitting terminal can not obtain it is described
Audio data.
In embodiments of the present invention, computer readable storage medium can be diversified forms, for example, in different examples
In, the machine readable storage medium may is that RAM (Radom Access Memory, random access memory), volatile deposit
Reservoir, nonvolatile memory, flash memory, memory driver (such as hard disk drive), solid state hard disk, any kind of storage dish
(such as CD, dvd) perhaps similar storage medium or their combination.Special, described computer-readable medium
Can also be paper or other be suitably capable of the medium of print routine.Using these media, these programs can be passed through
The mode of electricity gets (for example, optical scanner), can be compiled, be explained and processing in an appropriate manner, then can be by
It stores in computer media.
The realization process of each step is specifically detailed in the function and work of corresponding each unit in above-mentioned apparatus in the above method
Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality
Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with
It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual
The purpose for needing to select some or all of the modules therein to realize the present invention program.Those of ordinary skill in the art are not paying
Out in the case where creative work, it can understand and implement.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.
Claims (12)
1. sound intermediate frequency data processing method is shielded in a kind of throwing, which is characterized in that the method includes the steps:
Run virtual audio playback equipment；
Default audio playback equipment is set by the virtual audio playback equipment, the default audio playback equipment is for playing
Audio data；
In response to throwing screen instruction, capturing the audio data and throwing screen content, the audio data is appended the throwing and shields content
It is sent to receiving end, so that receiving end playing audio data and the throwing shield content.
2. the method according to claim 1, wherein before the operation virtual audio playback equipment, further includes:
Whether detection transmitting terminal is equipped with virtual audio playback equipment；
If transmitting terminal does not install virtual audio playback equipment, virtual audio playback equipment is installed.
3. the method according to claim 1, wherein described be set as defaulting by the virtual audio playback equipment
Audio-frequence player device captures the audio data, comprising:
Call the first api interface, audio data be passed to the virtual audio playback equipment so that physical audio playback equipment without
Method obtains the audio data；
The second api interface is written in the audio data that virtual audio playback equipment will acquire；
Second api interface is called to capture the audio data.
4. the method according to claim 1, wherein described be set as defaulting by the virtual audio playback equipment
Audio-frequence player device executes after the instruction for receiving receiving end broadcasting audio.
5. according to the method described in claim 4, it is characterized in that, the method also includes steps:
If receiving the instruction that transmitting terminal plays audio, default audio is set by the physical audio playback equipment of transmitting terminal and is played
Screen content is thrown in equipment, capture, and throwing screen content is sent to receiving end, the audio data is not sent to receiving end.
6. according to the method described in claim 5, it is characterized in that, the receiving end plays the instruction of audio, in the needle of displaying
Execution when being triggered to the playback interface of receiving end；
The transmitting terminal plays the instruction of audio, the execution when showing that the playback interface for transmitting terminal is triggered.
7. sound intermediate frequency data processing method is shielded in a kind of throwing, which is characterized in that the method includes the steps:
Receive the audio data and throw screen content that transmitting terminal is sent；
By local terminal physical audio playback equipment playing audio data and throw screen content, wherein the audio data is being sent
End is played by virtual audio playback equipment, so that the physical audio playback equipment of the transmitting terminal can not obtain the audio number
According to.
8. sound intermediate frequency data processing equipment is shielded in a kind of throwing characterized by comprising
Processing module, for running virtual audio playback equipment；Default audio is set by the virtual audio playback equipment to broadcast
Equipment is put, the default audio playback equipment is used for playing audio-fequency data；
Communication module, in response to throwing screen instruction, capturing the audio data and throwing screen content, the audio data to be appended
The throwing screen content is sent to receiving end, so that receiving end playing audio data and the throwing shield content.
9. sound intermediate frequency data processing equipment is shielded in a kind of throwing characterized by comprising
Communication module, for receiving the audio data of transmitting terminal transmission and throwing screen content；
Processing module, for by local terminal physical audio playback equipment playing audio data and throwing screen content, wherein the sound
Frequency in transmitting terminal by virtual audio playback equipment according to being played, so that the physical audio playback equipment of the transmitting terminal can not obtain
The audio data.
10. a kind of electronic equipment, which is characterized in that the electronic equipment includes: sending ending equipment or peripheral hardware throws screen equipment, described
Electronic equipment includes:
Processor；
The memory of storage processor executable instruction；Wherein, the processor is coupled in the memory, described for reading
The program instruction of memory storage, and in response, execute as claimed in any one of claims 1 to 6 throw at screen sound intermediate frequency data
Operation in reason method.
11. a kind of Intelligent flat characterized by comprising
Processor；
The memory of storage processor executable instruction；Wherein, the processor is coupled in the memory, described for reading
The program instruction of memory storage, and in response, it executes in the throwing screen sound intermediate frequency data processing method as described in right wants 7
Operation.
12. a kind of computer readable storage medium, is stored thereon with program, which is characterized in that the program be executed by processor as
Operation in throwing screen sound intermediate frequency data processing method described in claim 1-7 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810737582.XA CN109032555A (en) | 2018-07-06 | 2018-07-06 | Method and device for processing audio data in screen projection, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810737582.XA CN109032555A (en) | 2018-07-06 | 2018-07-06 | Method and device for processing audio data in screen projection, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109032555A true CN109032555A (en) | 2018-12-18 |
Family
ID=64640559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810737582.XA Pending CN109032555A (en) | 2018-07-06 | 2018-07-06 | Method and device for processing audio data in screen projection, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109032555A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110111613A (en) * | 2019-05-21 | 2019-08-09 | 阔地教育科技有限公司 | Audio-frequency processing method and system based on interactive teaching and learning scene |
| CN110286874A (en) * | 2019-06-28 | 2019-09-27 | 联想(北京)有限公司 | A kind of processing method and electronic equipment |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN111324327A (en) * | 2020-02-20 | 2020-06-23 | 华为技术有限公司 | Screen projection method and terminal equipment |
| CN111475133A (en) * | 2020-04-29 | 2020-07-31 | 广州视源电子科技股份有限公司 | Method, device and equipment for synchronizing sound state and storage medium |
| CN111796794A (en) * | 2020-07-09 | 2020-10-20 | 西安万像电子科技有限公司 | Voice data processing method and system and virtual machine |
| CN111988653A (en) * | 2020-08-25 | 2020-11-24 | 京东方科技集团股份有限公司 | Interaction method, device, equipment and storage medium for multi-video screen projection information |
| CN112512133A (en) * | 2020-11-18 | 2021-03-16 | 努比亚技术有限公司 | Reverse screen-projection audio control method and device and computer readable storage medium |
| WO2021103920A1 (en) * | 2019-11-25 | 2021-06-03 | 华为技术有限公司 | Audio output device switching method and device |
| CN112911383A (en) * | 2021-01-19 | 2021-06-04 | 深圳乐播科技有限公司 | Multipath screen projection method, device and system under local area network |
| CN113542706A (en) * | 2021-06-25 | 2021-10-22 | 深圳乐播科技有限公司 | Screen projection method, device and equipment of treadmill and storage medium |
| CN113746911A (en) * | 2021-08-26 | 2021-12-03 | 科大讯飞股份有限公司 | Audio processing method and related device, electronic equipment and storage medium |
| CN114501126A (en) * | 2021-12-25 | 2022-05-13 | 深圳市广和通无线股份有限公司 | Video playing method, system and storage medium |
| CN115314584A (en) * | 2021-05-07 | 2022-11-08 | 华为技术有限公司 | Audio playing method, device and equipment |
| WO2022267974A1 (en) * | 2021-06-25 | 2022-12-29 | 华为技术有限公司 | Screen projection method and related apparatus |
| EP4224865A4 (en) * | 2021-12-14 | 2023-12-27 | Honor Device Co., Ltd. | Screen projection method and device, and storage medium |
| EP4221198A4 (en) * | 2021-12-08 | 2023-12-27 | Honor Device Co., Ltd. | Screen projection method, device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104935845A (en) * | 2015-05-25 | 2015-09-23 | 深圳创维－Rgb电子有限公司 | Method and system for realizing Bluetooth subwoofer for televisions |
| CN105843579A (en) * | 2015-01-29 | 2016-08-10 | 三星电子株式会社 | Acoustic output device and control method thereof |
| CN107094266A (en) * | 2016-02-18 | 2017-08-25 | 中兴通讯股份有限公司 | Audio and video resources shared method, device, system and network gateway |
| US20170345460A1 (en) * | 2014-04-10 | 2017-11-30 | JBF Interlude 2009 LTD | Systems and methods for creating linear video from branched video |
| CN107995503A (en) * | 2017-11-07 | 2018-05-04 | 西安万像电子科技有限公司 | Audio and video playing method and apparatus |
-
2018
- 2018-07-06 CN CN201810737582.XA patent/CN109032555A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170345460A1 (en) * | 2014-04-10 | 2017-11-30 | JBF Interlude 2009 LTD | Systems and methods for creating linear video from branched video |
| CN105843579A (en) * | 2015-01-29 | 2016-08-10 | 三星电子株式会社 | Acoustic output device and control method thereof |
| CN104935845A (en) * | 2015-05-25 | 2015-09-23 | 深圳创维－Rgb电子有限公司 | Method and system for realizing Bluetooth subwoofer for televisions |
| CN107094266A (en) * | 2016-02-18 | 2017-08-25 | 中兴通讯股份有限公司 | Audio and video resources shared method, device, system and network gateway |
| CN107995503A (en) * | 2017-11-07 | 2018-05-04 | 西安万像电子科技有限公司 | Audio and video playing method and apparatus |
Non-Patent Citations (2)
| Title |
|---|
| MENGK114648: "苹果投屏后游戏打开语音，声音从扬声器传出电脑听不到怎么", 《百度贴吧OBS吧》 * |
| 教育故事2: "怎样实现电脑投屏电视，手机投屏电视", 《百度经验》 * |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110111613A (en) * | 2019-05-21 | 2019-08-09 | 阔地教育科技有限公司 | Audio-frequency processing method and system based on interactive teaching and learning scene |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN110381197B (en) * | 2019-06-27 | 2021-06-15 | 华为技术有限公司 | Method, device and system for processing audio data in many-to-one screen projection |
| CN110286874A (en) * | 2019-06-28 | 2019-09-27 | 联想(北京)有限公司 | A kind of processing method and electronic equipment |
| WO2021103920A1 (en) * | 2019-11-25 | 2021-06-03 | 华为技术有限公司 | Audio output device switching method and device |
| CN111324327A (en) * | 2020-02-20 | 2020-06-23 | 华为技术有限公司 | Screen projection method and terminal equipment |
| CN111324327B (en) * | 2020-02-20 | 2022-03-25 | 华为技术有限公司 | Screen projection method and terminal equipment |
| CN111475133A (en) * | 2020-04-29 | 2020-07-31 | 广州视源电子科技股份有限公司 | Method, device and equipment for synchronizing sound state and storage medium |
| CN111796794B (en) * | 2020-07-09 | 2023-12-22 | 西安万像电子科技有限公司 | Voice data processing method, system and virtual machine |
| CN111796794A (en) * | 2020-07-09 | 2020-10-20 | 西安万像电子科技有限公司 | Voice data processing method and system and virtual machine |
| CN111988653A (en) * | 2020-08-25 | 2020-11-24 | 京东方科技集团股份有限公司 | Interaction method, device, equipment and storage medium for multi-video screen projection information |
| US11924617B2 (en) | 2020-08-25 | 2024-03-05 | Boe Technology Group Co., Ltd. | Method for projecting screen, display device, screen projection terminal, and storage medium |
| CN112512133A (en) * | 2020-11-18 | 2021-03-16 | 努比亚技术有限公司 | Reverse screen-projection audio control method and device and computer readable storage medium |
| CN112512133B (en) * | 2020-11-18 | 2022-04-19 | 努比亚技术有限公司 | Reverse screen-projection audio control method and device and computer readable storage medium |
| CN112911383A (en) * | 2021-01-19 | 2021-06-04 | 深圳乐播科技有限公司 | Multipath screen projection method, device and system under local area network |
| WO2022233237A1 (en) * | 2021-05-07 | 2022-11-10 | 华为技术有限公司 | Audio playing method and apparatus, and device |
| CN115314584A (en) * | 2021-05-07 | 2022-11-08 | 华为技术有限公司 | Audio playing method, device and equipment |
| WO2022267974A1 (en) * | 2021-06-25 | 2022-12-29 | 华为技术有限公司 | Screen projection method and related apparatus |
| CN113542706B (en) * | 2021-06-25 | 2023-06-13 | 深圳乐播科技有限公司 | Screen throwing method, device and equipment of running machine and storage medium |
| CN113542706A (en) * | 2021-06-25 | 2021-10-22 | 深圳乐播科技有限公司 | Screen projection method, device and equipment of treadmill and storage medium |
| CN113746911A (en) * | 2021-08-26 | 2021-12-03 | 科大讯飞股份有限公司 | Audio processing method and related device, electronic equipment and storage medium |
| EP4221198A4 (en) * | 2021-12-08 | 2023-12-27 | Honor Device Co., Ltd. | Screen projection method, device, and storage medium |
| EP4224865A4 (en) * | 2021-12-14 | 2023-12-27 | Honor Device Co., Ltd. | Screen projection method and device, and storage medium |
| CN114501126A (en) * | 2021-12-25 | 2022-05-13 | 深圳市广和通无线股份有限公司 | Video playing method, system and storage medium |
| CN114501126B (en) * | 2021-12-25 | 2024-03-15 | 深圳市广和通无线股份有限公司 | Video playing method, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109032555A (en) | Method and device for processing audio data in screen projection, storage medium and electronic equipment | |
| CN104869467B (en) | Information output method, device and system in media play | |
| EP2282543A2 (en) | Audio/video monitoring service using set-top boxes and application servers | |
| CN107483812B (en) | Multi-platform parallel live broadcast method and device | |
| CN103412746B (en) | Media content sharing method and terminal device and content sharing system, content | |
| CN105847939A (en) | Bullet screen play method, bullet screen play device and bullet screen play system | |
| CN108124172B (en) | Cloud projection method, device and system | |
| CN103680551A (en) | Player and method thereof for simultaneously playing multiple videos | |
| CN104169913B (en) | A kind of picture display method and device, terminal device | |
| CN101480019A (en) | Composition of local user interface with remotely generated user interface and media | |
| CN109947387B (en) | Audio acquisition method, audio playing method, system, device and storage medium | |
| CN103945265A (en) | Advertisement processing method and terminal | |
| CN103747204A (en) | Multi-zone remote video monitoring system and method for network intelligent set top box | |
| CN103747326A (en) | Continuous playing method and device for multimedia file | |
| CN107659850A (en) | Media information processing method and device | |
| CN105357574B (en) | A kind of smart television pushes away the method, system and smart television of screen | |
| CN111901695A (en) | Video content interception method, device and equipment and computer storage medium | |
| CN102411488A (en) | Method for displaying images of mobile terminal and mobile terminal | |
| CN114143503A (en) | Video occlusion method and device, computer equipment and readable storage medium | |
| CN108134957A (en) | A kind of throwing screen method, terminal and computer storage media | |
| CN107580264A (en) | Multimedia resource play handling method and device | |
| CN113727125B (en) | Live broadcast room screenshot method, device, system, medium and computer equipment | |
| CN103957446B (en) | Set top box and its control method that support multi-user based on linux uses | |
| CN109194971A (en) | Method and device for generating multimedia file | |
| CN109166165A (en) | A kind of playback method of dynamic picture, terminal and can storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181218 |
|
| RJ01 | Rejection of invention patent application after publication |