WO2022252909A1 - Screen casting method and apparatus in wireless terminal, wireless terminal, and storage medium - Google Patents
Screen casting method and apparatus in wireless terminal, wireless terminal, and storage medium Download PDFInfo
- Publication number
- WO2022252909A1 WO2022252909A1 PCT/CN2022/091090 CN2022091090W WO2022252909A1 WO 2022252909 A1 WO2022252909 A1 WO 2022252909A1 CN 2022091090 W CN2022091090 W CN 2022091090W WO 2022252909 A1 WO2022252909 A1 WO 2022252909A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- audio
- screen projection
- output terminal
- audio output
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 98
- 238000005266 casting Methods 0.000 title abstract 13
- 238000004891 communication Methods 0.000 claims abstract description 83
- 230000004044 response Effects 0.000 claims abstract description 51
- 230000005540 biological transmission Effects 0.000 claims description 110
- 238000012790 confirmation Methods 0.000 claims description 21
- 230000001960 triggered effect Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 50
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 9
- 238000005259 measurement Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 238000000926 separation method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Definitions
- the embodiments of the present application relate to the technical field of screen projection, and in particular, to a screen projection method and device in a wireless terminal, a wireless terminal, and a storage medium.
- Screen projection is a technology that transmits the audio and video data on the terminal side to the screen projection device, so as to display the terminal screen and play the terminal sound through the screen projection device.
- the user can turn on the screen projection function of the mobile phone, and the mobile phone transmits the audio and video data to the TV through the wireless network, so that the screen of the mobile phone is displayed on the TV side, and the sound of the mobile phone is played.
- Embodiments of the present application provide a screen projection method and device in a wireless terminal, a wireless terminal, and a storage medium. Described technical scheme is as follows:
- an embodiment of the present application provides a screen projection method in a wireless terminal, the method comprising:
- the audio output terminal establishes a Bluetooth link with the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, so that the audio output terminal outputs sound based on the audio data ;
- the image data in the screen projection data is transmitted to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- an embodiment of the present application provides a screen projection device, and the device includes:
- a data link establishment module configured to establish a data communication link with the screen projection device in response to the screen projection instruction
- the first transmission module is configured to transmit the audio data in the projection data to the audio output terminal through the Bluetooth link when the audio output terminal and the wireless terminal establish a Bluetooth link, so that the audio output terminal outputting sound based on the audio data;
- the second transmission module is configured to transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- an embodiment of the present application provides a wireless terminal, the wireless terminal includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement The method for projecting a screen in a wireless terminal according to the above aspects.
- an embodiment of the present application provides a computer-readable storage medium, where at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the above-mentioned The screen projection method in the wireless terminal.
- an embodiment of the present application provides a computer program product, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; the Bluetooth chip of the electronic device reads the computer-readable storage medium from the computer-readable storage medium.
- FIG. 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application
- FIG. 2 shows a flow chart of a screen projection method provided by an exemplary embodiment of the present application
- Fig. 3 is an implementation schematic diagram of a screen projection process shown in an exemplary embodiment of the present application.
- Fig. 4 is a flowchart of the audio data transmission process shown in an exemplary embodiment of the present application.
- Fig. 5 is an implementation schematic diagram of a screen projection process shown in another exemplary embodiment of the present application.
- Fig. 6 is an implementation schematic diagram of a handover process shown in an exemplary embodiment of the present application.
- FIG. 7 is a flow chart of an image data and audio data transmission synchronization process shown in an exemplary embodiment of the present application.
- FIG. 8 shows an interactive flowchart of the screen projection process provided by an embodiment of the present application
- FIG. 9 shows a structural block diagram of a screen projection device provided by an embodiment of the present application.
- Fig. 10 shows a structural block diagram of a wireless terminal provided by an exemplary embodiment of the present application.
- FIG. 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application.
- the implementation environment includes a wireless terminal 110 , an audio output terminal 120 and a screen projection device 130 .
- the wireless terminal 110 is an electronic device with bluetooth and screen projection functions.
- the electronic device may be a smart phone, a tablet computer, a personal computer, etc. In FIG. limited.
- the audio output terminal 120 is an electronic device with Bluetooth and audio output functions.
- the electronic device can be a Bluetooth headset, a Bluetooth speaker, etc.
- the audio output terminal 120 is a Bluetooth headset as an example for illustration, but this is not limited .
- the wireless terminal 110 After the wireless terminal 110 establishes a Bluetooth link with the audio output terminal 120, the wireless terminal 110 transmits audio data to the audio output terminal 120 through the first Bluetooth link, and the audio output terminal 120 outputs sound based on the audio data.
- the screen projection device 130 is an electronic device with a display function.
- the electronic device may be a smart TV, a monitor, a personal computer, or a projector, etc.
- the screen projection device 130 is a smart TV as an example for illustration.
- the wireless terminal 110 and the screen projection device 130 are located in the same wireless network.
- the wireless terminal 110 and the screen projection device 130 establish a data communication link through the wireless network, and the screen projection During the process, the wireless terminal 110 transmits screen projection data (picture data and audio data) to the screen projection device 130 through the data communication link, and the screen projection device 130 outputs the screen and outputs the audio through its own speaker.
- the wireless terminal 110 and the screen projection device 130 may also establish a data communication link based on a wired connection.
- the wireless terminal 110 and the screen projection device 130 are connected through a data cable.
- the wireless terminal 110 and the screen projection device 130 establish a data communication link through the data cable, which is not limited in this embodiment.
- the wireless terminal 110 will use the Bluetooth link to The audio data is transmitted to the audio output terminal 120, and the audio output terminal 120 outputs sound based on the audio data.
- the wireless terminal 110 separates audio and video data from the projected data, and on the one hand, transmits the image data to the screen projection device 130 through a data communication link for the screen projection device 130 to output images;
- the audio data is transmitted to the audio output terminal 120 for the audio output terminal 120 to output sound, that is, the audio and video of the wireless terminal can be displayed and played by different devices during the screen projection process.
- the wireless terminal 110 also provides an audio channel switching function. Through this function, the user can switch the audio channel from the audio output terminal 120 to the screen projection device 130 as required, so as to output sound through the screen projection device 130 , or switch the audio path from the screen projection device 130 to the audio output terminal 120 , and then output sound through the audio output terminal 120 .
- the wireless terminal sends the screen projection data (including image data and audio data) to the screen projection device, and the screen projection device performs screen display and sound playback, even if there is a gap between the terminal and the audio output terminal at this time.
- the screen projection device performs screen display and sound playback, even if there is a gap between the terminal and the audio output terminal at this time.
- the wireless terminal can send the screen projection data to the screen projection device, and the screen projection device will display the screen.
- the screen projection device will display the screen.
- sound playback it is also possible to separate audio and video data from the projection data, and then transmit image data to the projection device through the data communication link and transmit audio data to the audio output terminal through the Bluetooth link, so that the projection process can be passed through While the screen projection device is displaying the screen, it can also play sound through the audio output terminal to avoid the impact caused by switching the audio playback source from the audio output terminal to the screen projection device.
- a Bluetooth connection is established between a smartphone and a Bluetooth headset.
- the smartphone transmits audio data to the Bluetooth headset, and the Bluetooth headset plays the audio to avoid causing interference to others.
- the smart phone can establish a data communication link with the smart TV by triggering the screen projection function of the smart phone.
- the sound of the smart phone will be played through the smart TV, and the sound played by the smart TV will cause interference to others.
- the smart phone transmits the image data to the smart TV, and transmits the audio data to the Bluetooth headset, so that the smart TV displays the screen of the mobile phone based on the received image data.
- the earphone plays the sound of the mobile phone based on the received audio data, so as to prevent the external sound from the smart TV from causing interference to others during screen projection.
- FIG. 2 shows a flow chart of a screen projection method in a wireless terminal provided by an exemplary embodiment of the present application.
- the method is used in the wireless terminal 110 in the implementation environment shown in FIG. 1 as an example To illustrate, the method includes:
- Step 201 in response to the screen projection instruction, establish a data communication link with the screen projection device.
- the wireless terminal and the screen projection device in response to the screen projection instruction, establish a wireless data communication link through a wireless network, or, the wireless terminal and the screen projection device establish a wired data communication link through a wired connection.
- the wireless terminal and the screen projection device establish a wireless data communication link through a wireless network, or, the wireless terminal and the screen projection device establish a wired data communication link through a wired connection.
- the following embodiments are described by taking a wireless data communication link as an example.
- the wireless terminal when there are multiple candidate screen projection devices in the wireless network, when receiving a screen projection instruction, displays the device identification of each candidate screen projection device, and when receiving a device selection operation, communicates with the selected The projection device establishes a data communication link.
- the wireless terminal uses the image data of its own display screen and the audio data of its own voice as the projection data, and the data communication link is used to transmit the projection data (all or part of the projection data).
- Step 202 when the audio output terminal establishes a bluetooth link with the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the bluetooth link, so that the audio output terminal outputs sound based on the audio data.
- the wireless terminal when a data communication link is established between the wireless terminal and the screen projection device, it is detected whether a Bluetooth link is established with the audio output terminal, and if no Bluetooth link is established, the wireless terminal adopts the conventional The screen projection process transmits the screen projection data including audio and video data to the screen projection device; if a Bluetooth link is established, the wireless terminal separates the audio and video data from the projection data.
- the Bluetooth link between the wireless terminal and the audio output terminal can be established before the screen projection, or can be established during the screen projection process (if the Bluetooth link is not established during the screen projection process, the screen projection device will display the wireless terminal screen and play terminal sound).
- the wireless terminal transmits the audio data to the audio output terminal through the bluetooth link, so that the terminal sound can continue to be played through the audio output terminal during the screen projection process.
- a Bluetooth link is established between the mobile phone 31 and the Bluetooth headset 32, and audio data is transmitted to the Bluetooth headset 32 through the Bluetooth link; and after the screen projection, the mobile phone 31 Separate the screen projection data from audio and video, and continue to transmit the audio data to the Bluetooth headset 32 through the Bluetooth link with the Bluetooth headset 32 .
- Step 203 transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- the wireless terminal transmits audio data to the audio output terminal, it transmits image data to the screen projection device through the established data communication link, and the screen projection device analyzes the image data and displays the terminal screen.
- steps 202 and 203 are executed synchronously, so as to ensure that the output sound of the audio output terminal and the image output by the screen projection device are kept in sync.
- the mobile phone 31 transmits the image data to the smart TV 33 , and the smart TV 33 and the mobile phone 31 synchronously display the picture of the mobile phone.
- the sound of the wireless terminal is played through the audio output terminal before and after screen projection, so as to avoid interference to others during the screen projection process due to the terminal sound being directly released through the screen projection device during the screen projection process.
- the wireless terminal during the process of the wireless terminal projecting the screen to the screen projection device, if the wireless terminal establishes a Bluetooth link with the audio output terminal, the wireless terminal performs the image data and audio data in the projection data. Separation, and transmit audio data to the audio output terminal through the Bluetooth link, and transmit image data through the data communication link with the screen projection device, so as to realize the separation of screen display and sound playback devices during the screen projection process; this application is implemented
- the degree of freedom of audio playback during the screen projection process can avoid the impact caused by the switching of audio playback sources during the screen projection process.
- the method before transmitting the audio data in the projection data to the audio output terminal through the Bluetooth link, the method includes:
- the image data and the audio data are transmitted synchronously.
- the image data and audio data are transmitted synchronously, including:
- Transmission synchronization of image data and audio data is performed based on a transmission time difference.
- the Bluetooth link when a Bluetooth link is established between the audio output terminal and the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, including:
- the first switching prompt is used to confirm whether to output sound through the audio output terminal
- audio data is transmitted to the audio output terminal through the Bluetooth link.
- the method further includes:
- image data and audio data are transmitted to the screen projection device through the data communication link.
- the Bluetooth link is established before receiving the screen projection instruction
- the audio output terminal establishes a bluetooth link with the wireless terminal, obtain the device status of the audio output terminal;
- the audio data is transmitted to the audio output terminal through a Bluetooth link.
- the method also includes:
- image data and audio data are transmitted to the screen projection device through the data communication link.
- the image data and audio data are transmitted to the projection device through a data communication link, including:
- a switching instruction is triggered, and the image data and audio data are transmitted to the screen projection device through the data communication link.
- the image data and audio data are transmitted to the projection device through a data communication link, including:
- the second switching prompt is displayed, and the second switching prompt is used to confirm whether to output sound through the screen projection device;
- the switching instruction is triggered, and the image data and audio data are transmitted to the screen projection device through the data communication link.
- the method further includes:
- a third switching prompt is displayed, and the third switching prompt is used to confirm whether to output sound through the audio output terminal;
- the audio data is transmitted to the audio output terminal through the Bluetooth link.
- the wireless terminal before performing screen projection, has established a Bluetooth link with the audio output terminal (that is, the Bluetooth link is established before receiving the screen projection instruction), and transmits data to the audio output terminal through the Bluetooth link. Transmit audio data.
- the wireless terminal in response to the screen projection command, the wireless terminal separates audio and video data for the screen projection data, so that the audio output terminal can continue to play the terminal sound during the screen projection process.
- the wireless terminal establishes a Bluetooth connection with the audio output terminal
- the user may not use the audio output terminal.
- the terminal obtains the device status of the audio output terminal, and transmits audio data to the audio output terminal through the Bluetooth link when the audio output terminal is in use. If the audio output terminal is not in use, the terminal transmits screen projection data including audio and video data to the screen projection device through the data communication link.
- the device status is detected by the audio output terminal through its own sensor, and reported to the wireless terminal through the Bluetooth link.
- the audio output terminal is a bluetooth earphone
- the bluetooth earphone determines the attitude of the earphone through the built-in sensor, and when the attitude of the earphone is in the ear state, it is determined that it is in the use state.
- the wireless terminal determines whether to perform separate transmission of audio data and image data based on the device status of the audio output terminal, so as to avoid playing the terminal sound through the audio output terminal when the audio output terminal is not in use, resulting in the need for manual switching again Audio playback source (manually switch to the screen mirroring device) problem.
- the wireless terminal before the screen projection, does not establish a Bluetooth link with the audio output terminal. If the screen projection is performed at this time, both image data and audio data will be transmitted to the screen projection device. Correspondingly, the screen projection device displays the terminal screen and plays the terminal sound. If the wireless terminal establishes a Bluetooth connection to the audio output terminal during screen projection, the terminal can determine whether to play the terminal sound through the audio output terminal according to user requirements. As shown in FIG. 4, the above step 202 may include the following steps.
- Step 202A establishing a Bluetooth link with the audio output terminal.
- the wireless terminal when a Bluetooth connection instruction is received, the wireless terminal establishes a Bluetooth link with the audio output terminal.
- the audio output terminal may be a Bluetooth device paired with the wireless terminal for the first time, or a Bluetooth device previously paired with the wireless terminal.
- step 202B a first switching prompt is displayed, and the first switching prompt is used to confirm whether to output sound through the audio output terminal.
- the wireless terminal When detecting that a Bluetooth connection is established with the audio output terminal during screen projection, in order to determine whether the audio needs to be switched from the screen projection device to the audio output terminal, the wireless terminal displays a first switching prompt to prompt the user to confirm whether to play through the audio output terminal terminal sound.
- the wireless terminal determines that the device for playing the terminal sound needs to be switched, and performs step 202C; if a cancel instruction is received, the wireless terminal determines to continue playing the terminal sound through the screen projection device.
- the mobile phone 31 transmits screen projection data to the TV 33 , and the TV 33 displays the screen of the mobile phone according to the image data therein, and plays the sound of the mobile phone according to the audio data therein.
- the mobile phone 31 establishes a Bluetooth connection with the Bluetooth headset 32
- the mobile phone 31 displays a first switching prompt 311, prompting whether to switch the Bluetooth headset 32 to play the mobile phone sound.
- Step 202C in response to the confirmation instruction, transmit the audio data to the audio output terminal through the Bluetooth link.
- the terminal When receiving the confirmation instruction, the terminal will separate the audio and video data from the projected screen data, and transmit the audio data to the audio output terminal through the Bluetooth link for playback by the audio output terminal.
- the confirmation instruction is triggered by a confirmation operation, and the confirmation operation is received through a wireless terminal (such as clicking a confirmation option), or is received through an audio output terminal (such as tapping a Bluetooth headset).
- the mobile phone 31 sends audio data to the Bluetooth earphone 32 through the Bluetooth link, thereby playing the sound of the mobile phone through the Bluetooth earphone 32 .
- the wireless terminal continues to transmit image data and audio data to the screen projection device through the data communication link.
- the user can switch the audio playback source of the phone's voice as needed during the screen projection process.
- the wireless terminal in response to the switching instruction, transmits image data and audio data to the screen projection device through the data communication link, so that the screen projection device synchronously plays the terminal sound while displaying the terminal screen.
- the terminal displays the audio channel switching interface during the screen projection process, and when receiving the audio channel switching operation in the audio channel switching interface, triggers the switching instruction, and sends the audio channel switching instruction to the screen projection device through the data communication link. Transfer image data and audio data.
- the TV 33 first displays the screen of the mobile phone, and plays the sound of the mobile phone through the Bluetooth headset 32; when receiving the switching instruction, the mobile phone 31 stops transmitting audio data to the Bluetooth headset 32, and The screen projection data including image data and audio data is transmitted to the TV 33, so that the sound of the mobile phone is played through the built-in speaker of the TV 33.
- the terminal when receiving the switching instruction triggered again, transmits the audio data to the audio output terminal again through the bluetooth link.
- the wireless terminal may prompt the user to switch the audio to the screen projection device.
- the wireless terminal determines the link quality of the Bluetooth link.
- the link quality can be determined by measuring the received signal strength indication (Received Signal Strength Indication, RSSI), transmission rate, transmission delay or packet loss rate of the Bluetooth signal. limited.
- the wireless terminal detects whether the link quality of the Bluetooth link meets the transmission requirements, and if the transmission requirements are met, the audio data will continue to be transmitted through the Bluetooth link; if the transmission requirements are not met, a second switching prompt will be displayed, and the second switching The prompt is used to confirm whether to play the terminal sound through the screen mirroring device.
- the wireless terminal triggers the switching instruction, and transmits the image data and audio data to the screen projection device through the data communication link.
- the transmission requirements may include at least one of the following: RSSI requirements, transmission rate requirements, transmission delay requirements, and packet loss rate requirements.
- RSSI requirements may include at least one of the following: RSSI requirements, transmission rate requirements, transmission delay requirements, and packet loss rate requirements.
- the embodiment of the present application does not limit the specific content of the transmission requirement.
- the wireless terminal when the wireless terminal detects that the packet loss rate of the Bluetooth link with the audio output terminal is greater than a packet loss rate threshold (such as 5%), it is determined that the link quality of the Bluetooth link does not meet the transmission requirements , so as to display a second switching prompt, prompting the user to switch the terminal audio to the screen projection device.
- a packet loss rate threshold such as 5%
- the wireless terminal after switching the audio data transmission path from the Bluetooth link to the data communication link, the wireless terminal continues to monitor the link quality of the Bluetooth link. When the link quality meets the transmission requirements, the wireless terminal displays a third switching prompt for the user to confirm whether to switch the audio data transmission path to the Bluetooth link, so as to play the terminal sound through the audio output terminal again.
- the wireless terminal switches and transmits audio data to the screen projection device because the RSSI of the Bluetooth link is lower than the RSSI threshold, and when the RSSI of the subsequent Bluetooth link is greater than the RSSI threshold, the wireless terminal displays a third switching prompt , prompting the user to play the terminal sound through the audio output terminal again.
- the wireless terminal transmits audio data to the audio output terminal through the Bluetooth link, thereby resuming the playback of the terminal sound at the audio output terminal.
- the wireless terminal switches the transmission link of the audio data, so as to realize the switching of sound playback between the screen projection device and the audio output terminal, which further improves the performance of the screen projection process.
- the freedom of sound playback is
- the wireless terminal monitors the link quality of the Bluetooth link, so as to perform switching prompts based on the link quality.
- the channel quality When the channel quality is restored, it prompts to switch back to the audio output terminal to play the terminal sound, so as to improve the audio playback quality during screen mirroring.
- the wireless terminal is based on the link between the data communication link and the Bluetooth link. State, to synchronize the transmission of image data and audio data, to ensure that in the projection data under the same timestamp, the display time of image data is synchronized with the playback time of audio data.
- the synchronization of the transmission of image data and audio data by the wireless terminal may include the following steps:
- Step 701 determine a first transmission delay of a data communication link and a second transmission delay of a Bluetooth link.
- the wireless terminal sends the first delay measurement instruction to the screen projection device through the data communication link, and the screen projection device receives the first delay measurement instruction After the command, the first response command is sent through the data communication link.
- the wireless terminal determines the first transmission delay of the data communication link based on the time interval between the first delay measurement instruction and the first response instruction.
- the wireless terminal sends the second delay measurement instruction to the audio output terminal through the Bluetooth link, and the audio output terminal sends the second response instruction through the Bluetooth link after receiving the second delay measurement instruction.
- the wireless terminal determines the second transmission delay of the Bluetooth link based on the time interval between the second delay measurement instruction and the second response instruction.
- the first transmission delay of the data communication link is (t2-t1)/2;
- the sending time of the second delay measurement command is t1', and the receiving time of the second response command is t2', the second transmission delay of the Bluetooth link is (t2'-t1')/2.
- Step 702 Determine a transmission time difference based on the first transmission delay and the second transmission delay.
- the wireless terminal determines the difference between the first transmission delay and the second transmission delay as the transmission time difference.
- the transmission time difference is (t2-t1)/2-(t2'-t1')/2.
- Step 703 Synchronize the transmission of the image data and the audio data based on the transmission time difference.
- the wireless terminal can delay the transmission of image data or audio based on the transmission time difference, so as to use the delay to offset the timing difference caused by the transmission of audio and video data in different links, ensuring that the projection device Synchronization of image decoding in the middle and audio decoding in the audio output terminal. For example, when the transmission time difference is 20ms (the transmission delay of the data communication link is higher than the transmission delay of the Bluetooth link), the wireless terminal delays sending audio data to the audio output terminal by 20ms.
- the wireless terminal when the terminal screen is displayed through the screen projection device, and the terminal sound is played through the audio output terminal, the wireless terminal synchronizes the transmission of image data and audio data based on the transmission time difference between the data communication link and the Bluetooth link. Improved the synchronization of audio and video during screencasting.
- Step 801 the wireless terminal establishes a bluetooth link with the audio output terminal.
- Step 802 the wireless terminal transmits audio data to the audio output terminal through the Bluetooth link.
- Step 803 the audio output terminal outputs sound based on the audio data.
- Step 804 in response to the screen projection instruction, the wireless terminal establishes a data communication link with the screen projection device.
- Step 805 the wireless terminal synchronizes the transmission of the image data and audio data in the screen projection data based on the link states of the data communication link and the Bluetooth link.
- Step 806 the wireless terminal transmits the audio data in the projection data to the audio output terminal through the bluetooth link.
- Step 807 the audio output terminal outputs sound based on the audio data.
- Step 808 the wireless terminal transmits the image data in the screen projection data to the screen projection device through the data communication link.
- Step 809 the screen projection device outputs a picture based on the image data.
- Step 810 in response to the switching instruction, the wireless terminal transmits image data and audio data to the screen projection device through the data communication link.
- Step 811 the screen projection device outputs a picture based on the image data, and outputs a sound based on the audio data.
- the screen projection device and the audio output terminal are independent of each other, and there is no data communication.
- the wireless terminal can use the solutions provided in the above embodiments to realize the screen projection; when the screen projection device has the Bluetooth function, the wireless terminal and the audio output terminal establish In the case of a Bluetooth link, the wireless terminal sends a Bluetooth link establishment request to the screen projection device, so that the screen projection device establishes a second Bluetooth link with the audio output terminal based on the Bluetooth link establishment request.
- the wireless terminal transmits the screen projection data to the screen projection device through the data communication link, and the screen projection device displays the terminal screen based on the image data, and transmits the screen projection data to the audio output terminal through the second Bluetooth link with the audio output terminal.
- the audio data is transmitted, and then the audio output terminal plays the terminal sound based on the audio data.
- the screen projection device when the audio data is transmitted to the audio output terminal through the screen projection device, the screen projection device needs to determine the transmission delay of the second Bluetooth link with the audio output terminal, so as to process the image data and audio data based on the transmission delay. Transmission is synchronized. For the process of determining the transmission delay and performing transmission synchronization based on the transmission delay, reference may be made to the above steps 701 to 703, which will not be repeated in this embodiment.
- the wireless terminal in response to the switching instruction, sends a switch request to the screen projection device, so that the screen projection device stops transmitting audio data to the audio output terminal through the second Bluetooth link, and the screen projection device transmits audio data based on the audio output. Data output sound.
- the wireless terminal in response to the screen projection end instruction, sends a screen projection end request to the screen projection device, so that the screen projection device disconnects the data communication link and the second Bluetooth link with the audio output terminal based on the screen projection end request road.
- the screen projection device will also send the Bluetooth information of the audio output terminal to the wireless terminal after receiving the screen projection end request, so that the wireless terminal can communicate with the audio output terminal based on the Bluetooth information of the audio output terminal.
- the audio output terminal re-establishes the Bluetooth link to ensure the continuity of audio playback at the audio output terminal before and after the end of screen projection.
- the steps with the wireless terminal as the execution subject can be independently implemented as a screen projection method on the wireless terminal side, and the steps with the screen projection device as the execution subject can be independently implemented as a projection method on the screen projection device side. screen method, this embodiment will not repeat it here.
- FIG. 9 shows a structural block diagram of a screen projection device provided by an embodiment of the present application.
- the device can include:
- a data link establishment module 901 configured to establish a data communication link with the screen projection device in response to the screen projection instruction
- the first transmission module 902 is configured to transmit the audio data in the projection data to the audio output terminal through the Bluetooth link when the audio output terminal establishes a Bluetooth link with the wireless terminal, so that the audio output the terminal outputs sound based on the audio data;
- the second transmission module 903 is configured to transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- the device also includes:
- a synchronization module configured to synchronize the transmission of the image data and the audio data based on the link states of the data communication link and the Bluetooth link.
- the synchronization module is specifically used for:
- the image data and the audio data are transmitted synchronously based on the transmission time difference.
- the first transmission module 902 includes:
- a Bluetooth link establishing unit configured to establish the Bluetooth link with the audio output terminal
- the first display unit is configured to display a first switching prompt, and the first switching prompt is used to confirm whether to output sound through the audio output terminal;
- the first transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link in response to the confirmation instruction.
- the device also includes:
- a third transmission module configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a cancel instruction.
- the Bluetooth link is established before receiving the screen projection instruction
- the first transmission module 902 includes:
- a state acquiring unit configured to acquire the device state of the audio output terminal when the Bluetooth link is established between the audio output terminal and the wireless terminal;
- the second transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link when the audio output terminal is in use.
- the device includes:
- the fourth transmission module is configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a switching instruction.
- the fourth transmission module includes:
- a first display unit configured to display an audio channel switching interface
- a first switching transmission unit configured to trigger the switching instruction in response to an audio channel switching operation in the audio channel switching interface, and transmit the image data and the image data to the screen projection device through the data communication link. described audio data.
- the fourth transmission module includes:
- a link quality determining unit configured to determine the link quality of the Bluetooth link
- the second display unit is configured to display a second switching prompt when the link quality does not meet the transmission requirement, and the second switching prompt is used to confirm whether to output sound through the screen projection device;
- a second switching transmission unit configured to trigger the switching instruction in response to a confirmation operation of the second switching prompt, and transmit the image data and the audio to the screen projection device through the data communication link data.
- the device also includes:
- a prompt module configured to display a third switching prompt when the link quality meets the transmission requirements, and the third switching prompt is used to confirm whether to output sound through the audio output terminal;
- a fifth transmission module configured to transmit the audio data to the audio output terminal through the Bluetooth link in response to a confirmation operation of the third switching prompt.
- the wireless terminal during the process of the wireless terminal projecting the screen to the screen projection device, if the wireless terminal establishes a Bluetooth link with the audio output terminal, the wireless terminal performs the image data and audio data in the projection data. Separation, and transmit audio data to the audio output terminal through the Bluetooth link, and transmit image data through the data communication link with the screen projection device, so as to realize the separation of screen display and sound playback devices during the screen projection process; this application is implemented
- the degree of freedom of audio playback during the screen projection process can avoid the impact caused by the switching of audio playback sources during the screen projection process.
- FIG. 10 shows a structural block diagram of a wireless terminal provided by an exemplary embodiment of the present application.
- the wireless terminal 1000 in this application may include one or more of the following components: a processor 1010 , a memory 1020 and a Bluetooth chip 1030 .
- Processor 1010 may include one or more processing cores.
- the processor 1010 uses various interfaces and lines to connect various parts in the entire wireless terminal 1000, and executes by running or executing instructions, programs, code sets or instruction sets stored in the memory 1020, and calling data stored in the memory 1020.
- the processor 1010 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware.
- DSP Digital Signal Processing
- FPGA Field-Programmable Gate Array
- PLA Programmable Logic Array
- the processor 1010 may integrate one or more of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem, etc.
- a central processing unit Central Processing Unit, CPU
- an image processor Graphics Processing Unit, GPU
- a neural network processor Neural-network Processing Unit, NPU
- the CPU mainly handles the operating system, user interface and application programs, etc.
- the GPU is used to render and draw the content that needs to be displayed on the display screen
- the NPU is used to realize artificial intelligence (Artificial Intelligence, AI) functions
- the modem is used to process wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1010, but may be realized by a single chip.
- the memory 1020 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM).
- the memory 1020 includes a non-transitory computer-readable storage medium.
- the memory 1020 may be used to store instructions, programs, codes, sets of codes or sets of instructions.
- the memory 1020 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following method embodiments; the storage data area can store data created according to the use of the wireless terminal 1000 (such as audio data, phone book) and the like.
- the Bluetooth chip 1030 is a component for realizing the Bluetooth function.
- the Bluetooth chip 1030 includes two parts, Host and Controller (corresponding to different Bluetooth protocol stacks), and the Host and Controller can run on the same chip (single-chip architecture), or can run on different chips (dual-chip architecture).
- the Host runs on the processor
- the Controller runs on the Bluetooth module; or, both the Host and the Controller run on the Bluetooth chip 1030 .
- the structure of the wireless terminal 1000 shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or less components than those shown in the figure, or combine certain components, or a different arrangement of components.
- the wireless terminal 1000 also includes components such as a display screen, a sensor, a speaker, a microphone, a power supply, and a WiFi component, which will not be repeated here.
- the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores at least one program, and at least one program is loaded and executed by a processor to realize the projection in the wireless terminal as described in each of the above embodiments. screen method.
- the embodiment of the present application also provides a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
- the bluetooth chip of the electronic device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the electronic device executes the screen projection method in the wireless terminal provided in various optional implementation manners of the above aspect.
- the "plurality” mentioned herein refers to two or more than two.
- “And/or” describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently.
- the character "/” generally indicates that the contextual objects are an "or” relationship.
- the numbering of the steps described herein only exemplarily shows a possible sequence of execution among the steps. In some other embodiments, the above-mentioned steps may not be executed according to the order of the numbers, such as two different numbers The steps are executed at the same time, or two steps with different numbers are executed in the reverse order as shown in the illustration, which is not limited in this embodiment of the present application.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
A screen casting method and apparatus in a wireless terminal, a wireless terminal, and a storage medium, relating to the technical field of screen casting. The method comprises: in response to a screen casting instruction, establishing a data communication link with a screen casting device (201); when a Bluetooth link is established between an audio output terminal and the wireless terminal, transmitting audio data in screen casting data to the audio output terminal by means of the Bluetooth link, such that the audio output terminal outputs sound on the basis of the audio data (202); and transmitting image data in the screen casting data to the screen casting device by means of the data communication link, such that the screen casting device outputs a picture on the basis of the image data (203). By adopting the solution provided in the embodiments of the present application, audio output terminals except for the screen casting device can also be used for audio playback during a screen casting process, such that the degree of freedom of audio playback during the screen casting process is improved, and the impact caused by switching of the audio playback source during the screen casting process is avoided.
Description
本申请要求于2021年6月3日提交的申请号为202110619639.8、发明名称为“无线终端中的投屏方法、装置、无线终端及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110619639.8 and the invention title "screen projection method, device, wireless terminal and storage medium in wireless terminal" filed on June 3, 2021, the entire contents of which are incorporated by reference incorporated in this application.
本申请实施例涉及投屏技术领域,特别涉及一种无线终端中的投屏方法、装置、无线终端及存储介质。The embodiments of the present application relate to the technical field of screen projection, and in particular, to a screen projection method and device in a wireless terminal, a wireless terminal, and a storage medium.
投屏是一种将终端侧音画数据传输至投屏设备,以此通过投屏设备展示终端画面并播放终端声音的技术。Screen projection is a technology that transmits the audio and video data on the terminal side to the screen projection device, so as to display the terminal screen and play the terminal sound through the screen projection device.
比如,当手机与电视接入同一无线网络时,用户可以开启手机的投屏功能,由手机通过无线网络将音画数据传输至电视,从而在电视侧显示手机侧画面,并播放手机侧声音。For example, when the mobile phone and the TV are connected to the same wireless network, the user can turn on the screen projection function of the mobile phone, and the mobile phone transmits the audio and video data to the TV through the wireless network, so that the screen of the mobile phone is displayed on the TV side, and the sound of the mobile phone is played.
发明内容Contents of the invention
本申请实施例提供了一种无线终端中的投屏方法、装置、无线终端及存储介质。所述技术方案如下:Embodiments of the present application provide a screen projection method and device in a wireless terminal, a wireless terminal, and a storage medium. Described technical scheme is as follows:
一方面,本申请实施例提供了一种无线终端中的投屏方法,所述方法包括:On the one hand, an embodiment of the present application provides a screen projection method in a wireless terminal, the method comprising:
响应于投屏指令,与投屏设备建立数据通信链路;Establishing a data communication link with the screen projection device in response to the screen projection instruction;
在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,以便所述音频输出终端基于所述音频数据输出声音;In the case that the audio output terminal establishes a Bluetooth link with the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, so that the audio output terminal outputs sound based on the audio data ;
通过所述数据通信链路向所述投屏设备传输投屏数据中的图像数据,以便所述投屏设备基于所述图像数据输出画面。The image data in the screen projection data is transmitted to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
另一方面,本申请实施例提供了一种投屏装置,所述装置包括:On the other hand, an embodiment of the present application provides a screen projection device, and the device includes:
数据链路建立模块,用于响应于投屏指令,与投屏设备建立数据通信链路;A data link establishment module, configured to establish a data communication link with the screen projection device in response to the screen projection instruction;
第一传输模块,用于在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,以便所述音频输出终端基于所述音频数据输出声音;The first transmission module is configured to transmit the audio data in the projection data to the audio output terminal through the Bluetooth link when the audio output terminal and the wireless terminal establish a Bluetooth link, so that the audio output terminal outputting sound based on the audio data;
第二传输模块,用于通过所述数据通信链路向所述投屏设备传输投屏数据中的图像数据,以便所述投屏设备基于所述图像数据输出画面。The second transmission module is configured to transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
另一方面,本申请实施例提供了一种无线终端,所述无线终端包括处理器和存储器,所述存储器中存储有至少一段程序,所述至少一段程序由所述处理器加载并执行以实现如上述方面所述的无线终端中的投屏方法。On the other hand, an embodiment of the present application provides a wireless terminal, the wireless terminal includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement The method for projecting a screen in a wireless terminal according to the above aspects.
另一方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一段程序,所述至少一段程序由处理器加载并执行以实现如上述方面所述的无线终端中的投屏方法。On the other hand, an embodiment of the present application provides a computer-readable storage medium, where at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the above-mentioned The screen projection method in the wireless terminal.
另一方面,本申请实施例提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中;电子设备的蓝牙芯片从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该电子设备执行上述方面提供的无线终端中的投屏方法。On the other hand, an embodiment of the present application provides a computer program product, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; the Bluetooth chip of the electronic device reads the computer-readable storage medium from the computer-readable storage medium. Computer instructions, the processor executes the computer instructions, so that the electronic device executes the screen projection method in the wireless terminal provided in the above aspect.
图1示出了本申请一个示例性实施例提供的实施环境的示意图;FIG. 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;
图2示出了本申请一个示例性实施例提供的投屏方法的流程图;FIG. 2 shows a flow chart of a screen projection method provided by an exemplary embodiment of the present application;
图3是本申请一个示例性实施例示出的投屏过程的实施示意图;Fig. 3 is an implementation schematic diagram of a screen projection process shown in an exemplary embodiment of the present application;
图4是本申请一个示例性实施例示出的音频数据传输过程的流程图;Fig. 4 is a flowchart of the audio data transmission process shown in an exemplary embodiment of the present application;
图5是本申请另一个示例性实施例示出的投屏过程的实施示意图;Fig. 5 is an implementation schematic diagram of a screen projection process shown in another exemplary embodiment of the present application;
图6是本申请一个示例性实施例示出的切换过程的实施示意图;Fig. 6 is an implementation schematic diagram of a handover process shown in an exemplary embodiment of the present application;
图7是本申请一个示例性实施例示出的图像数据和音频数据传输同步过程的流程图;FIG. 7 is a flow chart of an image data and audio data transmission synchronization process shown in an exemplary embodiment of the present application;
图8示出了本申请一个实施例提供的投屏过程的交互流程图;FIG. 8 shows an interactive flowchart of the screen projection process provided by an embodiment of the present application;
图9示出了本申请一个实施例提供的投屏装置的结构框图;FIG. 9 shows a structural block diagram of a screen projection device provided by an embodiment of the present application;
图10示出了本申请一个示例性实施例提供的无线终端的结构方框图。Fig. 10 shows a structural block diagram of a wireless terminal provided by an exemplary embodiment of the present application.
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.
请参考图1,其示出了本申请一个示例性实施例提供的实施环境的示意图,该实施环境中包括无线终端110、音频输出终端120以及投屏设备130。Please refer to FIG. 1 , which shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application. The implementation environment includes a wireless terminal 110 , an audio output terminal 120 and a screen projection device 130 .
无线终端110是具有蓝牙以及投屏功能的电子设备,该电子设备可以是智能手机、平板电脑、个人计算机等等,图1中以无线终端110为智能手机为例进行说明,但并不对此构成限定。The wireless terminal 110 is an electronic device with bluetooth and screen projection functions. The electronic device may be a smart phone, a tablet computer, a personal computer, etc. In FIG. limited.
音频输出终端120是具有蓝牙以及音频输出功能的电子设备,该电子设备可以是蓝牙耳机、蓝牙音箱等等,图1中以音频输出终端120为蓝牙耳机为例进行说明,但并不对此构成限定。The audio output terminal 120 is an electronic device with Bluetooth and audio output functions. The electronic device can be a Bluetooth headset, a Bluetooth speaker, etc. In FIG. 1, the audio output terminal 120 is a Bluetooth headset as an example for illustration, but this is not limited .
当无线终端110与音频输出终端120建立蓝牙链路后,无线终端110即通过第一蓝牙链路将音频数据传输至音频输出终端120,由音频输出终端120基于音频数据输出声音。After the wireless terminal 110 establishes a Bluetooth link with the audio output terminal 120, the wireless terminal 110 transmits audio data to the audio output terminal 120 through the first Bluetooth link, and the audio output terminal 120 outputs sound based on the audio data.
投屏设备130是具有显示功能的电子设备,该电子设备可以是智能电视、显示器、个人计算机或投影仪等等,图1中以投屏设备130为智能电视为例进行说明。在一种可能的实施方式中,无线终端110与投屏设备130位于同一无线网络中,当接收到投屏指令时,无线终端110和投屏设备130通过无线网络建立数据通信链路,投屏过程中,无线终端110即通过该数据通信链路向投屏设备130传输投屏数据(画面数据和音频数据),由投屏设备130输出画面,并通过自身的扬声器输出频。The screen projection device 130 is an electronic device with a display function. The electronic device may be a smart TV, a monitor, a personal computer, or a projector, etc. In FIG. 1 , the screen projection device 130 is a smart TV as an example for illustration. In a possible implementation manner, the wireless terminal 110 and the screen projection device 130 are located in the same wireless network. When receiving the screen projection instruction, the wireless terminal 110 and the screen projection device 130 establish a data communication link through the wireless network, and the screen projection During the process, the wireless terminal 110 transmits screen projection data (picture data and audio data) to the screen projection device 130 through the data communication link, and the screen projection device 130 outputs the screen and outputs the audio through its own speaker.
当然,在其他可能的实施方式中,无线终端110和投屏设备130也可以基于有线连接建立数据通信链路,比如,无线终端110与投屏设备130之间通过 数据线相连,当接收到投屏指令时,无线终端110和投屏设备130即通过数据线建立数据通信链路,本实施例对此不作限定。Of course, in other possible implementation manners, the wireless terminal 110 and the screen projection device 130 may also establish a data communication link based on a wired connection. For example, the wireless terminal 110 and the screen projection device 130 are connected through a data cable. When the screen command is issued, the wireless terminal 110 and the screen projection device 130 establish a data communication link through the data cable, which is not limited in this embodiment.
可选的,投屏过程中,若无线终端110与音频输出终端120之间建立有蓝牙链路,无线终端110与音频输出终端120建立蓝牙链路后,无线终端110即通过该蓝牙链路将音频数据传输至音频输出终端120,进而由音频输出终端120基于音频数据输出声音。此时,无线终端110对投屏的数据进行音画数据分离,一方面通过数据通信链路将图像数据传输至投屏设备130,供投屏设备130输出画面,另一方面通过蓝牙链路将音频数据传输至音频输出终端120,供音频输出终端120输出声音,即投屏过程中无线终端的音画可以通过不同设备显示播放。Optionally, during the screen projection process, if a Bluetooth link is established between the wireless terminal 110 and the audio output terminal 120, after the wireless terminal 110 establishes a Bluetooth link with the audio output terminal 120, the wireless terminal 110 will use the Bluetooth link to The audio data is transmitted to the audio output terminal 120, and the audio output terminal 120 outputs sound based on the audio data. At this time, the wireless terminal 110 separates audio and video data from the projected data, and on the one hand, transmits the image data to the screen projection device 130 through a data communication link for the screen projection device 130 to output images; The audio data is transmitted to the audio output terminal 120 for the audio output terminal 120 to output sound, that is, the audio and video of the wireless terminal can be displayed and played by different devices during the screen projection process.
可选的,投屏过程中,无线终端110还提供音频通路切换功能,通过该功能,用户可以根据需求将音频通路由音频输出终端120切换至投屏设备130,从而通过投屏设备130输出声音,或者,将音频通路由投屏设备130切换至音频输出终端120,进而通过音频输出终端120输出声音。Optionally, during the screen projection process, the wireless terminal 110 also provides an audio channel switching function. Through this function, the user can switch the audio channel from the audio output terminal 120 to the screen projection device 130 as required, so as to output sound through the screen projection device 130 , or switch the audio path from the screen projection device 130 to the audio output terminal 120 , and then output sound through the audio output terminal 120 .
相关技术中,投屏过程中,无线终端将投屏数据(包括图像数据和音频数据)发送至投屏设备,由投屏设备进行画面显示以及声音播放,即便此时终端与音频输出终端之间存在蓝牙连接,也不会通过音频输出终端播放终端声音。In related technologies, during the screen projection process, the wireless terminal sends the screen projection data (including image data and audio data) to the screen projection device, and the screen projection device performs screen display and sound playback, even if there is a gap between the terminal and the audio output terminal at this time. There is a bluetooth connection and no terminal sound is played through the audio output terminal.
而本申请实施例提供的方案中,若在无线终端与音频输出终端间存在蓝牙连接的情况下进行投屏,无线终端既能够将投屏数据发送至投屏设备,由投屏设备进行画面显示以及声音播放,也能够对投屏数据进行音画数据分离,进而分别通过数据通信链路向投屏设备传输图像数据以及通过蓝牙链路向音频输出终端传输音频数据,使投屏过程中能够通过投屏设备进行画面显示的同时,还能通过音频输出终端播放声音,避免音频播放源由音频输出终端切换为投屏设备所造成的影响。However, in the solution provided by the embodiment of the present application, if there is a Bluetooth connection between the wireless terminal and the audio output terminal to perform screen projection, the wireless terminal can send the screen projection data to the screen projection device, and the screen projection device will display the screen. As well as sound playback, it is also possible to separate audio and video data from the projection data, and then transmit image data to the projection device through the data communication link and transmit audio data to the audio output terminal through the Bluetooth link, so that the projection process can be passed through While the screen projection device is displaying the screen, it can also play sound through the audio output terminal to avoid the impact caused by switching the audio playback source from the audio output terminal to the screen projection device.
在一种可能的应用场景下,智能手机与蓝牙耳机建立有蓝牙连接,用户使用智能手机观看视频时,智能手机将音频数据传输至蓝牙耳机,由蓝牙耳机进行音频播放,避免对他人造成干扰。当用户要通过智能电视继续观看视频时,可以通过触发智能手机的投屏功能,使智能手机与智能电视建立数据通信链路。In a possible application scenario, a Bluetooth connection is established between a smartphone and a Bluetooth headset. When a user uses the smartphone to watch a video, the smartphone transmits audio data to the Bluetooth headset, and the Bluetooth headset plays the audio to avoid causing interference to others. When the user wants to continue watching videos through the smart TV, the smart phone can establish a data communication link with the smart TV by triggering the screen projection function of the smart phone.
采用相关技术提供的方案,投屏过程中,智能手机的声音将通过智能电视进行播放,而智能电视外放声音会对他人造成干扰。Using the solution provided by related technologies, during the screen projection process, the sound of the smart phone will be played through the smart TV, and the sound played by the smart TV will cause interference to others.
而采用本申请实施例提供的方案,在建立数据通信链路后,智能手机将图像数据传输至智能电视,将音频数据传输至蓝牙耳机,使智能电视基于接收到的图像数据显示手机画面,蓝牙耳机基于接收到的音频数据播放手机声音,避免投屏时智能电视外放声音对他人造成干扰。With the solution provided by the embodiment of the present application, after the data communication link is established, the smart phone transmits the image data to the smart TV, and transmits the audio data to the Bluetooth headset, so that the smart TV displays the screen of the mobile phone based on the received image data. The earphone plays the sound of the mobile phone based on the received audio data, so as to prevent the external sound from the smart TV from causing interference to others during screen projection.
请参考图2,其示出了本申请一个示例性实施例提供的无线终端中的投屏方法的流程图,本实施例以该方法用于图1所示实施环境中的无线终端110为例进行说明,该方法包括:Please refer to FIG. 2, which shows a flow chart of a screen projection method in a wireless terminal provided by an exemplary embodiment of the present application. In this embodiment, the method is used in the wireless terminal 110 in the implementation environment shown in FIG. 1 as an example To illustrate, the method includes:
步骤201,响应于投屏指令,与投屏设备建立数据通信链路。 Step 201, in response to the screen projection instruction, establish a data communication link with the screen projection device.
可选的,响应于投屏指令,无线终端与投屏设备通过无线网络建立无线数 据通信链路,或者,无线终端与投屏设备通过有线连接建立有线数据通信链路。为了方便表述,下述各个实施例以无线数据通信链路为例进行说明。Optionally, in response to the screen projection instruction, the wireless terminal and the screen projection device establish a wireless data communication link through a wireless network, or, the wireless terminal and the screen projection device establish a wired data communication link through a wired connection. For the convenience of description, the following embodiments are described by taking a wireless data communication link as an example.
在一些实施例中,当无线网络中存在多个候选投屏设备时,接收到投屏指令时,无线终端显示各个候选投屏设备的设备标识,并在接收到设备选择操作时,与选中的投屏设备建立数据通信链路。In some embodiments, when there are multiple candidate screen projection devices in the wireless network, when receiving a screen projection instruction, the wireless terminal displays the device identification of each candidate screen projection device, and when receiving a device selection operation, communicates with the selected The projection device establishes a data communication link.
投屏过程中,无线终端将自身显示画面的图像数据以及自身声音的音频数据作为投屏数据,而数据通信链路则用于传输该投屏数据(全部或部分投屏数据)。During the screen projection process, the wireless terminal uses the image data of its own display screen and the audio data of its own voice as the projection data, and the data communication link is used to transmit the projection data (all or part of the projection data).
步骤202,在音频输出终端与无线终端建立有蓝牙链路的情况下,通过蓝牙链路向音频输出终端传输投屏数据中的音频数据,以便音频输出终端基于音频数据输出声音。Step 202, when the audio output terminal establishes a bluetooth link with the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the bluetooth link, so that the audio output terminal outputs sound based on the audio data.
在一种可能的实施方式中,当无线终端与投屏设备之间建立有数据通信链路时,检测是否与音频输出终端建立有蓝牙链路,若未建立蓝牙链路,无线终端则采用常规投屏流程,将包含音画数据的投屏数据传输至投屏设备;若建立有蓝牙链路,无线终端则对投屏数据进行音画数据分离。In a possible implementation, when a data communication link is established between the wireless terminal and the screen projection device, it is detected whether a Bluetooth link is established with the audio output terminal, and if no Bluetooth link is established, the wireless terminal adopts the conventional The screen projection process transmits the screen projection data including audio and video data to the screen projection device; if a Bluetooth link is established, the wireless terminal separates the audio and video data from the projection data.
其中,无线终端与音频输出终端之间的蓝牙链路可以在投屏之前建立,也可以在投屏过程中建立(投屏过程中若未建立蓝牙链路,投屏设备则显示无线终端画面并播放终端声音)。Wherein, the Bluetooth link between the wireless terminal and the audio output terminal can be established before the screen projection, or can be established during the screen projection process (if the Bluetooth link is not established during the screen projection process, the screen projection device will display the wireless terminal screen and play terminal sound).
进一步的,对于分离得到的音频数据,无线终端通过蓝牙链路将音频数据传输至音频输出终端,使投屏过程中能够继续通过音频输出终端播放终端声音。Further, for the separated audio data, the wireless terminal transmits the audio data to the audio output terminal through the bluetooth link, so that the terminal sound can continue to be played through the audio output terminal during the screen projection process.
示意性的,如图3所示,投屏前,手机31与蓝牙耳机32之间建立有蓝牙链路,并通过该蓝牙链路向蓝牙耳机32传输音频数据;而在投屏后,手机31将投屏数据音画分离,继续通过与蓝牙耳机32之间的蓝牙链路,将音频数据传输至蓝牙耳机32。Schematically, as shown in Figure 3, before the screen projection, a Bluetooth link is established between the mobile phone 31 and the Bluetooth headset 32, and audio data is transmitted to the Bluetooth headset 32 through the Bluetooth link; and after the screen projection, the mobile phone 31 Separate the screen projection data from audio and video, and continue to transmit the audio data to the Bluetooth headset 32 through the Bluetooth link with the Bluetooth headset 32 .
步骤203,通过数据通信链路向投屏设备传输投屏数据中的图像数据,以便投屏设备基于图像数据输出画面。 Step 203, transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
无线终端向音频输出终端传输音频数据的同时,通过建立的数据通信链路向投屏设备传输图像数据,由投屏设备对图像数据进行解析,显示终端画面。While the wireless terminal transmits audio data to the audio output terminal, it transmits image data to the screen projection device through the established data communication link, and the screen projection device analyzes the image data and displays the terminal screen.
需要说明的是,上述步骤202和203同步执行,从而保证音频输出终端输出声音与投屏设备输出画面保持同步。It should be noted that the above steps 202 and 203 are executed synchronously, so as to ensure that the output sound of the audio output terminal and the image output by the screen projection device are kept in sync.
示意性的,如图3所示,投屏过程中,手机31将图像数据传输至智能电视33,由智能电视33与手机31同步显示手机画面。Schematically, as shown in FIG. 3 , during the screen projection process, the mobile phone 31 transmits the image data to the smart TV 33 , and the smart TV 33 and the mobile phone 31 synchronously display the picture of the mobile phone.
可见,采用本申请实施例提供的方案,投屏前后无线终端声音均通过音频输出终端播放,避免投屏过程中因直接通过投屏设备外放终端声音,导致投屏过程对他人造成干扰。It can be seen that with the solution provided by the embodiment of the present application, the sound of the wireless terminal is played through the audio output terminal before and after screen projection, so as to avoid interference to others during the screen projection process due to the terminal sound being directly released through the screen projection device during the screen projection process.
综上所述,本申请实施例中,无线终端向投屏设备进行投屏过程中,若无线终端与音频输出终端建立有蓝牙链路,无线终端对投屏数据中的图像数据和音频数据进行分离,并通过蓝牙链路向音频输出终端传输音频数据,通过与投屏设备之间的数据通信链路传输图像数据,从而实现投屏过程中画面显示和声 音播放的设备分离;采用本申请实施例提供的方案,投屏过程中可以继续使用投屏设备以外的音频输出终端进行音频播放,比如,投屏过程中可以继续通过投屏前与无线终端连接的蓝牙耳机进行音频播放,提高了投屏过程中音频播放的自由度,避免投屏过程中因音频播放源切换造成的影响。To sum up, in the embodiment of this application, during the process of the wireless terminal projecting the screen to the screen projection device, if the wireless terminal establishes a Bluetooth link with the audio output terminal, the wireless terminal performs the image data and audio data in the projection data. Separation, and transmit audio data to the audio output terminal through the Bluetooth link, and transmit image data through the data communication link with the screen projection device, so as to realize the separation of screen display and sound playback devices during the screen projection process; this application is implemented In the solution provided by the example, you can continue to use audio output terminals other than the projection device for audio playback during the screen projection process. For example, you can continue to play audio through the Bluetooth headset connected to the wireless terminal before the screen projection process, which improves the projection. The degree of freedom of audio playback during the screen projection process can avoid the impact caused by the switching of audio playback sources during the screen projection process.
可选的,通过蓝牙链路向音频输出终端传输投屏数据中的音频数据之前,方法包括:Optionally, before transmitting the audio data in the projection data to the audio output terminal through the Bluetooth link, the method includes:
基于数据通信链路和蓝牙链路的链路状态,对图像数据和音频数据进行传输同步。Based on the link states of the data communication link and the Bluetooth link, the image data and the audio data are transmitted synchronously.
可选的,基于数据通信链路和蓝牙链路的链路状态,对图像数据和音频数据进行传输同步,包括:Optionally, based on the link status of the data communication link and the Bluetooth link, the image data and audio data are transmitted synchronously, including:
确定数据通信链路的第一传输时延以及蓝牙链路的第二传输时延;determining a first transmission delay of the data communication link and a second transmission delay of the bluetooth link;
基于第一传输时延和第二传输时延,确定传输时间差;determining a transmission time difference based on the first transmission delay and the second transmission delay;
基于传输时间差对图像数据和音频数据进行传输同步。Transmission synchronization of image data and audio data is performed based on a transmission time difference.
可选的,在音频输出终端与无线终端建立有蓝牙链路的情况下,通过蓝牙链路向音频输出终端传输投屏数据中的音频数据,包括:Optionally, when a Bluetooth link is established between the audio output terminal and the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, including:
与音频输出终端建立蓝牙链路;Establish a Bluetooth link with the audio output terminal;
显示第一切换提示,第一切换提示用于确认是否通过音频输出终端输出声音;displaying a first switching prompt, the first switching prompt is used to confirm whether to output sound through the audio output terminal;
响应于确认指令,通过蓝牙链路向音频输出终端传输音频数据。In response to the confirmation command, audio data is transmitted to the audio output terminal through the Bluetooth link.
可选的,显示音频通路切换提示之后,方法还包括:Optionally, after the audio channel switching prompt is displayed, the method further includes:
响应于取消指令,通过数据通信链路向投屏设备传输图像数据和音频数据。In response to the cancel instruction, image data and audio data are transmitted to the screen projection device through the data communication link.
可选的,蓝牙链路在接收到投屏指令之前建立;Optionally, the Bluetooth link is established before receiving the screen projection instruction;
在音频输出终端与无线终端建立有蓝牙链路的情况下,通过蓝牙链路向音频输出终端传输投屏数据中的音频数据,包括:In the case where a Bluetooth link is established between the audio output terminal and the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, including:
在音频输出终端与无线终端建立有蓝牙链路的情况下,获取音频输出终端的设备状态;In the case that the audio output terminal establishes a bluetooth link with the wireless terminal, obtain the device status of the audio output terminal;
在音频输出终端处于使用状态的情况下,通过蓝牙链路向所述音频输出终端传输所述音频数据。When the audio output terminal is in use, the audio data is transmitted to the audio output terminal through a Bluetooth link.
可选的,方法还包括:Optionally, the method also includes:
响应于切换指令,通过数据通信链路向投屏设备传输图像数据和音频数据。In response to the switching instruction, image data and audio data are transmitted to the screen projection device through the data communication link.
可选的,响应于切换指令,通过数据通信链路向投屏设备传输图像数据和音频数据,包括:Optionally, in response to the switching instruction, the image data and audio data are transmitted to the projection device through a data communication link, including:
显示音频通路切换界面;Display the audio channel switching interface;
响应于音频通路切换界面内的音频通路切换操作,触发切换指令,并通过数据通信链路向投屏设备传输图像数据和音频数据。In response to the audio channel switching operation in the audio channel switching interface, a switching instruction is triggered, and the image data and audio data are transmitted to the screen projection device through the data communication link.
可选的,响应于切换指令,通过数据通信链路向投屏设备传输图像数据和音频数据,包括:Optionally, in response to the switching instruction, the image data and audio data are transmitted to the projection device through a data communication link, including:
确定蓝牙链路的链路质量;Determining the link quality of the Bluetooth link;
在链路质量不满足传输需求的情况下,显示第二切换提示,第二切换提示 用于确认是否通过投屏设备输出声音;When the link quality does not meet the transmission requirements, the second switching prompt is displayed, and the second switching prompt is used to confirm whether to output sound through the screen projection device;
响应于对第二切换提示的确认操作,触发切换指令,并通过数据通信链路向投屏设备传输图像数据和音频数据。In response to the confirmation operation of the second switching prompt, the switching instruction is triggered, and the image data and audio data are transmitted to the screen projection device through the data communication link.
可选的,响应于对第二切换提示的确认操作,触发切换指令,并通过数据通信链路向投屏设备传输图像数据和音频数据之后,方法还包括:Optionally, after triggering the switching instruction in response to the confirmation operation of the second switching prompt, and transmitting the image data and audio data to the screen projection device through the data communication link, the method further includes:
在链路质量满足传输需求的情况下,显示第三切换提示,第三切换提示用于确认是否通过音频输出终端输出声音;In the case that the link quality meets the transmission requirement, a third switching prompt is displayed, and the third switching prompt is used to confirm whether to output sound through the audio output terminal;
响应于对第三切换提示的确认操作,通过蓝牙链路向音频输出终端传输音频数据。In response to the confirmation operation of the third switching prompt, the audio data is transmitted to the audio output terminal through the Bluetooth link.
在一种可能的应用场景中,在进行投屏前,无线终端已经与音频输出终端建立蓝牙链路(即蓝牙链路在接收到投屏指令之前建立),并通过蓝牙链路向音频输出终端传输音频数据。当用户在这种情况下触发无线终端进行投屏时,响应于投屏指令,无线终端对投屏数据进行音画数据分离传输,使音频输出终端能够在投屏过程中继续播放终端声音。In a possible application scenario, before performing screen projection, the wireless terminal has established a Bluetooth link with the audio output terminal (that is, the Bluetooth link is established before receiving the screen projection instruction), and transmits data to the audio output terminal through the Bluetooth link. Transmit audio data. When the user triggers the wireless terminal to perform screen projection in this situation, in response to the screen projection command, the wireless terminal separates audio and video data for the screen projection data, so that the audio output terminal can continue to play the terminal sound during the screen projection process.
这种应用场景下,虽然无线终端与音频输出终端建立蓝牙连接,但用户可能并未使用音频输出终端,为了避免在这种情况下继续通过音频输出终端播放终端声音,在一种可能的实施方式中,在无线终端与音频输出终端建立有蓝牙链路的情况下,终端获取音频输出终端的设备状态,并在音频输出终端处于使用状态时,通过蓝牙链路向音频输出终端传输音频数据。若音频输出终端处于未使用状态,终端则通过数据通信链路向投屏设备传输包含音画数据的投屏数据。In this application scenario, although the wireless terminal establishes a Bluetooth connection with the audio output terminal, the user may not use the audio output terminal. In order to avoid continuing to play the terminal sound through the audio output terminal in this case, in a possible implementation In this method, when a Bluetooth link is established between the wireless terminal and the audio output terminal, the terminal obtains the device status of the audio output terminal, and transmits audio data to the audio output terminal through the Bluetooth link when the audio output terminal is in use. If the audio output terminal is not in use, the terminal transmits screen projection data including audio and video data to the screen projection device through the data communication link.
可选的,该设备状态由音频输出终端通过自身的传感器进行检测,并通过蓝牙链路上报至无线终端。比如,当音频输出终端为蓝牙耳机时,蓝牙耳机通过内置传感器确定耳机姿态,并在耳机姿态为入耳状态时,确定处于使用状态。Optionally, the device status is detected by the audio output terminal through its own sensor, and reported to the wireless terminal through the Bluetooth link. For example, when the audio output terminal is a bluetooth earphone, the bluetooth earphone determines the attitude of the earphone through the built-in sensor, and when the attitude of the earphone is in the ear state, it is determined that it is in the use state.
本实施例中,无线终端基于音频输出终端的设备状态,确定是否对音频数据和图像数据进行分离传输,避免在音频输出终端处于未使用状态时通过音频输出终端播放终端声音,导致需要再次手动切换音频播放源(手动切换至投屏设备)的问题。In this embodiment, the wireless terminal determines whether to perform separate transmission of audio data and image data based on the device status of the audio output terminal, so as to avoid playing the terminal sound through the audio output terminal when the audio output terminal is not in use, resulting in the need for manual switching again Audio playback source (manually switch to the screen mirroring device) problem.
在另一种可能的应用场景下,在进行投屏前,无线终端并未与音频输出终端建立蓝牙链路,若在此时进行投屏,图像数据和音频数据都被传输至投屏设备,相应的,投屏设备显示终端画面并播放终端声音。若无线终端在投屏过程中音频输出终端建立蓝牙连接,终端可以根据用户需求,确定是否进行通过音频输出终端播放终端声音。如图4所示,上述步骤202可以包括如下步骤。In another possible application scenario, before the screen projection, the wireless terminal does not establish a Bluetooth link with the audio output terminal. If the screen projection is performed at this time, both image data and audio data will be transmitted to the screen projection device. Correspondingly, the screen projection device displays the terminal screen and plays the terminal sound. If the wireless terminal establishes a Bluetooth connection to the audio output terminal during screen projection, the terminal can determine whether to play the terminal sound through the audio output terminal according to user requirements. As shown in FIG. 4, the above step 202 may include the following steps.
步骤202A,与音频输出终端建立蓝牙链路。 Step 202A, establishing a Bluetooth link with the audio output terminal.
可选的,投屏过程中,当接收到蓝牙连接指令时,无线终端与音频输出终端建立蓝牙链路。其中,该音频输出终端可以是与无线终端首次配对的蓝牙设备,或者,是与无线终端进行过历史配对的蓝牙设备。Optionally, during the screen projection process, when a Bluetooth connection instruction is received, the wireless terminal establishes a Bluetooth link with the audio output terminal. Wherein, the audio output terminal may be a Bluetooth device paired with the wireless terminal for the first time, or a Bluetooth device previously paired with the wireless terminal.
步骤202B,显示第一切换提示,第一切换提示用于确认是否通过音频输出终端输出声音。In step 202B, a first switching prompt is displayed, and the first switching prompt is used to confirm whether to output sound through the audio output terminal.
当检测到在投屏过程中与音频输出终端建立蓝牙连接,为了确定是否需要将音频由投屏设备切换至音频输出终端,无线终端显示第一切换提示,以提示用户确认是否通过音频输出终端播放终端声音。When detecting that a Bluetooth connection is established with the audio output terminal during screen projection, in order to determine whether the audio needs to be switched from the screen projection device to the audio output terminal, the wireless terminal displays a first switching prompt to prompt the user to confirm whether to play through the audio output terminal terminal sound.
若接收到确认指令,无线终端确定需要切换播放终端声音的设备,并执行步骤202C;若接收到取消指令,无线终端确定继续通过投屏设备播放终端声音。If the confirmation instruction is received, the wireless terminal determines that the device for playing the terminal sound needs to be switched, and performs step 202C; if a cancel instruction is received, the wireless terminal determines to continue playing the terminal sound through the screen projection device.
示意性的,如图5所示,投屏过程中,手机31向电视33传输投屏数据,电视33即根据其中的图像数据显示手机画面,根据其中的音频数据播放手机声音。当手机31与蓝牙耳机32建立蓝牙连接时,手机31显示第一切换提示311,提示是否需要切换蓝牙耳机32播放手机声音。Schematically, as shown in FIG. 5 , during the screen projection process, the mobile phone 31 transmits screen projection data to the TV 33 , and the TV 33 displays the screen of the mobile phone according to the image data therein, and plays the sound of the mobile phone according to the audio data therein. When the mobile phone 31 establishes a Bluetooth connection with the Bluetooth headset 32, the mobile phone 31 displays a first switching prompt 311, prompting whether to switch the Bluetooth headset 32 to play the mobile phone sound.
步骤202C,响应于确认指令,通过蓝牙链路向音频输出终端传输音频数据。 Step 202C, in response to the confirmation instruction, transmit the audio data to the audio output terminal through the Bluetooth link.
当接收到确认指令时,终端即对投屏数据进行音画数据分离,并通过蓝牙链路向音频输出终端传输音频数据,供音频输出终端进行播放。其中,该确认指令由确认操作触发,该确认操作通过无线终端(比如点击确认选项)接收,或者,通过音频输出终端(比如敲击蓝牙耳机)接收。When receiving the confirmation instruction, the terminal will separate the audio and video data from the projected screen data, and transmit the audio data to the audio output terminal through the Bluetooth link for playback by the audio output terminal. Wherein, the confirmation instruction is triggered by a confirmation operation, and the confirmation operation is received through a wireless terminal (such as clicking a confirmation option), or is received through an audio output terminal (such as tapping a Bluetooth headset).
示意性的,如图5所示,用户点击确认选项后,手机31即通过该蓝牙链路将音频数据发送至蓝牙耳机32,从而通过蓝牙耳机32播放手机声音。Schematically, as shown in FIG. 5 , after the user clicks the confirmation option, the mobile phone 31 sends audio data to the Bluetooth earphone 32 through the Bluetooth link, thereby playing the sound of the mobile phone through the Bluetooth earphone 32 .
可选的,响应于取消指令,无线终端继续通过数据通信链路向投屏设备传输图像数据和音频数据。Optionally, in response to the cancel instruction, the wireless terminal continues to transmit image data and audio data to the screen projection device through the data communication link.
为了进一步提高投屏过程中音频播放的自由度,投屏过程中用户可以根据需要切换手机声音的音频播放源。在一种可能的实施方式中,响应于切换指令,无线终端通过数据通信链路向投屏设备传输图像数据和音频数据,使投屏设备在显示终端画面的同时,同步播放终端声音。In order to further improve the freedom of audio playback during the screen projection process, the user can switch the audio playback source of the phone's voice as needed during the screen projection process. In a possible implementation manner, in response to the switching instruction, the wireless terminal transmits image data and audio data to the screen projection device through the data communication link, so that the screen projection device synchronously plays the terminal sound while displaying the terminal screen.
在一种可能的实施方式中,投屏过程中终端显示音频通路切换界面,当接收到对音频通路切换界面内的音频通路切换操作时,触发切换指令,并通过数据通信链路向投屏设备传输图像数据和音频数据。In a possible implementation, the terminal displays the audio channel switching interface during the screen projection process, and when receiving the audio channel switching operation in the audio channel switching interface, triggers the switching instruction, and sends the audio channel switching instruction to the screen projection device through the data communication link. Transfer image data and audio data.
示意性的,如图6所示,投屏过程中,电视33首先显示手机画面,并通过蓝牙耳机32播放手机声音;当接收到切换指令时,手机31停止向蓝牙耳机32传输音频数据,并将包含图像数据和音频数据的投屏数据传输至电视33,从而通过电视33的内置扬声器播放手机声音。Schematically, as shown in Figure 6, during the screen projection process, the TV 33 first displays the screen of the mobile phone, and plays the sound of the mobile phone through the Bluetooth headset 32; when receiving the switching instruction, the mobile phone 31 stops transmitting audio data to the Bluetooth headset 32, and The screen projection data including image data and audio data is transmitted to the TV 33, so that the sound of the mobile phone is played through the built-in speaker of the TV 33.
可选的,当接收到再次触发的切换指令,终端则重新通过蓝牙链路向音频输出终端传输音频数据。Optionally, when receiving the switching instruction triggered again, the terminal transmits the audio data to the audio output terminal again through the bluetooth link.
投屏过程中,若无线终端与音频输出终端之间蓝牙链路的链路质量变差(比如终端距离音频输出终端过远,或者蓝牙链路受到干扰)时,音频数据的传输会受到影响,进而影响音频输出终端侧终端声音的播放。这种情况下,为了提高投屏过程中音画同步性,无线终端可以提示用户将音频切换至投屏设备。During the screen projection process, if the link quality of the Bluetooth link between the wireless terminal and the audio output terminal deteriorates (for example, the terminal is too far away from the audio output terminal, or the Bluetooth link is interfered), the transmission of audio data will be affected. This in turn affects the playback of terminal sound on the audio output terminal side. In this case, in order to improve the synchronization of audio and video during screen projection, the wireless terminal may prompt the user to switch the audio to the screen projection device.
在一种可能的实施方式中,投屏过程中,无线终端确定蓝牙链路的链路质量。其中,该链路质量可以通过测量蓝牙信号的接收信号强度指示(Received Signal Strength Indication,RSSI)、传输速率、传输时延或丢包率等方式确定,本实施例对链路质量的衡量标准不作限定。In a possible implementation manner, during the screen projection process, the wireless terminal determines the link quality of the Bluetooth link. Wherein, the link quality can be determined by measuring the received signal strength indication (Received Signal Strength Indication, RSSI), transmission rate, transmission delay or packet loss rate of the Bluetooth signal. limited.
进一步的,无线终端检测蓝牙链路的链路质量是否满足传输需求,若满足传输需求,则继续通过蓝牙链路传输音频数据,若不满足传输需求,则显示第二切换提示,该第二切换提示用于确认是否通过投屏设备播放终端声音。响应于对第二切换提示的确认操作,无线终端触发切换指令,并通过数据通信链路向投屏设备传输图像数据和音频数据。Further, the wireless terminal detects whether the link quality of the Bluetooth link meets the transmission requirements, and if the transmission requirements are met, the audio data will continue to be transmitted through the Bluetooth link; if the transmission requirements are not met, a second switching prompt will be displayed, and the second switching The prompt is used to confirm whether to play the terminal sound through the screen mirroring device. In response to the confirmation operation of the second switching prompt, the wireless terminal triggers the switching instruction, and transmits the image data and audio data to the screen projection device through the data communication link.
可选的,该传输需求可以包括如下至少一种:RSSI需求、传输速率需求、传输时延需求以及丢包率需求。本申请实施例对传输需求的具体内容不作限定。Optionally, the transmission requirements may include at least one of the following: RSSI requirements, transmission rate requirements, transmission delay requirements, and packet loss rate requirements. The embodiment of the present application does not limit the specific content of the transmission requirement.
在一个示意性的例子中,当无线终端检测到与音频输出终端之间蓝牙链路的丢包率大于丢包率阈值(比如5%)时,确定蓝牙链路的链路质量不满足传输需求,从而显示第二切换提示,提示用户将终端音频切换至投屏设备。In an illustrative example, when the wireless terminal detects that the packet loss rate of the Bluetooth link with the audio output terminal is greater than a packet loss rate threshold (such as 5%), it is determined that the link quality of the Bluetooth link does not meet the transmission requirements , so as to display a second switching prompt, prompting the user to switch the terminal audio to the screen projection device.
在一些实施例中,将音频数据的传输通路由蓝牙链路切换至数据通信链路后,无线终端继续监测蓝牙链路的链路质量。当链路质量满足传输需求时,无线终端显示第三切换提示,供用户确认是否将音频数据的传输通路切换至蓝牙链路,从而再次通过音频输出终端播放终端声音。In some embodiments, after switching the audio data transmission path from the Bluetooth link to the data communication link, the wireless terminal continues to monitor the link quality of the Bluetooth link. When the link quality meets the transmission requirements, the wireless terminal displays a third switching prompt for the user to confirm whether to switch the audio data transmission path to the Bluetooth link, so as to play the terminal sound through the audio output terminal again.
在一个示意性的例子中,无线终端因蓝牙链路的RSSI低于RSSI阈值,将音频数据切换传输至投屏设备,当后续蓝牙链路的RSSI大于RSSI阈值时,无线终端显示第三切换提示,提示用户可以重新通过音频输出终端播放终端声音。In an illustrative example, the wireless terminal switches and transmits audio data to the screen projection device because the RSSI of the Bluetooth link is lower than the RSSI threshold, and when the RSSI of the subsequent Bluetooth link is greater than the RSSI threshold, the wireless terminal displays a third switching prompt , prompting the user to play the terminal sound through the audio output terminal again.
响应于对第三切换提示的确认操作,无线终端通过蓝牙链路向音频输出终端传输音频数据,从而恢复音频输出终端处终端声音的播放。In response to the confirmation operation of the third switching prompt, the wireless terminal transmits audio data to the audio output terminal through the Bluetooth link, thereby resuming the playback of the terminal sound at the audio output terminal.
本实施例中,投屏过程中,当接收到切换指令时,无线终端切换音频数据的传输链路,从而在投屏设备以及音频输出终端之间实现声音播放切换,进一步提高了投屏过程中声音播放的自由度。In this embodiment, during the screen projection process, when receiving the switching instruction, the wireless terminal switches the transmission link of the audio data, so as to realize the switching of sound playback between the screen projection device and the audio output terminal, which further improves the performance of the screen projection process. The freedom of sound playback.
此外,本实施例中,无线终端通过监测蓝牙链路的链路质量,从而基于链路质量进行切换提示,在链路质量较差的情况下,提示切换使用投屏设备播放终端声音,在链路质量恢复的情况下,提示切换回音频输出终端播放终端声音,从而提高投屏过程中的音频播放质量。In addition, in this embodiment, the wireless terminal monitors the link quality of the Bluetooth link, so as to perform switching prompts based on the link quality. When the channel quality is restored, it prompts to switch back to the audio output terminal to play the terminal sound, so as to improve the audio playback quality during screen mirroring.
当终端画面和终端声音均通过投屏设备显示和播放时,由于图像数据和音频数据通过同一链路传输至投屏设备,因此投屏设备处的终端画面与终端声音保持同步;而当终端画面由投屏设备显示,终端声音由音频输出终端播放时,由于终端图像数据和音频数据通过不同链路传输,而不同链路之间传输延时可能不同,因此可能会出现音画不同步的问题。When both the terminal picture and the terminal sound are displayed and played through the screen projection device, since the image data and audio data are transmitted to the screen projection device through the same link, the terminal picture at the screen projection device and the terminal sound are kept in sync; and when the terminal screen Displayed by the screen projection device, when the terminal sound is played by the audio output terminal, since the terminal image data and audio data are transmitted through different links, and the transmission delay between different links may be different, there may be a problem of out-of-sync audio and video .
为了提高投屏过程中的音画同步性,在一种可能的实施方式中,投屏过程中,当通过音频输出终端播放终端声音时,无线终端基于数据通信链路和蓝牙链路的链路状态,对图像数据和音频数据进行传输同步,保证同一时间戳下的投屏数据中,图像数据的显示时刻与音频数据的播放时刻同步。In order to improve the synchronization of audio and video during the screen projection process, in a possible implementation manner, during the screen projection process, when the terminal sound is played through the audio output terminal, the wireless terminal is based on the link between the data communication link and the Bluetooth link. State, to synchronize the transmission of image data and audio data, to ensure that in the projection data under the same timestamp, the display time of image data is synchronized with the playback time of audio data.
如图7所示,无线终端对图像数据和音频数据进行传输同步可以包括如下步骤:As shown in Figure 7, the synchronization of the transmission of image data and audio data by the wireless terminal may include the following steps:
步骤701,确定数据通信链路的第一传输时延以及蓝牙链路的第二传输时延。 Step 701, determine a first transmission delay of a data communication link and a second transmission delay of a Bluetooth link.
关于确定链路对应传输时延的具体方式,在一种可能的实施方式中,无线 终端通过数据通信链路向投屏设备发送第一时延测量指令,投屏设备接收到第一时延测量指令后,通过数据通信链路发送第一响应指令。无线终端基于第一时延测量指令以及第一响应指令之间的时间间隔,确定数据通信链路的第一传输时延。Regarding the specific method of determining the transmission delay corresponding to the link, in a possible implementation manner, the wireless terminal sends the first delay measurement instruction to the screen projection device through the data communication link, and the screen projection device receives the first delay measurement instruction After the command, the first response command is sent through the data communication link. The wireless terminal determines the first transmission delay of the data communication link based on the time interval between the first delay measurement instruction and the first response instruction.
类似的,无线终端通过蓝牙链路向音频输出终端发送第二时延测量指令,音频输出终端接收到第二时延测量指令后,通过蓝牙链路发送第二响应指令。无线终端基于第二时延测量指令以及第二响应指令之间的时间间隔,确定蓝牙链路的第二传输时延。Similarly, the wireless terminal sends the second delay measurement instruction to the audio output terminal through the Bluetooth link, and the audio output terminal sends the second response instruction through the Bluetooth link after receiving the second delay measurement instruction. The wireless terminal determines the second transmission delay of the Bluetooth link based on the time interval between the second delay measurement instruction and the second response instruction.
示意性的,当第一时延测量指令的发送时刻为t1,第一响应指令的接收时刻为t2时,数据通信链路的第一传输时延即为(t2-t1)/2;当第二时延测量指令的发送时刻为t1’,第二响应指令的接收时刻为t2’时,蓝牙链路的第二传输时延即为(t2’-t1’)/2。Schematically, when the sending time of the first delay measurement command is t1, and the receiving time of the first response command is t2, the first transmission delay of the data communication link is (t2-t1)/2; When the sending time of the second delay measurement command is t1', and the receiving time of the second response command is t2', the second transmission delay of the Bluetooth link is (t2'-t1')/2.
步骤702,基于第一传输时延和第二传输时延,确定传输时间差。Step 702: Determine a transmission time difference based on the first transmission delay and the second transmission delay.
进一步的,无线终端将第一传输时延与第二传输时延的差值确定为传输时间差。Further, the wireless terminal determines the difference between the first transmission delay and the second transmission delay as the transmission time difference.
结合上述步骤中的示例,该传输时间差即为(t2-t1)/2-(t2’-t1’)/2。Combining the examples in the above steps, the transmission time difference is (t2-t1)/2-(t2'-t1')/2.
步骤703,基于传输时间差对图像数据和音频数据进行传输同步。Step 703: Synchronize the transmission of the image data and the audio data based on the transmission time difference.
在一种可能的实施方式中,无线终端可以基于传输时间差对图像数据或音频进行延迟传输处理,从而利用该延迟抵消音画数据在不同链路中传输所造成的先后时序差异,保证投屏设备中图像解码与音频输出终端中音频解码的同步性。比如,当传输时间差为20ms时(数据通信链路的传输时延高于蓝牙链路的传输时延),无线终端即延后20ms向音频输出终端发送音频数据。In a possible implementation, the wireless terminal can delay the transmission of image data or audio based on the transmission time difference, so as to use the delay to offset the timing difference caused by the transmission of audio and video data in different links, ensuring that the projection device Synchronization of image decoding in the middle and audio decoding in the audio output terminal. For example, when the transmission time difference is 20ms (the transmission delay of the data communication link is higher than the transmission delay of the Bluetooth link), the wireless terminal delays sending audio data to the audio output terminal by 20ms.
本实施例中,当通过投屏设备显示终端画面,通过音频输出终端播放终端声音时,无线终端基于数据通信链路以及蓝牙链路之间的传输时间差,对图像数据和音频数据进行传输同步,提高了投屏过程中音画的同步性。In this embodiment, when the terminal screen is displayed through the screen projection device, and the terminal sound is played through the audio output terminal, the wireless terminal synchronizes the transmission of image data and audio data based on the transmission time difference between the data communication link and the Bluetooth link. Improved the synchronization of audio and video during screencasting.
在一个示例性的实施例中,如图8所示,无线终端通过投屏设备和音频输出终端实现投屏时包括如下步骤。In an exemplary embodiment, as shown in FIG. 8 , when a wireless terminal realizes screen projection through a screen projection device and an audio output terminal, the following steps are included.
步骤801,无线终端与音频输出终端建立蓝牙链路。Step 801, the wireless terminal establishes a bluetooth link with the audio output terminal.
步骤802,无线终端通过蓝牙链路向音频输出终端传输音频数据。Step 802, the wireless terminal transmits audio data to the audio output terminal through the Bluetooth link.
步骤803,音频输出终端基于音频数据输出声音。Step 803, the audio output terminal outputs sound based on the audio data.
步骤804,响应于投屏指令,无线终端与投屏设备建立数据通信链路。Step 804, in response to the screen projection instruction, the wireless terminal establishes a data communication link with the screen projection device.
步骤805,无线终端基于数据通信链路和蓝牙链路的链路状态,对投屏数据中的图像数据和音频数据进行传输同步。Step 805, the wireless terminal synchronizes the transmission of the image data and audio data in the screen projection data based on the link states of the data communication link and the Bluetooth link.
步骤806,无线终端通过蓝牙链路向音频输出终端传输投屏数据中的音频数据。Step 806, the wireless terminal transmits the audio data in the projection data to the audio output terminal through the bluetooth link.
步骤807,音频输出终端基于音频数据输出声音。Step 807, the audio output terminal outputs sound based on the audio data.
步骤808,无线终端通过数据通信链路向投屏设备传输投屏数据中的图像数据。Step 808, the wireless terminal transmits the image data in the screen projection data to the screen projection device through the data communication link.
步骤809,投屏设备基于图像数据输出画面。Step 809, the screen projection device outputs a picture based on the image data.
步骤810,响应于切换指令,无线终端通过数据通信链路向投屏设备传输图像数据和音频数据。Step 810, in response to the switching instruction, the wireless terminal transmits image data and audio data to the screen projection device through the data communication link.
步骤811,投屏设备基于图像数据输出画面,并基于音频数据输出声音。Step 811, the screen projection device outputs a picture based on the image data, and outputs a sound based on the audio data.
上述各个实施例中,投屏设备与音频输出终端之间相互独立,并不存在数据通信。在一种可能的实施方式中,当投屏设备不具备蓝牙功能时,无线终端可以采用上述实施例提供的方案实现投屏;当投屏设备具有蓝牙功能时,在无线终端与音频输出终端建立有蓝牙链路的情况下,无线终端向投屏设备发送蓝牙链路建立请求,以便投屏设备基于蓝牙链路建立请求与音频输出终端建立第二蓝牙链路。投屏过程中,无线终端通过数据通信链路向投屏设备传输投屏数据,投屏设备则基于图像数据显示终端画面,并通过与音频输出终端之间的第二蓝牙链路向音频输出终端传输音频数据,进而由音频输出终端基于音频数据播放终端声音。In each of the foregoing embodiments, the screen projection device and the audio output terminal are independent of each other, and there is no data communication. In a possible implementation manner, when the screen projection device does not have the Bluetooth function, the wireless terminal can use the solutions provided in the above embodiments to realize the screen projection; when the screen projection device has the Bluetooth function, the wireless terminal and the audio output terminal establish In the case of a Bluetooth link, the wireless terminal sends a Bluetooth link establishment request to the screen projection device, so that the screen projection device establishes a second Bluetooth link with the audio output terminal based on the Bluetooth link establishment request. During the screen projection process, the wireless terminal transmits the screen projection data to the screen projection device through the data communication link, and the screen projection device displays the terminal screen based on the image data, and transmits the screen projection data to the audio output terminal through the second Bluetooth link with the audio output terminal. The audio data is transmitted, and then the audio output terminal plays the terminal sound based on the audio data.
相应的,当通过投屏设备向音频输出终端传输音频数据时,投屏设备需要确定与音频输出终端间第二蓝牙链路的传输时延,从而基于该传输时延对图像数据和音频数据进行传输同步。其中,确定传输时延以及基于传输时延进行传输同步的过程可以参考上述步骤701至703,本实施例在此不再赘述。Correspondingly, when the audio data is transmitted to the audio output terminal through the screen projection device, the screen projection device needs to determine the transmission delay of the second Bluetooth link with the audio output terminal, so as to process the image data and audio data based on the transmission delay. Transmission is synchronized. For the process of determining the transmission delay and performing transmission synchronization based on the transmission delay, reference may be made to the above steps 701 to 703, which will not be repeated in this embodiment.
可选的,投屏过程中,响应于切换指令,无线终端向投屏设备发送切换请求,以便投屏设备停止通过第二蓝牙链路向音频输出终端传输音频数据,并由投屏设备基于音频数据输出声音。Optionally, during the screen projection process, in response to the switching instruction, the wireless terminal sends a switch request to the screen projection device, so that the screen projection device stops transmitting audio data to the audio output terminal through the second Bluetooth link, and the screen projection device transmits audio data based on the audio output. Data output sound.
可选的,响应于投屏结束指令,无线终端向投屏设备发送投屏结束请求,以便投屏设备基于投屏结束请求断开数据通信链路以及与音频输出终端之间的第二蓝牙链路。Optionally, in response to the screen projection end instruction, the wireless terminal sends a screen projection end request to the screen projection device, so that the screen projection device disconnects the data communication link and the second Bluetooth link with the audio output terminal based on the screen projection end request road.
同时,在音频输出终端支持单蓝牙链路的情况下,投屏设备接收到投屏结束请求后,还会向无线终端发送音频输出终端的蓝牙信息,以便无线终端基于音频输出终端的蓝牙信息与音频输出终端重新建立蓝牙链路,保证投屏结束前后音频输出终端处音频播放的连续性。At the same time, when the audio output terminal supports a single Bluetooth link, the screen projection device will also send the Bluetooth information of the audio output terminal to the wireless terminal after receiving the screen projection end request, so that the wireless terminal can communicate with the audio output terminal based on the Bluetooth information of the audio output terminal. The audio output terminal re-establishes the Bluetooth link to ensure the continuity of audio playback at the audio output terminal before and after the end of screen projection.
需要说明的是,上述各个实施例中,以无线终端为执行主体的步骤可以单独实现成为无线终端侧的投屏方法,以投屏设备为执行主体的步骤可以单独实现成为投屏设备侧的投屏方法,本实施例在此不做赘述。It should be noted that, in each of the above-mentioned embodiments, the steps with the wireless terminal as the execution subject can be independently implemented as a screen projection method on the wireless terminal side, and the steps with the screen projection device as the execution subject can be independently implemented as a projection method on the screen projection device side. screen method, this embodiment will not repeat it here.
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
请参考图9,其示出了本申请一个实施例提供的投屏装置的结构框图。该装置可以包括:Please refer to FIG. 9 , which shows a structural block diagram of a screen projection device provided by an embodiment of the present application. The device can include:
数据链路建立模块901,用于响应于投屏指令,与投屏设备建立数据通信链路;A data link establishment module 901, configured to establish a data communication link with the screen projection device in response to the screen projection instruction;
第一传输模块902,用于在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,以便所述音频输出终端基于所述音频数据输出声音;The first transmission module 902 is configured to transmit the audio data in the projection data to the audio output terminal through the Bluetooth link when the audio output terminal establishes a Bluetooth link with the wireless terminal, so that the audio output the terminal outputs sound based on the audio data;
第二传输模块903,用于通过所述数据通信链路向所述投屏设备传输投屏数据中的图像数据,以便所述投屏设备基于所述图像数据输出画面。The second transmission module 903 is configured to transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
可选的,所述装置还包括:Optionally, the device also includes:
同步模块,用于基于所述数据通信链路和所述蓝牙链路的链路状态,对所述图像数据和所述音频数据进行传输同步。A synchronization module, configured to synchronize the transmission of the image data and the audio data based on the link states of the data communication link and the Bluetooth link.
可选的,所述同步模块,具体用于:Optionally, the synchronization module is specifically used for:
确定所述数据通信链路的第一传输时延以及所述蓝牙链路的第二传输时延;determining a first transmission delay of the data communication link and a second transmission delay of the Bluetooth link;
基于所述第一传输时延和所述第二传输时延,确定传输时间差;determining a transmission time difference based on the first transmission delay and the second transmission delay;
基于所述传输时间差对所述图像数据和所述音频数据进行传输同步。The image data and the audio data are transmitted synchronously based on the transmission time difference.
可选的,所述第一传输模块902,包括:Optionally, the first transmission module 902 includes:
蓝牙链路建立单元,用于与所述音频输出终端建立所述蓝牙链路;A Bluetooth link establishing unit, configured to establish the Bluetooth link with the audio output terminal;
第一显示单元,用于显示第一切换提示,所述第一切换提示用于确认是否通过所述音频输出终端输出声音;The first display unit is configured to display a first switching prompt, and the first switching prompt is used to confirm whether to output sound through the audio output terminal;
第一传输单元,用于响应于确认指令,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。The first transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link in response to the confirmation instruction.
可选的,所述装置还包括:Optionally, the device also includes:
第三传输模块,用于响应于取消指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。A third transmission module, configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a cancel instruction.
可选的,所述蓝牙链路在接收到所述投屏指令之前建立;Optionally, the Bluetooth link is established before receiving the screen projection instruction;
所述第一传输模块902,包括:The first transmission module 902 includes:
状态获取单元,用于在所述音频输出终端与所述无线终端建立有所述蓝牙链路的情况下,获取所述音频输出终端的设备状态;A state acquiring unit, configured to acquire the device state of the audio output terminal when the Bluetooth link is established between the audio output terminal and the wireless terminal;
第二传输单元,用于在所述音频输出终端处于使用状态的情况下,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。The second transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link when the audio output terminal is in use.
可选的,所述装置包括:Optionally, the device includes:
第四传输模块,用于响应于切换指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。The fourth transmission module is configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a switching instruction.
可选的,所述第四传输模块,包括:Optionally, the fourth transmission module includes:
第一显示单元,用于显示音频通路切换界面;a first display unit, configured to display an audio channel switching interface;
第一切换传输单元,用于响应于所述音频通路切换界面内的音频通路切换操作,触发所述切换指令,并通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。A first switching transmission unit, configured to trigger the switching instruction in response to an audio channel switching operation in the audio channel switching interface, and transmit the image data and the image data to the screen projection device through the data communication link. described audio data.
可选的,所述第四传输模块,包括:Optionally, the fourth transmission module includes:
链路质量确定单元,用于确定所述蓝牙链路的链路质量;a link quality determining unit, configured to determine the link quality of the Bluetooth link;
第二显示单元,用于在所述链路质量不满足传输需求的情况下,显示第二切换提示,所述第二切换提示用于确认是否通过所述投屏设备输出声音;The second display unit is configured to display a second switching prompt when the link quality does not meet the transmission requirement, and the second switching prompt is used to confirm whether to output sound through the screen projection device;
第二切换传输单元,用于响应于对所述第二切换提示的确认操作,触发所述切换指令,并通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。A second switching transmission unit, configured to trigger the switching instruction in response to a confirmation operation of the second switching prompt, and transmit the image data and the audio to the screen projection device through the data communication link data.
可选的,所述装置还包括:Optionally, the device also includes:
提示模块,用于在所述链路质量满足传输需求的情况下,显示第三切换提示,所述第三切换提示用于确认是否通过所述音频输出终端输出声音;A prompt module, configured to display a third switching prompt when the link quality meets the transmission requirements, and the third switching prompt is used to confirm whether to output sound through the audio output terminal;
第五传输模块,用于响应于对所述第三切换提示的确认操作,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。A fifth transmission module, configured to transmit the audio data to the audio output terminal through the Bluetooth link in response to a confirmation operation of the third switching prompt.
综上所述,本申请实施例中,无线终端向投屏设备进行投屏过程中,若无线终端与音频输出终端建立有蓝牙链路,无线终端对投屏数据中的图像数据和音频数据进行分离,并通过蓝牙链路向音频输出终端传输音频数据,通过与投屏设备之间的数据通信链路传输图像数据,从而实现投屏过程中画面显示和声音播放的设备分离;采用本申请实施例提供的方案,投屏过程中可以继续使用投屏设备以外的音频输出终端进行音频播放,比如,投屏过程中可以继续通过投屏前与无线终端连接的蓝牙耳机进行音频播放,提高了投屏过程中音频播放的自由度,避免投屏过程中因音频播放源切换造成的影响。To sum up, in the embodiment of this application, during the process of the wireless terminal projecting the screen to the screen projection device, if the wireless terminal establishes a Bluetooth link with the audio output terminal, the wireless terminal performs the image data and audio data in the projection data. Separation, and transmit audio data to the audio output terminal through the Bluetooth link, and transmit image data through the data communication link with the screen projection device, so as to realize the separation of screen display and sound playback devices during the screen projection process; this application is implemented In the solution provided by the example, you can continue to use audio output terminals other than the projection device for audio playback during the screen projection process. For example, you can continue to play audio through the Bluetooth headset connected to the wireless terminal before the screen projection process, which improves the projection. The degree of freedom of audio playback during the screen projection process can avoid the impact caused by the switching of audio playback sources during the screen projection process.
请参考图10,其示出了本申请一个示例性实施例提供的无线终端的结构方框图。本申请中的无线终端1000可以包括一个或多个如下部件:处理器1010、存储器1020和蓝牙芯片1030。Please refer to FIG. 10 , which shows a structural block diagram of a wireless terminal provided by an exemplary embodiment of the present application. The wireless terminal 1000 in this application may include one or more of the following components: a processor 1010 , a memory 1020 and a Bluetooth chip 1030 .
处理器1010可以包括一个或者多个处理核心。处理器1010利用各种接口和线路连接整个无线终端1000内的各个部分,通过运行或执行存储在存储器1020内的指令、程序、代码集或指令集,以及调用存储在存储器1020内的数据,执行无线终端1000的各种功能和处理数据。可选地,处理器1010可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器1010可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)、神经网络处理器(Neural-network Processing Unit,NPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作***、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;NPU用于实现人工智能(Artificial Intelligence,AI)功能;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器1010中,单独通过一块芯片进行实现。 Processor 1010 may include one or more processing cores. The processor 1010 uses various interfaces and lines to connect various parts in the entire wireless terminal 1000, and executes by running or executing instructions, programs, code sets or instruction sets stored in the memory 1020, and calling data stored in the memory 1020. Various functions and processing data of the wireless terminal 1000. Optionally, the processor 1010 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1010 may integrate one or more of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem, etc. The combination. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the display screen; the NPU is used to realize artificial intelligence (Artificial Intelligence, AI) functions; the modem is used to process wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1010, but may be realized by a single chip.
存储器1020可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory,ROM)。可选地,该存储器1020包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器1020可用于存储指令、程序、代码、代码集或指令集。存储器1020可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作***的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等;存储数据区可存储根据无线终端1000的使用所创建的数据(比如音频数据、电话本)等。The memory 1020 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM). Optionally, the memory 1020 includes a non-transitory computer-readable storage medium. The memory 1020 may be used to store instructions, programs, codes, sets of codes or sets of instructions. The memory 1020 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following method embodiments; the storage data area can store data created according to the use of the wireless terminal 1000 (such as audio data, phone book) and the like.
蓝牙芯片1030是用于实现蓝牙功能的组件。其中,蓝牙芯片1030包含Host 和Controller两部分(对应不同蓝牙协议栈),Host和Controller可以运行在同一芯片上(单芯片架构),也可以运行在不同芯片上(双芯片架构)。比如,Host运行在处理器上,而Controller运行在蓝牙模块上;或者,Host和Controller均运行在蓝牙芯片1030上。The Bluetooth chip 1030 is a component for realizing the Bluetooth function. Wherein, the Bluetooth chip 1030 includes two parts, Host and Controller (corresponding to different Bluetooth protocol stacks), and the Host and Controller can run on the same chip (single-chip architecture), or can run on different chips (dual-chip architecture). For example, the Host runs on the processor, and the Controller runs on the Bluetooth module; or, both the Host and the Controller run on the Bluetooth chip 1030 .
除此之外,本领域技术人员可以理解,上述附图所示出的无线终端1000的结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。比如,无线终端1000中还包括显示屏、传感器、扬声器、麦克风、电源、WiFi组件等部件,在此不再赘述。In addition, those skilled in the art can understand that the structure of the wireless terminal 1000 shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or less components than those shown in the figure, or combine certain components, or a different arrangement of components. For example, the wireless terminal 1000 also includes components such as a display screen, a sensor, a speaker, a microphone, a power supply, and a WiFi component, which will not be repeated here.
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质存储有至少一段程序,至少一段程序由处理器加载并执行以实现如上各个实施例所述的无线终端中的投屏方法。The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores at least one program, and at least one program is loaded and executed by a processor to realize the projection in the wireless terminal as described in each of the above embodiments. screen method.
本申请实施例还提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。电子设备的蓝牙芯片从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该电子设备执行上述方面的各种可选实现方式中提供的无线终端中的投屏方法。The embodiment of the present application also provides a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The bluetooth chip of the electronic device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the electronic device executes the screen projection method in the wireless terminal provided in various optional implementation manners of the above aspect.
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。另外,本文中描述的步骤编号,仅示例性示出了步骤间的一种可能的执行先后顺序,在一些其它实施例中,上述步骤也可以不按照编号顺序来执行,如两个不同编号的步骤同时执行,或者两个不同编号的步骤按照与图示相反的顺序执行,本申请实施例对此不作限定。It should be understood that the "plurality" mentioned herein refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship. In addition, the numbering of the steps described herein only exemplarily shows a possible sequence of execution among the steps. In some other embodiments, the above-mentioned steps may not be executed according to the order of the numbers, such as two different numbers The steps are executed at the same time, or two steps with different numbers are executed in the reverse order as shown in the illustration, which is not limited in this embodiment of the present application.
以上所述仅为本申请的可选实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above are only optional embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.
Claims (20)
- 一种无线终端中的投屏方法,所述方法包括:A screen projection method in a wireless terminal, the method comprising:响应于投屏指令,与投屏设备建立数据通信链路;Establishing a data communication link with the screen projection device in response to the screen projection instruction;在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,以便所述音频输出终端基于所述音频数据输出声音;In the case that the audio output terminal establishes a Bluetooth link with the wireless terminal, transmit the audio data in the projection data to the audio output terminal through the Bluetooth link, so that the audio output terminal outputs sound based on the audio data ;通过所述数据通信链路向所述投屏设备传输投屏数据中的图像数据,以便所述投屏设备基于所述图像数据输出画面。The image data in the screen projection data is transmitted to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- 根据权利要求1所述的方法,其中,所述通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据之前,所述方法包括:The method according to claim 1, wherein, before transmitting the audio data in the projection data to the audio output terminal through the Bluetooth link, the method comprises:基于所述数据通信链路和所述蓝牙链路的链路状态,对所述图像数据和所述音频数据进行传输同步。The transmission of the image data and the audio data is synchronized based on the link states of the data communication link and the Bluetooth link.
- 根据权利要求2所述的方法,其中,所述基于所述数据通信链路和所述蓝牙链路的链路状态,对所述图像数据和所述音频数据进行传输同步,包括:The method according to claim 2, wherein said synchronizing the transmission of the image data and the audio data based on the link state of the data communication link and the Bluetooth link comprises:确定所述数据通信链路的第一传输时延以及所述蓝牙链路的第二传输时延;determining a first transmission delay of the data communication link and a second transmission delay of the Bluetooth link;基于所述第一传输时延和所述第二传输时延,确定传输时间差;determining a transmission time difference based on the first transmission delay and the second transmission delay;基于所述传输时间差对所述图像数据和所述音频数据进行传输同步。The image data and the audio data are transmitted synchronously based on the transmission time difference.
- 根据权利要求1至3任一所述的方法,其中,所述在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,包括:The method according to any one of claims 1 to 3, wherein, when the audio output terminal establishes a Bluetooth link with the wireless terminal, the screen projection data is transmitted to the audio output terminal through the Bluetooth link audio data, including:与所述音频输出终端建立所述蓝牙链路;Establishing the Bluetooth link with the audio output terminal;显示第一切换提示,所述第一切换提示用于确认是否通过所述音频输出终端输出声音;displaying a first switching prompt, the first switching prompt is used to confirm whether to output sound through the audio output terminal;响应于确认指令,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。Transmitting the audio data to the audio output terminal via the Bluetooth link in response to an acknowledgment instruction.
- 根据权利要求4所述的方法,其中,所述显示第一切换提示之后,所述方法还包括:The method according to claim 4, wherein, after displaying the first switching prompt, the method further comprises:响应于取消指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。In response to a cancel instruction, transmitting the image data and the audio data to the screen projection device via the data communication link.
- 根据权利要求1至3任一所述的方法,其中,所述蓝牙链路在接收到所述投屏指令之前建立;The method according to any one of claims 1 to 3, wherein the Bluetooth link is established before receiving the screen projection instruction;所述在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,包括:In the case where the audio output terminal and the wireless terminal have a bluetooth link, transmitting the audio data in the projection data to the audio output terminal through the bluetooth link includes:在所述音频输出终端与所述无线终端建立有所述蓝牙链路的情况下,获取所述音频输出终端的设备状态;When the Bluetooth link is established between the audio output terminal and the wireless terminal, acquire the device status of the audio output terminal;在所述音频输出终端处于使用状态的情况下,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。When the audio output terminal is in use, transmit the audio data to the audio output terminal through the Bluetooth link.
- 根据权利要求1至3任一所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 3, wherein the method further comprises:响应于切换指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。In response to a switching instruction, transmitting the image data and the audio data to the screen projection device through the data communication link.
- 根据权利要求7所述的方法,其中,所述响应于切换指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据,包括:The method according to claim 7, wherein the transmitting the image data and the audio data to the screen projection device through the data communication link in response to the switching instruction comprises:显示音频通路切换界面;Display the audio channel switching interface;响应于所述音频通路切换界面内的音频通路切换操作,触发所述切换指令,并通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。In response to an audio channel switching operation in the audio channel switching interface, the switching instruction is triggered, and the image data and the audio data are transmitted to the screen projection device through the data communication link.
- 根据权利要求7所述的方法,其中,所述响应于切换指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据,包括:The method according to claim 7, wherein the transmitting the image data and the audio data to the screen projection device through the data communication link in response to the switching instruction comprises:确定所述蓝牙链路的链路质量;determining a link quality of the bluetooth link;在所述链路质量不满足传输需求的情况下,显示第二切换提示,所述第二切换提示用于确认是否通过所述投屏设备输出声音;In the case that the link quality does not meet the transmission requirement, displaying a second switching prompt, the second switching prompt is used to confirm whether to output sound through the screen projection device;响应于对所述第二切换提示的确认操作,触发所述切换指令,并通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。In response to a confirmation operation on the second switching prompt, the switching instruction is triggered, and the image data and the audio data are transmitted to the screen projection device through the data communication link.
- 根据权利要求9所述的方法,其中,所述响应于对所述第二切换提示的确认操作,触发所述切换指令,并通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据之后,所述方法还包括:The method according to claim 9, wherein the switching instruction is triggered in response to the confirmation operation of the second switching prompt, and the image is transmitted to the screen projection device through the data communication link After the data and the audio data, the method also includes:在所述链路质量满足传输需求的情况下,显示第三切换提示,所述第三切换提示用于确认是否通过所述音频输出终端输出声音;When the link quality meets the transmission requirement, displaying a third switching prompt, where the third switching prompt is used to confirm whether to output sound through the audio output terminal;响应于对所述第三切换提示的确认操作,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。In response to a confirmation operation of the third switching prompt, the audio data is transmitted to the audio output terminal through the Bluetooth link.
- 一种投屏装置,所述装置包括:A screen projection device, the device comprising:数据链路建立模块,用于响应于投屏指令,与投屏设备建立数据通信链路;A data link establishment module, configured to establish a data communication link with the screen projection device in response to the screen projection instruction;第一传输模块,用于在音频输出终端与无线终端建立有蓝牙链路的情况下,通过所述蓝牙链路向所述音频输出终端传输投屏数据中的音频数据,以便所述音频输出终端基于所述音频数据输出声音;The first transmission module is configured to transmit the audio data in the projection data to the audio output terminal through the Bluetooth link when the audio output terminal and the wireless terminal establish a Bluetooth link, so that the audio output terminal outputting sound based on the audio data;第二传输模块,用于通过所述数据通信链路向所述投屏设备传输投屏数据中的图像数据,以便所述投屏设备基于所述图像数据输出画面。The second transmission module is configured to transmit the image data in the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data.
- 根据权利要求11所述的装置,其中,所述装置还包括:The device according to claim 11, wherein the device further comprises:同步模块,用于基于所述数据通信链路和所述蓝牙链路的链路状态,对所述图像数据和所述音频数据进行传输同步。A synchronization module, configured to synchronize the transmission of the image data and the audio data based on the link states of the data communication link and the Bluetooth link.
- 根据权利要求12所述的装置,其中,所述同步模块,具体用于:The device according to claim 12, wherein the synchronization module is specifically used for:确定所述数据通信链路的第一传输时延以及所述蓝牙链路的第二传输时延;determining a first transmission delay of the data communication link and a second transmission delay of the Bluetooth link;基于所述第一传输时延和所述第二传输时延,确定传输时间差;determining a transmission time difference based on the first transmission delay and the second transmission delay;基于所述传输时间差对所述图像数据和所述音频数据进行传输同步。The image data and the audio data are transmitted synchronously based on the transmission time difference.
- 根据权利要求11至13任一所述的装置,其中,所述第一传输模块,包括:The device according to any one of claims 11 to 13, wherein the first transmission module includes:蓝牙链路建立单元,用于与所述音频输出终端建立所述蓝牙链路;A Bluetooth link establishing unit, configured to establish the Bluetooth link with the audio output terminal;第一显示单元,用于显示第一切换提示,所述第一切换提示用于确认是否通过所述音频输出终端输出声音;The first display unit is configured to display a first switching prompt, and the first switching prompt is used to confirm whether to output sound through the audio output terminal;第一传输单元,用于响应于确认指令,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。The first transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link in response to the confirmation instruction.
- 根据权利要求14所述的装置,其中,所述显示第一切换提示之后,所述装置还包括:The device according to claim 14, wherein after the display of the first switching prompt, the device further comprises:第三传输模块,用于响应于取消指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。A third transmission module, configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a cancel instruction.
- 根据权利要求11至13任一所述的装置,其中,所述蓝牙链路在接收到所述投屏指令之前建立;The device according to any one of claims 11 to 13, wherein the Bluetooth link is established before receiving the screen projection instruction;所述第一传输模块,包括:The first transmission module includes:状态获取单元,用于在所述音频输出终端与所述无线终端建立有所述蓝牙链路的情况下,获取所述音频输出终端的设备状态;A state acquiring unit, configured to acquire the device state of the audio output terminal when the Bluetooth link is established between the audio output terminal and the wireless terminal;第二传输单元,用于在所述音频输出终端处于使用状态的情况下,通过所述蓝牙链路向所述音频输出终端传输所述音频数据。The second transmission unit is configured to transmit the audio data to the audio output terminal through the Bluetooth link when the audio output terminal is in use.
- 根据权利要求11至13任一所述的装置,其中,所述装置包括:The device according to any one of claims 11 to 13, wherein the device comprises:第四传输模块,用于响应于切换指令,通过所述数据通信链路向所述投屏设备传输所述图像数据和所述音频数据。The fourth transmission module is configured to transmit the image data and the audio data to the screen projection device through the data communication link in response to a switching instruction.
- 一种无线终端,所述无线终端包括处理器和存储器,所述存储器中存储有至少一段程序,所述至少一段程序由所述处理器加载并执行以实现如权利要求1至10任一所述的无线终端中的投屏方法。A wireless terminal, the wireless terminal includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement any one of claims 1 to 10 The screen projection method in the wireless terminal.
- 一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一段程序,所述至少一段程序由处理器加载并执行以实现如权利要求1至10任一所述的无线终端中的投屏方法。A computer-readable storage medium, at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the wireless terminal according to any one of claims 1 to 10. Screencasting method.
- 一种计算机程序产品,所述计算机程序产品包括计算机指令,所述计算机指令存储在计算机可读存储介质中;电子设备的蓝牙芯片从所述计算机可读存储介质读取所述计算机指令,所述处理器执行所述计算机指令,使得所述电子设备执行如权利要求1至10任一所述的无线终端中的投屏方法。A computer program product, the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium; the bluetooth chip of the electronic device reads the computer instructions from the computer-readable storage medium, the The processor executes the computer instructions, so that the electronic device executes the screen projection method in the wireless terminal according to any one of claims 1 to 10.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110619639.8A CN115442777A (en) | 2021-06-03 | 2021-06-03 | Screen projection method and device in wireless terminal, wireless terminal and storage medium |
CN202110619639.8 | 2021-06-03 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022252909A1 true WO2022252909A1 (en) | 2022-12-08 |
Family
ID=84240193
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/091090 WO2022252909A1 (en) | 2021-06-03 | 2022-05-06 | Screen casting method and apparatus in wireless terminal, wireless terminal, and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN115442777A (en) |
WO (1) | WO2022252909A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1558013A1 (en) * | 2003-12-23 | 2005-07-27 | Societé Française du Radiotéléphone | Process and terminals for the emission and the remote reception of signals of audio and/or video- telephony |
CN109996097A (en) * | 2019-03-12 | 2019-07-09 | 广州虎牙信息科技有限公司 | A kind of throwing screen method, system and storage device |
CN111031368A (en) * | 2019-11-25 | 2020-04-17 | 腾讯科技(深圳)有限公司 | Multimedia playing method, device, equipment and storage medium |
CN111984215A (en) * | 2020-08-19 | 2020-11-24 | Oppo广东移动通信有限公司 | Multimedia data playing method, terminal and storage medium |
CN112055252A (en) * | 2020-08-18 | 2020-12-08 | 腾讯科技(深圳)有限公司 | Multi-screen interaction method and device, computer readable medium and electronic equipment |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105812694B (en) * | 2014-12-29 | 2024-02-06 | 中强光电股份有限公司 | Projection system and projection method thereof |
CN105991962B (en) * | 2015-02-03 | 2020-08-18 | 阿里巴巴集团控股有限公司 | Connection method, information display method, device and system |
FR3033113B1 (en) * | 2015-02-19 | 2018-03-30 | 5V | METHOD, SYSTEM AND DEVICE FOR WIRELESS VIDEO PROJECTION |
CN105828139A (en) * | 2016-04-06 | 2016-08-03 | 乐视控股(北京)有限公司 | Video screen-projection method and apparatus |
CN107801088A (en) * | 2016-08-31 | 2018-03-13 | 南京极域信息科技有限公司 | One kind throws screen and receives share system and implementation method |
JP2019220765A (en) * | 2018-06-15 | 2019-12-26 | セイコーエプソン株式会社 | Display unit and control method therefor |
CN109168038A (en) * | 2018-10-11 | 2019-01-08 | 维沃移动通信有限公司 | A kind of processing method of resource, device and equipment |
CN109327728B (en) * | 2018-11-23 | 2021-10-15 | 深圳市鹰硕技术有限公司 | One-to-many same-screen method, device and system, same-screen equipment and storage medium |
CN112860204A (en) * | 2021-02-19 | 2021-05-28 | 西安万像电子科技有限公司 | Data processing method and system |
-
2021
- 2021-06-03 CN CN202110619639.8A patent/CN115442777A/en active Pending
-
2022
- 2022-05-06 WO PCT/CN2022/091090 patent/WO2022252909A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1558013A1 (en) * | 2003-12-23 | 2005-07-27 | Societé Française du Radiotéléphone | Process and terminals for the emission and the remote reception of signals of audio and/or video- telephony |
CN109996097A (en) * | 2019-03-12 | 2019-07-09 | 广州虎牙信息科技有限公司 | A kind of throwing screen method, system and storage device |
CN111031368A (en) * | 2019-11-25 | 2020-04-17 | 腾讯科技(深圳)有限公司 | Multimedia playing method, device, equipment and storage medium |
CN112055252A (en) * | 2020-08-18 | 2020-12-08 | 腾讯科技(深圳)有限公司 | Multi-screen interaction method and device, computer readable medium and electronic equipment |
CN111984215A (en) * | 2020-08-19 | 2020-11-24 | Oppo广东移动通信有限公司 | Multimedia data playing method, terminal and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN115442777A (en) | 2022-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5485009B2 (en) | Method and system for synchronous execution of commands at both ends of a communication link | |
KR101707637B1 (en) | Method and apparatus for decreasing presentation latency | |
EP3276973B1 (en) | Content projection method and mobile terminal | |
CN106303679B (en) | Media playing control method and media playing client | |
WO2022017007A1 (en) | Audio data processing method, server, and storage medium | |
US20130166769A1 (en) | Receiving device, screen frame transmission system and method | |
US8925032B2 (en) | AV output system performing video output | |
WO2023142389A1 (en) | Screen mirroring method and apparatus, and electronic device and storage medium | |
WO2015107909A1 (en) | Reproduction device and data reproduction method | |
WO2022206270A1 (en) | Device addition method and apparatus, bluetooth chip, and device | |
CN115623278A (en) | Audio processing method, apparatus, device and medium | |
US9247191B2 (en) | Wireless external multi-microphone system for mobile device environment | |
WO2022252909A1 (en) | Screen casting method and apparatus in wireless terminal, wireless terminal, and storage medium | |
KR20220133965A (en) | Audio transmission methods and electronic devices | |
WO2022258016A1 (en) | Data stream transmission method and device, communication apparatus, and storage medium | |
WO2022252928A1 (en) | Screen projection method and apparatus, wireless terminal, screen projection device and storage medium | |
JP2006129420A (en) | Information communication terminal device | |
JP5340880B2 (en) | Output control device for remote conversation system, method thereof, and computer-executable program | |
US20220141912A1 (en) | Rapid Data Path Recovery in an Electronic Communications Device | |
JP4168269B2 (en) | Mobile phone terminal and synchronization control method for mobile phone terminal | |
TWI765224B (en) | Wireless bluetooth (bt) audio output system and control method thereof | |
US20220382535A1 (en) | Consumer device firmware updating via hdmi | |
WO2024001362A1 (en) | Display device, bluetooth device, and data processing method | |
TWI841832B (en) | Method of transmitting audio data | |
US11704088B2 (en) | Intelligent control method and electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22814956 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22814956 Country of ref document: EP Kind code of ref document: A1 |