WO2022078061A1 - Video communication method and apparatus, electronic device and computer readable storage medium - Google Patents

Video communication method and apparatus, electronic device and computer readable storage medium Download PDF

Info

Publication number
WO2022078061A1
WO2022078061A1 PCT/CN2021/113433 CN2021113433W WO2022078061A1 WO 2022078061 A1 WO2022078061 A1 WO 2022078061A1 CN 2021113433 W CN2021113433 W CN 2021113433W WO 2022078061 A1 WO2022078061 A1 WO 2022078061A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
smart screen
video call
screen device
audio data
Prior art date
Application number
PCT/CN2021/113433
Other languages
French (fr)
Chinese (zh)
Inventor
沈卓彦
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022078061A1 publication Critical patent/WO2022078061A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/02—Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present invention requires the priority of the Chinese patent application filed on October 15, 2020 with the application number of 2020111035781 and the application title of "video communication method, device, electronic device and computer-readable storage medium", the entire content of which is Incorporated herein by reference.
  • the present invention relates to the technical field of video image data processing, and in particular, to a video communication method, apparatus, electronic device and computer-readable storage medium.
  • Smart screens have unique advantages such as long shooting distance and no need to hold hands, which can better support multi-person video conversations and free users' hands.
  • the smart terminal can cast the video call to the smart screen, and the user can make a video call through the smart screen. For example, when a mobile phone is making a video call, when a smart screen is found nearby, the user is prompted to use the smart screen to make a video call. After the user selects the smart screen, the mobile phone switches the video call to the smart screen through the server.
  • the smart terminal and the smart screen need to log in to the same account, but the smart screen generally has the attributes of public equipment, and there is a need for multiple people to use it. limit.
  • the embodiments of the present application provide a video communication method, device, electronic device, and computer-readable storage medium, so that the smart screen is not limited by the use scene in the scene of conducting a video session, so that the smart screen can match any type of Smart terminal, switch the video call operation on the smart terminal to the smart channel for video call.
  • this embodiment provides a video communication method, the method includes:
  • the interface display data and the first audio data are sent to the target smart screen device for playback.
  • this embodiment provides a video communication method, the method includes:
  • this embodiment provides a video communication device, the device comprising:
  • a detection connection module configured to search for a target smart screen device when it is detected that the first terminal enters a video call, and establish a connection based on a short-range communication network with the target smart screen device;
  • an acquisition module for acquiring interface display data and first audio data of the video call
  • a switching module is used to send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
  • this embodiment provides a video communication device, the device comprising:
  • a receiving module configured to receive interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
  • a playing module is used to play the interface display data and the first audio data.
  • this embodiment provides an electronic device, including a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, the processor implements the steps of any one of the methods provided in the embodiments of the first aspect.
  • this embodiment provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any one of the methods provided in the above-mentioned first aspect embodiment.
  • the above-mentioned video communication method, device, electronic device and computer-readable storage medium include: when it is detected that the first terminal enters a video call, searching for a target smart screen device, and establishing a short-range communication network-based proximity communication network with the target smart screen device.
  • the interface display data and the first audio data of the video call are obtained, and then the interface display data and the first audio data are sent to the target smart screen device for playback through the short-range communication network. Since a short-range communication network connection is established between the first terminal and the target smart screen device, when the first terminal and the target smart screen device perform data interaction, there is no need for the intervention of the background server, and the first terminal can directly transfer the video call to the target smart screen device.
  • the display screen is projected to the target smart screen device for playback, which improves the real-time performance of the first terminal switching the video call to the target smart screen device for playback.
  • the first terminal only needs to send the interface display data and the first audio data of the video call to the target smart screen device for playback, and then the switching relay function of the video call between the first terminal and the target smart screen device can be realized, without the need for
  • the target smart screen device installs the same video call application program as the first terminal. Therefore, the video communication method proposed in this application is not limited by the target smart screen device type and target smart screen device application, thereby expanding the target smart screen device. usage scenarios.
  • FIG. 1 is an application environment diagram of a video communication method in one embodiment
  • FIG. 2 is a flowchart of a video communication method in one embodiment
  • FIG. 3 is a schematic diagram of a display screen of a target smart screen in one embodiment
  • FIG. 4 is a schematic diagram of a display screen of a first terminal in an embodiment
  • FIG. 5 is a flowchart of a video communication method in one embodiment
  • FIG. 6 is a flowchart of an implementation manner of S101 in the embodiment of FIG. 2;
  • FIG. 7 is a schematic diagram of a display interface of a first terminal in one embodiment
  • FIG. 8 is a schematic diagram of a display interface of a first terminal in one embodiment
  • Fig. 9 is a flowchart of an implementation manner of S203 in the embodiment of Fig. 6;
  • FIG. 10 is a schematic diagram of a display interface of a first terminal in one embodiment
  • FIG. 11 is a flowchart of an implementation manner of S101 in the embodiment of FIG. 2;
  • FIG. 12 is a flowchart of a video communication method in one embodiment
  • FIG. 13 is a schematic diagram of a display screen of a first terminal in an embodiment
  • FIG. 14 is a schematic diagram of a display screen of a first terminal in an embodiment
  • 15 is a flowchart of a video communication method in one embodiment
  • 16 is a flowchart of a video communication method in one embodiment
  • 17 is a flowchart of a video communication method in one embodiment
  • 19 is a structural block diagram of a video communication device in one embodiment
  • 20 is a structural block diagram of a video communication device in one embodiment
  • FIG. 21 is a schematic diagram of the internal structure of an electronic device in one embodiment.
  • first, second, etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element.
  • a first client may be referred to as a second client, and similarly, a second client may be referred to as a first client, without departing from the scope of this application.
  • Both the first client and the second client are clients, but they are not the same client.
  • the video communication method provided in this application can be applied to the application environment shown in FIG. 1 .
  • the first terminal 101 communicates with the smart screen device 103 through a network.
  • the second terminal 102 is in communication connection with the first terminal 101 .
  • the first terminal 101 or the second terminal 102 can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices, and the smart screen device 103 can be a smart TV or a device with a video playback function .
  • FIG. 2 is a flowchart of a video communication method in one embodiment.
  • the video communication method in this embodiment is described by taking the operation on the first terminal 101 in FIG. 1 as an example. As shown in Figure 2, the method includes:
  • the video call interface may be a call interface answered by the user, or a call interface dialed by the user.
  • the video call application can be any application with video call function, for example, WeChat, QQ, DingTalk and other applications.
  • the target smart screen device is the smart screen device to be connected, which can be a smart TV, a computer, or a smart appliance with a video playback function.
  • the connection to the near field communication network includes the connection to a local area communication network, eg, a wifi connection, and/or a Bluetooth communication connection.
  • the first terminal will detect the video call on it in real time. If it is detected that the first terminal has entered a video call, the Bluetooth search function or the network search function can be enabled to search for smart screen devices in the nearby area. For multiple smart screen devices, determine one of the smart screen devices as the target smart screen device, and then establish a connection based on the short-range communication network with the target smart screen device, such as establishing a local area network connection or a Bluetooth network connection.
  • the first terminal may acquire the interface display data and the first audio data of the video call in real time.
  • the first terminal can collect the video data of the terminal user during the video call in real time through the image collecting device and the audio collecting device on the terminal, and receive the video data sent by the docking user terminal during the video call, and then further monitor the above-mentioned terminal.
  • the video data and the video data of the docking user terminal are processed to obtain display interface data and first audio data of the video call.
  • S103 Send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
  • the first terminal when the first terminal establishes a short-range communication network connection with the target smart screen device and acquires the interface display data and the first audio data of the video call, the first terminal can further convert the interface display data and the first audio data It is sent to the target smart screen device, and when the target smart screen device receives the interface display data, the screen displayed by the interface display data is displayed on the display screen, and the first audio data is played through the audio device or equipment of the target smart screen device.
  • the first terminal when the first terminal acquires the interface display data of the video call, it can also preprocess the interface display data first, that is, extract the content data to be displayed mainly from the interface display data, and then extract the extracted content.
  • the data is sent to the target smart screen device for screen display; or, when the first terminal obtains the first audio data of the video call, the first audio data can also be preprocessed, that is, the key points are extracted from the first audio data. Audio data to be played, and send the extracted audio data to the target smart screen device for playback.
  • the target smart screen device when it is detected that the first terminal has entered a video call, the target smart screen device is searched, a connection based on the short-range communication network is established with the target smart screen device, and the interface display of the video call is obtained. The data and the first audio data, and then the interface display data and the first audio data are sent to the target smart screen device for playback through the short-range communication network. Since a short-range communication network connection is established between the first terminal and the target smart screen device, when the first terminal and the target smart screen device perform data interaction, there is no need for the intervention of the background server, and the first terminal can directly transfer the video call to the target smart screen device.
  • the display screen is projected to the target smart screen device for playback, which improves the real-time performance of the first terminal switching the video call to the target smart screen device for playback.
  • the first terminal only needs to send the interface display data and the first audio data of the video call to the target smart screen device for playback, and then the switching relay function of the video call between the first terminal and the target smart screen device can be realized, without the need for
  • the target smart screen device installs the same video call application program as the first terminal. Therefore, the video communication method proposed in this application is not limited by the target smart screen device type and target smart screen device application, thereby expanding the target smart screen device. usage scenarios.
  • an implementation manner of the above S102 includes: acquiring interface display data and first audio data of a video call by means of screen recording.
  • the first terminal can turn on the recording device on the terminal during the video call, record all the displayed images on the display screen and all the voice during the video call, and obtain the interface display data and the first audio data.
  • the layout of the video call interface displayed on the target smart screen device is consistent with the layout of the video call interface of the first terminal , which avoids the user's discomfort caused by changing the layout of the display screen when switching the display interface of the video call to the target smart screen device, and is more in line with the user's actual use needs. For example, as shown in the display screen on the target smart screen as shown in FIG.
  • the area A displays the display screen of the first terminal user, the area includes the first terminal user A1, and the area B displays the display screen related to the first terminal user.
  • the display screen of the docking terminal user this area includes docking user B1.
  • the display screen of the video call on the first terminal as shown in FIG. 4 obviously, the layout of the display screen shown in FIG. 3 is the same as the layout of the display screen of the video call on the first terminal shown in FIG. 4. .
  • the above-mentioned video communication method uses screen projection to display the display interface of the video call on the first terminal to the target smart screen device, and the target smart screen device may be a public device
  • the above screen projection method The process may expose the privacy of the first terminal user, so in the video communication process described in the above embodiment, the present application also provides a method for controlling the content displayed on the target smart screen device, that is, as shown in FIG. 5 ,
  • the video communication method described in the embodiment of FIG. 2 further includes the steps:
  • the filtering rules may be pre-set by the first terminal according to actual application requirements.
  • the privacy information may include information unrelated to the video call on the first terminal.
  • the privacy information may include content information such as a system status bar, a banner notification, a control center, and an incoming call message on the first terminal.
  • the filtering process includes: the first terminal first classifies all the acquired interface display data, and then distinguishes which interface display data belongs to private information and which interface display data is classified according to the classified interface display data.
  • the display data does not belong to the data of the private information, and the interface display data belonging to the privacy information is filtered out, and the remaining interface display data is the filtered interface display data; or the first terminal removes the interface display data that does not belong to the privacy information from the interface display data. All the original display interface data are extracted as the filtered interface display data.
  • the filtering process of audio data is similar to the above-mentioned filtering process of display interface data, and details are not described here.
  • the first terminal obtains the filtered interface display data and the filtered audio data based on the steps of the above-mentioned S104, when the above-mentioned steps of S103 are performed, the above-mentioned S103 "sends the interface display data and the audio data to the target through the short-range communication network.
  • Playing by smart screen device may specifically include: sending the filtered interface display data and filtered audio data to the target smart screen device for playback through the short-range communication network, that is, the target smart screen device receives the filtered The interface displays the data and the filtered audio data, then when the screen of the filtered interface displaying data is displayed, the private information of the first terminal will not appear on the display screen of the target smart screen device, avoiding the problem that the target smart screen device is public The privacy leakage problem caused by the device.
  • the target smart screen device plays the voice of the video, it only plays the voice during the video call, so as to avoid the problem of unclear hearing caused by the interference caused by playing other voices on the first terminal.
  • the present application provides a specific implementation of the above S104, that is, the above S104 "uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, and obtains the filtered data.
  • the interface display data and the filtered audio data including: according to the preset whitelist list, filter the interface display data corresponding to the whitelist list from the interface display data as the filtered interface display data, and, from the first The audio data corresponding to the whitelist is filtered out from the audio data as the filtered audio data; the whitelist includes the identification of non-private information.
  • the whitelist list is preset by the first terminal and stored in the memory.
  • the identification of non-private information can be represented by numbers, letters, words, etc., to distinguish private information from non-private information.
  • the first terminal acquires the interface display data and the first audio data of the video call, it can further acquire a whitelist list from the memory, and query the identifier of the non-private information in the whitelist list, and according to the non-privacy information Identify the interface display data belonging to the non-private information in the interface display data, and then extract the interface display data corresponding to the non-privacy information identifier from the interface display data accordingly, and use the extracted interface display data as the filtered interface display data.
  • the interface displays the data, and distinguishes the audio data belonging to the non-privacy information in the first audio data according to the identification of the non-privacy information, and then correspondingly extracts the audio data corresponding to the identification of the non-privacy information from the first audio data, and extracts the audio data corresponding to the identification of the non-privacy information from the first audio data.
  • the extracted audio data is used as filtered audio data.
  • the present application provides another specific implementation of the above S104, that is, the above S104 "uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, and obtain the filtered data.
  • the above S104 uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, and obtain the filtered data.
  • the interface display data and the filtered audio data including: filtering out the data corresponding to the blacklist list in the interface display data according to the preset blacklist list, to obtain the filtered interface display data, and,
  • the data corresponding to the blacklist in the audio data is filtered out to obtain filtered audio data; the blacklist includes the identifier of the privacy information.
  • the blacklist list is preset by the first terminal and stored in the memory.
  • the identification of private information can be represented by numbers, letters, words, etc., to distinguish private information from non-private information.
  • the first terminal acquires the interface display data and the first audio data of the video call, it can further acquire the blacklist list from the memory, and query the identity of the privacy information in the blacklist, and according to the identity of the privacy information in the Distinguish the interface display data belonging to the privacy information in the interface display data, and then filter out the interface display data corresponding to the identity of the privacy information in the interface display data accordingly as the filtered interface display data, and use the identity of the privacy information in the first audio
  • the audio data belonging to the privacy information is distinguished from the data, and the audio data corresponding to the identifier of the privacy information in the first audio data is correspondingly filtered out as the filtered audio data.
  • the video communication method provided in this embodiment can also be implemented when the screen of the first terminal is off, that is, when the first terminal switches the video call to the target smart device, if the screen of the first terminal is off, the first terminal continues to perform the above
  • the step of S103 in the embodiment of FIG. 2 is the step of “sending the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network”.
  • the first terminal may continue to perform the step of S103 in the background, that is, whether the screen of the first terminal is closed does not affect the operation of the first terminal to send the interface display data and the first audio data to the target smart screen device for playback, thereby It is ensured that the video call between the target smart screen device through the first terminal and the docking terminal user can be carried out normally.
  • an implementation manner of the above S101 is also provided, as shown in FIG. 6 , the manner includes:
  • the Bluetooth search function can be enabled to search for smart screen devices that emit Bluetooth signals in a nearby area, which are available smart screen devices.
  • the first terminal detects that the first terminal has entered a video call it can also enable a network search function (such as a wifi network) to search for smart screen devices that emit network signals in a nearby area, which are available smart screen devices.
  • the first terminal searches for an available smart screen device, which means that there is a smart screen device that can be used for switching video calls in the vicinity of the first terminal.
  • the first terminal displays a switching suggestion on the display interface of the video call information to prompt the first terminal user to switch the current video call to the smart screen device.
  • the switching suggestion information can be displayed at any position on the display interface. For example, it is optimal to display the switching suggestion information in the area near the operation button, so that the user can easily find the switching suggestion information on the display interface to perform the video switching operation.
  • the above-mentioned switching suggestion information includes at least one of switching text prompt information and switching controls.
  • the first terminal displays the switching suggestion information and the non-first switching suggestion information for the first time.
  • the manner in which the switching suggestion information is displayed the second time may or may not be the same.
  • the first terminal displays the switching suggestion information on the display interface of the video call for the first time, it displays the switching text prompt information and switching controls on the display interface of the video call;
  • the toggle controls are displayed on the display interface of the video call.
  • the switching suggestion information is displayed for the first time on the display interface of the video call of the first terminal, as shown in FIG. 7 , the switching text prompt information "Switch to TV for video call" is displayed on the display interface.
  • the switching control C the user can operate the switching control C on the display interface of the video call (for example, click or slide the switching control C) to input the switching instruction, and the first terminal can execute the switching instruction after obtaining the switching instruction. Toggle action for video calls.
  • the switching suggestion information is displayed again on the display interface of the video call of the first terminal, as shown in FIG. 8 , only the switching control C may be displayed on the display interface.
  • the switching control C may be displayed on the display interface through a floating ball or other means, which is not limited here.
  • the switching instruction is an instruction input by the user on the video call display interface of the first terminal, which is used to switch the video call to the target smart screen device.
  • the user can determine whether to switch the video call to the target smart screen device according to the switch suggestion information, and if it is determined to switch the video call to the target smart screen device, then The user inputs the switching instruction by triggering the switching control or other means on the display interface of the video call.
  • the first terminal searches again for available smart screen devices in the nearby area. If multiple smart screens are found. device, and select a smart screen device from which you want to switch video calls as the target smart screen device.
  • the first terminal when the first terminal finds that there is a smart screen device capable of switching video calls nearby, it immediately displays switching suggestion information on the display interface of the video call, so that the user can timely know the video call switching function possessed by the first terminal, The intelligence of the first terminal is further improved.
  • the first terminal After the first terminal obtains the switching instruction based on the switching suggestion information, it can re-search for available smart screen devices in the nearby area, and when an available smart screen device is searched, it can be displayed on the display interface of the video call of the first terminal.
  • the device identifiers of the available smart screen devices or the device names of the available smart screen devices specifically, the device identifiers or device names of the searched smart screen devices can be displayed in the form of a list.
  • the display area of the available smart screen device can cover the entire display interface of the video call, or can cover part of the display interface of the video call. For example, as shown in FIG. 10 , on the display interface of the first terminal, the searched smart screen device 1 , smart screen device 2 , and smart screen device 3 are displayed thereon.
  • S302 based on the device identifiers of each available smart screen device, obtain a selection instruction; the selection instruction includes the target device identifier.
  • the target device identifier is the identifier of the smart screen device selected by the user to switch the video call. Specifically, when the identifiers of multiple available smart screen devices are displayed on the display interface of the video call of the first terminal, the user can perform a corresponding selection operation on the display interface, that is, select one from the multiple available smart screen devices For available smart screen devices, when the user finishes the selection operation and generates a selection instruction, the selection instruction carries the target device identifier.
  • S303 Determine the smart screen device corresponding to the target device identifier as the target smart screen device.
  • the first terminal when it obtains the selection instruction, it can further parse the selection instruction, obtain the target device identifier therefrom, and then determine the smart screen device corresponding to the target device identifier as the target smart screen device for video call switching.
  • the user can determine the target smart screen device according to his own selection operation, which improves the security of the first terminal switching the video call to the target smart screen device.
  • an implementation manner of the above S101 is provided.
  • the “establishing a short-range communication network connection with the target smart screen device” in the above S101 includes:
  • the first terminal When the first terminal establishes a short-range communication network connection with the target smart screen device, it can first establish a Bluetooth connection with the target smart screen device, so as to quickly connect to the target smart screen device.
  • the target smart screen device sends a network connection request to the target smart screen device through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
  • the network connection request is used for requesting to establish a short-range communication network connection (for example, a local area network connection) with the target smart screen device.
  • a short-range communication network connection for example, a local area network connection
  • the first terminal can send a network connection request to the target smart screen device, and the target smart screen device can further parse the network connection request to obtain short-range communication when receiving the network connection request. parameters of the network, and then establish a network connection with the first terminal according to the parameters of the short-range communication network.
  • the target smart screen device responds to the network connection request sent by the first terminal through the Bluetooth connection to inform the first terminal.
  • the terminal network connection is successful.
  • S403 Receive a network connection response fed back by the target smart screen device through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  • the first terminal receives the network connection response fed back by the target smart screen device, and after receiving the network connection response, can start based on the established network connection Data interaction with the target smart screen device.
  • the Bluetooth connection between the first device and the target smart screen device is first established, and then the network connection request and the parameters of the short-range communication network are transmitted through the Bluetooth connection, so that the first terminal and the target smart screen device can establish a network connection again. And then based on the network connection for data exchange. Because the speed of the Bluetooth connection is very fast, compared with the traditional method of directly searching for network signals to establish a network connection, this method can improve the speed of establishing a network connection between the first terminal and the target smart screen device, thereby improving the switching speed of the first terminal. Timeliness of video calls to the target smart screen device.
  • the target smart screen device plays the interface display data and the first audio data of the video call of the first terminal
  • the first terminal user can conduct a video call with the connected terminal user through the target smart screen device, that is, the above-mentioned After S103, as shown in FIG. 12, the method described in the embodiment of FIG. 2 further includes:
  • S105 receive image data and second audio data sent by the target smart screen device through a short-range communication network; the image data is image data collected by an image acquisition device of the target smart screen device, and the second audio data is the audio of the target smart screen device The audio data collected by the collecting device.
  • the image acquisition device may be a camera installed on the target smart screen device, and the camera may be installed at the front end of the display screen of the target smart screen device, so as to collect image data of the first terminal user.
  • the audio collection device can be a voice recording device installed on the target smart screen device, and the voice recording device can be installed anywhere on the target smart screen device.
  • the target smart screen device can collect the image data of the user of the first terminal through the image collection device, and collect the image data through the audio collection device.
  • the second audio data of the first terminal user, and then the target smart screen device sends the collected image data and the second audio data to the first terminal through the short-range communication network.
  • S106 Send the image data and the second audio data to the second terminal; the second terminal is a terminal that conducts a video call with the first terminal.
  • the first terminal When the first terminal receives the image data and the second audio data sent by the target smart screen device, it can send the image data and the second audio data to the second terminal that is in the video call with the first terminal, so that the user of the first terminal can Video call with second end user.
  • the method described in this embodiment realizes the function of the target smart screen device making a video call with the second terminal through the first terminal, that is, the target smart screen device only needs to send the collected image data and the second audio data to the first terminal, that is A video call can be made with the second terminal, and there is no need to install any video call application that is the same as the second terminal, nor does it need to have the same hardware requirements as the device type of the second terminal. Therefore, the application of the target smart screen device Scenarios are not limited. Moreover, the application scenarios of the first terminal and the second terminal are also not limited, that is, the method provided in this application can be applied to any different types and models of the first terminal and the second terminal.
  • the background switching control can be displayed on the display interface of the video call of the first terminal (as shown in Figure 13 ).
  • background toggle control D The background switching control is used to control the application corresponding to the current video call to switch to run in the background of the first terminal.
  • the first terminal will detect in real time whether the background switching control is triggered, and if it is detected that the background switching control is triggered, it will control the application corresponding to the video call to switch to the background running, so that the user can perform other applications on the first terminal Actions, such as browsing web pages, viewing messages, etc.
  • a function control of the video call (function control E shown in FIG. 14 ) is displayed on the display interface of the first terminal. .
  • the function control of the video call is used to control the application corresponding to the video call to switch to run in the foreground.
  • the first terminal will detect in real time whether the function control of the video call is triggered, and if it is detected that the function control of the video call is triggered, it will control the application corresponding to the video call to switch to run in the foreground, so that the user can reconnect to the first terminal to see the screen of the video call.
  • the settings of the above video call function controls and background switching controls enable the first terminal to perform other application operations in parallel when switching the video call to the target smart screen device for playback, which improves the flexibility of the first terminal during the video call. usability.
  • the display interface of the video call of the first terminal can also display a disconnection control (as shown in the figure).
  • Disconnect control F Disconnect control F shown in 13. The disconnection control is used to control the first terminal to disconnect from the target smart screen device.
  • the first terminal will detect in real time whether the disconnection control of the video call is triggered. If it is detected that the disconnection control is triggered, the first terminal will directly disconnect the connection with the target smart screen device. It is possible to stop sending the interface display data and the first audio data to the target smart screen device, or directly disconnect the short-range communication network connection with the target smart screen. It can be understood that the triggering methods of several controls in the above application scenarios can be preset according to application requirements, for example, click triggering, sliding triggering, etc., which are not limited here.
  • connection and disconnection control enables the user to operate on the first terminal at any time according to their own needs to cut off the video call process of the target smart screen, and provides a function of manually terminating the video call played by the target smart screen device.
  • the methods described in the above embodiments in FIG. 2 to FIG. 14 are the video communication methods described in the first terminal side, and the methods described in the following embodiments in FIG. 15 to FIG. 17 are the video communication methods described in the target smart screen device side communication method.
  • FIG. 15 is a flowchart of a video communication method in one embodiment.
  • the video communication method in this embodiment is described by taking the operation on the target smart screen device 103 in FIG. 1 as an example. As shown in Figure 15, the method includes:
  • S501 Receive interface display data and first audio data sent by a first terminal through a short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call.
  • the playback interface displays the data and the first audio data.
  • the present application further provides a video communication method, as shown in FIG. 16 , the method described in the embodiment of FIG. 15 further includes:
  • the method described in this embodiment is the same as the method described in the foregoing step S105 .
  • S504 send the image data and the second audio data to the first terminal through the short-range communication network; the first terminal is used for sending the image data and the second audio data to the second terminal; the second terminal is used for communicating with the first terminal Terminal for video calls.
  • the method described in this embodiment is the same as the method described in the foregoing step S106 .
  • the present application further provides a video communication method. As shown in FIG. 17 , the method described in the embodiment of FIG. 15 further includes:
  • the method described in this embodiment is the same as the method described in the foregoing step S401 .
  • S602 Receive a network connection request sent by the first terminal through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
  • a network connection response is fed back to the first terminal through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  • the method described in this embodiment is the same as the method described in the foregoing step S403.
  • the present application provides a video communication method, as shown in FIG. 18 , the method includes:
  • the first terminal establishes a Bluetooth connection with the target smart screen device when detecting that the first terminal has entered into a video call.
  • the target smart screen device establishes a Bluetooth connection with the first terminal.
  • the first terminal sends a network connection request to the target smart screen device through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
  • the target smart screen device receives a network connection request sent by the first terminal through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
  • the target smart screen device feeds back a network connection response to the first terminal through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  • the first terminal receives a network connection response fed back by the target smart screen device through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  • the first terminal acquires the interface display data and the first audio data of the video call by recording the screen.
  • the first terminal uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data to obtain filtered interface display data and filtered audio data.
  • the first terminal sends the filtered interface display data and the filtered audio data to the target smart screen device through the short-range communication network.
  • the target smart screen device receives the filtered interface display data and the filtered audio data.
  • the target smart screen device plays the filtered interface display data and the filtered audio data.
  • the target smart screen device collects image data through an image collection device, and collects second audio data through an audio collection device.
  • the target smart screen device sends the image data and the second audio data to the first terminal through the short-range communication network.
  • the target smart screen device sends the image data and the second audio data to the second terminal.
  • steps in the flowcharts of FIGS. 2 to 18 are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIG. 2-FIG. 18 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. These sub-steps or stages may be executed at different times. The order of execution of the stages is also not necessarily sequential, but may be performed alternately or alternately with other steps or sub-steps of other steps or at least a portion of a stage.
  • a video communication device including: a detection connection module 11, an acquisition module 12 and a switching module 13, wherein:
  • the detection and connection module 11 is configured to search for the target smart screen device when it is detected that the first terminal enters the video call, and establish a connection based on the short-range communication network with the target smart screen device;
  • an acquisition module 12 configured to acquire interface display data and first audio data of the video call
  • the switching module 13 is configured to send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
  • a video communication apparatus including: a receiving module 21 and a playing module 22, wherein:
  • the receiving module 21 is configured to receive interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
  • the playing module 22 is configured to play the interface display data and the first audio data.
  • each module in the above video communication apparatus is only for illustration. In other embodiments, the video communication apparatus may be divided into different modules as required to complete all or part of the functions of the above video communication apparatus.
  • Each module in the above-mentioned video communication device may be implemented in whole or in part by software, hardware, and combinations thereof.
  • the above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
  • an electronic device in one embodiment, the electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. 21 .
  • the electronic device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus.
  • the processor of the electronic device is used to provide computing and control capabilities.
  • the memory of the electronic device includes a non-volatile storage medium and an internal memory.
  • the nonvolatile storage medium stores an operating system and a computer program.
  • the internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium.
  • the communication interface of the electronic device is used for wired or wireless communication with an external terminal, and the wireless communication can be realized by WIFI, operator network, NFC (Near Field Communication) or other technologies.
  • the computer program when executed by a processor, implements a video communication method.
  • the display screen of the electronic device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the electronic device , or an external keyboard, trackpad, or mouse.
  • FIG. 21 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied.
  • the specific electronic device may be Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.
  • an electronic device including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
  • the interface display data and the first audio data are sent to the target smart screen device for playback.
  • an electronic device including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • the interface display data and the first audio data are sent to the target smart screen device for playback.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical memory, and the like.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • the RAM may be in various forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).

Abstract

A video communication method and apparatus, a computer device and a storage medium. The method comprises: in the case of detecting that a first terminal enters a video call, searching for a target smart screen device, and establishing connection based on a near field communication network with the target smart screen device; obtaining interface display data and first audio data of the video call; and sending the interface display data and the first audio data by means of the near field communication network to the target smart screen device for playback. Because the first terminal only needs to send the interface display data and the first audio data of the video call to the target smart screen device for playback, the switching relay function of the video call between the first terminal and the target smart screen device can be realized. In this way, the target smart screen device does not need to install an application program of the same video call as the first terminal, such that the video communication method is not limited by the type of the target smart screen device and the application of the target smart screen device.

Description

视频通信方法、装置、电子设备和计算机可读存储介质Video communication method, apparatus, electronic device, and computer-readable storage medium
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本发明要求于2020年10月15日提交中国专利局，申请号为2020111035781，申请名称为“视频通信方法、装置、电子设备和计算机可读存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本发明中。The present invention requires the priority of the Chinese patent application filed on October 15, 2020 with the application number of 2020111035781 and the application title of "video communication method, device, electronic device and computer-readable storage medium", the entire content of which is Incorporated herein by reference.
技术领域technical field
本发明涉及视频图像数据处理技术领域，尤其涉及一种视频通信方法、装置、电子设备和计算机可读存储介质。The present invention relates to the technical field of video image data processing, and in particular, to a video communication method, apparatus, electronic device and computer-readable storage medium.
背景技术Background technique
随着通信技术的发展，智慧屏的出现给用户带来了极大的便利。智慧屏具有拍摄距离远、不需要手持等独特优势，可以更好地支持多人视频会话，并解放用户双手。With the development of communication technology, the emergence of smart screens has brought great convenience to users. Smart screens have unique advantages such as long shooting distance and no need to hold hands, which can better support multi-person video conversations and free users' hands.
在一些视频会话场景中，智能终端可以将视频通话投屏到智慧屏，用户通过智慧屏进行视频通话。例如，在手机进行视频通话时，发现附近有智慧屏时，提示用户使用智慧屏进行视频通话，用户选择智慧屏后，手机通过服务器将视频通话切换到智慧屏上进行。In some video conversation scenarios, the smart terminal can cast the video call to the smart screen, and the user can make a video call through the smart screen. For example, when a mobile phone is making a video call, when a smart screen is found nearby, the user is prompted to use the smart screen to make a video call. After the user selects the smart screen, the mobile phone switches the video call to the smart screen through the server.
在上述使用智慧屏进行视频会话的场景中，智能终端和智慧屏需登陆同一账号，但智慧屏一般具备公共设备的属性，存在多人交叉使用的需求，上述方式导致智慧屏的使用场景十分受限。In the above scenario of using the smart screen for video conversation, the smart terminal and the smart screen need to log in to the same account, but the smart screen generally has the attributes of public equipment, and there is a need for multiple people to use it. limit.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种视频通信方法、装置、电子设备和计算机可读存储介质，可以使智慧屏在进行视频会话的场景中，不受到使用场景的限定，使智慧屏可以匹配任何类型的智能终端，将智能终端上的视频通话操作切换到智能频上进行视频通话。The embodiments of the present application provide a video communication method, device, electronic device, and computer-readable storage medium, so that the smart screen is not limited by the use scene in the scene of conducting a video session, so that the smart screen can match any type of Smart terminal, switch the video call operation on the smart terminal to the smart channel for video call.
第一方面，本实施例提供了一种视频通信方法，所述方法包括：In a first aspect, this embodiment provides a video communication method, the method includes:
在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；In the case of detecting that the first terminal enters the video call, search for the target smart screen device, and establish a connection based on the short-range communication network with the target smart screen device;
获取所述视频通话的界面显示数据和第一音频数据；obtaining interface display data and first audio data of the video call;
通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。Through the short-range communication network, the interface display data and the first audio data are sent to the target smart screen device for playback.
第二方面，本实施例提供了一种视频通信方法，所述方法包括：In a second aspect, this embodiment provides a video communication method, the method includes:
接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；receiving interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
播放所述界面显示数据和所述第一音频数据。Playing the interface display data and the first audio data.
第三方面，本实施例提供了一种视频通信装置，所述装置包括：In a third aspect, this embodiment provides a video communication device, the device comprising:
检测连接模块，用于在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；a detection connection module, configured to search for a target smart screen device when it is detected that the first terminal enters a video call, and establish a connection based on a short-range communication network with the target smart screen device;
获取模块，用于获取所述视频通话的界面显示数据和第一音频数据；an acquisition module for acquiring interface display data and first audio data of the video call;
切换模块，用于通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至 所述目标智慧屏设备进行播放。A switching module is used to send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
第四方面，本实施例提供了一种视频通信装置，所述装置包括：In a fourth aspect, this embodiment provides a video communication device, the device comprising:
接收模块，用于接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；a receiving module, configured to receive interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
播放模块，用于播放所述界面显示数据和所述第一音频数据。A playing module is used to play the interface display data and the first audio data.
第五方面，本实施例提供了一种电子设备，包括存储器和处理器，存储器存储有计算机程序，处理器执行计算机程序时实现上述第一方面实施例提供的任一项方法的步骤。In a fifth aspect, this embodiment provides an electronic device, including a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, the processor implements the steps of any one of the methods provided in the embodiments of the first aspect.
第六方面，本实施例提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现上述第一方面实施例提供的任一项方法的步骤。In a sixth aspect, this embodiment provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any one of the methods provided in the above-mentioned first aspect embodiment.
上述视频通信方法、装置、电子设备和计算机可读存储介质，包括：在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与目标智慧屏设备建立基于近距离通信网络的连接，并获取视频通话的界面显示数据和第一音频数据，再通过近距离通信网络，将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放。由于第一终端与目标智慧屏设备之间建立的是近距离通信网络连接，因此第一终端与目标智慧屏设备进行数据交互时，不需要后台服务器的介入，第一终端直接可以将视频通话的显示画面投屏至目标智慧屏设备上进行播放，提高了第一终端将视频通话切换到目标智慧屏设备进行播放的实时性。另外，第一终端仅需要将视频通话的界面显示数据和第一音频数据发送至目标智慧屏设备进行播放，即可实现第一终端与目标智慧屏设备之间视频通话的切换接力功能，不需要目标智慧屏设备安装与第一终端相同的视频通话的应用程序，因此，本申请提出的视频通信方法不会受到目标智慧屏设备类型和目标智慧屏设备应用的限定，进而扩大了目标智慧屏设备的使用场景。The above-mentioned video communication method, device, electronic device and computer-readable storage medium include: when it is detected that the first terminal enters a video call, searching for a target smart screen device, and establishing a short-range communication network-based proximity communication network with the target smart screen device. The interface display data and the first audio data of the video call are obtained, and then the interface display data and the first audio data are sent to the target smart screen device for playback through the short-range communication network. Since a short-range communication network connection is established between the first terminal and the target smart screen device, when the first terminal and the target smart screen device perform data interaction, there is no need for the intervention of the background server, and the first terminal can directly transfer the video call to the target smart screen device. The display screen is projected to the target smart screen device for playback, which improves the real-time performance of the first terminal switching the video call to the target smart screen device for playback. In addition, the first terminal only needs to send the interface display data and the first audio data of the video call to the target smart screen device for playback, and then the switching relay function of the video call between the first terminal and the target smart screen device can be realized, without the need for The target smart screen device installs the same video call application program as the first terminal. Therefore, the video communication method proposed in this application is not limited by the target smart screen device type and target smart screen device application, thereby expanding the target smart screen device. usage scenarios.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.
图1为一个实施例中视频通信方法的应用环境图；1 is an application environment diagram of a video communication method in one embodiment;
图2为一个实施例中视频通信方法的流程图；2 is a flowchart of a video communication method in one embodiment;
图3为一个实施例中目标智慧屏的显示画面的示意图；3 is a schematic diagram of a display screen of a target smart screen in one embodiment;
图4为一个实施例中第一终端的显示画面的示意图；4 is a schematic diagram of a display screen of a first terminal in an embodiment;
图5为一个实施例中视频通信方法的流程图；5 is a flowchart of a video communication method in one embodiment;
图6为图2实施例中S101的一种实现方式的流程图；FIG. 6 is a flowchart of an implementation manner of S101 in the embodiment of FIG. 2;
图7为一个实施例中第一终端显示界面的示意图；7 is a schematic diagram of a display interface of a first terminal in one embodiment;
图8为一个实施例中第一终端显示界面的示意图；8 is a schematic diagram of a display interface of a first terminal in one embodiment;
图9为图6实施例中S203的一种实现方式的流程图；Fig. 9 is a flowchart of an implementation manner of S203 in the embodiment of Fig. 6;
图10为一个实施例中第一终端显示界面的示意图；10 is a schematic diagram of a display interface of a first terminal in one embodiment;
图11为图2实施例中S101的一种实现方式的流程图；FIG. 11 is a flowchart of an implementation manner of S101 in the embodiment of FIG. 2;
图12为一个实施例中视频通信方法的流程图；12 is a flowchart of a video communication method in one embodiment;
图13为一个实施例中第一终端的显示画面的示意图；13 is a schematic diagram of a display screen of a first terminal in an embodiment;
图14为一个实施例中第一终端的显示画面的示意图；14 is a schematic diagram of a display screen of a first terminal in an embodiment;
图15为一个实施例中视频通信方法的流程图；15 is a flowchart of a video communication method in one embodiment;
图16为一个实施例中视频通信方法的流程图；16 is a flowchart of a video communication method in one embodiment;
图17为一个实施例中视频通信方法的流程图；17 is a flowchart of a video communication method in one embodiment;
图18为一个实施例中视频通信方法的流程图；18 is a flowchart of a video communication method in one embodiment;
图19为一个实施例中视频通信装置的结构框图；19 is a structural block diagram of a video communication device in one embodiment;
图20为一个实施例中视频通信装置的结构框图；20 is a structural block diagram of a video communication device in one embodiment;
图21为一个实施例中电子设备的内部结构示意图。FIG. 21 is a schematic diagram of the internal structure of an electronic device in one embodiment.
具体实施例方式specific embodiment
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.
可以理解，本申请所使用的术语“第一”、“第二”等可在本文中用于描述各种元件，但这些元件不受这些术语限制。这些术语仅用于将第一个元件与另一个元件区分。举例来说，在不脱离本申请的范围的情况下，可以将第一客户端称为第二客户端，且类似地，可将第二客户端称为第一客户端。第一客户端和第二客户端两者都是客户端，但其不是同一客户端。It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first client may be referred to as a second client, and similarly, a second client may be referred to as a first client, without departing from the scope of this application. Both the first client and the second client are clients, but they are not the same client.
本申请提供的视频通信方法，可以应用于如图1所示的应用环境中。其中，第一终端101与智慧屏设备103通过网络进行通信。第二终端102与第一终端101进行通信连接。其中，第一终端101或第二终端102可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备，智慧屏设备103可以是智能电视或具有播放视频功能的设备。The video communication method provided in this application can be applied to the application environment shown in FIG. 1 . The first terminal 101 communicates with the smart screen device 103 through a network. The second terminal 102 is in communication connection with the first terminal 101 . Wherein, the first terminal 101 or the second terminal 102 can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices, and the smart screen device 103 can be a smart TV or a device with a video playback function .
图2为一个实施例中视频通信方法的流程图。本实施例中的视频通信方法，以运行于图1中的第一终端101上为例进行描述。如图2所示，该方法包括：FIG. 2 is a flowchart of a video communication method in one embodiment. The video communication method in this embodiment is described by taking the operation on the first terminal 101 in FIG. 1 as an example. As shown in Figure 2, the method includes:
S101，在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与目标智慧屏设备建立基于近距离通信网络的连接。S101 , in the case of detecting that the first terminal enters a video call, search for a target smart screen device, and establish a connection based on a short-range communication network with the target smart screen device.
其中，当第一终端检测到其上的视频通话应用程序进入视频通话界面时，即认为检测到第一终端进入视频通话。其中的视频通话界面可以是用户接听的通话界面，也可以是用户拨打的通话界面。视频通话应用程序可以是任何具有视频通话功能的应用程序，例如，微信、QQ、钉钉等应用程序。目标智慧屏设备为待连接的智慧屏设备，其可以是智能电视机、电脑、或具有视频播放功能的智能电器。近距离通信网络的连接包括局域通信网络的连接，例如，wifi连接，和/或蓝牙通信连接。Wherein, when the first terminal detects that the video call application program on it has entered the video call interface, it is considered that the first terminal has entered the video call. The video call interface may be a call interface answered by the user, or a call interface dialed by the user. The video call application can be any application with video call function, for example, WeChat, QQ, DingTalk and other applications. The target smart screen device is the smart screen device to be connected, which can be a smart TV, a computer, or a smart appliance with a video playback function. The connection to the near field communication network includes the connection to a local area communication network, eg, a wifi connection, and/or a Bluetooth communication connection.
具体地，第一终端会实时检测其上的视频通话情况，若检测到第一终端进入视频通话时，即可开启蓝牙搜索功能或网络搜索功能，搜索附近区域内的智慧屏设备，如果搜索到多个智慧屏设备，则确定其中一个智慧屏设备作为目标智慧屏设备，然后与目标智慧屏设备建立基于近距离通信网络的连接，比如建立局域网络连接或蓝牙网络连接。Specifically, the first terminal will detect the video call on it in real time. If it is detected that the first terminal has entered a video call, the Bluetooth search function or the network search function can be enabled to search for smart screen devices in the nearby area. For multiple smart screen devices, determine one of the smart screen devices as the target smart screen device, and then establish a connection based on the short-range communication network with the target smart screen device, such as establishing a local area network connection or a Bluetooth network connection.
S102，获取视频通话的界面显示数据和第一音频数据。S102: Obtain interface display data and first audio data of the video call.
具体地，第一终端在进入视频通话的整个过程中，可以实时的获取视频通话的界面显示数据和第一音频数据。第一终端可以通过本终端上的图像采集装置和音频采集装置实时采集视频通话过程中本终端用户的视频数据，以及接收视频通话过程中对接用户终端发送的视频数据，再进一步的对上述本终端视频数据和对接用户终端的视频数据进行处理，得到视频通话的显示界面数据和第一音频数据。Specifically, during the entire process of entering the video call, the first terminal may acquire the interface display data and the first audio data of the video call in real time. The first terminal can collect the video data of the terminal user during the video call in real time through the image collecting device and the audio collecting device on the terminal, and receive the video data sent by the docking user terminal during the video call, and then further monitor the above-mentioned terminal. The video data and the video data of the docking user terminal are processed to obtain display interface data and first audio data of the video call.
S103，通过近距离通信网络，将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放。S103: Send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
具体地，当第一终端与目标智慧屏设备建立近距离通信网络连接，并获取到视频通话的界面显示数据和第一音频数据时，第一终端可以进一步的将界面显示数据和第一音频数据发送至目标智慧屏设备，目标智慧屏设备在接收到界面显示数据时将界面显示数据呈现的画面展示在显示屏上，以及将第一音频数据通过目标智慧屏设备的音响装置或设备进行播放。可选的，当第一终端获取到视频通话的界面显示数据时，也可以先对界面显示数据进行预处理，即从界面显示数据中提取出重点要显示的内容数据，并将提取出的内容数据发送至目标智慧屏设备进行画面显示；或者，当第一终端获取到视频通话的第一音频数据时，也可以先对第一音频数据进行预处理，即从第一音频数据中提取出重点要播放的音频数据，并将提取出的 音频数据发送至目标智慧屏设备进行播放。Specifically, when the first terminal establishes a short-range communication network connection with the target smart screen device and acquires the interface display data and the first audio data of the video call, the first terminal can further convert the interface display data and the first audio data It is sent to the target smart screen device, and when the target smart screen device receives the interface display data, the screen displayed by the interface display data is displayed on the display screen, and the first audio data is played through the audio device or equipment of the target smart screen device. Optionally, when the first terminal acquires the interface display data of the video call, it can also preprocess the interface display data first, that is, extract the content data to be displayed mainly from the interface display data, and then extract the extracted content. The data is sent to the target smart screen device for screen display; or, when the first terminal obtains the first audio data of the video call, the first audio data can also be preprocessed, that is, the key points are extracted from the first audio data. Audio data to be played, and send the extracted audio data to the target smart screen device for playback.
本实施例中的视频通信方法，在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与目标智慧屏设备建立基于近距离通信网络的连接，并获取视频通话的界面显示数据和第一音频数据，再通过近距离通信网络，将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放。由于第一终端与目标智慧屏设备之间建立的是近距离通信网络连接，因此第一终端与目标智慧屏设备进行数据交互时，不需要后台服务器的介入，第一终端直接可以将视频通话的显示画面投屏至目标智慧屏设备上进行播放，提高了第一终端将视频通话切换到目标智慧屏设备进行播放的实时性。另外，第一终端仅需要将视频通话的界面显示数据和第一音频数据发送至目标智慧屏设备进行播放，即可实现第一终端与目标智慧屏设备之间视频通话的切换接力功能，不需要目标智慧屏设备安装与第一终端相同的视频通话的应用程序，因此，本申请提出的视频通信方法不会受到目标智慧屏设备类型和目标智慧屏设备应用的限定，进而扩大了目标智慧屏设备的使用场景。In the video communication method in this embodiment, when it is detected that the first terminal has entered a video call, the target smart screen device is searched, a connection based on the short-range communication network is established with the target smart screen device, and the interface display of the video call is obtained. The data and the first audio data, and then the interface display data and the first audio data are sent to the target smart screen device for playback through the short-range communication network. Since a short-range communication network connection is established between the first terminal and the target smart screen device, when the first terminal and the target smart screen device perform data interaction, there is no need for the intervention of the background server, and the first terminal can directly transfer the video call to the target smart screen device. The display screen is projected to the target smart screen device for playback, which improves the real-time performance of the first terminal switching the video call to the target smart screen device for playback. In addition, the first terminal only needs to send the interface display data and the first audio data of the video call to the target smart screen device for playback, and then the switching relay function of the video call between the first terminal and the target smart screen device can be realized, without the need for The target smart screen device installs the same video call application program as the first terminal. Therefore, the video communication method proposed in this application is not limited by the target smart screen device type and target smart screen device application, thereby expanding the target smart screen device. usage scenarios.
在一个实施例中，提供了上述S102的一种实现方式，该方式包括：采用录屏的方式获取视频通话的界面显示数据和第一音频数据。In an embodiment, an implementation manner of the above S102 is provided, and the manner includes: acquiring interface display data and first audio data of a video call by means of screen recording.
具体地，第一终端在视频通话的过程中可以开启本终端上的录制装置，录制显示屏上的全部显示画面和视频通话过程中的全部语音，得到界面显示数据和第一音频数据。之后，当第一终端将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放时，目标智慧屏设备上显示的视频通话界面的布局方式与第一终端的视频通话界面的布局方式一致，避免了用户因将视频通话的显示界面切换到目标智慧屏设备时改变显示画面的布局方式而带来的不适感，更加符合用户的实际使用需求。例如，如图3所示的目标智慧屏上的显示画面，其中的A区域显示的是第一终端用户的显示画面，该区域中包含第一终端用户A1，B区域显示的是与第一终端对接终端用户的显示画面，该区域中包含对接用户B1。再例如，如图4所述的第一终端上视频通话的显示画面，显然，图3所示的显示画面的布局方式与图4所示的第一终端上视频通话的显示画面的布局方式相同。Specifically, the first terminal can turn on the recording device on the terminal during the video call, record all the displayed images on the display screen and all the voice during the video call, and obtain the interface display data and the first audio data. After that, when the first terminal sends the interface display data and the first audio data to the target smart screen device for playback, the layout of the video call interface displayed on the target smart screen device is consistent with the layout of the video call interface of the first terminal , which avoids the user's discomfort caused by changing the layout of the display screen when switching the display interface of the video call to the target smart screen device, and is more in line with the user's actual use needs. For example, as shown in the display screen on the target smart screen as shown in FIG. 3, the area A displays the display screen of the first terminal user, the area includes the first terminal user A1, and the area B displays the display screen related to the first terminal user. The display screen of the docking terminal user, this area includes docking user B1. For another example, the display screen of the video call on the first terminal as shown in FIG. 4, obviously, the layout of the display screen shown in FIG. 3 is the same as the layout of the display screen of the video call on the first terminal shown in FIG. 4. .
在实际应用中，因上述视频通信的方法采用的是投屏的方式将第一终端上的视频通话的显示界面显示到目标智慧屏设备，且目标智慧屏设备可能是公共设备，因此上述投屏过程存在暴露第一终端用户隐私的可能，故在上述实施例所述的视频通信过程中，本申请还提供了一种控制目标智慧屏设备上显示内容的方法，即，如图5所示，图2实施例所述的视频通信方法还包括步骤：In practical applications, because the above-mentioned video communication method uses screen projection to display the display interface of the video call on the first terminal to the target smart screen device, and the target smart screen device may be a public device, the above screen projection method The process may expose the privacy of the first terminal user, so in the video communication process described in the above embodiment, the present application also provides a method for controlling the content displayed on the target smart screen device, that is, as shown in FIG. 5 , The video communication method described in the embodiment of FIG. 2 further includes the steps:
S104，采用预设的过滤规则，对视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，得到过滤后的界面显示数据和过滤后的音频数据。S104, using a preset filtering rule, filter the interface display data of the video call and the privacy information in the first audio data to obtain filtered interface display data and filtered audio data.
其中，过滤规则可以由第一终端预先根据实际应用需求设定。隐私信息可以包括第一终端上与视频通话无关的信息，例如，隐私信息可以包括第一终端上的***状态栏、横幅通知、控制中心、来电消息等内容信息。The filtering rules may be pre-set by the first terminal according to actual application requirements. The privacy information may include information unrelated to the video call on the first terminal. For example, the privacy information may include content information such as a system status bar, a banner notification, a control center, and an incoming call message on the first terminal.
具体地，当第一终端获取到视频通话的界面显示数据和第一音频数据时，可以进一步的按照预先设定的过滤规则对界面显示数据和第一音频数据中的隐私信息进行过滤，例如，以界面显示数据为例说明过滤过程，过滤过程包括：第一终端先将获取到的全部界面显示数据进行分类，再根据分类后的界面显示数据区分哪些界面显示数据属于隐私信息的数据，哪些界面显示数据不属于隐私信息的数据，并将属于隐私信息的界面显示数据滤除掉，剩余的界面显示数据即为过滤后的界面显示数据；或者第一终端将不属于隐私信息的界面显示数据从原来全部的显示界面数据中提取出来作为过滤后的界面显示数据。可以理解的是，音频数据的过滤过程与上述显示界面数据过滤过程类似，此处不赘述。Specifically, when the first terminal acquires the interface display data and the first audio data of the video call, it can further filter the privacy information in the interface display data and the first audio data according to a preset filtering rule, for example, Taking the interface display data as an example to illustrate the filtering process, the filtering process includes: the first terminal first classifies all the acquired interface display data, and then distinguishes which interface display data belongs to private information and which interface display data is classified according to the classified interface display data. The display data does not belong to the data of the private information, and the interface display data belonging to the privacy information is filtered out, and the remaining interface display data is the filtered interface display data; or the first terminal removes the interface display data that does not belong to the privacy information from the interface display data. All the original display interface data are extracted as the filtered interface display data. It can be understood that the filtering process of audio data is similar to the above-mentioned filtering process of display interface data, and details are not described here.
第一终端基于上述S104的步骤得到过滤后的界面显示数据和过滤后的音频数据时，在执行上述S103的步骤时，上述S103“通过近距离通信网络，将界面显示数据和音频数据发送至目标智慧屏设备进行播放”可以具体包括：通过近距离通信网络，将过滤后的界面显示数 据和过滤后的音频数据发送至目标智慧屏设备进行播放，即，目标智慧屏设备接收的是过滤后的界面显示数据和过滤后的音频数据，那么在显示过滤后的界面显示数据的画面时，目标智慧屏设备的显示屏上不会出现第一终端的隐私信息，避免了因目标智慧屏设备为公共设备而带来的隐私泄露问题。同时，目标智慧屏设备在播放视频的语音时，也只播放视频通话过程中的语音，避免播放第一终端上的其它语音造成的干扰听不清楚的问题。When the first terminal obtains the filtered interface display data and the filtered audio data based on the steps of the above-mentioned S104, when the above-mentioned steps of S103 are performed, the above-mentioned S103 "sends the interface display data and the audio data to the target through the short-range communication network. "Playing by smart screen device" may specifically include: sending the filtered interface display data and filtered audio data to the target smart screen device for playback through the short-range communication network, that is, the target smart screen device receives the filtered The interface displays the data and the filtered audio data, then when the screen of the filtered interface displaying data is displayed, the private information of the first terminal will not appear on the display screen of the target smart screen device, avoiding the problem that the target smart screen device is public The privacy leakage problem caused by the device. At the same time, when the target smart screen device plays the voice of the video, it only plays the voice during the video call, so as to avoid the problem of unclear hearing caused by the interference caused by playing other voices on the first terminal.
可选地，本申请提供了上述S104的一种具体实现方式，即上述S104“采用预设的过滤规则，对视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，得到过滤后的界面显示数据和过滤后的音频数据”，包括：根据预设的白名单列表，从界面显示数据中筛选出白名单列表对应的界面显示数据作为过滤后的界面显示数据，以及，从第一音频数据中筛选出白名单列表对应的音频数据作为过滤后的音频数据；白名单列表中包括非隐私信息的标识。Optionally, the present application provides a specific implementation of the above S104, that is, the above S104 "uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, and obtains the filtered data. "The interface display data and the filtered audio data", including: according to the preset whitelist list, filter the interface display data corresponding to the whitelist list from the interface display data as the filtered interface display data, and, from the first The audio data corresponding to the whitelist is filtered out from the audio data as the filtered audio data; the whitelist includes the identification of non-private information.
其中，白名单列表由第一终端预先设置并存储在内存中。非隐私信息的标识可以使用数字、字母、文字等表示，用于区分隐私信息和非隐私信息。具体地，当第一终端获取到视频通话的界面显示数据和第一音频数据时，可以进一步从内存中获取白名单列表，并查询白名单列表中非隐私信息的标识，并根据非隐私信息的标识在界面显示数据中区分属于非隐私信息的界面显示数据，再相应的从界面显示数据中提取出与非隐私信息的标识对应的界面显示数据，并将提取出的界面显示数据作为过滤后的界面显示数据，以及根据非隐私信息的标识在第一音频数据中区分属于非隐私信息的音频数据，再相应的从第一音频数据中提取出与非隐私信息的标识对应的音频数据，并将提取出的音频数据作为过滤后的音频数据。上述通过白名单列表方式过滤界面显示数据和第一音频数据的方式简单实用，可以提高第一终端过滤数据的效率。Wherein, the whitelist list is preset by the first terminal and stored in the memory. The identification of non-private information can be represented by numbers, letters, words, etc., to distinguish private information from non-private information. Specifically, when the first terminal acquires the interface display data and the first audio data of the video call, it can further acquire a whitelist list from the memory, and query the identifier of the non-private information in the whitelist list, and according to the non-privacy information Identify the interface display data belonging to the non-private information in the interface display data, and then extract the interface display data corresponding to the non-privacy information identifier from the interface display data accordingly, and use the extracted interface display data as the filtered interface display data. The interface displays the data, and distinguishes the audio data belonging to the non-privacy information in the first audio data according to the identification of the non-privacy information, and then correspondingly extracts the audio data corresponding to the identification of the non-privacy information from the first audio data, and extracts the audio data corresponding to the identification of the non-privacy information from the first audio data. The extracted audio data is used as filtered audio data. The above method of filtering the interface display data and the first audio data through the whitelist list method is simple and practical, and can improve the efficiency of the first terminal to filter the data.
可选地，本申请提供了上述S104的另一种具体实现方式，即上述S104“采用预设的过滤规则，对视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，得到过滤后的界面显示数据和过滤后的音频数据”，包括：根据预设的黑名单列表，将界面显示数据中黑名单列表对应的数据滤除，得到过滤后的界面显示数据，以及，将第一音频数据中黑名单列表对应的数据滤除，得到过滤后的音频数据；黑名单列表中包括隐私信息的标识。Optionally, the present application provides another specific implementation of the above S104, that is, the above S104 "uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, and obtain the filtered data. After the interface display data and the filtered audio data", including: filtering out the data corresponding to the blacklist list in the interface display data according to the preset blacklist list, to obtain the filtered interface display data, and, The data corresponding to the blacklist in the audio data is filtered out to obtain filtered audio data; the blacklist includes the identifier of the privacy information.
其中，黑名单列表由第一终端预先设置并存储在内存中。隐私信息的标识可以使用数字、字母、文字等表示，用于区分隐私信息和非隐私信息。具体地，当第一终端获取到视频通话的界面显示数据和第一音频数据时，可以进一步从内存中获取黑名单列表，并查询黑名单列表中隐私信息的标识，并根据隐私信息的标识在界面显示数据中区分属于隐私信息的界面显示数据，再相应的过滤掉界面显示数据中与隐私信息的标识对应的界面显示数据作为过滤后的界面显示数据，以及根据隐私信息的标识在第一音频数据中区分属于隐私信息的音频数据，再相应的过滤掉第一音频数据中与隐私信息的标识对应的音频数据作为过滤后的音频数据。上述通过黑名单列表方式过滤界面显示数据和第一音频数据的方式简单实用，可以提高第一终端过滤数据的效率。Wherein, the blacklist list is preset by the first terminal and stored in the memory. The identification of private information can be represented by numbers, letters, words, etc., to distinguish private information from non-private information. Specifically, when the first terminal acquires the interface display data and the first audio data of the video call, it can further acquire the blacklist list from the memory, and query the identity of the privacy information in the blacklist, and according to the identity of the privacy information in the Distinguish the interface display data belonging to the privacy information in the interface display data, and then filter out the interface display data corresponding to the identity of the privacy information in the interface display data accordingly as the filtered interface display data, and use the identity of the privacy information in the first audio The audio data belonging to the privacy information is distinguished from the data, and the audio data corresponding to the identifier of the privacy information in the first audio data is correspondingly filtered out as the filtered audio data. The above method of filtering the interface display data and the first audio data through the blacklist list method is simple and practical, and can improve the efficiency of the first terminal to filter the data.
本实施例提供的视频通信方法还可以在第一终端息屏的情况下实现，即当第一终端将视频通话切换到目标智慧设备时，若第一终端息屏了，第一终端继续执行上述图2实施例中S103的步骤，即“通过近距离通信网络，将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放”的步骤。The video communication method provided in this embodiment can also be implemented when the screen of the first terminal is off, that is, when the first terminal switches the video call to the target smart device, if the screen of the first terminal is off, the first terminal continues to perform the above The step of S103 in the embodiment of FIG. 2 is the step of “sending the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network”.
具体的，第一终端可以在后台继续执行上述S103的步骤，即第一终端是否息屏，不影响第一终端将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放的操作，从而保证目标智慧屏设备通过第一终端与对接终端用户之间视频通话的正常进行。Specifically, the first terminal may continue to perform the step of S103 in the background, that is, whether the screen of the first terminal is closed does not affect the operation of the first terminal to send the interface display data and the first audio data to the target smart screen device for playback, thereby It is ensured that the video call between the target smart screen device through the first terminal and the docking terminal user can be carried out normally.
在一个实施例中，还提供了上述S101的一种实现方式，如图6所示，该方式包括：In an embodiment, an implementation manner of the above S101 is also provided, as shown in FIG. 6 , the manner includes:
S201，在检测到第一终端进入视频通话的情况下，搜索可用的智慧屏设备。S201, in the case of detecting that the first terminal has entered a video call, search for available smart screen devices.
具体地，若第一终端检测到第一终端进入视频通话时，即可开启蓝牙搜索功能，搜索附近区域内发出蓝牙信号的智慧屏设备，即为可用的智慧屏设备。可选的，第一终端检测到第 一终端进入视频通话时，也可以开启网络搜索功能(比如wifi网络)，搜索附近区域内发出网络信号的智慧屏设备，即为可用的智慧屏设备。Specifically, if the first terminal detects that the first terminal has entered a video call, the Bluetooth search function can be enabled to search for smart screen devices that emit Bluetooth signals in a nearby area, which are available smart screen devices. Optionally, when the first terminal detects that the first terminal has entered a video call, it can also enable a network search function (such as a wifi network) to search for smart screen devices that emit network signals in a nearby area, which are available smart screen devices.
S202，若搜索到可用的智慧屏设备，在视频通话的显示界面上显示切换建议信息；切换建议信息用于提示用户将视频通话切换至智慧屏设备。S202, if an available smart screen device is found, display switching suggestion information on the display interface of the video call; the switching suggestion information is used to prompt the user to switch the video call to the smart screen device.
第一终端搜索到可用的智慧屏设备，即说明第一终端的附近区域内有可以用于切换视频通话的智慧屏设备，在此情况下，第一终端在视频通话的显示界面上显示切换建议信息，以提示第一终端用户可以切换当前的视频通话至智慧屏设备。切换建议信息可以显示在显示界面的任意位置，例如，切换建议信息显示在操作按键附近区域为最优，以便用户在显示界面上容易查找切换建议信息进行视频切换操作。The first terminal searches for an available smart screen device, which means that there is a smart screen device that can be used for switching video calls in the vicinity of the first terminal. In this case, the first terminal displays a switching suggestion on the display interface of the video call information to prompt the first terminal user to switch the current video call to the smart screen device. The switching suggestion information can be displayed at any position on the display interface. For example, it is optimal to display the switching suggestion information in the area near the operation button, so that the user can easily find the switching suggestion information on the display interface to perform the video switching operation.
可选的，上述切换建议信息包括切换文字提示信息和切换控件中的至少一种，则第一终端在视频通话的显示界面上显示切换建议信息时，第一次显示切换建议信息和非第一次显示切换建议信息的方式可以相同，也可以不相同。当不相同时，若第一终端在视频通话的显示界面上首次显示切换建议信息时，则在视频通话的显示界面上显示切换文字提示信息和切换控件；若非首次显示切换建议信息时，则在视频通话的显示界面上显示切换控件。Optionally, the above-mentioned switching suggestion information includes at least one of switching text prompt information and switching controls. When displaying the switching suggestion information on the display interface of the video call, the first terminal displays the switching suggestion information and the non-first switching suggestion information for the first time. The manner in which the switching suggestion information is displayed the second time may or may not be the same. When they are not the same, if the first terminal displays the switching suggestion information on the display interface of the video call for the first time, it displays the switching text prompt information and switching controls on the display interface of the video call; The toggle controls are displayed on the display interface of the video call.
示例性说明上述显示切换建议信息的方式，第一终端的视频通话的显示界面上首次显示切换建议信息时，如图7所示，显示界面上显示切换文字提示信息“切换到电视进行视频通话”，以及切换控件C，用户可以在该视频通话的显示界面上操作切换控件C(例如点击或滑动切换控件C)，以输入切换指令，此时第一终端在获取到该切换指令后即可执行切换视频通话的操作。第一终端的视频通话的显示界面上再次显示切换建议信息时，如图8所示，显示界面上可以仅显示切换控件C，用户再次切换视频通话到目标智慧屏设备时，可以在该视频通话的显示界面上快速的找到切换控件C进行切换。需要说明的是，切换控件C可以通过悬浮球或其它方式显示在显示界面上，此处不限定。The above method of displaying the switching suggestion information is exemplarily described. When the switching suggestion information is displayed for the first time on the display interface of the video call of the first terminal, as shown in FIG. 7 , the switching text prompt information "Switch to TV for video call" is displayed on the display interface. , and the switching control C, the user can operate the switching control C on the display interface of the video call (for example, click or slide the switching control C) to input the switching instruction, and the first terminal can execute the switching instruction after obtaining the switching instruction. Toggle action for video calls. When the switching suggestion information is displayed again on the display interface of the video call of the first terminal, as shown in FIG. 8 , only the switching control C may be displayed on the display interface. When the user switches the video call to the target smart screen device again, he On the display interface of , quickly find the switch control C to switch. It should be noted that the switching control C may be displayed on the display interface through a floating ball or other means, which is not limited here.
S203，基于切换建议信息获取切换指令后，重新搜索可用的智慧屏设备，并从搜索到的可用的智慧屏设备中确定目标智慧屏设备。S203, after obtaining the switching instruction based on the switching suggestion information, search for available smart screen devices again, and determine the target smart screen device from the searched available smart screen devices.
其中，切换指令为用户在第一终端的视频通话显示界面上输入的指令，用于切换视频通话至目标智慧屏设备。具体地，当第一终端的视频通话的显示界面上显示切换建议信息时，用户可以根据该切换建议信息确定是否切换视频通话至目标智慧屏设备，若确定切换视频通话至目标智慧屏设备，则用户在视频通话的显示界面上通过触发切换控件或其它方式输入切换指令，第一终端在获取到用户输入的切换指令后，重新搜索附近区域中可用的智慧屏设备，若搜索到多个智慧屏设备，并从中选择一个要切换视频通话的智慧屏设备作为目标智慧屏设备。上述实施例中，第一终端在发现附近有可切换视频通话的智慧屏设备时，立即在视频通话的显示界面上显示切换建议信息，以便用户及时了解到第一终端具有的视频通话切换功能，进一步的提高了第一终端的智能性。The switching instruction is an instruction input by the user on the video call display interface of the first terminal, which is used to switch the video call to the target smart screen device. Specifically, when switching suggestion information is displayed on the display interface of the video call of the first terminal, the user can determine whether to switch the video call to the target smart screen device according to the switch suggestion information, and if it is determined to switch the video call to the target smart screen device, then The user inputs the switching instruction by triggering the switching control or other means on the display interface of the video call. After obtaining the switching instruction input by the user, the first terminal searches again for available smart screen devices in the nearby area. If multiple smart screens are found. device, and select a smart screen device from which you want to switch video calls as the target smart screen device. In the above embodiment, when the first terminal finds that there is a smart screen device capable of switching video calls nearby, it immediately displays switching suggestion information on the display interface of the video call, so that the user can timely know the video call switching function possessed by the first terminal, The intelligence of the first terminal is further improved.
可选的，提供了一种上述S203的具体实现方式，如图9所示，上述S203中的“重新搜索可用的智慧屏设备，并从搜索到的可用的智慧屏设备中确定目标智慧屏设备”，包括：Optionally, a specific implementation of the above S203 is provided. As shown in FIG. 9 , in the above S203, “research for available smart screen devices, and determine the target smart screen device from the searched available smart screen devices. ",include:
S301，搜索可用的智慧屏设备，并显示可用的智慧屏设备的设备标识。S301 , searching for available smart screen devices, and displaying the device identifiers of the available smart screen devices.
第一终端基于切换建议信息获取切换指令后，即可重新搜索附近区域内可用的智慧屏设备，当搜索到可用的智慧屏设备时，可以在第一终端的视频通话的显示界面上显示搜索到的可用的智慧屏设备的设备标识或可用的智慧屏设备的设备名称，具体可以通过列表的形式显示搜索到的智慧屏设备的设备标识或设备名称。可用的智慧屏设备的显示区域可以覆盖整个视频通话的显示界面，也可以覆盖视频通话的部分显示界面。例如，如图10所示的第一终端的显示界面，其上显示有搜索到的智慧屏设备1、智慧屏设备2、智慧屏设备3。After the first terminal obtains the switching instruction based on the switching suggestion information, it can re-search for available smart screen devices in the nearby area, and when an available smart screen device is searched, it can be displayed on the display interface of the video call of the first terminal. The device identifiers of the available smart screen devices or the device names of the available smart screen devices, specifically, the device identifiers or device names of the searched smart screen devices can be displayed in the form of a list. The display area of the available smart screen device can cover the entire display interface of the video call, or can cover part of the display interface of the video call. For example, as shown in FIG. 10 , on the display interface of the first terminal, the searched smart screen device 1 , smart screen device 2 , and smart screen device 3 are displayed thereon.
S302，基于各可用的智慧屏设备的设备标识，获取选择指令；选择指令包括目标设备标识。S302, based on the device identifiers of each available smart screen device, obtain a selection instruction; the selection instruction includes the target device identifier.
其中，目标设备标识为用户选择的将要切换视频通话的智慧屏设备的标识。具体地，当 第一终端的视频通话的显示界面上显示多个可用的智慧屏设备的标识时，用户可以在显示界面上执行相应的选择操作，即从多个可用的智慧屏设备中选择一个可用的智慧屏设备，当用户执行完选择操作生成选择指令时，选择指令中携带目标设备标识。The target device identifier is the identifier of the smart screen device selected by the user to switch the video call. Specifically, when the identifiers of multiple available smart screen devices are displayed on the display interface of the video call of the first terminal, the user can perform a corresponding selection operation on the display interface, that is, select one from the multiple available smart screen devices For available smart screen devices, when the user finishes the selection operation and generates a selection instruction, the selection instruction carries the target device identifier.
S303，将目标设备标识对应的智慧屏设备确定为目标智慧屏设备。S303: Determine the smart screen device corresponding to the target device identifier as the target smart screen device.
具体地，当第一终端获取到选择指令时，可以进一步的解析选择指令，从中获取到目标设备标识，然后将该目标设备标识对应的智慧屏设备确定为目标智慧屏设备进行视频通话切换。上述实施例中，用户可以根据自己的选择操作确定目标智慧屏设备，提高了第一终端将视频通话切换至目标智慧屏设备的安全性。Specifically, when the first terminal obtains the selection instruction, it can further parse the selection instruction, obtain the target device identifier therefrom, and then determine the smart screen device corresponding to the target device identifier as the target smart screen device for video call switching. In the above embodiment, the user can determine the target smart screen device according to his own selection operation, which improves the security of the first terminal switching the video call to the target smart screen device.
在一个实施例中，提供了上述S101的一种实现方式，如图11所示，上述S101中的“与目标智慧屏设备建立近距离通信网络连接”，包括：In one embodiment, an implementation manner of the above S101 is provided. As shown in FIG. 11 , the “establishing a short-range communication network connection with the target smart screen device” in the above S101 includes:
S401，与目标智慧屏设备建立蓝牙连接。S401, establish a Bluetooth connection with the target smart screen device.
第一终端与目标智慧屏设备建立近距离通信网络连接时，可以先与目标智慧屏设备建立蓝牙连接，以便快速连接到目标智慧屏设备。When the first terminal establishes a short-range communication network connection with the target smart screen device, it can first establish a Bluetooth connection with the target smart screen device, so as to quickly connect to the target smart screen device.
S402，通过蓝牙连接向目标智慧屏设备发送网络连接请求；网络连接请求包括近距离通信网络的参数。S402, send a network connection request to the target smart screen device through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
其中，网络连接请求用于请求与目标智慧屏设备建立近距离通信网络连接(例如局域网络连接)。当第一终端通过蓝牙连接上目标智慧屏设备时，第一终端可以向目标智慧屏设备发送网络连接请求，目标智慧屏设备在接收到网络连接请求时可以进一步的解析网络连接请求得到近距离通信网络的参数，然后根据该近距离通信网络的参数建立与第一终端的网络连接，当建立网络连接成功后，目标智慧屏设备通过蓝牙连接响应第一终端发送的网络连接请求，以告知第一终端网络连接成功。Wherein, the network connection request is used for requesting to establish a short-range communication network connection (for example, a local area network connection) with the target smart screen device. When the first terminal is connected to the target smart screen device through Bluetooth, the first terminal can send a network connection request to the target smart screen device, and the target smart screen device can further parse the network connection request to obtain short-range communication when receiving the network connection request. parameters of the network, and then establish a network connection with the first terminal according to the parameters of the short-range communication network. When the network connection is established successfully, the target smart screen device responds to the network connection request sent by the first terminal through the Bluetooth connection to inform the first terminal. The terminal network connection is successful.
S403，接收目标智慧屏设备通过蓝牙连接反馈的网络连接响应；网络连接响应表示基于近距离通信网络的连接建立成功。S403: Receive a network connection response fed back by the target smart screen device through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
具体地，当目标智慧屏设备响应第一终端发送的网络连接请求后，第一终端接收目标智慧屏设备反馈的网络连接响应，并在接收到网络连接响应之后，即可开始基于建立的网络连接与目标智慧屏设备之间进行数据交互。Specifically, after the target smart screen device responds to the network connection request sent by the first terminal, the first terminal receives the network connection response fed back by the target smart screen device, and after receiving the network connection response, can start based on the established network connection Data interaction with the target smart screen device.
上述实施例中先建立第一设备与目标智慧屏设备之间的蓝牙连接，再通过蓝牙连接传递网络连接请求和近距离通信网络的参数，使第一终端与目标智慧屏设备再建立网络连接，并之后基于网络连接进行数据交互。由于蓝牙连接的速度很快，因此该方法相比于传统的直接搜索网络信号建立网络连接的方法，可以提高第一终端与目标智慧屏设备之间网络连接的建立速度，进而提高第一终端切换视频通话至目标智慧屏设备的时效性。In the above embodiment, the Bluetooth connection between the first device and the target smart screen device is first established, and then the network connection request and the parameters of the short-range communication network are transmitted through the Bluetooth connection, so that the first terminal and the target smart screen device can establish a network connection again. And then based on the network connection for data exchange. Because the speed of the Bluetooth connection is very fast, compared with the traditional method of directly searching for network signals to establish a network connection, this method can improve the speed of establishing a network connection between the first terminal and the target smart screen device, thereby improving the switching speed of the first terminal. Timeliness of video calls to the target smart screen device.
在实际应用中，当目标智慧屏设备播放第一终端的视频通话的界面显示数据和第一音频数据时，第一终端用户即可与对接的终端用户通过目标智慧屏设备进行视频通话，即上述S103之后，如图12所示，图2实施例所述的方法还包括：In practical applications, when the target smart screen device plays the interface display data and the first audio data of the video call of the first terminal, the first terminal user can conduct a video call with the connected terminal user through the target smart screen device, that is, the above-mentioned After S103, as shown in FIG. 12, the method described in the embodiment of FIG. 2 further includes:
S105，通过近距离通信网络接收目标智慧屏设备发送的图像数据和第二音频数据；图像数据为目标智慧屏设备的图像采集装置采集到的图像数据，第二音频数据为目标智慧屏设备的音频采集装置采集到的音频数据。S105, receive image data and second audio data sent by the target smart screen device through a short-range communication network; the image data is image data collected by an image acquisition device of the target smart screen device, and the second audio data is the audio of the target smart screen device The audio data collected by the collecting device.
其中，图像采集装置可以是目标智慧屏设备上安装的摄像头，摄像头可以安装在目标智慧屏设备的显示屏前端，以便采集第一终端用户的图像数据。音频采集装置可以是目标智慧屏设备上安装的录制语音装置，录制语音装置可以被安装在目标智慧屏设备的任意位置。The image acquisition device may be a camera installed on the target smart screen device, and the camera may be installed at the front end of the display screen of the target smart screen device, so as to collect image data of the first terminal user. The audio collection device can be a voice recording device installed on the target smart screen device, and the voice recording device can be installed anywhere on the target smart screen device.
具体地，当第一终端将界面显示数据和第一音频数据发送至目标智慧屏设备进行播放后，目标智慧屏设备可以通过图像采集装置采集第一终端用户的图像数据，以及通过音频采集装置采集第一终端用户的第二音频数据，然后目标智慧屏设备通过近距离通信网络将采集到的图像数据和第二音频数据发送给第一终端。Specifically, after the first terminal sends the interface display data and the first audio data to the target smart screen device for playback, the target smart screen device can collect the image data of the user of the first terminal through the image collection device, and collect the image data through the audio collection device. The second audio data of the first terminal user, and then the target smart screen device sends the collected image data and the second audio data to the first terminal through the short-range communication network.
S106，将图像数据和第二音频数据发送至第二终端；第二终端为与第一终端进行视频通 话的终端。S106: Send the image data and the second audio data to the second terminal; the second terminal is a terminal that conducts a video call with the first terminal.
当第一终端接收到目标智慧屏设备发送的图像数据和第二音频数据时，即可将图像数据和第二音频数据发送至与第一终端进行视频通话的第二终端，实现第一终端用户与第二终端用户的视频通话。本实施例所述的方法实现了目标智慧屏设备通过第一终端与第二终端进行视频通话的功能，即目标智慧屏设备仅需要将采集的图像数据和第二音频数据发送给第一终端即可与第二终端进行视频通话，且不需要安装任何与第二终端相同的视频通话应用程序，也不需要具有与第二终端的设备类型保持一致等硬件要求，因此，目标智慧屏设备的应用场景不受限定。而且，第一终端与第二终端的应用场景也不受限定，即本申请提供的方法可以适用于任何不同类型、不同型号的第一终端和第二终端。When the first terminal receives the image data and the second audio data sent by the target smart screen device, it can send the image data and the second audio data to the second terminal that is in the video call with the first terminal, so that the user of the first terminal can Video call with second end user. The method described in this embodiment realizes the function of the target smart screen device making a video call with the second terminal through the first terminal, that is, the target smart screen device only needs to send the collected image data and the second audio data to the first terminal, that is A video call can be made with the second terminal, and there is no need to install any video call application that is the same as the second terminal, nor does it need to have the same hardware requirements as the device type of the second terminal. Therefore, the application of the target smart screen device Scenarios are not limited. Moreover, the application scenarios of the first terminal and the second terminal are also not limited, that is, the method provided in this application can be applied to any different types and models of the first terminal and the second terminal.
在实际应用中存在一种应用场景，即在第一终端将视频通话切换至目标智慧屏设备上进行播放后，第一终端的视频通话的显示界面上可以显示后台切换控件(如图13所示的后台切换控件D)。该后台切换控件用于控制当前的视频通话对应的应用切换至第一终端后台运行。In practical applications, there is an application scenario, that is, after the first terminal switches the video call to the target smart screen device for playback, the background switching control can be displayed on the display interface of the video call of the first terminal (as shown in Figure 13 ). background toggle control D). The background switching control is used to control the application corresponding to the current video call to switch to run in the background of the first terminal.
在此情况下，第一终端会实时检测后台切换控件是否被触发，若检测到后台切换控件被触发，则控制视频通话对应的应用切换至后台运行，以便用户可以在第一终端上进行其它应用操作，例如，浏览网页、查看消息等。In this case, the first terminal will detect in real time whether the background switching control is triggered, and if it is detected that the background switching control is triggered, it will control the application corresponding to the video call to switch to the background running, so that the user can perform other applications on the first terminal Actions, such as browsing web pages, viewing messages, etc.
在另一种应用场景中，若第一终端检测到视频通话对应的应用切换至后台运行时，在第一终端的显示界面上显示视频通话的功能控件(如图14所示的功能控件E)。该视频通话的功能控件用于控制视频通话对应的应用切换至前台运行。In another application scenario, if the first terminal detects that the application corresponding to the video call is switched to run in the background, a function control of the video call (function control E shown in FIG. 14 ) is displayed on the display interface of the first terminal. . The function control of the video call is used to control the application corresponding to the video call to switch to run in the foreground.
在此情况下，第一终端会实时检测视频通话的功能控件是否被触发，若检测到视频通话的功能控件被触发，则控制视频通话对应的应用切换至前台运行，以便用户重新在第一终端上查看到视频通话的画面。上述视频通话的功能控件和后台切换控件的设置，使第一终端将视频通话切换到目标智慧屏设备进行播放时，还可以并行进行其它应用操作，提高了第一终端在视频通话过程中的灵活使用性。In this case, the first terminal will detect in real time whether the function control of the video call is triggered, and if it is detected that the function control of the video call is triggered, it will control the application corresponding to the video call to switch to run in the foreground, so that the user can reconnect to the first terminal to see the screen of the video call. The settings of the above video call function controls and background switching controls enable the first terminal to perform other application operations in parallel when switching the video call to the target smart screen device for playback, which improves the flexibility of the first terminal during the video call. usability.
在实际应用中还存在一种应用场景，即在第一终端将视频通话切换至目标智慧屏设备上进行播放后，第一终端的视频通话的显示界面上还可以显示连接断开控件(如图13所示的连接断开控件F)。该连接断开控件用于控制第一终端断开与目标智慧屏设备之间的连接。In practical applications, there is also an application scenario, that is, after the first terminal switches the video call to the target smart screen device for playback, the display interface of the video call of the first terminal can also display a disconnection control (as shown in the figure). Disconnect control F) shown in 13. The disconnection control is used to control the first terminal to disconnect from the target smart screen device.
在此情况下，第一终端会实时检测视频通话的连接断开控件是否被触发，若检测到连接断开控件被触发，则第一终端直接断开与目标智慧屏设备之间的连接，具体可以停止发送界面显示数据和第一音频数据至目标智慧屏设备，或者直接断开与目标智慧屏之间的近距离通信网络连接。可以理解的是，上述几个应用场景中几种控件的触发方式可以根据应用需求预先设定，例如，点击触发、滑动触发等，此处不做限定。上述连接断开控件的设置，使用户可以根据自身的需求随时在第一终端上进行操作以切断目标智慧屏的视频通话过程，提供了一种手动终止目标智慧屏设备播放视频通话的功能。In this case, the first terminal will detect in real time whether the disconnection control of the video call is triggered. If it is detected that the disconnection control is triggered, the first terminal will directly disconnect the connection with the target smart screen device. It is possible to stop sending the interface display data and the first audio data to the target smart screen device, or directly disconnect the short-range communication network connection with the target smart screen. It can be understood that the triggering methods of several controls in the above application scenarios can be preset according to application requirements, for example, click triggering, sliding triggering, etc., which are not limited here. The setting of the above-mentioned connection and disconnection control enables the user to operate on the first terminal at any time according to their own needs to cut off the video call process of the target smart screen, and provides a function of manually terminating the video call played by the target smart screen device.
上述图2实施例至图14实施例所述的方法为第一终端侧所述的视频通信方法，下面图15实施例至图17实施例所述的方法为目标智慧屏设备侧所述的视频通信方法。The methods described in the above embodiments in FIG. 2 to FIG. 14 are the video communication methods described in the first terminal side, and the methods described in the following embodiments in FIG. 15 to FIG. 17 are the video communication methods described in the target smart screen device side communication method.
图15为一个实施例中视频通信方法的流程图。本实施例中的视频通信方法，以运行于图1中的目标智慧屏设备103上为例进行描述。如图15所示，该方法包括：Figure 15 is a flowchart of a video communication method in one embodiment. The video communication method in this embodiment is described by taking the operation on the target smart screen device 103 in FIG. 1 as an example. As shown in Figure 15, the method includes:
S501，接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，界面显示数据和第一音频数据为第一终端进入视频通话时的数据。S501: Receive interface display data and first audio data sent by a first terminal through a short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call.
S502，播放界面显示数据和第一音频数据。S502, the playback interface displays the data and the first audio data.
上述各步骤所述的方法在前述图2实施例中都有说明，详细说明请参见前述图2实施例所述的内容。The methods described in the above steps are described in the foregoing embodiment of FIG. 2 . For detailed description, please refer to the content described in the foregoing embodiment of FIG. 2 .
基于上述实施例，本申请还提供了一种视频通信方法，如图16所示，图15实施例所述的方法还包括：Based on the foregoing embodiment, the present application further provides a video communication method, as shown in FIG. 16 , the method described in the embodiment of FIG. 15 further includes:
S503，通过图像采集装置采集图像数据，以及通过音频采集装置采集第二音频数据。S503 , collecting image data through an image collecting device, and collecting second audio data through an audio collecting device.
本实施例所述的方法与前述步骤S105所述的方法一致，详细说明内容请参见前述图12实施例所述的方法，此处不赘述。The method described in this embodiment is the same as the method described in the foregoing step S105 . For details, please refer to the method described in the foregoing embodiment in FIG. 12 , which will not be repeated here.
S504，通过近距离通信网络，将图像数据和第二音频数据发送至第一终端；第一终端用于将图像数据和第二音频数据发送至第二终端；第二终端为与第一终端进行视频通话的终端。S504, send the image data and the second audio data to the first terminal through the short-range communication network; the first terminal is used for sending the image data and the second audio data to the second terminal; the second terminal is used for communicating with the first terminal Terminal for video calls.
本实施例所述的方法与前述步骤S106所述的方法一致，详细说明内容请参见前述图12实施例所述的方法，此处不赘述。The method described in this embodiment is the same as the method described in the foregoing step S106 . For details, please refer to the method described in the foregoing embodiment in FIG. 12 , which will not be repeated here.
在一个实施例中，本申请还提供了一种视频通信方法，如图17所示，图15实施例所述的方法还包括：In an embodiment, the present application further provides a video communication method. As shown in FIG. 17 , the method described in the embodiment of FIG. 15 further includes:
S601，与第一终端建立蓝牙连接。S601, establishing a Bluetooth connection with a first terminal.
本实施例所述的方法与前述步骤S401所述的方法一致，详细说明内容请参见前述图11实施例所述的方法，此处不赘述。The method described in this embodiment is the same as the method described in the foregoing step S401 . For detailed description, please refer to the method described in the foregoing embodiment in FIG. 11 , which will not be repeated here.
S602，通过蓝牙连接接收第一终端发送的网络连接请求；网络连接请求包括近距离通信网络的参数。S602: Receive a network connection request sent by the first terminal through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
本实施例所述的方法与前述步骤S402所述的方法一致，详细说明内容请参见前述图11实施例所述的方法，此处不赘述。The method described in this embodiment is the same as the method described in the foregoing step S402. For detailed description, please refer to the method described in the foregoing embodiment in FIG. 11, which will not be repeated here.
S603，通过蓝牙连接向第一终端反馈网络连接响应；网络连接响应表示基于近距离通信网络的连接建立成功。S603, a network connection response is fed back to the first terminal through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
本实施例所述的方法与前述步骤S403所述的方法一致，详细说明内容请参见前述图11实施例所述的方法，此处不赘述。The method described in this embodiment is the same as the method described in the foregoing step S403. For detailed description, please refer to the method described in the foregoing embodiment in FIG. 11, which is not repeated here.
综合上述所有实施例，本申请提供了一种视频通信方法，如图18所示，该方法包括：Combining all the above embodiments, the present application provides a video communication method, as shown in FIG. 18 , the method includes:
S701，第一终端在检测到第一终端进入视频通话的情况下，与目标智慧屏设备建立蓝牙连接。S701, the first terminal establishes a Bluetooth connection with the target smart screen device when detecting that the first terminal has entered into a video call.
S702，目标智慧屏设备与第一终端建立蓝牙连接。S702, the target smart screen device establishes a Bluetooth connection with the first terminal.
S703，第一终端通过蓝牙连接向目标智慧屏设备发送网络连接请求；网络连接请求包括近距离通信网络的参数。S703, the first terminal sends a network connection request to the target smart screen device through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
S704，目标智慧屏设备通过蓝牙连接接收第一终端发送的网络连接请求；网络连接请求包括近距离通信网络的参数。S704, the target smart screen device receives a network connection request sent by the first terminal through a Bluetooth connection; the network connection request includes parameters of the short-range communication network.
S705，目标智慧屏设备通过蓝牙连接向第一终端反馈网络连接响应；网络连接响应表示基于近距离通信网络的连接建立成功。S705, the target smart screen device feeds back a network connection response to the first terminal through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
S706，第一终端接收目标智慧屏设备通过蓝牙连接反馈的网络连接响应；网络连接响应表示基于近距离通信网络的连接建立成功。S706, the first terminal receives a network connection response fed back by the target smart screen device through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
S707，第一终端采用录屏的方式获取视频通话的界面显示数据和第一音频数据。S707, the first terminal acquires the interface display data and the first audio data of the video call by recording the screen.
S708，第一终端采用预设的过滤规则，对视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，得到过滤后的界面显示数据和过滤后的音频数据。S708, the first terminal uses a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data to obtain filtered interface display data and filtered audio data.
S709，第一终端通过近距离通信网络，将过滤后的界面显示数据和过滤后的音频数据发送至目标智慧屏设备。S709, the first terminal sends the filtered interface display data and the filtered audio data to the target smart screen device through the short-range communication network.
S710，目标智慧屏设备接收过滤后的界面显示数据和过滤后的音频数据。S710, the target smart screen device receives the filtered interface display data and the filtered audio data.
S711，目标智慧屏设备播放过滤后的界面显示数据和过滤后的音频数据。S711, the target smart screen device plays the filtered interface display data and the filtered audio data.
S712，目标智慧屏设备通过图像采集装置采集图像数据，以及通过音频采集装置采集第二音频数据。S712, the target smart screen device collects image data through an image collection device, and collects second audio data through an audio collection device.
S713，目标智慧屏设备通过近距离通信网络，将图像数据和第二音频数据发送至第一终端。S713, the target smart screen device sends the image data and the second audio data to the first terminal through the short-range communication network.
S714，目标智慧屏设备将图像数据和第二音频数据发送至第二终端。S714, the target smart screen device sends the image data and the second audio data to the second terminal.
上述各步骤所述的方法在前述实施例中都有说明，详细说明请参见前述实施例所述的内容。The methods described in the above steps are described in the foregoing embodiments, and for detailed descriptions, please refer to the contents described in the foregoing embodiments.
应该理解的是，虽然图2-图18的流程图中的各个步骤按照箭头的指示依次显示，但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明，这些步骤的执行并没有严格的顺序限制，这些步骤可以以其它的顺序执行。而且，图2-图18中的至少一部分步骤可以包括多个子步骤或者多个阶段，这些子步骤或者阶段并不必然是在同一时刻执行完成，而是可以在不同的时刻执行，这些子步骤或者阶段的执行顺序也不必然是依次进行，而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flowcharts of FIGS. 2 to 18 are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIG. 2-FIG. 18 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. These sub-steps or stages may be executed at different times. The order of execution of the stages is also not necessarily sequential, but may be performed alternately or alternately with other steps or sub-steps of other steps or at least a portion of a stage.
在一个实施例中，如图19所示，提供了一种视频通信装置，包括：检测连接模块11、获取模块12和切换模块13，其中：In one embodiment, as shown in FIG. 19, a video communication device is provided, including: a detection connection module 11, an acquisition module 12 and a switching module 13, wherein:
检测连接模块11，用于在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；The detection and connection module 11 is configured to search for the target smart screen device when it is detected that the first terminal enters the video call, and establish a connection based on the short-range communication network with the target smart screen device;
获取模块12，用于获取所述视频通话的界面显示数据和第一音频数据；an acquisition module 12, configured to acquire interface display data and first audio data of the video call;
切换模块13，用于通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。The switching module 13 is configured to send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
在一个实施例中，如图20所示，提供了一种视频通信装置，包括：接收模块21和播放模块22，其中：In one embodiment, as shown in FIG. 20, a video communication apparatus is provided, including: a receiving module 21 and a playing module 22, wherein:
接收模块21，用于接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；The receiving module 21 is configured to receive interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
播放模块22，用于播放所述界面显示数据和所述第一音频数据。The playing module 22 is configured to play the interface display data and the first audio data.
上述视频通信装置中各个模块的划分仅仅用于举例说明，在其他实施例中，可将视频通信装置按照需要划分为不同的模块，以完成上述视频通信装置的全部或部分功能。The division of each module in the above video communication apparatus is only for illustration. In other embodiments, the video communication apparatus may be divided into different modules as required to complete all or part of the functions of the above video communication apparatus.
关于视频通信装置的具体限定可以参见上文中对于视频通信方法的限定，在此不再赘述。上述视频通信装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。For the specific limitations of the video communication apparatus, reference may be made to the above limitations on the video communication method, which will not be repeated here. Each module in the above-mentioned video communication device may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
在一个实施例中，提供了一种电子设备，该电子设备可以是终端，其内部结构图可以如图21所示。该电子设备包括通过***总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中，该电子设备的处理器用于提供计算和控制能力。该电子设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作***和计算机程序。该内存储器为非易失性存储介质中的操作***和计算机程序的运行提供环境。该电子设备的通信接口用于与外部的终端进行有线或无线方式的通信，无线方式可通过WIFI、运营商网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种视频通信方法。该电子设备的显示屏可以是液晶显示屏或者电子墨水显示屏，该电子设备的输入装置可以是显示屏上覆盖的触摸层，也可以是电子设备外壳上设置的按键、轨迹球或触控板，还可以是外接的键盘、触控板或鼠标等。In one embodiment, an electronic device is provided, the electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. 21 . The electronic device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The communication interface of the electronic device is used for wired or wireless communication with an external terminal, and the wireless communication can be realized by WIFI, operator network, NFC (Near Field Communication) or other technologies. The computer program, when executed by a processor, implements a video communication method. The display screen of the electronic device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the electronic device , or an external keyboard, trackpad, or mouse.
本领域技术人员可以理解，图21中示出的结构，仅仅是与本申请方案相关的部分结构的框图，并不构成对本申请方案所应用于其上的电子设备的限定，具体的电子设备可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in FIG. 21 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may be Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.
在一个实施例中，提供了一种电子设备，包括存储器和处理器，存储器中存储有计算机程序，该处理器执行计算机程序时实现以下步骤：In one embodiment, an electronic device is provided, including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；In the case of detecting that the first terminal enters the video call, search for the target smart screen device, and establish a connection based on the short-range communication network with the target smart screen device;
获取所述视频通话的界面显示数据和第一音频数据；obtaining interface display data and first audio data of the video call;
通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。Through the short-range communication network, the interface display data and the first audio data are sent to the target smart screen device for playback.
上述实施例提供的一种电子设备，其实现原理和技术效果与上述方法实施例类似，在此 不再赘述。The implementation principle and technical effect of the electronic device provided by the above-mentioned embodiments are similar to those of the above-mentioned method embodiments, and details are not described herein again.
在一个实施例中，提供了一种电子设备，包括存储器和处理器，存储器中存储有计算机程序，该处理器执行计算机程序时实现以下步骤：In one embodiment, an electronic device is provided, including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；receiving interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
播放所述界面显示数据和所述第一音频数据。Playing the interface display data and the first audio data.
上述实施例提供的一种电子设备，其实现原理和技术效果与上述方法实施例类似，在此不再赘述。The implementation principle and technical effect of the electronic device provided by the foregoing embodiment are similar to those of the foregoing method embodiment, and details are not described herein again.
在一个实施例中，提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现以下步骤：In one embodiment, a computer-readable storage medium is provided on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；In the case of detecting that the first terminal enters the video call, search for the target smart screen device, and establish a connection based on the short-range communication network with the target smart screen device;
获取所述视频通话的界面显示数据和第一音频数据；obtaining interface display data and first audio data of the video call;
通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。Through the short-range communication network, the interface display data and the first audio data are sent to the target smart screen device for playback.
在一个实施例中，提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现以下步骤：In one embodiment, a computer-readable storage medium is provided on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；receiving interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
播放所述界面显示数据和所述第一音频数据。Playing the interface display data and the first audio data.
上述实施例提供的一种计算机可读存储介质，其实现原理和技术效果与上述方法实施例类似，在此不再赘述。The implementation principle and technical effect of the computer-readable storage medium provided by the above-mentioned embodiments are similar to those of the above-mentioned method embodiments, and details are not described herein again.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一非易失性计算机可读取存储介质中，该计算机程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-Only Memory，ROM)、磁带、软盘、闪存或光存储器等。易失性存储器可包括随机存取存储器(Random Access Memory，RAM)或外部高速缓冲存储器。作为说明而非局限，RAM可以是多种形式，比如静态随机存取存储器(Static Random Access Memory，SRAM)或动态随机存取存储器(Dynamic Random Access Memory，DRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the various embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical memory, and the like. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, the RAM may be in various forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。以上所述实施例仅表达了本申请的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification. The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (22)

  1. 一种视频通信方法，其特征在于，所述方法包括：A video communication method, characterized in that the method comprises:
    在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；In the case of detecting that the first terminal enters the video call, search for the target smart screen device, and establish a connection based on the short-range communication network with the target smart screen device;
    获取所述视频通话的界面显示数据和第一音频数据；obtaining interface display data and first audio data of the video call;
    通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。Through the short-range communication network, the interface display data and the first audio data are sent to the target smart screen device for playback.
  2. 根据权利要求1所述的方法，其特征在于，所述获取所述视频通话的界面显示数据和第一音频数据，包括：The method according to claim 1, wherein the acquiring the interface display data and the first audio data of the video call comprises:
    采用录屏的方式获取所述视频通话的界面显示数据和第一音频数据。The interface display data and the first audio data of the video call are acquired by recording the screen.
  3. 根据权利要求2所述的方法，其特征在于，所述方法还包括：The method according to claim 2, wherein the method further comprises:
    采用预设的过滤规则，对所述视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，得到过滤后的界面显示数据和过滤后的音频数据；Using preset filtering rules, filter the interface display data of the video call and the privacy information in the first audio data to obtain filtered interface display data and filtered audio data;
    所述通过所述近距离通信网络，将所述界面显示数据和音频数据发送至所述目标智慧屏设备进行播放，包括：Sending the interface display data and audio data to the target smart screen device for playback through the short-range communication network includes:
    通过所述近距离通信网络，将所述过滤后的界面显示数据和过滤后的音频数据发送至所述目标智慧屏设备进行播放。Through the short-range communication network, the filtered interface display data and the filtered audio data are sent to the target smart screen device for playback.
  4. 根据权利要求3所述的方法，其特征在于，所述采用预设的过滤规则，对所述视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，包括：The method according to claim 3, wherein the adopting a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, comprising:
    根据预设的白名单列表，从所述界面显示数据中筛选出所述白名单列表对应的界面显示数据作为所述过滤后的界面显示数据，以及，从所述第一音频数据中筛选出所述白名单列表对应的音频数据作为所述过滤后的音频数据；所述白名单列表中包括非隐私信息的标识。According to a preset whitelist list, the interface display data corresponding to the whitelist list is filtered out from the interface display data as the filtered interface display data, and the first audio data is filtered out of the interface display data. The audio data corresponding to the whitelist is used as the filtered audio data; the whitelist includes the identification of non-privacy information.
  5. 根据权利要求3所述的方法，其特征在于，所述采用预设的过滤规则，对所述视频通话的界面显示数据和第一音频数据中的隐私信息进行过滤，包括：The method according to claim 3, wherein the adopting a preset filtering rule to filter the interface display data of the video call and the privacy information in the first audio data, comprising:
    根据预设的黑名单列表，将所述界面显示数据中所述黑名单列表对应的数据滤除，得到所述过滤后的界面显示数据，以及，将所述第一音频数据中所述黑名单列表对应的数据滤除，得到所述过滤后的音频数据；所述黑名单列表中包括隐私信息的标识。Filter out the data corresponding to the blacklist in the interface display data according to a preset blacklist to obtain the filtered interface display data, and filter the blacklist in the first audio data The data corresponding to the list is filtered out to obtain the filtered audio data; the blacklist list includes the identifier of the privacy information.
  6. 根据权利要求1-5任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-5, wherein the method further comprises:
    在所述第一终端的屏幕处于灭屏状态的情况下，继续执行通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放的步骤。When the screen of the first terminal is in an off-screen state, continue to perform the step of sending the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
  7. 根据权利要求1-5任一项所述的方法，其特征在于，所述在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，包括：The method according to any one of claims 1-5, wherein, when it is detected that the first terminal enters a video call, searching for a target smart screen device includes:
    在检测到所述第一终端进入视频通话的情况下，搜索可用的智慧屏设备；In the case of detecting that the first terminal has entered a video call, search for available smart screen devices;
    若搜索到可用的智慧屏设备，在所述视频通话的显示界面上显示切换建议信息；所述切换建议信息用于提示用户将所述视频通话切换至智慧屏设备；If an available smart screen device is found, display switching suggestion information on the display interface of the video call; the switching suggestion information is used to prompt the user to switch the video call to the smart screen device;
    基于所述切换建议信息获取切换指令后，重新搜索可用的智慧屏设备，并从搜索到的可用的智慧屏设备中确定所述目标智慧屏设备。After the switching instruction is acquired based on the switching suggestion information, the available smart screen devices are searched again, and the target smart screen device is determined from the searched available smart screen devices.
  8. 根据权利要求7所述的方法，其特征在于，所述重新搜索可用的智慧屏设备，并从搜索到的可用的智慧屏设备中确定所述目标智慧屏设备，包括：The method according to claim 7, wherein the re-searching for available smart screen devices, and determining the target smart screen device from the searched available smart screen devices, comprises:
    搜索可用的智慧屏设备，并显示所述可用的智慧屏设备的设备标识；Search for available smart screen devices, and display the device identifiers of the available smart screen devices;
    基于各所述可用的智慧屏设备的设备标识，获取选择指令；所述选择指令包括目标设备标识；Obtain a selection instruction based on the device identifier of each of the available smart screen devices; the selection instruction includes the target device identifier;
    将所述目标设备标识对应的智慧屏设备确定为所述目标智慧屏设备。The smart screen device corresponding to the target device identifier is determined as the target smart screen device.
  9. 根据权利要求7所述的方法，其特征在于，所述切换建议信息包括切换文字提示信 息和切换控件中的至少一种；所述在所述视频通话的显示界面上显示切换建议信息，包括：The method according to claim 7, wherein the switching suggestion information includes at least one of switching text prompt information and switching controls; the displaying the switching suggestion information on the display interface of the video call includes:
    若所述第一终端在所述视频通话的显示界面上首次显示所述切换建议信息，则在所述视频通话的显示界面上显示所述切换文字提示信息和所述切换控件；If the first terminal displays the switching suggestion information on the display interface of the video call for the first time, displaying the switching text prompt information and the switching control on the display interface of the video call;
    若非首次显示所述切换建议信息，则在所述视频通话的显示界面上显示所述切换控件。If the switching suggestion information is not displayed for the first time, the switching control is displayed on the display interface of the video call.
  10. 根据权利要求1-5任一项所述的方法，其特征在于，所述与所述目标智慧屏设备建立近距离通信网络连接，包括：The method according to any one of claims 1-5, wherein the establishing a short-range communication network connection with the target smart screen device comprises:
    与所述目标智慧屏设备建立蓝牙连接；establishing a Bluetooth connection with the target smart screen device;
    通过所述蓝牙连接向所述目标智慧屏设备发送网络连接请求；所述网络连接请求包括所述近距离通信网络的参数；Send a network connection request to the target smart screen device through the Bluetooth connection; the network connection request includes the parameters of the short-range communication network;
    接收所述目标智慧屏设备通过所述蓝牙连接反馈的网络连接响应；所述网络连接响应表示所述基于近距离通信网络的连接建立成功。A network connection response fed back by the target smart screen device through the Bluetooth connection is received; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  11. 根据权利要求1-5任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-5, wherein the method further comprises:
    通过所述近距离通信网络接收所述目标智慧屏设备发送的图像数据和第二音频数据；所述图像数据为所述目标智慧屏设备的图像采集装置采集到的图像数据，所述第二音频数据为所述目标智慧屏设备的音频采集装置采集到的音频数据；Receive image data and second audio data sent by the target smart screen device through the short-range communication network; the image data is the image data collected by the image acquisition device of the target smart screen device, and the second audio The data is the audio data collected by the audio collection device of the target smart screen device;
    将所述图像数据和所述第二音频数据发送至第二终端；所述第二终端为与所述第一终端进行视频通话的终端。The image data and the second audio data are sent to a second terminal; the second terminal is a terminal that conducts a video call with the first terminal.
  12. 根据权利要求1-5任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-5, wherein the method further comprises:
    若检测到所述视频通话对应的应用切换至后台运行，则在所述第一终端的显示界面上显示所述视频通话的功能控件。If it is detected that the application corresponding to the video call is switched to run in the background, the function controls of the video call are displayed on the display interface of the first terminal.
  13. 根据权利要求12所述的方法，其特征在于，所述方法还包括：The method of claim 12, wherein the method further comprises:
    若检测到所述视频通话的功能控件被触发，则控制所述视频通话对应的应用切换至前台运行。If it is detected that the function control of the video call is triggered, the application corresponding to the video call is controlled to be switched to run in the foreground.
  14. 根据权利要求12所述的方法，其特征在于，所述第一终端的视频通话的显示界面上包括后台切换控件，所述方法还包括：The method according to claim 12, wherein the display interface of the video call of the first terminal includes a background switching control, and the method further comprises:
    若检测到所述后台切换控件被触发，则控制所述视频通话对应的应用切换至后台运行。If it is detected that the background switching control is triggered, the application corresponding to the video call is controlled to be switched to run in the background.
  15. 根据权利要求14所述的方法，其特征在于，所述第一终端的视频通话的显示界面上还包括连接断开控件，所述方法还包括：The method according to claim 14, wherein the display interface of the video call of the first terminal further comprises a connection and disconnection control, and the method further comprises:
    若检测到所述连接断开控件被触发，则控制所述第一终端断开与所述目标智慧屏设备之间的连接。If it is detected that the disconnection control is triggered, the first terminal is controlled to disconnect the connection with the target smart screen device.
  16. 一种视频通信方法，其特征在于，所述方法包括：A video communication method, characterized in that the method comprises:
    接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；receiving interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
    播放所述界面显示数据和所述第一音频数据。Playing the interface display data and the first audio data.
  17. 根据权利要求16所述的方法，其特征在于，所述方法还包括：The method of claim 16, wherein the method further comprises:
    通过图像采集装置采集图像数据，以及通过音频采集装置采集第二音频数据；The image data is collected by the image collection device, and the second audio data is collected by the audio collection device;
    通过所述近距离通信网络，将所述图像数据和第二音频数据发送至所述第一终端；所述第一终端用于将述图像数据和所述第二音频数据发送至第二终端；所述第二终端为与所述第一终端进行视频通话的终端。Send the image data and the second audio data to the first terminal through the short-range communication network; the first terminal is configured to send the image data and the second audio data to the second terminal; The second terminal is a terminal that conducts a video call with the first terminal.
  18. 根据权利要求16或17所述的方法，其特征在于，所述方法还包括：The method according to claim 16 or 17, wherein the method further comprises:
    与所述第一终端建立蓝牙连接；establishing a Bluetooth connection with the first terminal;
    通过所述蓝牙连接接收所述第一终端发送的网络连接请求；所述网络连接请求包括所述近距离通信网络的参数；Receive a network connection request sent by the first terminal through the Bluetooth connection; the network connection request includes the parameters of the short-range communication network;
    通过所述蓝牙连接向所述第一终端反馈网络连接响应；所述网络连接响应表示基于所述近距离通信网络的连接建立成功。A network connection response is fed back to the first terminal through the Bluetooth connection; the network connection response indicates that the connection based on the short-range communication network is successfully established.
  19. 一种视频通信装置，其特征在于，包括：A video communication device, comprising:
    检测连接模块，用于在检测到第一终端进入视频通话的情况下，搜索目标智慧屏设备，并与所述目标智慧屏设备建立基于近距离通信网络的连接；a detection connection module, configured to search for a target smart screen device when it is detected that the first terminal enters a video call, and establish a connection based on a short-range communication network with the target smart screen device;
    获取模块，用于获取所述视频通话的界面显示数据和第一音频数据；an acquisition module for acquiring interface display data and first audio data of the video call;
    切换模块，用于通过所述近距离通信网络，将所述界面显示数据和第一音频数据发送至所述目标智慧屏设备进行播放。The switching module is configured to send the interface display data and the first audio data to the target smart screen device for playback through the short-range communication network.
  20. 一种视频通信装置，其特征在于，包括：A video communication device, comprising:
    接收模块，用于接收第一终端通过近距离通信网络发送的界面显示数据和第一音频数据，所述界面显示数据和第一音频数据为所述第一终端进入视频通话时的数据；a receiving module, configured to receive interface display data and first audio data sent by the first terminal through the short-range communication network, where the interface display data and the first audio data are data when the first terminal enters a video call;
    播放模块，用于播放所述界面显示数据和所述第一音频数据。A playing module is used to play the interface display data and the first audio data.
  21. 一种电子设备，包括存储器及处理器，所述存储器中储存有计算机程序，其特征在于，所述计算机程序被所述处理器执行时，使得所述处理器执行如权利要求1至18中任一项所述的方法的步骤。An electronic device, comprising a memory and a processor, wherein a computer program is stored in the memory, wherein, when the computer program is executed by the processor, the processor executes any one of claims 1 to 18. A step of the method.
  22. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现如权利要求1至18中任一项所述的方法的步骤。A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 18 are implemented.
PCT/CN2021/113433 2020-10-15 2021-08-19 Video communication method and apparatus, electronic device and computer readable storage medium WO2022078061A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011103578.1A CN112261339B (en) 2020-10-15 2020-10-15 Video communication method, video communication device, electronic equipment and computer-readable storage medium
CN202011103578.1 2020-10-15

Publications (1)

Publication Number Publication Date
WO2022078061A1 true WO2022078061A1 (en) 2022-04-21

Family

ID=74243231

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/113433 WO2022078061A1 (en) 2020-10-15 2021-08-19 Video communication method and apparatus, electronic device and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN112261339B (en)
WO (1) WO2022078061A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115242994A (en) * 2022-06-10 2022-10-25 荣耀终端有限公司 Video call system, method and device
CN117135385A (en) * 2023-03-23 2023-11-28 荣耀终端有限公司 Multi-device collaborative screen recording and sharing method, electronic device and communication system

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112261339B (en) * 2020-10-15 2023-04-11 Oppo广东移动通信有限公司 Video communication method, video communication device, electronic equipment and computer-readable storage medium
WO2022205793A1 (en) * 2021-03-30 2022-10-06 海信视像科技股份有限公司 Display device and device control method
CN113992953A (en) * 2021-09-27 2022-01-28 阿里云计算有限公司 Motion data processing method and device
CN116137639A (en) * 2021-11-16 2023-05-19 华为终端有限公司 Cross-equipment audio data transmission method and electronic equipment
WO2023216684A1 (en) * 2022-05-09 2023-11-16 海信视像科技股份有限公司 Terminal device and data relay method
CN116095233A (en) * 2022-05-20 2023-05-09 荣耀终端有限公司 Barrier-free conversation method and terminal equipment
CN117177059B (en) * 2023-10-27 2024-04-12 荣耀终端有限公司 Camera control method for video call, electronic device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105163059A (en) * 2015-08-21 2015-12-16 深圳创维－Rgb电子有限公司 Smart home device based video call method and video call system
CN105635625A (en) * 2014-10-31 2016-06-01 腾讯科技（深圳）有限公司 Video conversation method and device
US20170105046A1 (en) * 2015-10-08 2017-04-13 Lg Electronics Inc. Digital device and method of processing data using the same
CN111447487A (en) * 2020-04-02 2020-07-24 深圳创维－Rgb电子有限公司 Reverse screen projection method and system for smart screen, smart screen and readable storage medium
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device
CN112261339A (en) * 2020-10-15 2021-01-22 Oppo广东移动通信有限公司 Video communication method, video communication device, electronic equipment and computer-readable storage medium

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001218176A (en) * 2000-01-28 2001-08-10 Nihon Enterprise Co Ltd Video and audio communication processing mechanism
CN103595949B (en) * 2013-11-07 2018-06-08 深圳创维数字技术有限公司 A kind of forwarding method of video calling, terminal and system
TWI540903B (en) * 2014-06-03 2016-07-01 鴻海精密工業股份有限公司 Mobile terminal, smart television and method of video call switching
CN104853136A (en) * 2015-05-29 2015-08-19 小米科技有限责任公司 Video communication method and device
CN107222791A (en) * 2017-07-12 2017-09-29 北京奇艺世纪科技有限公司 A kind of switching method, system and the server of video calling information
CN109495769B (en) * 2017-09-11 2021-07-23 腾讯科技（深圳）有限公司 Video communication method, terminal, smart television, server and storage medium
CN110312160A (en) * 2019-06-17 2019-10-08 广州视源电子科技股份有限公司 It is wireless to throw screen method, apparatus, Intelligent flat, terminal and system
CN111277807A (en) * 2020-01-14 2020-06-12 广东小天才科技有限公司 Projection implementation method, wearable device, display device and storage medium
CN111447398A (en) * 2020-04-23 2020-07-24 上海悠络客电子科技股份有限公司 Multi-screen interaction method for audio and video real-time talkback

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105635625A (en) * 2014-10-31 2016-06-01 腾讯科技（深圳）有限公司 Video conversation method and device
CN105163059A (en) * 2015-08-21 2015-12-16 深圳创维－Rgb电子有限公司 Smart home device based video call method and video call system
US20170105046A1 (en) * 2015-10-08 2017-04-13 Lg Electronics Inc. Digital device and method of processing data using the same
CN111447487A (en) * 2020-04-02 2020-07-24 深圳创维－Rgb电子有限公司 Reverse screen projection method and system for smart screen, smart screen and readable storage medium
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device
CN112261339A (en) * 2020-10-15 2021-01-22 Oppo广东移动通信有限公司 Video communication method, video communication device, electronic equipment and computer-readable storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115242994A (en) * 2022-06-10 2022-10-25 荣耀终端有限公司 Video call system, method and device
CN117135385A (en) * 2023-03-23 2023-11-28 荣耀终端有限公司 Multi-device collaborative screen recording and sharing method, electronic device and communication system

Also Published As

Publication number Publication date
CN112261339A (en) 2021-01-22
CN112261339B (en) 2023-04-11

Similar Documents

Publication Publication Date Title
WO2022078061A1 (en) Video communication method and apparatus, electronic device and computer readable storage medium
US20230029382A1 (en) Services over wireless communication with high flexibility and efficiency
WO2021018274A1 (en) Screen projection method and electronic device
US10419804B2 (en) Cooperative provision of personalized user functions using shared and personal devices
US20220239718A1 (en) Communication Protocol Switching Method, Apparatus, and System
CN104967889A (en) Method used for controlling intelligent television to carry out video information processing and device
WO2017035997A1 (en) Connection state indication method and device
US11435975B2 (en) Preview display method based on multi-angle and communication system
US11321407B2 (en) Search method, and apparatus
CN104301308B (en) Call control method and device
CN112751971A (en) Voice playing method and device and electronic equipment
CN110392304A (en) A kind of video display method, apparatus, electronic equipment and storage medium
US20220326845A1 (en) Method for acquiring historical information, storage medium, and system
CN104158854B (en) Resource share method and device
CN111262870B (en) Video call switching method and device, storage medium and terminal
JP2016524767A (en) Instant message management method, apparatus, program, and recording medium
KR101659420B1 (en) Personalized video content consumption using shared video device and personal device
CN114510166B (en) Operation method, intelligent terminal and storage medium
CN114594886B (en) Operation method, intelligent terminal and storage medium
CN107070816A (en) Recognition methods, device and the mobile terminal of application
US10015557B2 (en) Content-based control system
CN105391816B (en) The recommended method and device of special list
CN109977425A (en) A kind of text interpretation method and device
CN116668582B (en) Audio file sharing method and electronic equipment
CN113726954B (en) Control method of Near Field Communication (NFC) function and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21879108

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21879108

Country of ref document: EP

Kind code of ref document: A1