WO2023020012A1 - Data communication method between devices, device, storage medium, and program product - Google Patents

Data communication method between devices, device, storage medium, and program product Download PDF

Info

Publication number
WO2023020012A1
WO2023020012A1 PCT/CN2022/090301 CN2022090301W WO2023020012A1 WO 2023020012 A1 WO2023020012 A1 WO 2023020012A1 CN 2022090301 W CN2022090301 W CN 2022090301W WO 2023020012 A1 WO2023020012 A1 WO 2023020012A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
window
display window
information
data communication
Prior art date
Application number
PCT/CN2022/090301
Other languages
French (fr)
Chinese (zh)
Inventor
葛雄华
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Publication of WO2023020012A1 publication Critical patent/WO2023020012A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication

Definitions

  • the present application relates to the technical field of terminals, and in particular to a data communication method between devices, a device, a storage medium and a program product.
  • electronic devices such as tablet computers and mobile phones support more and more functions.
  • multiple electronic devices A can be connected to the same electronic device B, and the window display data of each of the multiple electronic devices A can be displayed in the electronic device B, for example, the display screens of multiple mobile phones can be Project the screen to the tablet to facilitate information sharing for users.
  • the present application provides a data communication method, device, storage medium and program product between devices, which solves the problem of how to enable data communication between electronic devices connected to the same electronic device in the prior art.
  • a data communication method between devices is provided, which is applied to a target device, and the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the The window display data of different devices are respectively displayed in the second display window, and the method includes:
  • Detecting a first operation determining first device information of a first device corresponding to the first display window and second device information of a second device corresponding to the second display window, the first operation includes A line operation in which a display window is moved to the display area of the second display window or from the first display window to the end of the second display window;
  • the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices. If the first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, determine the first device information corresponding to the first display window and the second device information corresponding to the second display window, and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device.
  • the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
  • the detection first operation includes:
  • the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
  • the user is supported to operate the first display window through different operation modes, so that a direct or indirect data communication connection can be established between the first device and the second device according to the user's operation, so that the first device's The window display data is displayed on the second device.
  • Added user operation methods are provided.
  • the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
  • the first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information
  • the second indication message is used to indicate that the first device is communicating with the first device
  • the two devices send the window display data of the first device to the second device for display.
  • the target device detects the first operation, and instructs the first device and the second device respectively, so as to control the establishment of a communication connection between the first device and the second device, thereby enabling data communication between the devices.
  • the target device by operating on the target device and establishing a direct communication connection between the first device and the second device, it can solve the problem that the interface of user A's mobile phone is displayed in the conference scene between user A of the first device and user B of the second device.
  • user B wants to simultaneously view the display interface of A's mobile phone on his mobile phone, and at this time, the distance between A and B is relatively far (but it does not affect the establishment of data communication connection), which is inconvenient for face-to-face operation and the problem of connecting to mobile phones .
  • the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
  • the third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
  • the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending a third indication message to the first device, so that data communication can be realized between the devices.
  • the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
  • the window display data of the first device or the second device is forwarded via the target device, there is no need to establish a direct data connection between the first device and the second device, only the first device and the second device are connected to the target device respectively, Interaction between the first device and the second device is reduced.
  • the method before controlling data communication between the first device and the second device based on the first device information and the second device information, the method further includes:
  • the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
  • the controlling the data communication between the first device and the second device based on the first device information and the second device information includes:
  • the method further includes:
  • the target device superimposes and displays the first display window in the second display window, which not only facilitates other users to continue viewing the display screen of the first device and/or the display screen of the second device in the target device, but also allows other users to According to the superimposed display effect, it can be known which two devices have performed data communication, and which device's display screen is displayed on which device's screen.
  • the method also includes:
  • Detecting the first operation acquiring a snapshot of the first display window, and obtaining a first snapshot
  • the second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
  • the superimposed display of the first display window in the second display window further includes:
  • Detecting a second operation controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
  • the second operation can be performed based on the screen display area of the target device to Drag the first display window corresponding to the first device from the second display window corresponding to the second device.
  • the target device controls the first device and the second device to terminate data communication. That is, the user can directly operate on the target device to control the termination of data communication between the first device and the second device.
  • the controlling the termination of data communication between the first device and the second device includes:
  • termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
  • the target device can control the termination of data communication between the first device and the second device by instructing the first device.
  • the controlling the termination of data communication between the first device and the second device further includes:
  • the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
  • restoring the first display window to the original display position can keep the display state before the data communication between the first device and the second device. In this way, if there are multiple display windows in the display area of the screen, the user can quickly locate the position of the first display window from the multiple display windows after the display is resumed in this display mode.
  • a data communication method between devices is provided, which is applied to a first device, and the window display data of the first device is displayed in the first display window of the screen display area of the target device, and the target device
  • the screen display area of the screen also includes a second display window, the window display data of the second device is displayed in the second display window, and the method includes:
  • Responding to the target indication message establish a direct or indirect data communication connection with the second device, and display the window display data of the first device in the second device through the data communication;
  • the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation,
  • the first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
  • the target indication message includes a second indication message and a request indication message for establishing a communication connection of the second device, and the second indication message is used to indicate that the first device is communicating with the second device.
  • the window display data of the first device is sent to the second device for display.
  • the target device After the target device detects the first operation, it sends a second indication message to the first device, and sends a first indication message carrying the information of the first device to the second device, and the first indication message is used to indicate the The second device establishes a communication connection with the first device based on the first device information.
  • the second device After receiving the first indication message, the second device requests to establish a communication connection with the first device, and correspondingly, the first device establishes a communication connection with the second device according to the request indication message of the second device.
  • the window display data of the first device is sent to the second device for display.
  • the target indication message includes a third indication message carrying the information of the second device, and the third indication message is used to instruct the first device based on the information of the second device and the The second device establishes a communication connection, and sends the window display data of the first device to the second device for display after the communication connection is established with the second device.
  • the target indication message includes a fourth indication message
  • the fourth indication message is sent by the second device after receiving the indication of the target device, and is used to request to establish a communication connection with the first device , and request to send the window display data of the first device to the second device.
  • the target device after detecting the first operation, sends the first device information to the second device and instructs the second device.
  • the second device sends a fourth indication message to the first device.
  • establishing an indirect data communication connection between the first device and the second device refers to forwarding the window display data of the first device to the second device through the target device.
  • the target device detects the first operation, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window.
  • the target device instructs the first device to establish a direct or indirect data communication connection with the second device, so that the first device displays the window display data of the first device in the second device through data communication.
  • the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
  • a data communication device between devices which is configured in a target device, and the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the The window display data of different devices are respectively displayed in the second display window, and the device includes:
  • a detection module configured to detect a first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first operation including moving the first display window to the display area of the second display window or a scribing operation from the first display window to the end of the second display window;
  • control module configured to control data communication between the first device and the second device based on the first device information and the second device information, so that the first device can The window display data of is displayed in the second device.
  • the detection module is used for:
  • the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
  • control module is used for:
  • the first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information
  • the second indication message is used to indicate that the first device is communicating with the first device
  • the two devices send the window display data of the first device to the second device for display.
  • control module is used for:
  • the third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
  • control module is used for:
  • control module is also used for:
  • the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
  • control module is also used for:
  • the detection module is also used for:
  • Detecting the first operation acquiring a snapshot of the first display window, and obtaining a first snapshot
  • the second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
  • the detection module is also used for:
  • Detecting a second operation controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
  • control module is used for:
  • termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
  • control module is also used for:
  • the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
  • a data communication device between devices, configured in a first device, the window display data of the first device is displayed in the first display window of the screen display area of the target device, and the target device
  • the screen display area of the screen also includes a second display window, the window display data of the second device is displayed in the second display window, and the device includes:
  • a response module configured to establish a direct or indirect data communication connection with the second device in response to the target indication message, and display the window display data of the first device in the second device through the data communication;
  • the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation,
  • the first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
  • an electronic device including a touch screen, a memory, one or more processors, multiple application programs, and one or more programs; wherein the one or more programs are stored in the memory; When the one or more processors execute the one or more programs, the electronic device is enabled to implement the method described in any one of the above first aspects, or to implement the method described in the above second aspect.
  • a computer-readable storage medium stores instructions, and when it is run on a computer, it causes the computer to execute the method described in any one of the above-mentioned first aspects, or , implementing the method described in the second aspect above.
  • a computer program product containing instructions, which, when run on a computer, cause the computer to execute the method described in any one of the above-mentioned first aspects, or realize the method described in the above-mentioned second aspect.
  • FIG. 1 is a system architecture diagram of an electronic device 100 provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a screen display area of a target device provided in an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application
  • FIG. 5 is a schematic diagram of an interface display of a second device provided in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a screen display area of a target device provided in an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a screen display area of another target device provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application.
  • FIG. 10 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application.
  • FIG. 11 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application.
  • FIG. 12 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application.
  • FIG. 13 is a schematic diagram of an operation of a screen display area based on a target device provided by an embodiment of the present application.
  • FIG. 14 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application.
  • FIG. 15 is a schematic diagram of a screen display area of another target device provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of the internal structure of another target device provided by the embodiment of the present application.
  • FIG. 17 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 18 is a schematic diagram of an operation of a screen display area based on a target device provided by an embodiment of the present application.
  • FIG. 19 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 20 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 21 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 22 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 23 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 24 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application.
  • FIG. 25 is a schematic structural diagram of an apparatus for data communication between devices provided by an embodiment of the present application.
  • FIG. 26 is a schematic structural diagram of another apparatus for data communication between devices provided by an embodiment of the present application.
  • the execution subject involved in the embodiment of the present application is introduced first.
  • the method provided in the embodiment of the present application may be executed by an electronic device.
  • the electronic device may include but not limited to a terminal device, a television, and the like.
  • the terminal device may include, but not limited to, a mobile phone, a tablet computer, an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC ), netbook, personal digital assistant (personal digital assistant, PDA).
  • FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the electronic device 100 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
  • processor 110 may include multiple sets of I2C buses.
  • the processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces.
  • the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100 .
  • the I2S interface can be used for audio communication.
  • processor 110 may include multiple sets of I2S buses.
  • the processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 .
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
  • the PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is generally used to connect the processor 110 and the wireless communication module 160 .
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function.
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
  • MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 .
  • the processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 110 with the camera 193 , the display screen 194 , the wireless communication module 160 , the audio module 170 , the sensor module 180 and so on.
  • the GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device 100 through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be disposed in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100.
  • System global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG moving picture experts group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 .
  • the internal memory 121 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
  • Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the receiver 170B can be placed close to the human ear to receive the voice.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 170D is used for connecting wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • pressure sensor 180A may be disposed on display screen 194 .
  • pressure sensors 180A such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors.
  • a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material.
  • the gyro sensor 180B can be used to determine the motion posture of the electronic device 100 .
  • the angular velocity of the electronic device 100 around three axes ie, x, y and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip leather case.
  • the electronic device 100 when the electronic device 100 is a clamshell machine, the electronic device 100 can detect opening and closing of the clamshell according to the magnetic sensor 180D.
  • the acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize the posture of the electronic device 100, and be applied to applications such as horizontal and vertical screen switching, pedometer, etc.
  • the distance sensor 180F is used to measure the distance.
  • the electronic device 100 may measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F for distance measurement to achieve fast focusing.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 100 emits infrared light through the light emitting diode.
  • Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 100 .
  • the ambient light sensor 180L is used for sensing ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket, so as to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like.
  • the temperature sensor 180J is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy.
  • Touch sensor 180K also known as "touch panel”.
  • the touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal.
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
  • the motor 191 can generate a vibrating reminder.
  • the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 195 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 195 is also compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the electronic device 100 interacts with the network through the SIM card to implement functions such as calling and data communication.
  • the electronic device 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • the software structure of the electronic device 100 is exemplarily described by taking an Android system with a layered architecture as an example.
  • FIG. 2 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, Android runtime (Android runtime) and system libraries, and the kernel layer from top to bottom.
  • the application layer can consist of a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of the electronic device 100 . For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is issued, the electronic device 100 vibrates, an indicator light flashes, and the like.
  • the Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the Surface Manager is used to manage the display system and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • FIG. 3 is a schematic diagram of an application scenario according to an exemplary embodiment, wherein, the screen display area of the tablet computer C is shown as 30 in FIG. 3 , and the first display window is shown in FIG. 3 As shown in 31, the current display screen of mobile phone A is displayed in 31, and the second display window is shown in 32 in FIG. 3, and the current display screen of mobile phone B is displayed in 32.
  • the tablet computer C in order to distinguish which display window is used to display the display screen of mobile phone A and which display window is used to display the display screen of mobile phone B, when the tablet computer C displays the first display window and the second display window , which can be distinguished and displayed in various ways.
  • the tablet computer C can mark the relevant information of the mobile phone A in the first display window, and mark the relevant information of the mobile phone B in the second display window, and the relevant information can include but not limited to the model of the mobile phone, the brand of the mobile phone, the At least one item of address information.
  • the tablet computer C may also set the first display window and the second display window to be of different sizes.
  • the tablet computer C may also set the first display window and the second display window into different shapes and so on.
  • FIG. 4 is a schematic diagram of an operation according to an exemplary embodiment.
  • a finger selects the first display window on the screen display area, and then drags the first display window to the second displayed in the window.
  • the tablet computer C may display operation guidance information in the screen display area, for example, as shown in FIG. symbol.
  • the mobile phone A and mobile phone B are controlled to perform data communication , so that mobile phone A sends the window display data corresponding to the current display screen to mobile phone B for display.
  • mobile phone B displays the display screen of mobile phone A after receiving the window display data sent by mobile phone A.
  • mobile phone B may display a target display window in the screen display area of mobile phone B, and then display a display screen of mobile phone A in the target display window based on the received window display data.
  • the size of the target display window may be set according to actual requirements.
  • the display effect in mobile phone B can be shown in Figure 5 (a), using the window display data of mobile phone A to replace the original display screen of mobile phone B; or it can also be shown in Figure 5
  • the display window of mobile phone A is reduced, and only the part of the display window of mobile phone B is displayed.
  • the mobile phone B may also close the initial display interface of the mobile phone B, and then switch to display the display screen of the mobile phone A, which is not limited in this embodiment of the present application.
  • the tablet computer C controls the mobile phone A to perform data communication with the mobile phone B, if it is determined that the mobile phone A successfully sends the window display data to the mobile phone B for display, for example, the tablet computer C receives the data from the mobile phone A and/or the mobile phone B. If the data communication is successful, the tablet computer C superimposes and displays the first display window in the second display window.
  • the size and/or shape of the first display window may be adjusted before the first display window is superimposed on the second display window. The shape is adjusted so that the first display window can be superimposed and displayed in the second display window.
  • the effect of the tablet computer C superimposing and displaying the first display window behind the second display window is shown in FIG. 6 . That is, the tablet computer C superimposes the first display window on the second display window, and continues to display the first display window at the original position of the first display window.
  • the original position refers to the display position of the first display window before being dragged.
  • the effect after the tablet computer C superimposes and displays the first display window on the second display window is shown in FIG. 7 . That is, after the tablet computer C overlays and displays the first display window on the second display window, it may not continue to display the first display window at the original position of the first display window.
  • the tablet computer C can set a display prompt of the first display window at the original position of the first display window.
  • the tablet computer The computer C can display the translucent snapshot of the first display window at the original position of the first display window. If it is detected that the first display window is dragged to the second display window and then released, the tablet computer C displays the first display window superimposed on the second display window, and deletes the translucent snapshot.
  • the final display effect can be as shown in Figure 7 Show.
  • the tablet computer C starts with The pop-up method redisplays the first display window at the position of the translucent snapshot, and deletes the translucent snapshot.
  • the tablet computer C before the tablet computer C controls the data communication between the mobile phone A and the mobile phone B, it can also display an inquiry window, so as to request the user to confirm whether to agree to the data communication between the mobile phone A and the mobile phone B through the inquiry window. data communication.
  • FIG. 9 is a schematic diagram showing a query window according to an exemplary embodiment. If the tablet computer C detects that the first display window is dragged to the second display window, release, the inquiry window pops up, and the inquiry window includes inquiry information.
  • the inquiry information is "do you want to establish a communication connection?"
  • the inquiry window also includes a confirmation option and a cancellation option, and the confirmation option is used
  • the tablet computer C is triggered to control the data communication between the mobile phone A and the mobile phone B
  • the cancel option is used to trigger the tablet computer C to cancel the data communication between the mobile phone A and the mobile phone B.
  • the confirmation option is “Yes” touch control
  • the cancel option is “No” touch control.
  • FIG. 10 is a schematic display diagram of an inquiry window according to another exemplary embodiment.
  • Tablet PC C superimposes and displays the first display window in the second display window, and displays a translucent snapshot of the first display window at the original position of the first display window.
  • tablet C pops up the inquiry window. If the user agrees to display the display interface of mobile phone A on mobile phone B, the "yes" touch control can be triggered. communication, and the tablet computer keeps superimposing and displaying the first display window into the second display window. If the user does not agree to display the display interface of mobile phone A on mobile phone B, the "No" touch control can be triggered. communication. Moreover, the tablet computer restores the first display window to the original position for display, and the second display window continues to display the display screen of the mobile phone B.
  • the display screen of mobile phone A at the current moment may be displayed in the first display window , that is, even if the display screen of mobile phone A is dynamic, before the connection is established, the content displayed in the first display window can be the screen capture at the moment when the first display window is dragged to the second display window .
  • the first display window superimposed on the second display window may also be The current display screen of mobile phone A, for example, if the display screen of mobile phone A is dynamic, the content displayed in the first display window may change in real time as the display screen of mobile phone A changes before the connection is established.
  • the second display window can be highlighted.
  • the second display window is enlarged and displayed to distinguish it from the third display window 33 , so that the user can know from the display effect that the first display window is currently located in the second display window.
  • FIG. 12 is a schematic diagram of a screen display area according to an exemplary embodiment. The user can select the first display window and then drag the first display window from the second display window come out.
  • the tablet computer C may display operation guidance information in the screen display area, such as displaying indicators such as arrows, so as to indicate to the user how to use the operation guidance information. operate.
  • the user drags the first display window according to the operation guidance information may drag toward the original position of the first display window or other positions.
  • the tablet computer C controls the mobile phone A and the mobile phone B to terminate the data communication.
  • the mobile phone A no longer sends the window display data to the mobile phone B, and correspondingly, the mobile phone B no longer displays the display screen of the mobile phone A.
  • the mobile phone B displays the main interface, and as another example, the mobile phone B continues to display the display screen before receiving the window display data sent by the mobile phone A.
  • a disconnection prompt window may also be displayed, and the disconnection prompt The window is used to prompt the user to confirm whether to agree to disconnect the data communication between mobile phone A and mobile phone B.
  • the disconnection prompt window includes a disconnection prompt message.
  • the disconnection prompt window also includes a confirmation option and a cancellation option. The confirmation option is used to trigger the tablet computer C to control the mobile phone A and mobile phone B to terminate data communication, cancel The option is used to trigger the tablet computer C to cancel the control of the mobile phone A and the mobile phone B to terminate the data communication.
  • FIG. 14 is a schematic diagram of a disconnection prompt window according to an exemplary embodiment.
  • the disconnection prompt information included in the disconnection prompt window is "disconnect the communication connection?",
  • the confirmation option is "Yes” touch control, and the cancel option is "No” touch control. If the user confirms that the display screen of mobile phone A is no longer displayed on mobile phone B, the "yes" touch control is triggered, and in response to the user's trigger operation on the "yes” touch control, the tablet computer C controls mobile phone A to disconnect from mobile phone B .
  • the "No" touch control can be triggered, and in response to the user's trigger operation on the "No" touch control, the tablet computer C will not disconnect the communication between mobile phone A and mobile phone B. data communication.
  • Fig. 15 is a schematic diagram showing a screen display area of a tablet computer according to an exemplary embodiment.
  • the above is an example of the user dragging the first display window from the second display window on the tablet computer C to terminate the data communication between the mobile phone A and the mobile phone B.
  • the second display window may also be dragged by the user, so that the second display window is separated from the first display window, so that the tablet computer C controls the mobile phone A and the mobile phone B to terminate the data communication.
  • a trigger can also be uploaded on mobile phone A or mobile phone B to disconnect the data communication between the two.
  • mobile phone B may provide an option to disconnect communication, and when the user does not want to continue displaying the display screen of mobile phone A on mobile phone B, the option to disconnect communication may be triggered.
  • the mobile phone B no longer displays the display screen of the mobile phone A.
  • the display windows of the mobile phone A and mobile phone B may also be other large-screen devices, such as a personal computer PC or a conference screen.
  • FIG. 16 is a schematic diagram showing an internal structure of an electronic device according to an exemplary embodiment.
  • the electronic device includes a communication module, a control module, a cache module, and a user interface (User Interface, UI) module.
  • UI User Interface
  • control module is configured to analyze the connection establishment request after receiving the connection establishment request sent by other electronic devices, and parse out the data used to establish the communication connection from the connection establishment request, such as the data can be other
  • the device information of the electronic device for example, the device information may include but not limited to device address information, device name, device ID, and the like. Then transmit the analyzed data to the communication module.
  • the communication module is used to control the electronic device to establish a communication connection with other electronic devices.
  • the communication module is used to control the tablet computer C and mobile phone B.
  • the mobile phone A establishes a communication connection, and controls the tablet PC C to establish a communication connection with the mobile phone B.
  • the cache module is used for storing the window display data received by the electronic device from other electronic devices.
  • the control module is also used to acquire window display data from the cache module, and then submit the window display data to the UI module.
  • the UI module is configured to generate a display window, and display the acquired window display data through the display window, such as displaying display images of other electronic devices in the screen display area of the electronic device.
  • the cache module stores the window display data of multiple other electronic devices
  • the UI module obtains the window display data of multiple other electronic devices, it displays the window display data of each other electronic device through different display windows. data.
  • the control module is further configured to determine the end position of the trigger operation after detecting the user's trigger operation on any display window displayed by the UI module, so as to determine which two devices need to be controlled according to the end position. data communication between them.
  • the control module after detecting that the first display window is moved to the second display window and released, notifies the first device corresponding to the first display window to establish a communication connection with the second device corresponding to the second display window, and notifies The first device sends the window display data to the second device through the communication connection, so as to display the display screen of the first device on the second device.
  • the control module forwards the window display data of the first device to the second device, so that the display screen of the first device can be displayed on in the second device.
  • control module controls the first device to communicate with the second device, it can also notify the UI module, so that the UI module will superimpose and display the first display window on the second display window, so that the user can
  • the screen display effect of the electronic device can know which devices have established data communication and the current display status between other electronic devices.
  • the UI module when it is detected that the user moves the first display window out of the second display window, controls the first display window to be displayed at the original position or the position where the movement stops, and continues to display in the second display window The initial display screen. In addition, the UI module notifies the control module when detecting a trigger operation of moving the first display window from the second display window by the user.
  • control module After the control module receives the notification from the UI module, it controls the disconnection between the two devices that are in data communication, for example, notifies the disconnection of the communication connection between the first device and the second device, and at this time the first device and the second device disconnect The connection is opened, so that the first device no longer sends window display data to the second device. Or, the electronic device stops forwarding the window display data of the first device to the second device. It is not difficult to understand that after that, the second device no longer displays the window display data of the first device.
  • the disconnection is triggered by other electronic devices Triggered on the device side, for example, the user triggers on the first device or the second device.
  • the control module receives disconnection requests from other electronic devices. It is not difficult to understand that the disconnection requests may be sent by the first device, or may also be sent by the second device. Afterwards, the control module no longer forwards the window display data of the first device to the second device, thereby disconnecting the data communication between the first device and the second device.
  • FIG. 17 is a schematic flowchart of a method for data communication between devices according to an exemplary embodiment.
  • the method can be applied to a target device, and the screen display area of the target device includes at least the first display The window and the second display window, the first display window and the second display window respectively display window display data of different devices.
  • the target device may be the above-mentioned electronic device. This method may include some or all of the following:
  • Step 1701 Detect the first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first operation includes moving the first display window to A scribing operation in the second display window or from the beginning of the first display window to the end of the second display window.
  • Both the first device information and the second device information are device information that can be used for data communication.
  • the first device information may include but not limited to one or more items of device ID, device name, and device address information of the first device.
  • the second device information may include, but not limited to, one or more items of the second device's device ID, device name, and device address information.
  • the device address information may be internet protocol address (internet protocol address, IP) or media access control (media access control, MAC) address information.
  • Both the first display window and the second display window are operable windows, for example, both the first display window and the second display window are floating windows.
  • the target device displays the window display data of the first device through the first display window, and displays the window display data of the second device through the second display window. That is, the user can simultaneously view the window display data of the first device and view the window display data of the second device on the target device.
  • the first display position of the first display window (that is, the original position of the first display window) and the second display position of the second display window may be preset, for example, the first display position is located on the screen
  • the first designated area of the display area, the second display position is located in the second designated area of the screen display area, the first designated area and the second designated area can be set according to actual needs, there is no gap between the first designated area and the second designated area There are overlapping areas.
  • the first display position of the first display window and the second display position of the second display window may also be set randomly.
  • the screen projection method described in the embodiments of the present application may be push projection or mirror projection.
  • the first device push screen projection means that the first device pushes resources in the form of streaming media.
  • the user can continue on the first device. perform other operations.
  • Mirroring the screen of the first device means that the first device starts mirroring, and then the first device continuously records the screen, and sends the screen recording data to the target device while recording the screen.
  • the first device and the second device can also display window display data in the screen display area of the target device in other ways.
  • the first device may send some fields, parameters or content to the target device, so that the target device displays the window display data of the first device based on these fields, parameters or content. Not limited.
  • the specific implementation of detecting the first operation includes: detecting that the first display window is moved into the display area of the second display window and then released, and the overlapping area of the first display window and the second display window is greater than the area threshold.
  • the area threshold may be set according to actual requirements, which is not limited in this embodiment of the present application.
  • moving the first display window into the second display window may include dragging the first display window into the second display window. That is, during this process, the first display window moves along with the movement of the finger.
  • the target device detects that the first display window is being dragged, it detects the dragging end point of the first display window, and if the dragging end point is located at the display of the second display window In the region, the overlapping area of the first display window and the second display window is determined.
  • the overlapping area is greater than the area threshold, it means that the first display window and the second display window overlap in a large area, for example, the first display window and the second display window are almost completely overlapped, and it can be determined that the first display window is dragged to the second display window. Released after displaying the window.
  • the above-mentioned dragging operation on the first display window may be triggered by a finger. That is, the user can click on the first display window in the display screen, as shown in FIG. 4 , and the target device can display a moving direction guide rendering, for example, including arrows and schematic pictures of fingers. Afterwards, the user's finger slides in the display screen, and the display window moves with the finger, and releases after sliding into the second display window, so as to drag the first display window into the second display window.
  • the above-mentioned dragging operation on the first display window may also be triggered by a gesture.
  • the user can park his hand at a position parallel to the first display window, and stay there for a preset time.
  • the target device detects the user's gesture through a sensing device such as a camera, it is determined that the user selects the first display window.
  • the target device may prompt the user that the first display window has been selected by highlighting the first display window or the like.
  • the user can slide the hand that selected the first display window to the direction of the second display window, and when the hand is in a position parallel to the second display window, stay for a preset time again.
  • the target device detects the user's gesture through the sensing device, it determines that the user is dragging the first display window into the second display window.
  • the preset duration can be set according to actual needs.
  • the specific implementation of detecting the first operation includes: detecting the scribing operation with the first display window as the starting point of the scribing, the scribing end point is located in the display area of the second display window, and the scribing starting point is the same as the The straight-line distance between the end points of the line is within the preset distance range.
  • the preset distance range may be set according to actual requirements, which is not limited in this embodiment of the present application.
  • the scribing operation can be triggered by a finger.
  • the finger starts to slide from the first display window, and the landing point of the finger is located in the second display window, and the first display window is in a static state during the operation.
  • the display window does not follow the finger movement.
  • the scribing track of the finger may be a straight line or a curve.
  • the finger starts to draw a line in the direction of the arrow from the first display window.
  • the target device After detecting the scribing operation of the finger, if it is detected that the landing point of the finger is located in the second display window and released, determine the straight-line distance between the starting point of the scribing line and the end point of the scribing line, if the distance is within If it is within the preset distance range, it is determined that a scribing operation from the beginning of the first display window to the end of the second display window is detected.
  • the scribing operation can also be triggered by a gesture.
  • the target device can detect the user's gesture through the sensing device. For example, when it detects that the user has parked the hand at a position parallel to the first display window and stays there for a preset period of time, determine the starting point of the line. A position within the first area parallel to the plane where the current parking position is located.
  • the target device may prompt the user that the starting point of the line has been determined by highlighting the first display window or other manners. After being prompted by the target device, the user can slide the hand that selected the first display window to the direction of the second display window, and when the hand is in a position parallel to the second display window, stay for a preset time again.
  • the target device detects the user's gesture through the sensing device, it determines the end point of the line.
  • the end point of the line may be a position in the second area of the display screen parallel to the plane where the hand is currently resting.
  • the distance between the starting point of the scribing line and the end point of the scribing line is determined, and when the distance is within a preset distance range, it is determined that a scribing operation from the beginning of the first display window to the end of the second display window is detected.
  • the specific realization of the above detection of the first operation is only exemplary.
  • the specific realization of detection of the first operation may also include: detection of the first display window as the starting point of the dashed line Operation, the end point of the line is located in the display area of the second display window.
  • the target device detects the first operation, determine the first device information of the first device corresponding to the first display window, and determine the second device information of the second device corresponding to the second display window. In this way, on the one hand, it is convenient to determine which device's window display data is to be displayed on which device, and on the other hand, it is convenient to subsequently control the data communication between the first device and the second device.
  • the target device detects the first operation, acquires a snapshot of the first display window, and obtains the first snapshot.
  • Transparency processing is performed on the first snapshot to obtain the second snapshot.
  • the second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
  • the transparent processing when performing transparent processing on the first snapshot, the transparent processing may be performed according to a transparency threshold, and the transparency threshold may be set according to actual requirements.
  • the first snapshot is translucently processed.
  • a snapshot of the first display window may be displayed at the original position of the first display window to identify the original display position of the first display window.
  • the target device displays the second snapshot at the original position of the first display window
  • the target device detects that the first display window is not dragged into the second display window and then releases it, the In this way, the first display window is redisplayed at the original position, and the target device deletes the second snapshot.
  • the target device's screen display area may also include a third display window, and the third display window is used to display window display data of the third device.
  • the second display window may be relatively close to the third display window.
  • the target device After the target device detects the first operation, when the first display window is located in the second display window or detects that the end position of the scribing operation is located in the second display window, in order to distinguish it from the third display window, the target device can also Highlight the second display window, such as enlarging the second display window, etc., to indicate that the first display window is currently being moved to the second display window or the end position of the scribing operation is located in the second display window, so as to facilitate the user Determine whether to release the first display window.
  • the target device can also Highlight the second display window, such as enlarging the second display window, etc., to indicate that the first display window is currently being moved to the second display window or the end position of the scribing operation is located in the second display window, so as to facilitate the user Determine whether to release the first display window.
  • the above is an example of a third display window included in the screen display area of the target device.
  • more display windows may be included in the screen display area of the target device.
  • the embodiment of the present application There is no limit to this.
  • attributes such as shape and size of the first display window remain unchanged.
  • the first operation is a move operation.
  • the first device displays the display screen of the first device on the target device, that is, the content displayed in the first display window is the same as the content currently displayed by the first device.
  • the display screen of the first device may change dynamically, for example, a PPT is being played.
  • the target device may continue to update the display screen in the first display window in real time according to the window display data sent by the first device, that is, the display in the first display window The screen changes as the display screen in the first device changes.
  • the target device may also obtain a screenshot of the display screen of the first device, and then, during the first display window being moved, the first The screen shot is displayed in the display window, that is, the display screen in the first display window may also be a screen shot at the moment of being moved, instead of being updated in real time.
  • Step 1702 Based on the first device information and the second device information, control data communication between the first device and the second device, so that the window display data of the first device is displayed on the second device through data communication.
  • the establishment of a direct or indirect communication connection between the first device and the second device may be controlled, so as to perform data communication through the communication connection, thereby controlling the first device
  • the window display data of the first device is sent to the second device for display, so that the window display data of the first device is displayed on the second device.
  • the target device may also forward the window display data of the first device to the second device in real time based on the information of the first device and the information of the second device, so that the window display data of the first device is displayed on the second device. in the device. That is, the target device may serve as an intermediate forwarding device between the first device and the second device, thereby controlling the first device to perform data communication with the second device.
  • the target device before controlling the data communication between the first device and the second device based on the information of the first device and the information of the second device, may also display an inquiry window, the inquiry window includes the inquiry information , the query information is used to indicate whether to display the window display data of the first device on the second device based on the query window confirmation.
  • an operation of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device is performed based on the confirmation instruction received in the inquiry window.
  • the target device detects the first operation, it means that the user may wish to display the window display data of the first device on the second device.
  • the target device can display the inquiry window and Inquiry information is displayed in the window.
  • the inquiry information may be "do you want to establish a communication connection?".
  • the confirmation instruction it means that the user confirms the establishment of communication.
  • the target device controls the first device to perform data communication with the second device based on the information of the first device and the information of the second device.
  • the target device receives the cancel instruction based on the query window
  • the execution of the operation of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device is cancelled.
  • the query window is used to request the user to confirm whether to agree to control the data communication between the first device and the second device, so as to ensure that the window display data of the first device is displayed in the second device when the user agrees, thereby improving user experience.
  • the target device may also send inquiry information to the first device.
  • the first device may display an inquiry window, and the inquiry window includes the inquiry information. That is, the inquiry window may also be displayed by the first device, so that the user of the first device can confirm whether to display the window display data of the first device in the second device.
  • the first device receives the confirmation instruction based on the query window, it sends a confirmation control instruction to the target device.
  • the target device After receiving the acknowledgment control instruction, the target device performs an operation of controlling data communication between the first device and the second device based on the first device information and the second device information. Certainly, if the first device receives the cancel instruction based on the query window, it will send a cancel control instruction to the target device, so that the target device cancels the control between the first device and the second device based on the information of the first device and the information of the second device. Perform data communication operations.
  • the target device before controlling data communication between the first device and the second device based on the first device information and the second device information, the target device may also send inquiry information to the second device.
  • the second device After receiving the inquiry information, the second device may display an inquiry window, and the inquiry window includes the inquiry information. That is, the second device may also display an inquiry window, so that the user of the second device can confirm whether to agree to display the window display data of the first device in the second device.
  • the second device receives the confirmation instruction based on the query window, it sends a confirmation control instruction to the target device.
  • the target device After receiving the acknowledgment control instruction, the target device performs an operation of controlling data communication between the first device and the second device based on the first device information and the second device information.
  • the second device receives the cancel instruction based on the query window, it will send a cancel control instruction to the target device, so that the target device cancels the control between the first device and the second device based on the information of the first device and the information of the second device. Perform data communication operations.
  • the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices. If the first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, determine the first device information corresponding to the first display window and the second device information corresponding to the second display window, and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device.
  • the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
  • the user can enable the first device to perform data communication with the second device by dragging, and can also enable the first device to perform data communication with the second device by drawing lines, which increases user operation methods and improves user experience. .
  • FIG. 19 is a schematic flowchart of a data communication method between devices according to an exemplary embodiment.
  • the method can include the following:
  • Step 1901 The first device projects the display screen of the first device to the target device.
  • the first device projects the display screen of the first device to the target device based on the communication connection established with the target device, that is, before projecting the display screen of the first device to the target device, there is a Establish a communication connection.
  • the first device may send first device information to the target device, so as to request to establish a communication connection with the target device.
  • the target device determines to establish a communication connection with the first device, it sends the device information of the target device to the first device, so as to establish a communication connection with the first device.
  • the first device projects a screen to the target device, and sends the window display data of the first device to the target device, as shown in FIG. 20 .
  • the target device After receiving the window display data of the first device, the target device displays the window display data of the first device through the first display window.
  • Step 1902 the second device projects the display screen of the second device to the target device.
  • the second device projects the display screen of the second device to the target device based on the communication connection established with the target device, that is, before projecting the display screen of the second device to the target device, the second device and the target device A communication connection is established between them.
  • the second device sends second device information to the target device, so as to request to establish a communication connection with the target device.
  • the target device determines to establish a communication connection with the second device, it sends the device information of the target device to the second device, so as to establish a communication connection with the second device.
  • the second device projects the screen to the target device, and sends the window display data of the second device to the target device, as shown in 2003 in FIG. 20 .
  • the target device displays the window display data of the second device through the second display window.
  • the first device and the second device may also display their own window display data on the target device in other ways. That is, in the embodiment of the present application, the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices.
  • the first device and the second device establish communication connections with the target device as an example.
  • more devices may establish communication connections with the target device, as shown in FIG. 20 , there are n devices establishing a communication connection with the target device.
  • step 1901 may be executed before step 1902, may also be executed after step 1902, or may be executed in parallel with step 1902.
  • step 1901 Based on the scenarios provided in step 1901 and step 1902, the flow of data communication between devices will be introduced next.
  • Step 1903 The target device detects the first operation, and determines the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window.
  • step 1701 in the above embodiment shown in FIG. 17 , which will not be described in detail here.
  • Step 1904 The target device sends a first indication message carrying the first device information to the second device based on the second device information, and sends a second indication message to the first device based on the first device information.
  • the first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information
  • the second indication message is used to instruct the first device to display the window of the first device after establishing a communication connection with the second device.
  • the data is sent to the second device for display.
  • the target device generates a first indication message, where the first indication message carries the first device information. Afterwards, the target device determines the communication channel between the target device and the second device according to the second device information, and then sends the generated first indication message to the second device through the communication channel between the target device and the second device, that is, As shown at 2004 in FIG. 20, the target device requests the second device to establish a communication connection with the first device. In addition, the target device generates a second indication message, determines the communication channel between the target device and the first device according to the information of the first device, and then sends the second indication message to the second indication message through the communication channel between the target device and the first device. a device.
  • the target device may first send the first indication message to the second device, and then send the second indication message to the first device.
  • the target device may also first send the second indication message to the first device, and then send the first indication message to the second device.
  • the target device may also send the first indication message to the second device and the second indication message to the first device at the same time.
  • the target device may first send a first indication message to the second device, and then send a second indication message to the first device when receiving a notification that the communication is established successfully.
  • the notification of successfully establishing communication is used to indicate that the first device has successfully established a communication connection with the second device, and the notification of successfully establishing communication can be sent by the first device or by the second device.
  • step 1904 is an exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
  • Step 1905 The second device requests to establish a communication connection with the first device based on the information of the first device.
  • the second device After the second device receives the first indication message sent by the target device, it parses the first indication message to obtain the first device information from the first indication message, and in addition, determines the purpose of the first indication message, such as the first indication message The purpose of is to request to establish a direct communication connection with the first device based on the first device information. Afterwards, the second device performs a corresponding operation according to the first indication message.
  • the first device information includes first MAC address information
  • the second device information includes second MAC address information
  • the second device sends a connection establishment request to the first device based on the first MAC address information
  • the connection establishment request may carry Second MAC address information
  • Step 1906 the first device establishes a communication connection with the second device.
  • the first device after receiving the connection establishment request sent by the second device, parses the connection establishment request, and parses out the second device information from the connection establishment request, and then, the first device based on the second device information and The second device establishes a communication connection, as shown at 2005 in FIG. 20 .
  • a communication connection may be established between the first device and the second device through Bluetooth, wireless fidelity (Wi-Fi), WLAN, wireless network, etc., which is not limited in this embodiment of the present application.
  • Wi-Fi wireless fidelity
  • WLAN wireless network
  • step 1907 to step 1908 may be directly performed.
  • Step 1907 the first device sends the window display data of the first device to the second device.
  • the second indication message is used to instruct the first device to send the window display data of the first device to the second device after establishing a communication connection with the second device , so after the first device successfully establishes a communication connection with the second device, the first device sends the window display data of the first device to the second device.
  • Step 1908 The second device displays the display screen of the first device based on the window display data of the first device.
  • the display screen of the first device can be displayed on the second device.
  • the second device may display the display screen of the first device through the target display window, for example, the target display window is a floating window. That is, at this time, the second device continues to display the display screen of the second device, and displays the display screen of the first device through the target display window on the display screen of the second device. In this way, the user can not only continue to view The display screen of the second device, and the display screen of the first device can also be viewed in the second device. For example, assuming that the second device is playing multimedia resources before displaying the display screen of the first device, when the second device displays the display screen of the first device, it can display the display screen of the first device on the playing screen through the target display window. In this way, the user can not only continue to watch the played multimedia resource on the second device, but also view the display screen of the first device on the second device.
  • the target display window is a floating window. That is, at this time, the second device continues to display the display screen of the second device, and displays the display screen of the first device through the target display window on
  • the second device may switch the display screen of the second device to the display screen of the first device. That is, the second device may no longer display the display screen of the second device, but display the display screen of the first device. At this time, the user can only see the display screen of the first device in the second device. For example, assuming that the second device is playing multimedia resources before displaying the display screen of the first device, when the second device displays the display screen of the first device, it can close the currently displayed multimedia resource and switch to displaying the multimedia resource of the first device. Display screen. In this way, the display screen of the first device can be clearly displayed on the second device, which is convenient for the user to view.
  • the user can operate the display screen of the first device in the second device.
  • the second device In response to a user's trigger operation on the display screen of the first device in the second device, the second device generates a screen operation instruction based on the trigger operation.
  • the second device sends a screen operation instruction to the first device, and the first device performs a corresponding operation in response to the screen operation instruction.
  • the pause option can be triggered on the display screen of the first device in the second device, and in response to the user's trigger operation on the pause option , the second device sends a playback pause instruction to the first device, and the first device pauses playing the video after receiving the playback pause instruction.
  • the playback of the video will also be paused synchronously in the second device.
  • the target device also pauses playing the video in the first display window.
  • the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window.
  • a first indication message is generated based on the first device information. sending a first indication message to the second device based on the second device information, and sending a second indication message to the first device based on the first device information, so that the second device establishes a communication connection with the first device based on the first indication message, And make the first device send the window display data of the first device to the second device for display after successfully establishing a communication connection with the second device.
  • the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending the second indication message to the first device and the first indication message to the second device, so that the connection between the devices capable of data communication.
  • This embodiment establishes a direct communication connection between the first device and the second device by operating on the target device, which can solve the problem that the interface of user A's mobile phone is in a conference scene between user A of the first device and user B of the second device.
  • user B wants to view the display interface of A's mobile phone synchronously on his mobile phone.
  • the distance between A and B is relatively far (but it does not affect the establishment of data communication connection), which is inconvenient for face-to-face operation. question.
  • FIG. 21 is a schematic flowchart of a data communication method between devices according to another exemplary embodiment.
  • the interaction between multiple devices is taken as an example for illustration.
  • the method can include the following:
  • steps 2101 to 2103 please refer to steps 1901 to 1903 in the embodiment in FIG. 19 above.
  • Step 2104 The target device sends a third indication message carrying the second device information to the first device based on the first device information.
  • the third indication message is used to instruct the first device to establish a communication connection with the second device based on the information of the second device, and to send the window display data of the first device to the second device for display after the communication connection is established with the second device.
  • the target device generates a third indication message based on the second device information, and determines a communication channel between the target device and the first device based on the first device information. Then the third indication message is sent to the first device through the communication channel between the target device and the first device.
  • step 2104 is another exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
  • Step 2105 The first device requests to establish a communication connection with the second device based on the information of the second device.
  • the first device After the third indication message, it parses the third indication message, and parses out the information of the second device from the third indication message. In addition, it analyzes the purpose of the third indication message.
  • the purpose of the third indication message includes two On the one hand, on the one hand, instruct the first device to establish a communication connection with the second device; on the other hand, instruct the first device to send the window display data of the first device to the second device for display after successfully establishing a communication connection with the second device. Therefore, after parsing the third indication message, the first device first requests to establish a communication connection with the second device.
  • the first device may send a connection establishment request to the second device based on the information of the second device. The first device information of the first device is carried in the connection establishment request.
  • Step 2106 the second device establishes a communication connection with the first device.
  • the second device After receiving the connection establishment request sent by the first device, the second device parses the connection establishment request, and parses out the first device information from the connection establishment request. Afterwards, the second device establishes a communication connection with the first device based on the first device information.
  • Step 2107 the first device sends the window display data of the first device to the second device.
  • step 1907 in the above embodiment shown in FIG. 19 refers to step 1907 in the above embodiment shown in FIG. 19 .
  • Step 2108 The second device displays the window display data of the first device.
  • step 1908 in the above embodiment shown in FIG. 19 .
  • the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window.
  • a third indication message is generated based on the second device information.
  • the window display data is sent to the second device for display.
  • the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending a third indication message to the first device, so that data communication can be realized between the devices.
  • FIG. 22 is a schematic flowchart of a data communication method between devices according to another exemplary embodiment.
  • the interaction between multiple devices is taken as an example for illustration.
  • the method can include the following:
  • steps 2201 to 2203 please refer to steps 1901 to 1903 in the embodiment of FIG. 19 above.
  • Step 2204 The target device forwards the window display data of the first device to the second device in real time based on the first device information and the second device information.
  • the target device obtains the window display data from the first device from the communication channel between the first device and the target device based on the first device information, and determines the relationship between the target device and the second device based on the second device information. and send the acquired window display data of the first device to the second device through the communication channel between the target device and the second device.
  • the target device acts as an intermediate forwarding device between the first device and the second device, or it can be understood that the target device is the proxy of the first device, which is used to display data in the window of the first device forwarded to the second device in real time.
  • step 2204 is another exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
  • Step 2205 the second device displays the window display data of the first device.
  • step 1908 in the embodiment in FIG. 19 , which will not be described in detail here.
  • the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window. Based on the first device information and the second device information, the window display data of the first device is forwarded to the second device in real time. In this way, the target device performs data forwarding by detecting the first operation, so that data communication between devices can be performed quickly.
  • the window display data of the first device or the second device is forwarded via the target device, there is no need to establish a direct data connection between the first device and the second device, only the first device and the second device are connected to the target device respectively, However, after the target device is disconnected from one of the first device and the second device, the window display data of the first device cannot be displayed on the second device.
  • the implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device described above is only exemplary. In another embodiment, it can also be implemented in other ways. For example, it may include but not limited to the following methods:
  • the target device may also send the first device information to the second device based on the second device information, to instruct the second device to establish a communication connection with the first device based on the first device information, and to instruct the second device to After successfully establishing a communication connection with the first device, the first device is requested to send the window display data of the first device.
  • the target device may also send the second device information to the first device based on the first device information, and send the first device information to the second device based on the second device information, so that the first device and the second A communication connection is established between the devices.
  • FIG. 23 is a schematic flow chart of another data communication method between devices provided by the embodiment of the present application.
  • the method is implemented through the interaction of multiple devices as an example.
  • the method includes:
  • steps 2301 to 2302 reference may be made to any one of the above-mentioned embodiments shown in FIG. 17-FIG. 22 , which will not be repeated here.
  • Step 2303 When it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimpose and display the first display window in the second display window.
  • the target device after receiving the notification of successful data communication sent by the first device and/or the second device, determines that the first device has successfully sent the window display data of the first device to the second device for display. For example, after the first device sends the window display data of the first device to the second device, it can send a data communication success notification to the target device, and the second device can also send data to the target device after receiving the window display data of the first device. Notification of successful communication. As an example, after receiving a notification of successful data communication sent by any one of the first device and the second device, the target device determines that the first device has successfully sent the window display data of the first device to the second device for display. As another example, after receiving the notification of successful data communication sent by the first device and the notification of successful data communication sent by the second device, the target device determines that the first device has successfully sent the window display data of the first device to displayed on the second device.
  • the target device may adjust the size and/or shape of the first display window, for example, The first display window is reduced, and the shape of the first display window is adjusted to be the same as that of the second display window, so as to overlay and display the first display window into the second display window.
  • the target device superimposes and displays the first display window in the second display window, which not only facilitates other users to continue viewing the display screen of the first device and/or the display screen of the second device in the target device, but also allows other users to According to the superimposed display effect, it can be known which two devices have performed data communication, and which device's display screen is displayed on which device's screen.
  • the first display window is displayed at the original position of the first display window, as shown in FIG. 6 .
  • the first display window may be shrunk when the first display window is overlaid and displayed in the second display window, the content in the first display window may be reduced. Therefore, continuing to display the first display window at the original position of the first display window allows the user to continue to see a clear display screen of the first device.
  • the target device when it is determined that the first device has successfully sent the window display data of the first device to the second device for display, after the first display window is superimposed on the second display window, the target device can The first display window is deleted from the original position of the first display window, that is, the first display window is no longer displayed separately in the screen display area of the target device, as shown in FIG. 7 , so that the display space of the screen display area can be saved.
  • the target device may also perform the following operation steps.
  • Step 2304 The target device detects the second operation, and controls the first device to terminate the data communication with the second device.
  • the second operation includes moving the first display window out of the second display window and then releasing it or starting from the first display window to a specified
  • the marking operation at the end of the area, the specified area does not include the area where the first display window is located and the area where the second display window is located.
  • the detection of the second operation by the target device refers to: the target device detects that the user drags the first display window from the second display window and then releases it. Specifically, after the target device detects the user's drag operation on the first display window and releases it, if the overlapping area between the first display window and the second display window is smaller than the area threshold, for example, the area between the first display window and the second display window If the overlapping area between them is 0, it can be determined that the first display window is released after being dragged out from the second display window.
  • the detection of the second operation by the target device refers to: the target device detects that the user starts from the area where the first display window is located and performs a scribing operation, and the end point of the scribing is within the specified area.
  • the target device detects that the user starts from the first display window and draws a line in the direction of the original position of the first display window, and the end point of the line is located in the original display area of the first display window or in another area outside the second display window , and the straight-line distance between the starting point of the line and the end point of the line is greater than the distance threshold, it can be determined that the second operation is detected.
  • the specific implementation of controlling the termination of the data communication between the first device and the second device may include: sending a termination indication message to the first device, where the termination indication message is used to indicate the termination of sending the window of the first device to the second device Display Data.
  • the target device may only instruct the first device to stop sending the window display data of the first device to the second device without disconnecting the communication connection with the second device. In another embodiment, the target device may also instruct the first device to stop sending the window display data of the first device to the second device, and disconnect the communication connection with the second device.
  • the target device may also instruct the second device to disconnect the communication connection with the first device, so that the first device terminates the data communication with the second device.
  • the target device is an intermediate forwarding device between the first device and the second device
  • the specific realization of controlling the termination of data communication between the first device and the second device is that the target device stops sending the first device
  • the window display data of the first device is forwarded to the second device in real time, that is, the target device no longer forwards the window display data of the first device to the second device.
  • the target device controls the termination of the data communication between the first device and the second device, it may further perform the following operations.
  • Step 2305 When the target device determines that the data communication between the first device and the second device has terminated, restore the first display window to the original position for display.
  • the target device receives the data communication end notification sent by the first device and/or the second device, and determines that the data communication between the first device and the second device has terminated. For example, after the first device stops sending the window display data of the first device to the second device, it sends a data communication end notification to the target device, and after the second device no longer displays the window display data of the first device, it can also send a notification to the target device Data communication end notification. As an example, after receiving the data communication end notification sent by any one of the first device and the second device, the target device determines that the data communication between the first device and the second device has been terminated. As another example, after receiving the data communication end notification sent by the first device and the data communication end notification sent by the second device, the target device determines that the data communication between the first device and the second device has terminated.
  • the target device determines that the data communication between the first device and the second device has terminated, the target device no longer superimposes the first display window on the second display window, but restores the first display window to its original position for display, and also That is, the display interface of the target device returns to the display state before the data communication between the first device and the second device, for example, returns to the display effect as shown in FIG. 15 .
  • the first display window is superimposed and displayed in the second display window, so that other users can continue to display in the second display window.
  • the target device views the display screen of the first device, and other users can know that the display screen of the first device is displayed in the second device, that is, other users can know the connection between the first device and the second device.
  • the above description is made by taking the target device restoring the first display window to its original position for display when it determines that the data communication between the first device and the second device has terminated.
  • the first display window may also be displayed at the position where the dragging stops or the position where the line ends.
  • the target device detects that the first display window is dragged to the second display window and releases it.
  • the target device displays an inquiry window.
  • the target device requests confirmation through the inquiry window whether to agree to establish a data communication connection between the first device and the second device.
  • the confirmation instruction is received based on the inquiry window, it means that the user agrees to establish a data communication connection between the first device and the second device, and at this time, enter the following step 2404 . Otherwise, if the cancel instruction is received based on the inquiry window, it means that the user does not agree to establish the data communication connection between the first device and the second device, and the data communication is canceled at this time.
  • the target device controls the first device to perform data communication with the second device.
  • the target device controls the first device to establish a communication connection with the second device, so as to perform data communication through the communication connection.
  • the first device establishes a communication connection with the second device.
  • the first device sends the window display data of the first device to the second device for display.
  • the first device and/or the second device feeds back to the target device.
  • the purpose of this feedback is to inform the target device that data communication has been achieved.
  • the first device or the second device sends a data communication success notification to the target device.
  • the target device displays the first display window in the second display window.
  • the target device receives the cancel instruction based on the inquiry window, it means that the user does not agree to display the screen display data of the first device on the second device, and the target device cancels the data communication at this time.
  • the target device restores the first display window to the original position for display, and the target device does not control the first device to perform data communication with the second device.
  • Fig. 25 is a structural block diagram of a data communication device between devices provided in the embodiment of the present application, which is configured in the above target device. For the convenience of description, Only the parts related to the embodiments of the present application are shown.
  • the device includes:
  • the detection module 2510 is configured to detect the first operation, and determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first The operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window;
  • a control module 2520 configured to control data communication between the first device and the second device based on the first device information and the second device information, so that the first The window display data of the device is displayed in the second device.
  • the detection module 2510 is used to:
  • the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
  • control module 2520 is used to:
  • the first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information
  • the second indication message is used to indicate that the first device is communicating with the first device
  • the two devices send the window display data of the first device to the second device for display.
  • control module 2520 is used to:
  • the third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
  • control module 2520 is used to:
  • control module 2520 is also used to:
  • the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
  • control module 2520 is also used to:
  • the detection module 2510 is also used to:
  • Detecting the first operation acquiring a snapshot of the first display window, and obtaining a first snapshot
  • the second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
  • the detection module 2510 is also used to:
  • Detecting a second operation controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
  • control module 2520 is used to:
  • termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
  • control module 2520 is also used to:
  • the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
  • the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window.
  • determine the first device information corresponding to the first display window and the second device information corresponding to the second display window and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device.
  • the user may perform the first operation on the target device, so that the target device controls the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
  • FIG. 26 is a structural block diagram of an apparatus for data communication between devices provided by an embodiment of the present application, which is configured in the above-mentioned first device. For ease of description, only parts related to the embodiment of the present application are shown.
  • the device includes:
  • a response module 2610 configured to establish a direct or indirect data communication connection with the second device in response to the target indication message, and display the window display data of the first device in the second device through the data communication ;
  • the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation,
  • the first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
  • the target device detects the first operation, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window.
  • the target device instructs the first device to establish a direct or indirect data communication connection with the second device, so that the first device displays the window display data of the first device in the second device through data communication.
  • the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
  • the disclosed devices and methods may be implemented in other ways.
  • the system embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division.
  • multiple units or components can be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the procedures in the methods of the above embodiments in the present application can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a computer-readable storage medium.
  • the computer program When executed by a processor, the steps in the above-mentioned various method embodiments can be realized.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form.
  • the computer-readable medium may at least include: any entity or device capable of carrying computer program codes to an electronic device, recording medium, computer memory, read-only memory (read-only memory, ROM), random access memory (random access) memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media.
  • any entity or device capable of carrying computer program codes to an electronic device recording medium, computer memory, read-only memory (read-only memory, ROM), random access memory (random access) memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media.
  • computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

The present application relates to the technical field of terminals, and provides a data communication method between devices, a device, a storage medium, and a program product. The method comprises: detecting a first operation, and determining first device information of a first device corresponding to a first display window and second device information of a second device corresponding to a second display window, the first operation comprising a scribing operation of moving the first display window to a display region of the second display window or starting from the first display window and ending at the second display window; and controlling, on the basis of the first device information and the second device information, the first device to perform data communication with the second device so that window display data of the first device is displayed in the second device by means of data communication. In this way, a user performs the first operation on a target device, so that the target device controls the first device to perform data communication with the second device, in order to display the window display data of the first device in the second device, thereby improving the convenience of operation.

Description

设备之间的数据通信方法、设备、存储介质及程序产品Data communication method between devices, device, storage medium and program product
本申请要求于2021年8月20日提交到国家知识产权局、申请号为202110966346.7、申请名称为“设备之间的数据通信方法、设备、存储介质及程序产品”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the State Intellectual Property Office on August 20, 2021, with the application number 202110966346.7 and the application name "Data communication method between devices, device, storage medium and program product", The entire contents of which are incorporated by reference in this application.
技术领域technical field
本申请涉及终端技术领域,尤其涉及一种设备之间的数据通信方法、设备、存储介质及程序产品。The present application relates to the technical field of terminals, and in particular to a data communication method between devices, a device, a storage medium and a program product.
背景技术Background technique
随着终端技术的快速发展,诸如平板电脑、手机之类的电子设备支持的功能越来越丰富。譬如,多个电子设备A可以连接到同一个电子设备B上,并在电子设备B中可以显示多个电子设备A中每个电子设备A的窗口显示数据,譬如可以将多个手机的显示画面投屏至平板电脑上,以便于用户进行信息分享。With the rapid development of terminal technology, electronic devices such as tablet computers and mobile phones support more and more functions. For example, multiple electronic devices A can be connected to the same electronic device B, and the window display data of each of the multiple electronic devices A can be displayed in the electronic device B, for example, the display screens of multiple mobile phones can be Project the screen to the tablet to facilitate information sharing for users.
在一些场景中,多个电子设备A之间未建立有通信连接,但多个电子设备A之间可能会有进行数据通信的需求。譬如,在某会议场景中,手机1和手机2投屏至平板电脑上,手机2的使用者想在手机2上查看手机1的显示画面。在该种情况下,如何使得电子设备A之间进行数据通信成为亟需解决的问题。In some scenarios, there is no communication connection established between the multiple electronic devices A, but there may be a need for data communication among the multiple electronic devices A. For example, in a conference scene, mobile phone 1 and mobile phone 2 are projected to a tablet computer, and the user of mobile phone 2 wants to view the display screen of mobile phone 1 on mobile phone 2. In this case, how to enable data communication between the electronic devices A becomes an urgent problem to be solved.
发明内容Contents of the invention
本申请提供一种设备之间的数据通信方法、设备、存储介质及程序产品,解决了现有技术中如何使得连接于同一电子设备的电子设备之间进行数据通信的问题。The present application provides a data communication method, device, storage medium and program product between devices, which solves the problem of how to enable data communication between electronic devices connected to the same electronic device in the prior art.
为达到上述目的,本申请采用如下技术方案:In order to achieve the above object, the application adopts the following technical solutions:
第一方面,提供了一种设备之间的数据通信方法,应用于目标设备,所述目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,所述第一显示窗口和所述第二显示窗口中分别显示有不同设备的窗口显示数据,所述方法包括:In the first aspect, a data communication method between devices is provided, which is applied to a target device, and the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the The window display data of different devices are respectively displayed in the second display window, and the method includes:
检测第一操作,确定所述第一显示窗口对应的第一设备的第一设备信息和所述第二显示窗口对应的第二设备的第二设备信息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作;Detecting a first operation, determining first device information of a first device corresponding to the first display window and second device information of a second device corresponding to the second display window, the first operation includes A line operation in which a display window is moved to the display area of the second display window or from the first display window to the end of the second display window;
基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,以通过所述数据通信使得所述第一设备的窗口显示数据显示于所述第二设备中。Based on the first device information and the second device information, controlling data communication between the first device and the second device, so that the window of the first device displays data through the data communication in the second device.
本申请实施例中,目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,第一显示窗口和第二显示窗口中分别显示有不同设备的窗口显示数据。若检测到第一操作,则可以确认用户想将第一显示窗口中的第一设备的窗口显示数据显示于第二显示窗口对应的第二设备中。为此,确定第一显示窗口对应的第一设备信息以及第二显示窗口对应的第二设备信息,基于第一设备信息和第二设备信息,控制第一设 备和第二设备进行数据通信,以通过该数据通信使得第一设备的窗口显示数据能够显示于第二设备中。如此,在第一设备和第二设备均连接于目标设备的情况下,用户可以通过在目标设备上进行第一操作,使得目标设备控制第一设备与第二设备进行数据通信,以将第一设备的窗口显示数据显示于第二设备中,提高了操作的便捷性。In the embodiment of the present application, the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices. If the first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, determine the first device information corresponding to the first display window and the second device information corresponding to the second display window, and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device. In this way, when both the first device and the second device are connected to the target device, the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
作为本申请的一个示例,所述检测第一操作,包括:As an example of the present application, the detection first operation includes:
检测所述第一显示窗口被移动至所述第二显示窗口的显示区域内后释放,所述第一显示窗口与所述第二显示窗口的重叠面积大于面积阈值;或者,Release after detecting that the first display window is moved into the display area of the second display window, and the overlapping area of the first display window and the second display window is greater than an area threshold; or,
检测以所述第一显示窗口为划线起点的划线操作,划线终点位于所述第二显示窗口的显示区域内,且划线起点与划线终点之间的直线距离处于预设距离范围内。Detecting a scribing operation with the first display window as the scribing start point, the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
如此,支持用户通过不同的操作方式对第一显示窗口进行操作,以便于后续根据用户的操作,在第一设备与第二设备之间建立直接或者间接的数据通信连接,从而将第一设备的窗口显示数据显示在第二设备上。增加了用户操作方式。In this way, the user is supported to operate the first display window through different operation modes, so that a direct or indirect data communication connection can be established between the first device and the second device according to the user's operation, so that the first device's The window display data is displayed on the second device. Added user operation methods.
作为本申请的一个示例,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:As an example of the present application, the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
基于所述第二设备信息向所述第二设备发送携带有所述第一设备信息的第一指示消息,以及基于所述第一设备信息向所述第一设备发送第二指示消息;sending a first indication message carrying the first device information to the second device based on the second device information, and sending a second indication message to the first device based on the first device information;
所述第一指示消息用于指示所述第二设备基于所述第一设备信息与所述第一设备建立通信连接,所述第二指示消息用于指示所述第一设备在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second indication message is used to indicate that the first device is communicating with the first device After establishing the communication connection, the two devices send the window display data of the first device to the second device for display.
也即是,目标设备检测第一操作,分别指示第一设备和第二设备,以控制第一设备与第二设备之间建立通信连接,进而使得设备之间能够进行数据通信。如此,通过在目标设备上操作,为第一设备与第二设备建立通信直连,可以解决第一设备的用户A与第二设备的用户B在会议场景下,用户A的手机的界面在展示过程中,用户B想在自己的手机上同步查看A的手机的展示界面,而此时A和B位置距离又比较远(但不影响建立数据通信连接),不方便面对面操作,连接手机的问题。That is, the target device detects the first operation, and instructs the first device and the second device respectively, so as to control the establishment of a communication connection between the first device and the second device, thereby enabling data communication between the devices. In this way, by operating on the target device and establishing a direct communication connection between the first device and the second device, it can solve the problem that the interface of user A's mobile phone is displayed in the conference scene between user A of the first device and user B of the second device. During the process, user B wants to simultaneously view the display interface of A's mobile phone on his mobile phone, and at this time, the distance between A and B is relatively far (but it does not affect the establishment of data communication connection), which is inconvenient for face-to-face operation and the problem of connecting to mobile phones .
作为本申请的一个示例,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:As an example of the present application, the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
基于所述第一设备信息,向所述第一设备发送携带有所述第二设备信息的第三指示消息;Sending a third indication message carrying the second device information to the first device based on the first device information;
所述第三指示消息用于指示所述第一设备基于所述第二设备信息与所述第二设备建立通信连接,以及在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
如此,目标设备检测第一操作,通过向第一设备发送第三指示消息控制第一设备与第二设备之间建立通信连接,使得设备之间能够实现数据通信。In this way, the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending a third indication message to the first device, so that data communication can be realized between the devices.
作为本申请的一个示例,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:As an example of the present application, the controlling data communication between the first device and the second device based on the first device information and the second device information includes:
基于所述第一设备信息和所述第二设备信息,将所述第一设备的窗口显示数据实时转发给所述第二设备。Based on the first device information and the second device information, forward the window display data of the first device to the second device in real time.
第一设备或第二设备的窗口显示数据经由目标设备转发,无需建立第一设备与第 二设备之间的数据直连,只需第一设备、第二设备分别与目标设备存在连接即可,减少第一设备与第二设备之间的交互。The window display data of the first device or the second device is forwarded via the target device, there is no need to establish a direct data connection between the first device and the second device, only the first device and the second device are connected to the target device respectively, Interaction between the first device and the second device is reduced.
作为本申请的一个示例,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信之前,还包括:As an example of the present application, before controlling data communication between the first device and the second device based on the first device information and the second device information, the method further includes:
显示问询窗口,所述问询窗口包括问询信息,所述问询信息用于指示基于所述问询窗口确认是否将所述第一设备的窗口显示数据显示于所述第二设备中;displaying an inquiry window, the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:The controlling the data communication between the first device and the second device based on the first device information and the second device information includes:
基于所述问询窗口接收确认指令,执行所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信的操作。Based on the inquiry window receipt confirmation instruction, perform the operation of controlling data communication between the first device and the second device based on the first device information and the second device information.
如此,通过在第一设备上显示问询窗口,以请求第一设备的使用者确认是否同意控制第一设备与第二设备进行数据通信,保证在第一设备的使用者同意的情况下将第一设备的窗口显示数据显示于第二设备中,提高了用户体验。In this way, by displaying an inquiry window on the first device to request the user of the first device to confirm whether he agrees to control the data communication between the first device and the second device, it is ensured that the second device will be transferred under the condition of the user's consent. The window display data of one device is displayed in the second device, which improves user experience.
作为本申请的一个示例,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信之后,还包括:As an example of the present application, after controlling the data communication between the first device and the second device based on the first device information and the second device information, the method further includes:
在确定所述第一设备成功将所述第一设备的窗口显示数据发送至所述第二设备中显示的情况下,在所述第二显示窗口中叠加显示所述第一显示窗口。In a case where it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimposing and displaying the first display window in the second display window.
如此,目标设备在第二显示窗口中叠加显示第一显示窗口,不仅便于其他用户继续在目标设备中查看第一设备的显示画面和/或第二设备的显示画面,另外,还可以使得其他用户根据叠加显示效果可以获知哪两个设备之间进行了数据通信,以及哪个设备的显示画面显示在哪个设备的屏幕上。In this way, the target device superimposes and displays the first display window in the second display window, which not only facilitates other users to continue viewing the display screen of the first device and/or the display screen of the second device in the target device, but also allows other users to According to the superimposed display effect, it can be known which two devices have performed data communication, and which device's display screen is displayed on which device's screen.
作为本申请的一个示例,所述方法还包括:As an example of the present application, the method also includes:
检测所述第一操作,获取所述第一显示窗口的快照,得到第一快照;Detecting the first operation, acquiring a snapshot of the first display window, and obtaining a first snapshot;
对所述第一快照进行透明化处理,得到第二快照;performing transparent processing on the first snapshot to obtain a second snapshot;
在所述第一显示窗口的原位置处显示所述第二快照,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
如此,通过在第一显示窗口的原位置处显示第二快照,可以便于用户直观获知哪个显示窗口***作。In this way, by displaying the second snapshot at the original position of the first display window, it may be convenient for the user to intuitively know which display window is operated.
作为本申请的一个示例,所述在所述第二显示窗口中叠加显示所述第一显示窗口之后,还包括:As an example of the present application, after the superimposed display of the first display window in the second display window, further includes:
检测第二操作,控制所述第一设备与所述第二设备终止数据通信,所述第二操作包括将所述第一显示窗口从所述第二显示窗口的显示区域移动出后释放或者从所述第一显示窗口开始至指定区域结束的划线操作,所述指定区域不包括所述第一显示窗口所在区域和所述第二显示窗口所在区域。Detecting a second operation, controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
如此,在第一设备与第二设备进行数据通信的过程中,当用户想要断开第一设备与第二设备之间的数据通信,可以基于目标设备的屏幕显示区域执行第二操作,以将第一设备对应的第一显示窗口从第二设备对应的第二显示窗口中拖出。相应的,目标设备在检测到第二操作后,控制第一设备与第二设备终止数据通信。也即用户可以直接在目标设备上操作以控制第一设备与第二设备终止数据通信。In this way, during the process of data communication between the first device and the second device, when the user wants to disconnect the data communication between the first device and the second device, the second operation can be performed based on the screen display area of the target device to Drag the first display window corresponding to the first device from the second display window corresponding to the second device. Correspondingly, after detecting the second operation, the target device controls the first device and the second device to terminate data communication. That is, the user can directly operate on the target device to control the termination of data communication between the first device and the second device.
作为本申请的一个示例,所述控制所述第一设备与所述第二设备终止数据通信,包括:As an example of the present application, the controlling the termination of data communication between the first device and the second device includes:
向所述第一设备发送终止指示消息,所述终止指示消息用于指示终止向所述第二设备发送所述第一设备的窗口显示数据。sending a termination indication message to the first device, where the termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
也即,目标设备通过对第一设备进行指示,可以控制第一设备与第二设备之间终止数据通信。That is, the target device can control the termination of data communication between the first device and the second device by instructing the first device.
作为本申请的一个示例,所述控制所述第一设备与所述第二设备终止数据通信之后,还包括:As an example of the present application, after the controlling the termination of data communication between the first device and the second device, further includes:
在确定所述第一设备与所述第二设备已终止数据通信的情况下,将所述第一显示窗口恢复至原位置显示,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。When it is determined that the data communication between the first device and the second device has terminated, the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
也即是,在第一设备与第二设备终止数据通信的情况下,将第一显示窗口恢复至原位置显示,可以保持第一设备与第二设备未进行数据通信之前的显示状态。如此,若屏幕显示区域内存在多个显示窗口,按照该种显示方式恢复显示后,可以便于用户从多个显示窗口中快速定位到第一显示窗口所在位置。That is, when the data communication between the first device and the second device is terminated, restoring the first display window to the original display position can keep the display state before the data communication between the first device and the second device. In this way, if there are multiple display windows in the display area of the screen, the user can quickly locate the position of the first display window from the multiple display windows after the display is resumed in this display mode.
第二方面,提供了一种设备之间的数据通信方法,应用于第一设备,所述第一设备的窗口显示数据显示在目标设备的屏幕显示区域的第一显示窗口内,所述目标设备的屏幕显示区域内还包括第二显示窗口,所述第二显示窗口中显示有第二设备的窗口显示数据,所述方法包括:In the second aspect, a data communication method between devices is provided, which is applied to a first device, and the window display data of the first device is displayed in the first display window of the screen display area of the target device, and the target device The screen display area of the screen also includes a second display window, the window display data of the second device is displayed in the second display window, and the method includes:
响应于目标指示消息,与所述第二设备建立直接或间接的数据通信连接,通过所述数据通信将所述第一设备的窗口显示数据显示于所述第二设备中;Responding to the target indication message, establish a direct or indirect data communication connection with the second device, and display the window display data of the first device in the second device through the data communication;
其中,所述目标指示消息包括所述目标设备在检测第一操作后发送的指示消息,和/或,所述目标设备在检测所述第一操作后指示所述第二设备发送的指示消息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作。Wherein, the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation, The first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
作为本申请的一个示例,目标指示消息包括第二指示消息和第二设备的用于建立通信连接的请求指示消息,所述第二指示消息用于指示所述第一设备在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。As an example of the present application, the target indication message includes a second indication message and a request indication message for establishing a communication connection of the second device, and the second indication message is used to indicate that the first device is communicating with the second device. After the device establishes the communication connection, the window display data of the first device is sent to the second device for display.
具体地,目标设备检测第一操作后,向第一设备发送第二指示消息,以及向第二设备发送携带有第一设备信息的第一指示消息,所述第一指示消息用于指示所述第二设备基于所述第一设备信息与所述第一设备建立通信连接。第二设备接收第一指示消息后请求与第一设备建立通信连接,相应的,第一设备根据第二设备的请求指示消息,与第二设备建立通信连接。之后,根据第二指示消息,将第一设备的窗口显示数据发送至所述第二设备中显示。Specifically, after the target device detects the first operation, it sends a second indication message to the first device, and sends a first indication message carrying the information of the first device to the second device, and the first indication message is used to indicate the The second device establishes a communication connection with the first device based on the first device information. After receiving the first indication message, the second device requests to establish a communication connection with the first device, and correspondingly, the first device establishes a communication connection with the second device according to the request indication message of the second device. Afterwards, according to the second indication message, the window display data of the first device is sent to the second device for display.
作为本申请的另一个示例,所述目标指示消息包括携带有第二设备信息的第三指示消息,所述第三指示消息用于指示所述第一设备基于所述第二设备信息与所述第二设备建立通信连接,以及在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。As another example of the present application, the target indication message includes a third indication message carrying the information of the second device, and the third indication message is used to instruct the first device based on the information of the second device and the The second device establishes a communication connection, and sends the window display data of the first device to the second device for display after the communication connection is established with the second device.
作为本申请的另一种示例,所述目标指示消息包括第四指示消息,第四指示消息 是由第二设备在接收到目标设备的指示后发送的,用于请求与第一设备建立通信连接,以及请求将第一设备的窗口显示数据发送给第二设备。譬如目标设备在检测到第一操作后将第一设备信息发送给第二设备,并指示第二设备。相应的,第二设备向第一设备发送第四指示消息。As another example of the present application, the target indication message includes a fourth indication message, the fourth indication message is sent by the second device after receiving the indication of the target device, and is used to request to establish a communication connection with the first device , and request to send the window display data of the first device to the second device. For example, after detecting the first operation, the target device sends the first device information to the second device and instructs the second device. Correspondingly, the second device sends a fourth indication message to the first device.
在本申请实施例中,第一设备与第二设备之间建立间接的数据通信连接是指,将第一设备的窗口显示数据通过目标设备转发给第二设备。In this embodiment of the present application, establishing an indirect data communication connection between the first device and the second device refers to forwarding the window display data of the first device to the second device through the target device.
本申请实施例中,若目标设备检测到第一操作,则可以确认用户想将第一显示窗口中的第一设备的窗口显示数据显示于第二显示窗口对应的第二设备中。为此,目标设备指示第一设备与第二设备之间建立直接或间接的数据通信连接,使得第一设备通过数据通信将第一设备的窗口显示数据显示于第二设备中。如此,在第一设备和第二设备均连接于目标设备的情况下,用户可以通过在目标设备上进行第一操作,使得目标设备控制第一设备与第二设备进行数据通信,以将第一设备的窗口显示数据显示于第二设备中,提高了操作的便捷性。In this embodiment of the present application, if the target device detects the first operation, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the target device instructs the first device to establish a direct or indirect data communication connection with the second device, so that the first device displays the window display data of the first device in the second device through data communication. In this way, when both the first device and the second device are connected to the target device, the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
第三方面,提供一种设备之间的数据通信装置,配置于目标设备中,所述目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,所述第一显示窗口和所述第二显示窗口中分别显示有不同设备的窗口显示数据,所述装置包括:In a third aspect, there is provided a data communication device between devices, which is configured in a target device, and the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the The window display data of different devices are respectively displayed in the second display window, and the device includes:
检测模块,用于检测第一操作,确定所述第一显示窗口对应的第一设备的第一设备信息和所述第二显示窗口对应的第二设备的第二设备信息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作;A detection module, configured to detect a first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first operation including moving the first display window to the display area of the second display window or a scribing operation from the first display window to the end of the second display window;
控制模块,用于基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,以通过所述数据通信使得所述第一设备的窗口显示数据显示于所述第二设备中。a control module, configured to control data communication between the first device and the second device based on the first device information and the second device information, so that the first device can The window display data of is displayed in the second device.
作为本申请的一个示例,所述检测模块用于:As an example of the present application, the detection module is used for:
检测所述第一显示窗口被移动至所述第二显示窗口的显示区域内后释放,所述第一显示窗口与所述第二显示窗口的重叠面积大于面积阈值;或者,Release after detecting that the first display window is moved into the display area of the second display window, and the overlapping area of the first display window and the second display window is greater than an area threshold; or,
检测以所述第一显示窗口为划线起点的划线操作,划线终点位于所述第二显示窗口的显示区域内,且划线起点与划线终点之间的直线距离处于预设距离范围内。Detecting a scribing operation with the first display window as the scribing start point, the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
作为本申请的一个示例,所述控制模块用于:As an example of the present application, the control module is used for:
基于所述第二设备信息向所述第二设备发送携带有所述第一设备信息的第一指示消息,以及基于所述第一设备信息向所述第一设备发送第二指示消息;sending a first indication message carrying the first device information to the second device based on the second device information, and sending a second indication message to the first device based on the first device information;
所述第一指示消息用于指示所述第二设备基于所述第一设备信息与所述第一设备建立通信连接,所述第二指示消息用于指示所述第一设备在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second indication message is used to indicate that the first device is communicating with the first device After establishing the communication connection, the two devices send the window display data of the first device to the second device for display.
作为本申请的一个示例,所述控制模块用于:As an example of the present application, the control module is used for:
基于所述第一设备信息,向所述第一设备发送携带有所述第二设备信息的第三指示消息;Sending a third indication message carrying the second device information to the first device based on the first device information;
所述第三指示消息用于指示所述第一设备基于所述第二设备信息与所述第二设备建立通信连接,以及在与所述第二设备建立通信连接后将所述第一设备的窗口显示数 据发送至所述第二设备中显示。The third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
作为本申请的一个示例,所述控制模块用于:As an example of the present application, the control module is used for:
基于所述第一设备信息和所述第二设备信息,将所述第一设备的窗口显示数据实时转发给所述第二设备。Based on the first device information and the second device information, forward the window display data of the first device to the second device in real time.
作为本申请的一个示例,所述控制模块还用于:As an example of the present application, the control module is also used for:
显示问询窗口,所述问询窗口包括问询信息,所述问询信息用于指示基于所述问询窗口确认是否将所述第一设备的窗口显示数据显示于所述第二设备中;displaying an inquiry window, the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
基于所述问询窗口接收确认指令,执行所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信的操作。Based on the inquiry window receipt confirmation instruction, perform the operation of controlling data communication between the first device and the second device based on the first device information and the second device information.
作为本申请的一个示例,所述控制模块还用于:As an example of the present application, the control module is also used for:
在确定所述第一设备成功将所述第一设备的窗口显示数据发送至所述第二设备中显示的情况下,在所述第二显示窗口中叠加显示所述第一显示窗口。In a case where it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimposing and displaying the first display window in the second display window.
作为本申请的一个示例,所述检测模块还用于:As an example of the present application, the detection module is also used for:
检测所述第一操作,获取所述第一显示窗口的快照,得到第一快照;Detecting the first operation, acquiring a snapshot of the first display window, and obtaining a first snapshot;
对所述第一快照进行透明化处理,得到第二快照;performing transparent processing on the first snapshot to obtain a second snapshot;
在所述第一显示窗口的原位置处显示所述第二快照,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
作为本申请的一个示例,所述检测模块还用于:As an example of the present application, the detection module is also used for:
检测第二操作,控制所述第一设备与所述第二设备终止数据通信,所述第二操作包括将所述第一显示窗口从所述第二显示窗口的显示区域移动出后释放或者从所述第一显示窗口开始至指定区域结束的划线操作,所述指定区域不包括所述第一显示窗口所在区域和所述第二显示窗口所在区域。Detecting a second operation, controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
作为本申请的一个示例,所述控制模块用于:As an example of the present application, the control module is used for:
向所述第一设备发送终止指示消息,所述终止指示消息用于指示终止向所述第二设备发送所述第一设备的窗口显示数据。sending a termination indication message to the first device, where the termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
作为本申请的一个示例,所述控制模块还用于:As an example of the present application, the control module is also used for:
在确定所述第一设备与所述第二设备已终止数据通信的情况下,将所述第一显示窗口恢复至原位置显示,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。When it is determined that the data communication between the first device and the second device has terminated, the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
第四方面,提供一种设备之间的数据通信装置,配置于第一设备中,所述第一设备的窗口显示数据显示在目标设备的屏幕显示区域的第一显示窗口内,所述目标设备的屏幕显示区域内还包括第二显示窗口,所述第二显示窗口中显示有第二设备的窗口显示数据,所述装置包括:In the fourth aspect, there is provided a data communication device between devices, configured in a first device, the window display data of the first device is displayed in the first display window of the screen display area of the target device, and the target device The screen display area of the screen also includes a second display window, the window display data of the second device is displayed in the second display window, and the device includes:
响应模块,用于响应于目标指示消息,与所述第二设备建立直接或间接的数据通信连接,通过所述数据通信将所述第一设备的窗口显示数据显示于所述第二设备中;A response module, configured to establish a direct or indirect data communication connection with the second device in response to the target indication message, and display the window display data of the first device in the second device through the data communication;
其中,所述目标指示消息包括所述目标设备在检测第一操作后发送的指示消息,和/或,所述目标设备在检测所述第一操作后指示所述第二设备发送的指示消息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作。Wherein, the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation, The first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
第五方面,提供一种电子设备,包括触摸屏,存储器,一个或多个处理器,多个应用程序,以及一个或多个程序;其中所述一个或多个程序被存储在所述存储器中;所述一个或多个处理器在执行所述一个或多个程序时,使得所述电子设备实现上述第一方面中任一项所述的方法,或者,实现上述第二方面所述的方法。In a fifth aspect, an electronic device is provided, including a touch screen, a memory, one or more processors, multiple application programs, and one or more programs; wherein the one or more programs are stored in the memory; When the one or more processors execute the one or more programs, the electronic device is enabled to implement the method described in any one of the above first aspects, or to implement the method described in the above second aspect.
第六方面,提供一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,当其在计算机上运行时,使得计算机执行上述第一方面中任一项所述的方法,或者,实现上述第二方面所述的方法。In a sixth aspect, there is provided a computer-readable storage medium, the computer-readable storage medium stores instructions, and when it is run on a computer, it causes the computer to execute the method described in any one of the above-mentioned first aspects, or , implementing the method described in the second aspect above.
第七方面,提供一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述第一方面中任一项所述的方法,或者,实现上述第二方面所述的方法。In a seventh aspect, there is provided a computer program product containing instructions, which, when run on a computer, cause the computer to execute the method described in any one of the above-mentioned first aspects, or realize the method described in the above-mentioned second aspect.
上述第二方面、第三方面、第四方面、第五方面、第六方面和第七方面所获得的技术效果与上述第一方面或第二方面中对应的技术手段获得的技术效果近似,在这里不再赘述。The technical effects obtained by the above-mentioned second aspect, third aspect, fourth aspect, fifth aspect, sixth aspect and seventh aspect are similar to the technical effects obtained by the corresponding technical means in the above-mentioned first aspect or second aspect. I won't go into details here.
附图说明Description of drawings
图1为本申请实施例提供的一种电子设备100***架构图;FIG. 1 is a system architecture diagram of an electronic device 100 provided by an embodiment of the present application;
图2为本申请实施例提供的一种电子设备的软件架构示意图;FIG. 2 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
图3为本申请实施例提供的一种目标设备的屏幕显示区域的示意图;FIG. 3 is a schematic diagram of a screen display area of a target device provided in an embodiment of the present application;
图4为本申请实施例提供的一种基于目标设备的屏幕显示区域的操作示意图;FIG. 4 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application;
图5为本申请实施例提供的一种第二设备的界面显示示意图;FIG. 5 is a schematic diagram of an interface display of a second device provided in an embodiment of the present application;
图6为本申请实施例提供的一种目标设备的屏幕显示区域的示意图;FIG. 6 is a schematic diagram of a screen display area of a target device provided in an embodiment of the present application;
图7为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 7 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application;
图8为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 8 is a schematic diagram of a screen display area of another target device provided by an embodiment of the present application;
图9为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 9 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application;
图10为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 10 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application;
图11为本申请实施例提供的一种基于目标设备的屏幕显示区域的操作示意图;FIG. 11 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application;
图12为本申请实施例提供的一种基于目标设备的屏幕显示区域的操作示意图;FIG. 12 is a schematic diagram of an operation of a screen display area based on a target device provided in an embodiment of the present application;
图13为本申请实施例提供的一种基于目标设备的屏幕显示区域的操作示意图;FIG. 13 is a schematic diagram of an operation of a screen display area based on a target device provided by an embodiment of the present application;
图14为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 14 is a schematic diagram of a screen display area of another target device provided in an embodiment of the present application;
图15为本申请实施例提供的另一种目标设备的屏幕显示区域的示意图;FIG. 15 is a schematic diagram of a screen display area of another target device provided by an embodiment of the present application;
图16为本申请实施例提供的另一种目标设备的内部结构的示意图;FIG. 16 is a schematic diagram of the internal structure of another target device provided by the embodiment of the present application;
图17为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 17 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图18为本申请实施例提供的一种基于目标设备的屏幕显示区域的操作示意图;FIG. 18 is a schematic diagram of an operation of a screen display area based on a target device provided by an embodiment of the present application;
图19为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 19 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图20为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 20 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图21为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 21 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图22为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 22 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图23为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 23 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图24为本申请实施例提供的一种设备之间数据通信方法的流程示意图;FIG. 24 is a schematic flowchart of a data communication method between devices provided in an embodiment of the present application;
图25为本申请实施例提供的一种设备之间数据通信的装置的结构示意图;FIG. 25 is a schematic structural diagram of an apparatus for data communication between devices provided by an embodiment of the present application;
图26为本申请实施例提供的另一种设备之间数据通信的装置的结构示意图。FIG. 26 is a schematic structural diagram of another apparatus for data communication between devices provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.
应当理解的是,本申请提及的“多个”是指两个或两个以上。在本申请的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,为了便于清楚描述本申请的技术方案,采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分。本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定,并且“第一”、“第二”等字样也并不限定一定不同。It should be understood that the "plurality" mentioned in this application means two or more. In the description of this application, unless otherwise specified, "/" means or means, for example, A/B can mean A or B; "and/or" in this article is just a description of the relationship between associated objects, Indicates that there may be three relationships, for example, A and/or B, may indicate: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in order to clearly describe the technical solution of the present application, words such as "first" and "second" are used to distinguish the same or similar items with basically the same function and effect. Those skilled in the art can understand that words such as "first" and "second" do not limit the number and execution order, and words such as "first" and "second" do not necessarily limit the difference.
在对本申请实施例提供的设备之间的数据通信方法进行详细介绍之前,先对本申请实施例涉及的执行主体进行介绍。本申请实施例提供的方法可以由电子设备执行。作为本申请的一个示例,电子设备可以包括但不限于终端设备、电视机等。示例性地,终端设备可以包括但不限于手机、平板电脑、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personal digital assistant,PDA)。Before a detailed introduction to the data communication method between devices provided by the embodiment of the present application, the execution subject involved in the embodiment of the present application is introduced first. The method provided in the embodiment of the present application may be executed by an electronic device. As an example of the present application, the electronic device may include but not limited to a terminal device, a television, and the like. Exemplarily, the terminal device may include, but not limited to, a mobile phone, a tablet computer, an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC ), netbook, personal digital assistant (personal digital assistant, PDA).
请参阅图1,图1是本申请实施例提供的一种电子设备的结构示意图。Please refer to FIG. 1 . FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It can be understood that, the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。Wherein, the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了***的效率。A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器180K,使处理器110与触摸传感器180K通过I2C总线接口通信,实现电子设备100的触摸功能。The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100 .
I2S接口可以用于音频通信。在一些实施例中,处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合,实现处理器110与音频模块170之间的通信。在一些实施例中,音频模块170可以通过I2S接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中,音频模块170也可以通过PCM接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。The PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与无线通信模块160。例如:处理器110通过UART接口与无线通信模块160中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块170可以通过UART接口向无线通信模块160传递音频信号,实现通过蓝牙耳机播放音乐的功能。The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160 . For example: the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等***器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现电子设备100的显示功能。The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 .
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为 数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头193,显示屏194,无线通信模块160,音频模块170,传感器模块180等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193 , the display screen 194 , the wireless communication module 160 , the audio module 170 , the sensor module 180 and so on. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电,也可以用于电子设备100与***设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。The USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。It can be understood that the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备100供电。The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device 100 through the power management module 141 .
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 . The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be disposed in the processor 110 . In some other embodiments, the power management module 141 and the charging management module 140 may also be set in the same device.
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。The wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。 Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A, 受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system,GPS),全球导航卫星***(global navigation satellite system,GLONASS),北斗卫星导航***(beidou navigation satellite system,BDS),准天顶卫星***(quasi-zenith satellite system,QZSS)和/或星基增强***(satellite based augmentation systems,SBAS)。In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传 递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作***,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。The electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100 可以通过扬声器170A收听音乐,或收听免提通话。Speaker 170A, also referred to as a "horn", is used to convert audio electrical signals into sound signals. Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。 Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the receiver 170B can be placed close to the human ear to receive the voice.
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中,电子设备100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动终端平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。The earphone interface 170D is used for connecting wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备100根据压力传感器180A检测所述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions.
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。The gyro sensor 180B can be used to determine the motion posture of the electronic device 100 . In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization.
气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中,当电子设备100是翻盖机时,电子设备100可以根据磁传感器180D检测翻盖的开合。The magnetic sensor 180D includes a Hall sensor. The electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a clamshell machine, the electronic device 100 can detect opening and closing of the clamshell according to the magnetic sensor 180D.
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备100的姿态,应用于横竖屏切换,计步器等应用。The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize the posture of the electronic device 100, and be applied to applications such as horizontal and vertical screen switching, pedometer, etc.
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备100可以利用距离传感器180F测距以实现快速对焦。The distance sensor 180F is used to measure the distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F for distance measurement to achieve fast focusing.
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定电子设备100附近有物体。Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The electronic device 100 emits infrared light through the light emitting diode. Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 100 .
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合,检测电子设备100是否在口袋里,以防误触。The ambient light sensor 180L is used for sensing ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket, so as to prevent accidental touch.
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like.
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器180J检测的温度,执行温度处理策略。The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy.
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏,接收血压跳动信号。The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal.
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时***多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备100中,不能和电子设备100分离。The SIM card interface 195 is used for connecting a SIM card. The SIM card can be connected and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the electronic device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .
电子设备100的软件***可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的Android***为例,示例性说明电子设备100的软件结构。The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the software structure of the electronic device 100 is exemplarily described by taking an Android system with a layered architecture as an example.
图2是本申请实施例的电子设备100的软件结构框图。FIG. 2 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android***分为四层,从上至下分别为应用程 序层,应用程序框架层,安卓运行时(Android runtime)和***库,以及内核层。The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, Android runtime (Android runtime) and system libraries, and the kernel layer from top to bottom.
应用程序层可以包括一系列应用程序包。The application layer can consist of a series of application packages.
如图2所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。As shown in Figure 2, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
如图2所示,应用程序框架层可以包括窗口管理器,内容提供器,视图***,电话管理器,资源管理器,通知管理器等。As shown in Figure 2, the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
视图***包括可视控件,例如显示文字的控件,显示图片的控件等。视图***可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通,挂断等)。The phone manager is used to provide communication functions of the electronic device 100 . For example, the management of call status (including connected, hung up, etc.).
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。通知管理器还可以是以图表或者滚动条文本形式出现在***顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备100振动,指示灯闪烁等。The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is issued, the electronic device 100 vibrates, an indicator light flashes, and the like.
Android Runtime包括核心库和虚拟机。Android runtime负责安卓***的调度和管理。Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
***库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。A system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
表面管理器用于对显示***进行管理,并且为多个应用程序提供了2D和3D图层的融合。The Surface Manager is used to manage the display system and provides the fusion of 2D and 3D layers for multiple applications.
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
2D图形引擎是2D绘图的绘图引擎。2D graphics engine is a drawing engine for 2D drawing.
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
接下来对本申请实施例涉及的应用场景进行介绍。Next, the application scenarios involved in the embodiments of the present application are introduced.
假设手机A和手机B分别投屏至平板电脑C上,平板电脑C在屏幕显示区域内的不同位置分别显示第一显示窗口和第二显示窗口,其中第一显示窗口中显示有手机A的显示画面,第二显示窗口中显示有手机B的显示画面。譬如请参考图3,图3是根据一示例性实施例示出的一种应用场景的示意图,其中,平板电脑C的屏幕显示区域如图3中的30所示区域,第一显示窗口如图3中的31所示,31中显示有手机A当前的显示画面,第二显示窗口如图3中的32所示,32中显示有手机B当前的显示画面。Assume that mobile phone A and mobile phone B respectively project their screens to tablet computer C, and tablet computer C displays the first display window and the second display window at different positions in the screen display area, in which the display of mobile phone A is displayed in the first display window screen, the display screen of mobile phone B is displayed in the second display window. For example, please refer to FIG. 3 . FIG. 3 is a schematic diagram of an application scenario according to an exemplary embodiment, wherein, the screen display area of the tablet computer C is shown as 30 in FIG. 3 , and the first display window is shown in FIG. 3 As shown in 31, the current display screen of mobile phone A is displayed in 31, and the second display window is shown in 32 in FIG. 3, and the current display screen of mobile phone B is displayed in 32.
在一个实施例中,为了区分哪个显示窗口是用于显示手机A的显示画面,以及哪个显示窗口是用于显示手机B的显示画面,平板电脑C在显示第一显示窗口和第二显示窗口时,可以采用多种方式进行区分显示。示例性地,平板电脑C可以在第一显示窗口中标注手机A的相关信息,以及在第二显示窗口中标注手机B的相关信息,相关信息可以包括但不限于手机型号、手机品牌、手机的地址信息中的至少一项。再如,平板电脑C也可以将第一显示窗口和第二显示窗口分别设置成不同的尺寸。又如,平板电脑C还可以将第一显示窗口和第二显示窗口分别设置成不同的形状等。In one embodiment, in order to distinguish which display window is used to display the display screen of mobile phone A and which display window is used to display the display screen of mobile phone B, when the tablet computer C displays the first display window and the second display window , which can be distinguished and displayed in various ways. Exemplarily, the tablet computer C can mark the relevant information of the mobile phone A in the first display window, and mark the relevant information of the mobile phone B in the second display window, and the relevant information can include but not limited to the model of the mobile phone, the brand of the mobile phone, the At least one item of address information. For another example, the tablet computer C may also set the first display window and the second display window to be of different sizes. As another example, the tablet computer C may also set the first display window and the second display window into different shapes and so on.
作为本申请的一个示例,当使用手机B的用户想要在手机B上查看手机A的显示画面时,可以在平板电脑C的屏幕显示区域上进行操作。在一个实施例中,请参考图4,图4是根据一示例性实施例示出的一种操作示意图,手指在屏幕显示区域上选中第一显示窗口,然后将第一显示窗口拖动至第二显示窗口中。在一个实施例中,手指在屏幕显示区域上选中第一显示窗口后,平板电脑C可以在屏幕显示区域中显示操作引导信息,比如如图4所示,显示有用于引导用户操作的箭头等指示符号。As an example of the present application, when the user using the mobile phone B wants to view the display screen of the mobile phone A on the mobile phone B, he can operate on the screen display area of the tablet computer C. In one embodiment, please refer to FIG. 4 . FIG. 4 is a schematic diagram of an operation according to an exemplary embodiment. A finger selects the first display window on the screen display area, and then drags the first display window to the second displayed in the window. In one embodiment, after the finger selects the first display window on the screen display area, the tablet computer C may display operation guidance information in the screen display area, for example, as shown in FIG. symbol.
在一个实施例中,响应于对第一显示窗口的拖动操作,如果平板电脑C检测到第一显示窗口被拖动至第二显示窗口内后释放,则控制手机A和手机B进行数据通信,以使得手机A将当前的显示画面对应的窗口显示数据发送至手机B中显示。相应的,手机B接收手机A发送的窗口显示数据后显示手机A的显示画面。作为一种示例,手机B可以在手机B的屏幕显示区域内显示目标显示窗口,然后在目标显示窗口内基于所接收的窗口显示数据显示手机A的显示画面。其中,目标显示窗口的大小可以根据实际需求进行设置。示例性地,请参考图5,手机B中的显示效果可以如图5中的(a)图所示,用手机A的窗口显示数据替代手机B原有的显示画面;或者也可以如图5中的(b)图所示,手机A的显示窗口缩小,只在手机B显示窗口的部分显示。作为另一种示例,手机B也可以关闭手机B初始的显示界面,然后切换为显示手机A的显示画面,本申请实施例对此不作限定。In one embodiment, in response to the drag operation on the first display window, if the tablet computer C detects that the first display window is dragged into the second display window and releases it, then the mobile phone A and mobile phone B are controlled to perform data communication , so that mobile phone A sends the window display data corresponding to the current display screen to mobile phone B for display. Correspondingly, mobile phone B displays the display screen of mobile phone A after receiving the window display data sent by mobile phone A. As an example, mobile phone B may display a target display window in the screen display area of mobile phone B, and then display a display screen of mobile phone A in the target display window based on the received window display data. Wherein, the size of the target display window may be set according to actual requirements. For example, please refer to Figure 5, the display effect in mobile phone B can be shown in Figure 5 (a), using the window display data of mobile phone A to replace the original display screen of mobile phone B; or it can also be shown in Figure 5 As shown in (b) of the figure, the display window of mobile phone A is reduced, and only the part of the display window of mobile phone B is displayed. As another example, the mobile phone B may also close the initial display interface of the mobile phone B, and then switch to display the display screen of the mobile phone A, which is not limited in this embodiment of the present application.
作为本申请的一个示例,平板电脑C控制手机A与手机B进行数据通信后,若确定手机A将窗口显示数据成功发送至手机B中显示,比如平板电脑C接收到手机A 和/或手机B的数据通信成功通知,则平板电脑C在第二显示窗口中叠加显示第一显示窗口。在实施中,由于第一显示窗口和第二显示窗口的尺寸和/或形状存在一定的差异,所以在将第一显示窗口叠加显示至第二显示窗口之前可以对第一显示窗口的尺寸/或形状进行调整,使得第二显示窗口中能够叠加显示第一显示窗口。As an example of this application, after the tablet computer C controls the mobile phone A to perform data communication with the mobile phone B, if it is determined that the mobile phone A successfully sends the window display data to the mobile phone B for display, for example, the tablet computer C receives the data from the mobile phone A and/or the mobile phone B. If the data communication is successful, the tablet computer C superimposes and displays the first display window in the second display window. In implementation, since there is a certain difference in size and/or shape between the first display window and the second display window, the size and/or shape of the first display window may be adjusted before the first display window is superimposed on the second display window. The shape is adjusted so that the first display window can be superimposed and displayed in the second display window.
在一个实施例中,平板电脑C将第一显示窗口叠加显示在第二显示窗口后的效果如图6所示。也即,平板电脑C将第一显示窗口叠加至第二显示窗口,并且在第一显示窗口的原位置继续显示第一显示窗口,原位置是指第一显示窗口被拖动前的显示位置。In one embodiment, the effect of the tablet computer C superimposing and displaying the first display window behind the second display window is shown in FIG. 6 . That is, the tablet computer C superimposes the first display window on the second display window, and continues to display the first display window at the original position of the first display window. The original position refers to the display position of the first display window before being dragged.
在另一个实施例中,平板电脑C将第一显示窗口叠加显示至第二显示窗口后的效果如图7所示。也即,平板电脑C将第一显示窗口叠加显示至第二显示窗口后,也可以不再继续在第一显示窗口的原位置显示第一显示窗口。In another embodiment, the effect after the tablet computer C superimposes and displays the first display window on the second display window is shown in FIG. 7 . That is, after the tablet computer C overlays and displays the first display window on the second display window, it may not continue to display the first display window at the original position of the first display window.
作为本申请的一个示例,在对第一显示窗口的拖动过程中,平板电脑C可以在第一显示窗口的原位置设置第一显示窗口的显示提示,示例性地,请参考图8,平板电脑C可以在第一显示窗口的原位置显示第一显示窗口的半透明状快照。若检测到第一显示窗口被拖动至第二显示窗口后释放,则平板电脑C在第二显示窗口叠加显示第一显示窗口,并删除半透明状快照,最终的显示效果可以如图7所示。在一种情况下,若检测到对第一显示窗口的拖动程度不够,也即第一显示窗口在未被完全拖动至第二显示窗口内的情况下就释放了,则平板电脑C以弹回方式将第一显示窗口重新显示于半透明状快照的位置,并删除半透明状快照。As an example of the present application, during the dragging process of the first display window, the tablet computer C can set a display prompt of the first display window at the original position of the first display window. For example, please refer to FIG. 8 , the tablet computer The computer C can display the translucent snapshot of the first display window at the original position of the first display window. If it is detected that the first display window is dragged to the second display window and then released, the tablet computer C displays the first display window superimposed on the second display window, and deletes the translucent snapshot. The final display effect can be as shown in Figure 7 Show. In one case, if it is detected that the dragging degree of the first display window is not enough, that is, the first display window is released without being fully dragged into the second display window, then the tablet computer C starts with The pop-up method redisplays the first display window at the position of the translucent snapshot, and deletes the translucent snapshot.
作为本申请的一个示例,平板电脑C在控制手机A和手机B之间进行数据通信之前,还可以显示问询窗口,以通过该问询窗口请求用户确认是否同意手机A和手机B之间进行数据通信。在一个示例中,请参考图9,图9是根据一示例性实施例示出了一种问询窗口的显示示意图,若平板电脑C在检测到第一显示窗口被拖动至第二显示窗口后释放,弹出该问询窗口,问询窗口中包括问询信息,示例性地,问询信息为“是否建立通信连接?”,另外,问询窗口中还包括确认选项和取消选项,确认选项用于触发平板电脑C控制手机A与手机B之间进行数据通信,取消选项用于触发平板电脑C取消控制手机A与手机B之间进行数据通信。如图9所示,确认选项为“是”触摸控件,取消选项为“否”触摸控件。当用户同意将手机A的显示画面显示于手机B中时,可以触发“是”触摸控件,响应于用户对“是”触摸控件的触发操作,平板电脑C控制手机A与手机B之间进行数据通信,以通过该数据通信使得手机A的显示画面显示于手机B中;反之,当用户不同意将手机A的显示画面显示于手机B中时,可以触发“否”触摸控件,响应于用户对“否”触摸控件的触发操作,平板电脑C取消控制手机A与手机B之间的数据通信,也即,不将手机A的显示画面显示于手机B中。As an example of this application, before the tablet computer C controls the data communication between the mobile phone A and the mobile phone B, it can also display an inquiry window, so as to request the user to confirm whether to agree to the data communication between the mobile phone A and the mobile phone B through the inquiry window. data communication. In an example, please refer to FIG. 9, which is a schematic diagram showing a query window according to an exemplary embodiment. If the tablet computer C detects that the first display window is dragged to the second display window, release, the inquiry window pops up, and the inquiry window includes inquiry information. Exemplarily, the inquiry information is "do you want to establish a communication connection?" In addition, the inquiry window also includes a confirmation option and a cancellation option, and the confirmation option is used The tablet computer C is triggered to control the data communication between the mobile phone A and the mobile phone B, and the cancel option is used to trigger the tablet computer C to cancel the data communication between the mobile phone A and the mobile phone B. As shown in FIG. 9 , the confirmation option is “Yes” touch control, and the cancel option is “No” touch control. When the user agrees to display the display screen of mobile phone A on mobile phone B, the "Yes" touch control can be triggered. Communication, so that the display screen of mobile phone A is displayed on mobile phone B through the data communication; on the contrary, when the user does not agree to display the display screen of mobile phone A on mobile phone B, the "No" touch control can be triggered, and in response to the user's "No" trigger operation of the touch control, the tablet computer C cancels the control of the data communication between the mobile phone A and the mobile phone B, that is, does not display the display screen of the mobile phone A on the mobile phone B.
在另一个示例中,请参考图10,图10是根据另一示例性实施例示出的一种问询窗口的显示示意图。平板电脑C在第二显示窗口中叠加显示第一显示窗口,以及在第一显示窗口的原位置显示第一显示窗口的半透明状快照,另外,平板电脑C弹出该问询窗口。若用户同意将手机A的显示界面显示于手机B中,则可以触发“是”触摸控件,响应于用户对“是”触摸控件的触发操作,平板电脑C控制手机A与手机B之间进行数据通信,且平板电脑保持将第一显示窗口叠加显示至第二显示窗口中。若用户 不同意将手机A的显示界面显示于手机B中,则可以触发“否”触摸控件,响应于用户对“否”触摸控件的触发操作,平板电脑C不控制手机A与手机B进行数据通信。并且,平板电脑将第一显示窗口恢复至原位置显示,第二显示窗口中继续显示手机B的显示画面。In another example, please refer to FIG. 10 , which is a schematic display diagram of an inquiry window according to another exemplary embodiment. Tablet PC C superimposes and displays the first display window in the second display window, and displays a translucent snapshot of the first display window at the original position of the first display window. In addition, tablet C pops up the inquiry window. If the user agrees to display the display interface of mobile phone A on mobile phone B, the "yes" touch control can be triggered. communication, and the tablet computer keeps superimposing and displaying the first display window into the second display window. If the user does not agree to display the display interface of mobile phone A on mobile phone B, the "No" touch control can be triggered. communication. Moreover, the tablet computer restores the first display window to the original position for display, and the second display window continues to display the display screen of the mobile phone B.
作为示例而非限定,基于图10提供的技术方案,在第二显示窗口中叠加显示第一显示窗口后,在未建立通信之前,第一显示窗口中显示的可以是当前时刻手机A的显示画面的截屏画面,也即即使手机A的显示画面是动态的,则在未建立连接之前,在第一显示窗口中显示的内容可以是将第一显示窗口拖动至第二显示窗口时刻的截屏画面。As an example and not limitation, based on the technical solution provided in Figure 10, after the first display window is superimposed and displayed in the second display window, before the communication is established, the display screen of mobile phone A at the current moment may be displayed in the first display window , that is, even if the display screen of mobile phone A is dynamic, before the connection is established, the content displayed in the first display window can be the screen capture at the moment when the first display window is dragged to the second display window .
作为示例而非限定,基于图10提供的技术方案,在第二显示窗口中叠加显示第一显示窗口后,在未建立通信之前,叠加在第二显示窗口上的第一显示窗口中也可以是手机A当前的显示画面,譬如若手机A的显示画面是动态的,则在未建立连接之前,在第一显示窗口中显示的内容可以是随着手机A的显示画面的变化而实时变化的。As an example and not a limitation, based on the technical solution provided in Figure 10, after the first display window is superimposed on the second display window, before communication is established, the first display window superimposed on the second display window may also be The current display screen of mobile phone A, for example, if the display screen of mobile phone A is dynamic, the content displayed in the first display window may change in real time as the display screen of mobile phone A changes before the connection is established.
作为本申请的一个示例,假设平板电脑C上还显示有第三显示窗口,第三显示窗口中显示手机D的显示画面,则当检测到用户将第一显示窗口拖动至第二显示窗口中时,可以将第二显示窗口突出显示。示例性地,请参考图11,将第二显示窗口放大显示,以与第三显示窗口33进行区分,便于用户根据显示效果获知第一显示窗口当前是位于第二显示窗口中。As an example of the present application, assuming that a third display window is also displayed on the tablet computer C, and the display screen of the mobile phone D is displayed in the third display window, then when it is detected that the user drags the first display window to the second display window , the second display window can be highlighted. For example, referring to FIG. 11 , the second display window is enlarged and displayed to distinguish it from the third display window 33 , so that the user can know from the display effect that the first display window is currently located in the second display window.
基于图6或图7提供的技术方案,接下来对平板电脑C控制手机A和手机B断开数据通信连接的过程进行介绍。Based on the technical solution provided in FIG. 6 or FIG. 7 , the process of the tablet computer C controlling the mobile phone A and the mobile phone B to disconnect the data communication connection is introduced next.
在手机A将窗口显示数据发送至手机B中显示后,平板电脑C在第二显示窗口中叠加显示第一显示窗口。之后,若用户想要断开手机A与手机B之间的数据通信,则可以将第一显示窗口从第二显示窗口中拖动出来。示例性的,请参考图12,图12是根据一示例性实施例示出的一种屏幕显示区域的示意图,用户可以选中第一显示窗口,然后将第一显示窗口从第二显示窗口中拖动出来。示例性地,请参考图13,当检测到用户选中第一显示窗口时,平板电脑C可以在屏幕显示区域内显示操作引导信息,比如显示有箭头等指示符号,以通过操作引导信息指示用户如何操作。After the mobile phone A sends the window display data to the mobile phone B for display, the tablet computer C superimposes and displays the first display window in the second display window. Afterwards, if the user wants to disconnect the data communication between mobile phone A and mobile phone B, the first display window can be dragged out from the second display window. For example, please refer to FIG. 12 . FIG. 12 is a schematic diagram of a screen display area according to an exemplary embodiment. The user can select the first display window and then drag the first display window from the second display window come out. Exemplarily, please refer to FIG. 13 , when it is detected that the user selects the first display window, the tablet computer C may display operation guidance information in the screen display area, such as displaying indicators such as arrows, so as to indicate to the user how to use the operation guidance information. operate.
用户根据操作引导信息拖动第一显示窗口,比如,可以向第一显示窗口的原位置方向或其他位置拖动。响应于用户对第一显示窗口的拖动操作,平板电脑C控制手机A与手机B终止数据通信。在该种情况下,手机A不再向手机B发送窗口显示数据,相应的,手机B不再显示手机A的显示画面。作为一种示例,手机B显示主界面,作为另一种示例,手机B继续显示未接收手机A发送的窗口显示数据之前的显示画面。The user drags the first display window according to the operation guidance information, for example, may drag toward the original position of the first display window or other positions. In response to the user's dragging operation on the first display window, the tablet computer C controls the mobile phone A and the mobile phone B to terminate the data communication. In this case, the mobile phone A no longer sends the window display data to the mobile phone B, and correspondingly, the mobile phone B no longer displays the display screen of the mobile phone A. As an example, the mobile phone B displays the main interface, and as another example, the mobile phone B continues to display the display screen before receiving the window display data sent by the mobile phone A.
作为本申请的一个示例,当检测到用户将第一显示窗口从第二显示窗口中拖动出来后,在控制手机A与手机B终止数据通信之前,还可以显示断开提示窗口,断开提示窗口用于提示用户确认是否同意断开手机A与手机B之间的数据通信。作为一种示例,断开提示窗口中包括断开提示消息,另外,断开提示窗口中还包括确认选项和取消选项,确认选项用于触发平板电脑C控制手机A与手机B终止数据通信,取消选项用于触发平板电脑C取消控制手机A与手机B终止数据通信。As an example of this application, when it is detected that the user drags the first display window out of the second display window, before controlling mobile phone A and mobile phone B to terminate data communication, a disconnection prompt window may also be displayed, and the disconnection prompt The window is used to prompt the user to confirm whether to agree to disconnect the data communication between mobile phone A and mobile phone B. As an example, the disconnection prompt window includes a disconnection prompt message. In addition, the disconnection prompt window also includes a confirmation option and a cancellation option. The confirmation option is used to trigger the tablet computer C to control the mobile phone A and mobile phone B to terminate data communication, cancel The option is used to trigger the tablet computer C to cancel the control of the mobile phone A and the mobile phone B to terminate the data communication.
示例性地,请参考图14,图14是根据一示例性实施例示出的一种断开提示窗口的示意图,断开提示窗口中包括的断开提示信息为“是否断开通信连接?”,确认选项为“是”触摸控件,取消选项为“否”触摸控件。若用户确认不再将手机A的显示画面显示于手机B中,则触发“是”触摸控件,响应于用户对“是”触摸控件的触发操作,平板电脑C控制手机A与手机B断开通信。若用户想继续在手机B中显示手机A的显示画面,则可以触发“否”触摸控件,响应于用户对“否”触摸控件的触发操作,平板电脑C不断开手机A与手机B之间的数据通信。For example, please refer to FIG. 14 . FIG. 14 is a schematic diagram of a disconnection prompt window according to an exemplary embodiment. The disconnection prompt information included in the disconnection prompt window is "disconnect the communication connection?", The confirmation option is "Yes" touch control, and the cancel option is "No" touch control. If the user confirms that the display screen of mobile phone A is no longer displayed on mobile phone B, the "yes" touch control is triggered, and in response to the user's trigger operation on the "yes" touch control, the tablet computer C controls mobile phone A to disconnect from mobile phone B . If the user wants to continue to display the display screen of mobile phone A in mobile phone B, the "No" touch control can be triggered, and in response to the user's trigger operation on the "No" touch control, the tablet computer C will not disconnect the communication between mobile phone A and mobile phone B. data communication.
作为本申请的一个示例,平板电脑C控制手机A与手机B终止数据通信之后,可以将第一显示窗口恢复至原位置或用户拖动操作停止的位置显示,示例性地,请参考图15,图15是根据一示例性实施例示出的一种平板电脑的屏幕显示区域的示意图。As an example of this application, after the tablet computer C controls the mobile phone A and the mobile phone B to terminate the data communication, the first display window can be restored to the original position or the position where the user's dragging operation stopped. For example, please refer to FIG. 15 , Fig. 15 is a schematic diagram showing a screen display area of a tablet computer according to an exemplary embodiment.
需要说明的是,上述是以由用户通过在平板电脑C上将第一显示窗口从第二显示窗口中拖动出来终止手机A和手机B之间的数据通信为例进行说明,在另一实施例中,还可以由用户拖动第二显示窗口,以使得第二显示窗口与第一显示窗口分离,从而使得平板电脑C控制手机A与手机B终止数据通信。It should be noted that, the above is an example of the user dragging the first display window from the second display window on the tablet computer C to terminate the data communication between the mobile phone A and the mobile phone B. In another implementation In an example, the second display window may also be dragged by the user, so that the second display window is separated from the first display window, so that the tablet computer C controls the mobile phone A and the mobile phone B to terminate the data communication.
另外需要说明的是,上述是以通过在平板电脑C上触发来断开手机A与手机B之间的数据通信为例进行说明。在另一实施例中,还可以在手机A或者手机B上传触发,以断开两者之间的数据通信。示例性地,以在手机B上触发为例,手机B上可以提供有断开通信选项,当用户不想在手机B上继续显示手机A的显示画面时,可以触发断开通信选项。响应于用户对断开通信选项的触发操作,手机B不再显示手机A的显示画面。In addition, it should be noted that the above description is made by disconnecting the data communication between the mobile phone A and the mobile phone B by triggering on the tablet computer C as an example. In another embodiment, a trigger can also be uploaded on mobile phone A or mobile phone B to disconnect the data communication between the two. Exemplarily, taking triggering on mobile phone B as an example, mobile phone B may provide an option to disconnect communication, and when the user does not want to continue displaying the display screen of mobile phone A on mobile phone B, the option to disconnect communication may be triggered. In response to the user's trigger operation on the option of disconnecting the communication, the mobile phone B no longer displays the display screen of the mobile phone A.
需要说明的是,显示手机A,手机B显示窗口的除了平板电脑,还可以是其他大屏设备,如个人电脑PC,会议屏。It should be noted that, in addition to the tablet computer, the display windows of the mobile phone A and mobile phone B may also be other large-screen devices, such as a personal computer PC or a conference screen.
接下来对本申请实施例涉及的电子设备的内部结构进行介绍。作为示例而非限定,请参考图16,图16是根据一示例性实施例示出的一种电子设备的内部结构的示意图。该电子设备包括通信模块、控制模块、缓存模块、用户界面(User Interface,UI)模块。Next, the internal structure of the electronic device involved in the embodiment of the present application will be introduced. As an example but not a limitation, please refer to FIG. 16 , which is a schematic diagram showing an internal structure of an electronic device according to an exemplary embodiment. The electronic device includes a communication module, a control module, a cache module, and a user interface (User Interface, UI) module.
作为一种示例,控制模块用于在接收到其他电子设备发送的建立连接请求后,对建立连接请求进行解析,从建立连接请求中解析出用于建立通信连接的数据,如该数据可以为其他电子设备的设备信息,示例性地,设备信息可以包括但不限于设备地址信息、设备名称、设备ID等。之后将解析出的数据传输给通信模块。As an example, the control module is configured to analyze the connection establishment request after receiving the connection establishment request sent by other electronic devices, and parse out the data used to establish the communication connection from the connection establishment request, such as the data can be other The device information of the electronic device, for example, the device information may include but not limited to device address information, device name, device ID, and the like. Then transmit the analyzed data to the communication module.
通信模块用于控制电子设备与其他电子设备建立通信连接,譬如以上述应用场景为例,假设电子设备为平板电脑C,其他电子设备包括手机A和手机B,通信模块用于控制平板电脑C与手机A建立通信连接,以及控制平板电脑C与手机B建立通信连接。The communication module is used to control the electronic device to establish a communication connection with other electronic devices. For example, taking the above application scenario as an example, assuming that the electronic device is a tablet computer C, and other electronic devices include mobile phone A and mobile phone B, the communication module is used to control the tablet computer C and mobile phone B. The mobile phone A establishes a communication connection, and controls the tablet PC C to establish a communication connection with the mobile phone B.
缓存模块用于存储电子设备所接收的来自其他电子设备的窗口显示数据。The cache module is used for storing the window display data received by the electronic device from other electronic devices.
控制模块,还用于从缓存模块中获取窗口显示数据,之后,将窗口显示数据递交给UI模块。The control module is also used to acquire window display data from the cache module, and then submit the window display data to the UI module.
UI模块,用于生成显示窗口,并通过显示窗口对所获取的窗口显示数据进行显示, 譬如在电子设备的屏幕显示区域中显示其他电子设备的显示画面。在一个实施例中,当缓存模块中存储多个其他电子设备的窗口显示数据时,UI模块获取多个其他电子设备的窗口显示数据后,分别通过不同的显示窗口显示各个其他电子设备的窗口显示数据。The UI module is configured to generate a display window, and display the acquired window display data through the display window, such as displaying display images of other electronic devices in the screen display area of the electronic device. In one embodiment, when the cache module stores the window display data of multiple other electronic devices, after the UI module obtains the window display data of multiple other electronic devices, it displays the window display data of each other electronic device through different display windows. data.
作为本申请的一个示例,控制模块,还用于在检测到用户对UI模块显示的任意一个显示窗口的触发操作后,确定触发操作的结束位置,以根据结束位置确定需要控制哪两个设备之间进行数据通信。作为一个示例,控制模块在检测到第一显示窗口被移动至第二显示窗口中释放后,通知第一显示窗口对应的第一设备与第二显示窗口对应的第二设备建立通信连接,并通知第一设备通过该通信连接将窗口显示数据发送给第二设备,以将第一设备的显示画面显示于第二设备中。作为另一个示例,控制模块在检测到第一显示窗口被移动至第二显示窗口中释放后,将第一设备的窗口显示数据转发给第二设备,以使得第一设备的显示画面能够显示于第二设备中。As an example of the present application, the control module is further configured to determine the end position of the trigger operation after detecting the user's trigger operation on any display window displayed by the UI module, so as to determine which two devices need to be controlled according to the end position. data communication between them. As an example, after detecting that the first display window is moved to the second display window and released, the control module notifies the first device corresponding to the first display window to establish a communication connection with the second device corresponding to the second display window, and notifies The first device sends the window display data to the second device through the communication connection, so as to display the display screen of the first device on the second device. As another example, after detecting that the first display window is moved to the second display window and released, the control module forwards the window display data of the first device to the second device, so that the display screen of the first device can be displayed on in the second device.
作为本申请的一个示例,控制模块在控制第一设备与第二设备实现数据通信后,还可以通知UI模块,以由UI模块将第一显示窗口叠加显示于第二显示窗口中,便于用户根据电子设备的屏幕显示效果即可获知哪些设备之间建立数据通信,以及其他电子设备之间当前的显示状态。As an example of the present application, after the control module controls the first device to communicate with the second device, it can also notify the UI module, so that the UI module will superimpose and display the first display window on the second display window, so that the user can The screen display effect of the electronic device can know which devices have established data communication and the current display status between other electronic devices.
在一个实施例中,当检测到用户将第一显示窗口从第二显示窗口中移出时,UI模块控制第一显示窗口于原位置或移动停止的位置显示,并继续在第二显示窗口中显示初始的显示画面。另外,UI模块在检测到用户将第一显示窗口从第二显示窗口中移动出来的触发操作时,通知控制模块。In one embodiment, when it is detected that the user moves the first display window out of the second display window, the UI module controls the first display window to be displayed at the original position or the position where the movement stops, and continues to display in the second display window The initial display screen. In addition, the UI module notifies the control module when detecting a trigger operation of moving the first display window from the second display window by the user.
控制模块接收到UI模块的通知后,控制正在进行数据通信的两个设备之间断开通信,譬如,通知第一设备与第二设备之间断开通信连接,此时第一设备和第二设备断开连接,如此第一设备不再向第二设备发送窗口显示数据。或者,电子设备停止将第一设备的窗口显示数据转发给第二设备。不难理解,之后第二设备不再显示第一设备的窗口显示数据。After the control module receives the notification from the UI module, it controls the disconnection between the two devices that are in data communication, for example, notifies the disconnection of the communication connection between the first device and the second device, and at this time the first device and the second device disconnect The connection is opened, so that the first device no longer sends window display data to the second device. Or, the electronic device stops forwarding the window display data of the first device to the second device. It is not difficult to understand that after that, the second device no longer displays the window display data of the first device.
在一个实施例中,若电子设备是通过转发第一设备的窗口显示数据控制第一设备与第二设备进行数据通信,则在一种可能的实现方式中,断开连接的触发是由其他电子设备端触发的,譬如用户在第一设备或第二设备上触发。在该种情况下,控制模块接收来自其他电子设备的断开连接请求,不难理解,断开连接请求可以是第一设备发送的,或者,也可以是第二设备发送的。之后,控制模块不再将第一设备的窗口显示数据转发给第二设备,从而断开第一设备与第二设备之间的数据通信。In one embodiment, if the electronic device controls the data communication between the first device and the second device by forwarding the window display data of the first device, in a possible implementation, the disconnection is triggered by other electronic devices Triggered on the device side, for example, the user triggers on the first device or the second device. In this case, the control module receives disconnection requests from other electronic devices. It is not difficult to understand that the disconnection requests may be sent by the first device, or may also be sent by the second device. Afterwards, the control module no longer forwards the window display data of the first device to the second device, thereby disconnecting the data communication between the first device and the second device.
接下来结合附图对本申请实施例提供的设备之间的数据通信的方法流程进行详细介绍。Next, the flow of the method for data communication between devices provided by the embodiment of the present application will be described in detail with reference to the accompanying drawings.
请参考图17,图17是根据一示例性实施例示出的一种设备之间的数据通信的方法流程示意图,该方法可以应用于目标设备中,目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,第一显示窗口和第二显示窗口中分别显示有不同设备的窗口显示数据。目标设备可以为上述电子设备。该方法可以包括如下部分或者全部内容:Please refer to FIG. 17. FIG. 17 is a schematic flowchart of a method for data communication between devices according to an exemplary embodiment. The method can be applied to a target device, and the screen display area of the target device includes at least the first display The window and the second display window, the first display window and the second display window respectively display window display data of different devices. The target device may be the above-mentioned electronic device. This method may include some or all of the following:
步骤1701:检测第一操作,确定第一显示窗口对应的第一设备的第一设备信息和第二显示窗口对应的第二设备的第二设备信息,第一操作包括将第一显示窗口移动至第二显示窗口内或者从第一显示窗口开始至第二显示窗口结束的划线操作。Step 1701: Detect the first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first operation includes moving the first display window to A scribing operation in the second display window or from the beginning of the first display window to the end of the second display window.
第一设备信息和第二设备信息均是能够用于数据通信的设备信息。作为一个示例,第一设备信息可以包括但不限于第一设备的设备ID、设备名称、设备地址信息中的一项或者多项。第二设备信息可以包括但不限于第二设备的设备ID、设备名称、设备地址信息中的一项或者多项。示例性地,设备地址信息可以为互联网协议地址(internet protocol address,IP)、媒体访问控制(media access control,MAC)地址信息。Both the first device information and the second device information are device information that can be used for data communication. As an example, the first device information may include but not limited to one or more items of device ID, device name, and device address information of the first device. The second device information may include, but not limited to, one or more items of the second device's device ID, device name, and device address information. Exemplarily, the device address information may be internet protocol address (internet protocol address, IP) or media access control (media access control, MAC) address information.
第一显示窗口和第二显示窗口均是可以操作的窗口,譬如,第一显示窗口和第二显示窗口均是悬浮窗等。Both the first display window and the second display window are operable windows, for example, both the first display window and the second display window are floating windows.
作为本申请的一个示例,在第一设备与第二设备分别与目标设备建立通信连接的情况下,第一设备投屏至目标设备中,以及第二设备投屏至目标设备中。如此,目标设备通过第一显示窗口显示第一设备的窗口显示数据,以及通过第二显示窗口显示第二设备的窗口显示数据。也即,用户在目标设备上可以同时查看第一设备的窗口显示数据以及查看第二设备的窗口显示数据。As an example of the present application, when the first device and the second device respectively establish a communication connection with the target device, the screen of the first device is projected to the target device, and the screen of the second device is projected to the target device. In this way, the target device displays the window display data of the first device through the first display window, and displays the window display data of the second device through the second display window. That is, the user can simultaneously view the window display data of the first device and view the window display data of the second device on the target device.
在一个实施例中,第一显示窗口的第一显示位置(也即第一显示窗口的原位置)和第二显示窗口的第二显示位置可以是预置的,譬如,第一显示位置位于屏幕显示区域的第一指定区域,第二显示位置位于屏幕显示区域的第二指定区域,第一指定区域和第二指定区域可以根据实际需求进行设置,第一指定区域和第二指定区域之间不存在重叠区域。在另一个实施例中,第一显示窗口的第一显示位置和第二显示窗口的第二显示位置也可以是随机设置的。In one embodiment, the first display position of the first display window (that is, the original position of the first display window) and the second display position of the second display window may be preset, for example, the first display position is located on the screen The first designated area of the display area, the second display position is located in the second designated area of the screen display area, the first designated area and the second designated area can be set according to actual needs, there is no gap between the first designated area and the second designated area There are overlapping areas. In another embodiment, the first display position of the first display window and the second display position of the second display window may also be set randomly.
需要说明的是,本申请实施例中所述的投屏方式可以为推送投屏,也可以是镜像投屏。以第一设备为例,第一设备推送投屏是指第一设备以流媒体的方式推送资源,在该种投屏方式下,第一设备完成投屏后,用户可以在第一设备上继续执行其他操作。第一设备镜像投屏是指第一设备开启镜像,之后第一设备不断地录屏,且一边录屏一边将录屏数据发送给目标设备。It should be noted that the screen projection method described in the embodiments of the present application may be push projection or mirror projection. Taking the first device as an example, the first device push screen projection means that the first device pushes resources in the form of streaming media. In this screen projection mode, after the first device completes screen projection, the user can continue on the first device. perform other operations. Mirroring the screen of the first device means that the first device starts mirroring, and then the first device continuously records the screen, and sends the screen recording data to the target device while recording the screen.
另外需要说明的是,上述是以投屏为例进行说明,在另一实施例中,第一设备和第二设备还可以通过其他方式将窗口显示数据分别显示于目标设备的屏幕显示区域内,譬如以第一设备为例,第一设备可以将一些字段、参数或内容发送给目标设备,以使得目标设备基于这些字段、参数或内容显示第一设备的窗口显示数据,本申请实施例对此不作限定。In addition, it should be noted that the above description is based on screen projection as an example. In another embodiment, the first device and the second device can also display window display data in the screen display area of the target device in other ways. For example, taking the first device as an example, the first device may send some fields, parameters or content to the target device, so that the target device displays the window display data of the first device based on these fields, parameters or content. Not limited.
作为本申请的一个示例,检测第一操作的具体实现包括:检测到第一显示窗口被移动至第二显示窗口的显示区域内后释放,第一显示窗口与第二显示窗口的重叠面积大于面积阈值。As an example of the present application, the specific implementation of detecting the first operation includes: detecting that the first display window is moved into the display area of the second display window and then released, and the overlapping area of the first display window and the second display window is greater than the area threshold.
其中,面积阈值可以根据实际需求进行设置,本申请实施例对此不作限定。Wherein, the area threshold may be set according to actual requirements, which is not limited in this embodiment of the present application.
作为示例而非限定,将第一显示窗口移动至第二显示窗口内可以包括将第一显示窗口拖动至第二显示窗口内。也即在此过程中,第一显示窗口随着手指的移动而移动。目标设备在显示第一显示窗口和第二显示窗口的过程中,如果检测到第一显示窗口被拖动,则检测第一显示窗口的拖动终点,如果拖动终点位于第二显示窗口的显示区域 内,则确定第一显示窗口与第二显示窗口的重叠面积。若该重叠面积大于面积阈值,说明第一显示窗口与第二显示窗口大面积重叠,譬如第一显示窗口与第二显示窗口几乎完全重合,此时可以确定第一显示窗口被拖动至第二显示窗口内后释放。As an example and not a limitation, moving the first display window into the second display window may include dragging the first display window into the second display window. That is, during this process, the first display window moves along with the movement of the finger. In the process of displaying the first display window and the second display window, if the target device detects that the first display window is being dragged, it detects the dragging end point of the first display window, and if the dragging end point is located at the display of the second display window In the region, the overlapping area of the first display window and the second display window is determined. If the overlapping area is greater than the area threshold, it means that the first display window and the second display window overlap in a large area, for example, the first display window and the second display window are almost completely overlapped, and it can be determined that the first display window is dragged to the second display window. Released after displaying the window.
可选地,上述对第一显示窗口的拖动操作可以通过手指触发。也即用户可以点击显示屏中的第一显示窗口,如图4所示,目标设备可以显示移动方向指引效果图,譬如包括箭头和手指示意图片。之后,用户的手指在显示屏中滑动,显示窗口跟随手指移动,在滑动至第二显示窗口内后释放,以将第一显示窗口拖动至第二显示窗口内。Optionally, the above-mentioned dragging operation on the first display window may be triggered by a finger. That is, the user can click on the first display window in the display screen, as shown in FIG. 4 , and the target device can display a moving direction guide rendering, for example, including arrows and schematic pictures of fingers. Afterwards, the user's finger slides in the display screen, and the display window moves with the finger, and releases after sliding into the second display window, so as to drag the first display window into the second display window.
可选地,上述对第一显示窗口的拖动操作也可以通过手势触发。示例性地,如图18所示,用户可以将手停放在与第一显示窗口平行的位置,并停留预设时长。若目标设备通过诸如摄像头之类的感应装置检测到用户的该手势,确定用户选中第一显示窗口。之后,目标设备可以通过突出显示第一显示窗口等方式提示用户已选中第一显示窗口。用户得到目标设备的提示后,可以将选中第一显示窗口的手向第二显示窗口的方向划动,当手在与第二显示窗口平行的位置时,再次停留预设时长。相应的,目标设备通过感应装置检测到用户的这一手势后,确定用户是在将第一显示窗口拖动至第二显示窗口内。其中,预设时长可以根据实际需求进行设置。Optionally, the above-mentioned dragging operation on the first display window may also be triggered by a gesture. Exemplarily, as shown in FIG. 18 , the user can park his hand at a position parallel to the first display window, and stay there for a preset time. If the target device detects the user's gesture through a sensing device such as a camera, it is determined that the user selects the first display window. Afterwards, the target device may prompt the user that the first display window has been selected by highlighting the first display window or the like. After being prompted by the target device, the user can slide the hand that selected the first display window to the direction of the second display window, and when the hand is in a position parallel to the second display window, stay for a preset time again. Correspondingly, after the target device detects the user's gesture through the sensing device, it determines that the user is dragging the first display window into the second display window. Wherein, the preset duration can be set according to actual needs.
作为本申请的另一个示例,检测第一操作的具体实现包括:检测以第一显示窗口为划线起点的划线操作,划线终点位于第二显示窗口的显示区域内,且划线起点与划线终点之间的直线距离处于预设距离范围内。As another example of the present application, the specific implementation of detecting the first operation includes: detecting the scribing operation with the first display window as the starting point of the scribing, the scribing end point is located in the display area of the second display window, and the scribing starting point is the same as the The straight-line distance between the end points of the line is within the preset distance range.
其中,预设距离范围可以根据实际需求进行设置,本申请实施例对此不作限定。Wherein, the preset distance range may be set according to actual requirements, which is not limited in this embodiment of the present application.
作为示例而非限定,划线操作可以通过手指触发。譬如,手指从第一显示窗口开始滑动,且手指的落点位于第二显示窗口内,在该操作过程中第一显示窗口处于静止不动的状态。划线时,显示窗口不跟随手指移动。可选地,手指的划线轨迹可以为直线或者曲线。譬如如图4所示,手指从第一显示窗口开始按照箭头方向进行划线操作。对于目标设备来说,在检测到手指的划线操作后,若检测到手指的落点位于第二显示窗口内并释放,确定划线起点与划线终点之间的直线距离,若该距离处于预设距离范围内,则确定检测到从第一显示窗口开始至第二显示窗口结束的划线操作。As an example but not a limitation, the scribing operation can be triggered by a finger. For example, the finger starts to slide from the first display window, and the landing point of the finger is located in the second display window, and the first display window is in a static state during the operation. When drawing a line, the display window does not follow the finger movement. Optionally, the scribing track of the finger may be a straight line or a curve. For example, as shown in FIG. 4 , the finger starts to draw a line in the direction of the arrow from the first display window. For the target device, after detecting the scribing operation of the finger, if it is detected that the landing point of the finger is located in the second display window and released, determine the straight-line distance between the starting point of the scribing line and the end point of the scribing line, if the distance is within If it is within the preset distance range, it is determined that a scribing operation from the beginning of the first display window to the end of the second display window is detected.
作为示例而非限定,划线操作还可以通过手势触发。目标设备可以通过感知装置检测用户的手势,譬如当检测到用户将手停放在与第一显示窗口平行的位置,并停留预设时长,确定划线起点,划线起点可以是显示屏中与手当前停放位置所在平面平行的第一区域内的某个位置。目标设备可以通过突出显示第一显示窗口等方式提示用户已确定划线起点。用户得到目标设备的提示后,可以将选中第一显示窗口的手向第二显示窗口的方向划动,当手在与第二显示窗口平行的位置时,再次停留预设时长。相应的,目标设备通过感应装置检测到用户的这一手势后,确定划线终点,划线终点可以是显示屏中与手当前停放位置所在平面平行的第二区域内的某个位置。之后确定划线起点与划线终点之间的距离,当该距离处于预设距离范围内,则确定检测到从第一显示窗口开始至第二显示窗口结束的划线操作。As an example but not a limitation, the scribing operation can also be triggered by a gesture. The target device can detect the user's gesture through the sensing device. For example, when it detects that the user has parked the hand at a position parallel to the first display window and stays there for a preset period of time, determine the starting point of the line. A position within the first area parallel to the plane where the current parking position is located. The target device may prompt the user that the starting point of the line has been determined by highlighting the first display window or other manners. After being prompted by the target device, the user can slide the hand that selected the first display window to the direction of the second display window, and when the hand is in a position parallel to the second display window, stay for a preset time again. Correspondingly, after the target device detects the user's gesture through the sensing device, it determines the end point of the line. The end point of the line may be a position in the second area of the display screen parallel to the plane where the hand is currently resting. Afterwards, the distance between the starting point of the scribing line and the end point of the scribing line is determined, and when the distance is within a preset distance range, it is determined that a scribing operation from the beginning of the first display window to the end of the second display window is detected.
需要说明的是,上述检测第一操作的具体实现仅是示例性地,在另一个实施例中,检测第一操作的具体实现还可以包括:检测以第一显示窗口为划线起点的划线操作,划线终点位于第二显示窗口的显示区域内。It should be noted that the specific realization of the above detection of the first operation is only exemplary. In another embodiment, the specific realization of detection of the first operation may also include: detection of the first display window as the starting point of the dashed line Operation, the end point of the line is located in the display area of the second display window.
若目标设备检测第一操作,则确定第一显示窗口对应的第一设备的第一设备信息,以及确定第二显示窗口对应的第二设备的第二设备信息。如此,一方面便于确定是哪个设备的窗口显示数据要显示于哪个设备上,另一方面便于后续控制第一设备与第二设备之间进行数据通信。If the target device detects the first operation, determine the first device information of the first device corresponding to the first display window, and determine the second device information of the second device corresponding to the second display window. In this way, on the one hand, it is convenient to determine which device's window display data is to be displayed on which device, and on the other hand, it is convenient to subsequently control the data communication between the first device and the second device.
可选地,目标设备检测第一操作,获取第一显示窗口的快照,得到第一快照。对第一快照进行透明化处理,得到第二快照。在第一显示窗口的原位置处显示第二快照,原位置是指未执行第一操作前第一显示窗口的显示位置。Optionally, the target device detects the first operation, acquires a snapshot of the first display window, and obtains the first snapshot. Transparency processing is performed on the first snapshot to obtain the second snapshot. The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
作为一种示例,对第一快照进行透明化处理时,可以按照透明度阈值进行透明化处理,透明度阈值可以根据实际需求进行设置。譬如,将第一快照半透明化处理等。As an example, when performing transparent processing on the first snapshot, the transparent processing may be performed according to a transparency threshold, and the transparency threshold may be set according to actual requirements. For example, the first snapshot is translucently processed.
也即,当目标设备检测到第一操作时,在第一操作未结束之前,可以在第一显示窗口的原位置显示第一显示窗口的快照,以标识第一显示窗口原始的显示位置。That is, when the target device detects the first operation, before the first operation ends, a snapshot of the first display window may be displayed at the original position of the first display window to identify the original display position of the first display window.
可选地,在目标设备在第一显示窗口的原位置显示第二快照的情况下,若目标设备检测到第一显示窗口未被拖动至第二显示窗口内后释放,则以弹回的方式,将第一显示窗口重新显示于原位置处,并且目标设备删除第二快照。Optionally, when the target device displays the second snapshot at the original position of the first display window, if the target device detects that the first display window is not dragged into the second display window and then releases it, the In this way, the first display window is redisplayed at the original position, and the target device deletes the second snapshot.
可选地,目标设备的屏幕显示区域内除了包括第一显示窗口和第二显示窗口之外,还可能包括第三显示窗口,第三显示窗口用于显示第三设备的窗口显示数据。在一个实施例中,第二显示窗口与第三显示窗口可能靠的比较近。目标设备检测到第一操作后,当第一显示窗口位于第二显示窗口内或者检测到划线操作的结束位置位于第二显示窗口内时,为了与第三显示窗口进行区分,目标设备还可以对第二显示窗口进行突出显示,譬如放大第二显示窗口等,以表示第一显示窗口当前是被移动至第二显示窗口或者划线操作的结束位置是位于第二显示窗口内,从而便于用户确定是否释放第一显示窗口。Optionally, in addition to the first display window and the second display window, the target device's screen display area may also include a third display window, and the third display window is used to display window display data of the third device. In an embodiment, the second display window may be relatively close to the third display window. After the target device detects the first operation, when the first display window is located in the second display window or detects that the end position of the scribing operation is located in the second display window, in order to distinguish it from the third display window, the target device can also Highlight the second display window, such as enlarging the second display window, etc., to indicate that the first display window is currently being moved to the second display window or the end position of the scribing operation is located in the second display window, so as to facilitate the user Determine whether to release the first display window.
当然,上述是以目标设备的屏幕显示区域内还包括第三显示窗口为例进行说明,在另一实施例中,目标设备的屏幕显示区域内还可能包括更多的显示窗口,本申请实施例对此不作限定。Of course, the above is an example of a third display window included in the screen display area of the target device. In another embodiment, more display windows may be included in the screen display area of the target device. The embodiment of the present application There is no limit to this.
作为示例而非限定,第一显示窗口在被移动的过程中,第一显示窗口的形状、大小等属性不变。As an example but not a limitation, during the process of the first display window being moved, attributes such as shape and size of the first display window remain unchanged.
以第一操作是移动操作为例。作为本申请的一个示例,第一设备将第一设备的显示画面显示于目标设备中,也即第一显示窗口中显示的内容与第一设备当前显示的内容相同。该种情况下,第一设备的显示画面可能是动态变化的,譬如正在播放PPT。作为一个示例,第一显示窗口在被移动的过程中,目标设备可以继续根据第一设备发送的窗口显示数据对第一显示窗口中的显示画面进行实时更新,也即第一显示窗口中的显示画面随着第一设备中的显示画面的变化而变化。作为另一种示例,在检测到对第一显示窗口的移动操作时,目标设备还可以获取第一设备的显示画面的截屏画面,之后,第一显示窗口在被移动的过程中,在第一显示窗口中显示截屏画面,也即第一显示窗口中的显示画面也可以是在被移动的时刻的截屏画面,而不是实时更新的。Take for example that the first operation is a move operation. As an example of the present application, the first device displays the display screen of the first device on the target device, that is, the content displayed in the first display window is the same as the content currently displayed by the first device. In this case, the display screen of the first device may change dynamically, for example, a PPT is being played. As an example, when the first display window is being moved, the target device may continue to update the display screen in the first display window in real time according to the window display data sent by the first device, that is, the display in the first display window The screen changes as the display screen in the first device changes. As another example, when a moving operation on the first display window is detected, the target device may also obtain a screenshot of the display screen of the first device, and then, during the first display window being moved, the first The screen shot is displayed in the display window, that is, the display screen in the first display window may also be a screen shot at the moment of being moved, instead of being updated in real time.
步骤1702:基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信,以通过数据通信使得第一设备的窗口显示数据显示于第二设备上。Step 1702: Based on the first device information and the second device information, control data communication between the first device and the second device, so that the window display data of the first device is displayed on the second device through data communication.
在一个实施例中,可以基于第一设备信息和第二设备信息,控制第一设备与第二 设备之间建立直接或间接的通信连接,以通过该通信连接进行数据通信,从而控制第一设备将第一设备的窗口显示数据发送第二设备中显示,进而使得第一设备的窗口显示数据显示于第二设备上。In one embodiment, based on the information of the first device and the information of the second device, the establishment of a direct or indirect communication connection between the first device and the second device may be controlled, so as to perform data communication through the communication connection, thereby controlling the first device The window display data of the first device is sent to the second device for display, so that the window display data of the first device is displayed on the second device.
在另一个实施例中,也可以由目标设备基于第一设备信息和第二设备信息,将第一设备的窗口显示数据实时转发给第二设备,使得第一设备的窗口显示数据显示于第二设备中。也即,目标设备可以作为第一设备与第二设备的中间转发设备,从而控制第一设备与第二设备进行数据通信。In another embodiment, the target device may also forward the window display data of the first device to the second device in real time based on the information of the first device and the information of the second device, so that the window display data of the first device is displayed on the second device. in the device. That is, the target device may serve as an intermediate forwarding device between the first device and the second device, thereby controlling the first device to perform data communication with the second device.
作为本申请的一个示例,在基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信之前,目标设备还可以显示问询窗口,问询窗口包括问询信息,问询信息用于指示基于问询窗口确认是否将第一设备的窗口显示数据显示于第二设备中。在该种情况下,基于问询窗口接收确认指令,执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。As an example of the present application, before controlling the data communication between the first device and the second device based on the information of the first device and the information of the second device, the target device may also display an inquiry window, the inquiry window includes the inquiry information , the query information is used to indicate whether to display the window display data of the first device on the second device based on the query window confirmation. In this case, an operation of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device is performed based on the confirmation instruction received in the inquiry window.
也即,若目标设备检测到第一操作,则说明用户可能希望将第一设备的窗口显示数据显示于第二设备中,为了使得用户再次确认,目标设备可以显示问询窗口,并在问询窗口中显示问询信息,譬如请参考图9,问询信息可以为“是否建立通信连接?”。当接收到确认指令时,说明用户确认建立通信,此时,目标设备再基于第一设备信息和第二设备信息,控制第一设备与第二设备进行数据通信。当然,若目标设备基于问询窗口接收到取消指令,则取消执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。如此,通过问询窗口请求用户确认是否同意控制第一设备与第二设备进行数据通信,保证在用户同意的情况下将第一设备的窗口显示数据显示于第二设备中,提高了用户体验。That is, if the target device detects the first operation, it means that the user may wish to display the window display data of the first device on the second device. In order to make the user confirm again, the target device can display the inquiry window and Inquiry information is displayed in the window. For example, referring to FIG. 9 , the inquiry information may be "do you want to establish a communication connection?". When the confirmation instruction is received, it means that the user confirms the establishment of communication. At this time, the target device controls the first device to perform data communication with the second device based on the information of the first device and the information of the second device. Of course, if the target device receives the cancel instruction based on the query window, the execution of the operation of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device is cancelled. In this way, the query window is used to request the user to confirm whether to agree to control the data communication between the first device and the second device, so as to ensure that the window display data of the first device is displayed in the second device when the user agrees, thereby improving user experience.
上述是以在目标设备中显示问询窗口为例进行说明。作为本申请的另一个示例,在基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信之前,目标设备还可以向第一设备发送问询信息。第一设备接收问询信息后,可以显示问询窗口,问询窗口中包括问询信息。也即还可以由第一设备显示问询窗口,以便于由第一设备的使用者确认是否将第一设备的窗口显示数据显示于第二设备中。当第一设备基于问询窗口接收到确认指令时,向目标设备发送确认控制指示。目标设备接收确认控制指示后,执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。当然,若第一设备基于问询窗口接收到取消指令,则向目标设备发送取消控制指示,使得目标设备取消执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。The above is described by taking the inquiry window displayed on the target device as an example. As another example of the present application, before controlling data communication between the first device and the second device based on the first device information and the second device information, the target device may also send inquiry information to the first device. After receiving the inquiry information, the first device may display an inquiry window, and the inquiry window includes the inquiry information. That is, the inquiry window may also be displayed by the first device, so that the user of the first device can confirm whether to display the window display data of the first device in the second device. When the first device receives the confirmation instruction based on the query window, it sends a confirmation control instruction to the target device. After receiving the acknowledgment control instruction, the target device performs an operation of controlling data communication between the first device and the second device based on the first device information and the second device information. Certainly, if the first device receives the cancel instruction based on the query window, it will send a cancel control instruction to the target device, so that the target device cancels the control between the first device and the second device based on the information of the first device and the information of the second device. Perform data communication operations.
如此,通过在第一设备上显示问询窗口,以请求第一设备的使用者确认是否同意控制第一设备与第二设备进行数据通信,保证在第一设备的使用者同意的情况下将第一设备的窗口显示数据显示于第二设备中,提高了用户体验。In this way, by displaying an inquiry window on the first device to request the user of the first device to confirm whether he agrees to control the data communication between the first device and the second device, it is ensured that the second device will be transferred under the condition of the user's consent. The window display data of one device is displayed in the second device, which improves user experience.
作为本申请的又一个示例,在基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信之前,目标设备还可以向第二设备发送问询信息。第二设备接收问询信息后,可以显示问询窗口,问询窗口中包括问询信息。也即还可以由第二设备显示问询窗口,以便于由第二设备的使用者确认是否同意在第二设备中显示第一设备的窗口显示数据。当第二设备基于问询窗口接收到确认指令时,向目标设备 发送确认控制指示。目标设备接收确认控制指示后,执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。当然,若第二设备基于问询窗口接收到取消指令,则向目标设备发送取消控制指示,使得目标设备取消执行基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的操作。As yet another example of the present application, before controlling data communication between the first device and the second device based on the first device information and the second device information, the target device may also send inquiry information to the second device. After receiving the inquiry information, the second device may display an inquiry window, and the inquiry window includes the inquiry information. That is, the second device may also display an inquiry window, so that the user of the second device can confirm whether to agree to display the window display data of the first device in the second device. When the second device receives the confirmation instruction based on the query window, it sends a confirmation control instruction to the target device. After receiving the acknowledgment control instruction, the target device performs an operation of controlling data communication between the first device and the second device based on the first device information and the second device information. Of course, if the second device receives the cancel instruction based on the query window, it will send a cancel control instruction to the target device, so that the target device cancels the control between the first device and the second device based on the information of the first device and the information of the second device. Perform data communication operations.
如此,通过在第二设备上显示问询窗口,以请求第二设备的使用者确认是否同意控制第一设备与第二设备进行数据通信,保证在第二设备的使用者同意的情况下将第一设备的窗口显示数据显示于第二设备中,提高了用户体验。In this way, by displaying an inquiry window on the second device to request the user of the second device to confirm whether to agree to control the data communication between the first device and the second device, it is ensured that the second device will be transferred under the condition that the user of the second device agrees. The window display data of one device is displayed in the second device, which improves user experience.
在本申请实施例中,目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,第一显示窗口和第二显示窗口中分别显示有不同设备的窗口显示数据。若检测到第一操作,则可以确认用户想将第一显示窗口中的第一设备的窗口显示数据显示于第二显示窗口对应的第二设备中。为此,确定第一显示窗口对应的第一设备信息以及第二显示窗口对应的第二设备信息,基于第一设备信息和第二设备信息,控制第一设备和第二设备进行数据通信,以通过该数据通信使得第一设备的窗口显示数据能够显示于第二设备中。如此,在第一设备和第二设备均连接于目标设备的情况下,用户可以通过在目标设备上进行第一操作,使得目标设备控制第一设备与第二设备进行数据通信,以将第一设备的窗口显示数据显示于第二设备中,提高了操作的便捷性。In this embodiment of the present application, the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices. If the first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, determine the first device information corresponding to the first display window and the second device information corresponding to the second display window, and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device. In this way, when both the first device and the second device are connected to the target device, the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
另外,用户可以通过拖动的方式使得第一设备与第二设备进行数据通信,还可以通过划线操作使得第一设备与第二设备进行数据通信,增加了用户操作方式,提升了用户体验效果。In addition, the user can enable the first device to perform data communication with the second device by dragging, and can also enable the first device to perform data communication with the second device by drawing lines, which increases user operation methods and improves user experience. .
接下来以第一设备、第二设备以及目标设备之间的交互为例,对本申请实施例提供的设备之间的数据通信方法流程进行介绍。请参考图19,图19是根据一示例性实施例示出的一种设备之间的数据通信方法的流程示意图。该方法可以包括如下内容:Next, taking the interaction between the first device, the second device, and the target device as an example, the flow of the data communication method between devices provided in the embodiment of the present application will be introduced. Please refer to FIG. 19 , which is a schematic flowchart of a data communication method between devices according to an exemplary embodiment. The method can include the following:
步骤1901:第一设备将第一设备的显示画面投屏至目标设备。Step 1901: The first device projects the display screen of the first device to the target device.
第一设备基于与目标设备建立的通信连接将第一设备的显示画面投屏至目标设备,也即在将第一设备的显示画面投屏至目标设备之前,第一设备与目标设备之间是建立有通信连接的。譬如请参考图20中2001,第一设备可以将第一设备信息发送给目标设备,以请求与目标设备之间建立通信连接。相应的,目标设备确定与第一设备建立通信连接后,将目标设备的设备信息发送给第一设备,以与第一设备建立起通信连接。The first device projects the display screen of the first device to the target device based on the communication connection established with the target device, that is, before projecting the display screen of the first device to the target device, there is a Establish a communication connection. For example, referring to 2001 in FIG. 20 , the first device may send first device information to the target device, so as to request to establish a communication connection with the target device. Correspondingly, after the target device determines to establish a communication connection with the first device, it sends the device information of the target device to the first device, so as to establish a communication connection with the first device.
在实施中,第一设备向目标设备投屏,将第一设备的窗口显示数据发送给目标设备,如图20所示。目标设备接收第一设备的窗口显示数据后,通过第一显示窗口对第一设备的窗口显示数据进行显示。In implementation, the first device projects a screen to the target device, and sends the window display data of the first device to the target device, as shown in FIG. 20 . After receiving the window display data of the first device, the target device displays the window display data of the first device through the first display window.
步骤1902:第二设备将第二设备的显示画面投屏至目标设备。Step 1902: the second device projects the display screen of the second device to the target device.
同理,第二设备基于与目标设备建立的通信连接将第二设备的显示画面投屏至目标设备,也即在将第二设备的显示画面投屏至目标设备之前,第二设备与目标设备之间是建立有通信连接的。譬如,如图20中2002所示,第二设备将第二设备信息发送给目标设备,以请求与目标设备之间建立通信连接。相应的,目标设备确定与第二设备建立通信连接后,将目标设备的设备信息发送给第二设备,以与第二设备建立起通 信连接。Similarly, the second device projects the display screen of the second device to the target device based on the communication connection established with the target device, that is, before projecting the display screen of the second device to the target device, the second device and the target device A communication connection is established between them. For example, as shown at 2002 in FIG. 20, the second device sends second device information to the target device, so as to request to establish a communication connection with the target device. Correspondingly, after the target device determines to establish a communication connection with the second device, it sends the device information of the target device to the second device, so as to establish a communication connection with the second device.
在实施中,第二设备向目标设备投屏,将第二设备的窗口显示数据发送给目标设备,如图20中的2003所示。目标设备接收第二设备的窗口显示数据后,通过第二显示窗口对第二设备的窗口显示数据进行显示。In implementation, the second device projects the screen to the target device, and sends the window display data of the second device to the target device, as shown in 2003 in FIG. 20 . After receiving the window display data of the second device, the target device displays the window display data of the second device through the second display window.
需要说明的是,上述是以投屏为例进行说明,在另一实施例中,第一设备和第二设备还可以通过其他方式将自身的窗口显示数据分别显示在目标设备上。也即在本申请实施例中,目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,第一显示窗口和第二显示窗口中分别显示有不同设备的窗口显示数据。It should be noted that the above description is based on screen projection as an example. In another embodiment, the first device and the second device may also display their own window display data on the target device in other ways. That is, in the embodiment of the present application, the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices.
需要说明的是,这里以第一设备和第二设备分别与目标设备建立通信连接为例进行说明,在一个实施例中,还可以有更多设备与目标设备建立通信连接,如图20所示,存在n个设备与目标设备建立通信连接,该种情况下,目标设备的屏幕显示区域内可以显示有n个显示窗口,其中,n为大于或等于3的整数。It should be noted that, here, the first device and the second device establish communication connections with the target device as an example. In one embodiment, more devices may establish communication connections with the target device, as shown in FIG. 20 , there are n devices establishing a communication connection with the target device. In this case, there may be n display windows displayed in the screen display area of the target device, where n is an integer greater than or equal to 3.
需要说明的是,步骤1901与步骤1902之间没有先后执行顺序,步骤1901可以在步骤1902之前执行,也可以在步骤1902之后执行,或者,也可以与步骤1902并行执行。It should be noted that there is no sequential execution order between step 1901 and step 1902, step 1901 may be executed before step 1902, may also be executed after step 1902, or may be executed in parallel with step 1902.
基于步骤1901和步骤1902提供的场景,接下来对设备之间的数据通信流程进行介绍。Based on the scenarios provided in step 1901 and step 1902, the flow of data communication between devices will be introduced next.
步骤1903:目标设备检测第一操作,确定第一显示窗口对应的第一设备的第一设备信息和第二显示窗口对应的第二设备的第二设备信息。Step 1903: The target device detects the first operation, and determines the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window.
其具体实现可以参见上述图17所示实施例中的步骤1701,这里不再详细介绍。For its specific implementation, reference may be made to step 1701 in the above embodiment shown in FIG. 17 , which will not be described in detail here.
步骤1904:目标设备基于第二设备信息向第二设备发送携带有第一设备信息的第一指示消息,以及基于第一设备信息向第一设备发送第二指示消息。Step 1904: The target device sends a first indication message carrying the first device information to the second device based on the second device information, and sends a second indication message to the first device based on the first device information.
第一指示消息用于指示第二设备基于第一设备信息与第一设备建立通信连接,第二指示消息用于指示第一设备在与第二设备建立通信连接后,将第一设备的窗口显示数据发送至第二设备中显示。The first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second indication message is used to instruct the first device to display the window of the first device after establishing a communication connection with the second device. The data is sent to the second device for display.
在实施中,目标设备生成第一指示消息,第一指示消息中携带第一设备信息。之后,目标设备根据第二设备信息确定目标设备与第二设备之间的通信通道,然后将生成的第一指示消息通过目标设备与第二设备之间的通信通道发送给第二设备,也即如图20中2004所示,目标设备请求第二设备与第一设备建立通信连接。另外,目标设备生成第二指示消息,并根据第一设备信息确定目标设备与第一设备之间的通信通道,然后将第二指示消息通过目标设备与第一设备之间的通信通道发送给第一设备。In an implementation, the target device generates a first indication message, where the first indication message carries the first device information. Afterwards, the target device determines the communication channel between the target device and the second device according to the second device information, and then sends the generated first indication message to the second device through the communication channel between the target device and the second device, that is, As shown at 2004 in FIG. 20, the target device requests the second device to establish a communication connection with the first device. In addition, the target device generates a second indication message, determines the communication channel between the target device and the first device according to the information of the first device, and then sends the second indication message to the second indication message through the communication channel between the target device and the first device. a device.
需要说明的是,目标设备向第二设备发送第一指示消息与向第一设备发送第二指示消息之间没有严格的先后执行顺序。在一个实施例中,目标设备可以先向第二设备发送第一指示消息,然后向第一设备发送第二指示消息。在另一个实施例中,目标设备也可以先向第一设备发送第二指示消息,然后向第二设备发送第一指示消息。在另一个实施例中,目标设备还可以同时向第二设备发送第一指示消息,以及向第一设备发送第二指示消息。在另一个实施例中,目标设备还可以先向第二设备发送第一指示消息,在接收到建立通信成功通知的情况下,向第一设备发送第二指示消息。建立通信成功通知用于指示第一设备与第二设备已成功建立通信连接,建立通信成功通知可 以由第一设备发送,也可以由第二设备发送。It should be noted that there is no strict execution sequence between the target device sending the first indication message to the second device and sending the second indication message to the first device. In an embodiment, the target device may first send the first indication message to the second device, and then send the second indication message to the first device. In another embodiment, the target device may also first send the second indication message to the first device, and then send the first indication message to the second device. In another embodiment, the target device may also send the first indication message to the second device and the second indication message to the first device at the same time. In another embodiment, the target device may first send a first indication message to the second device, and then send a second indication message to the first device when receiving a notification that the communication is established successfully. The notification of successfully establishing communication is used to indicate that the first device has successfully established a communication connection with the second device, and the notification of successfully establishing communication can be sent by the first device or by the second device.
需要说明的是,上述步骤1904为基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的一种示例性实现方式。It should be noted that the above step 1904 is an exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
步骤1905:第二设备基于第一设备信息请求与第一设备建立通信连接。Step 1905: The second device requests to establish a communication connection with the first device based on the information of the first device.
第二设备接收目标设备发送的第一指示消息后,对第一指示消息进行解析,以从第一指示消息中获取第一设备信息,另外,确定第一指示消息的目的,比如第一指示消息的目的是基于第一设备信息请求与第一设备建立直接的通信连接。之后,第二设备根据第一指示消息执行对应的操作。After the second device receives the first indication message sent by the target device, it parses the first indication message to obtain the first device information from the first indication message, and in addition, determines the purpose of the first indication message, such as the first indication message The purpose of is to request to establish a direct communication connection with the first device based on the first device information. Afterwards, the second device performs a corresponding operation according to the first indication message.
示例性地,第一设备信息包括第一MAC地址信息,第二设备信息包括第二MAC地址信息,第二设备基于第一MAC地址信息向第一设备发送建立连接请求,建立连接请求中可以携带第二MAC地址信息。Exemplarily, the first device information includes first MAC address information, the second device information includes second MAC address information, and the second device sends a connection establishment request to the first device based on the first MAC address information, and the connection establishment request may carry Second MAC address information.
步骤1906:第一设备与第二设备建立通信连接。Step 1906: the first device establishes a communication connection with the second device.
在一个实施例中,第一设备接收第二设备发送的建立连接请求后,对建立连接请求进行解析,从建立连接请求中解析出第二设备信息,之后,第一设备基于第二设备信息与第二设备建立通信连接,如图20中的2005所示。In one embodiment, after receiving the connection establishment request sent by the second device, the first device parses the connection establishment request, and parses out the second device information from the connection establishment request, and then, the first device based on the second device information and The second device establishes a communication connection, as shown at 2005 in FIG. 20 .
作为本申请的一个示例,第一设备与第二设备之间可以通过蓝牙、无线保真(wireless fidelity,WiFi)、WLAN、无线网络等方式建立通信连接,本申请实施例对此不作限定。As an example of the present application, a communication connection may be established between the first device and the second device through Bluetooth, wireless fidelity (Wi-Fi), WLAN, wireless network, etc., which is not limited in this embodiment of the present application.
需要说明的是,上述是以第一设备与第二设备之间预先未建立有通信连接为例进行说明。在另一实施例中,当第一设备与第二设备之间建立有通信连接时,可以直接执行如下步骤1907至步骤1908的操作。It should be noted that, the above description is based on an example where no communication connection has been previously established between the first device and the second device. In another embodiment, when a communication connection is established between the first device and the second device, the following operations from step 1907 to step 1908 may be directly performed.
步骤1907:第一设备将第一设备的窗口显示数据发送给第二设备。Step 1907: the first device sends the window display data of the first device to the second device.
如前文所述,由于目标设备向第一设备发送第二指示消息,第二指示消息用于指示第一设备在与第二设备建立通信连接后将第一设备的窗口显示数据发送给第二设备,所以第一设备在与第二设备之间成功建立通信连接之后,第一设备向第二设备发送第一设备的窗口显示数据。As mentioned above, because the target device sends the second indication message to the first device, the second indication message is used to instruct the first device to send the window display data of the first device to the second device after establishing a communication connection with the second device , so after the first device successfully establishes a communication connection with the second device, the first device sends the window display data of the first device to the second device.
步骤1908:第二设备基于第一设备的窗口显示数据,显示第一设备的显示画面。Step 1908: The second device displays the display screen of the first device based on the window display data of the first device.
如此,第一设备的显示画面即可显示于第二设备中。In this way, the display screen of the first device can be displayed on the second device.
作为本申请的一个示例,第二设备可以通过目标显示窗口显示第一设备的显示画面,比如目标显示窗口为悬浮窗等。也即,此时第二设备继续显示第二设备的显示画面,且在第二设备的显示画面上通过目标显示窗口显示第一设备的显示画面,如此,用户在第二设备中不仅可以继续查看第二设备的显示画面,且还可以在第二设备中查看第一设备的显示画面。譬如,假设第二设备在显示第一设备的显示画面之前正在播放多媒体资源,则第二设备在显示第一设备的显示画面时,可以通过目标显示窗口将第一设备的显示画面显示于播放的多媒体资源的画面之上,如此,用户不仅可以继续在第二设备上观看播放的多媒体资源,还可以在第二设备上查看第一设备的显示画面。As an example of the present application, the second device may display the display screen of the first device through the target display window, for example, the target display window is a floating window. That is, at this time, the second device continues to display the display screen of the second device, and displays the display screen of the first device through the target display window on the display screen of the second device. In this way, the user can not only continue to view The display screen of the second device, and the display screen of the first device can also be viewed in the second device. For example, assuming that the second device is playing multimedia resources before displaying the display screen of the first device, when the second device displays the display screen of the first device, it can display the display screen of the first device on the playing screen through the target display window. In this way, the user can not only continue to watch the played multimedia resource on the second device, but also view the display screen of the first device on the second device.
作为本申请的另一个示例,第二设备可以将第二设备的显示画面切换为第一设备的显示画面。也即,第二设备可以不再显示第二设备的显示画面,而是显示第一设备的显示画面,此时用户在第二设备中仅可以看到第一设备的显示画面。譬如,假设第 二设备在显示第一设备的显示画面之前正在播放多媒体资源,则第二设备在显示第一设备的显示画面时,可以关闭当前正在显示的多媒体资源,切换为显示第一设备的显示画面。如此,可以使得第一设备的显示画面清晰地显示于第二设备中,便于用户查看。As another example of the present application, the second device may switch the display screen of the second device to the display screen of the first device. That is, the second device may no longer display the display screen of the second device, but display the display screen of the first device. At this time, the user can only see the display screen of the first device in the second device. For example, assuming that the second device is playing multimedia resources before displaying the display screen of the first device, when the second device displays the display screen of the first device, it can close the currently displayed multimedia resource and switch to displaying the multimedia resource of the first device. Display screen. In this way, the display screen of the first device can be clearly displayed on the second device, which is convenient for the user to view.
在一个实施例中,用户可以在第二设备中对第一设备的显示画面进行操作。响应于用户在第二设备中对第一设备的显示画面上的触发操作,第二设备基于该触发操作生成画面操作指令。第二设备向第一设备发送画面操作指令,第一设备响应于画面操作指令,执行对应的操作。示例性地,假设第一设备的显示画面中正在播放视频,当用户想要暂停播放时,可以在第二设备中第一设备的显示画面中触发暂停选项,响应于用户对暂停选项的触发操作,第二设备向第一设备发送暂停播放指示,第一设备接收暂停播放指示后,暂停对视频的播放。当然,第二设备中也会同步暂停对视频的播放。可选地,当目标设备中显示有第一显示窗口时,目标设备在第一显示窗口中也暂停对视频的播放。In an embodiment, the user can operate the display screen of the first device in the second device. In response to a user's trigger operation on the display screen of the first device in the second device, the second device generates a screen operation instruction based on the trigger operation. The second device sends a screen operation instruction to the first device, and the first device performs a corresponding operation in response to the screen operation instruction. For example, assuming that a video is being played on the display screen of the first device, when the user wants to pause the playback, the pause option can be triggered on the display screen of the first device in the second device, and in response to the user's trigger operation on the pause option , the second device sends a playback pause instruction to the first device, and the first device pauses playing the video after receiving the playback pause instruction. Of course, the playback of the video will also be paused synchronously in the second device. Optionally, when the first display window is displayed on the target device, the target device also pauses playing the video in the first display window.
在本申请实施例中,目标设备检测第一操作,获取第一显示窗口对应的第一设备信息和第二显示窗口对应的第二设备信息。基于第一设备信息生成第一指示消息。基于第二设备信息向第二设备发送第一指示消息,以及基于第一设备信息向第一设备发送第二指示消息,使得第二设备基于第一指示消息与第一设备之间建立通信连接,以及使得第一设备在与第二设备成功建立通信连接后,将第一设备的窗口显示数据发送至第二设备中显示。如此,目标设备检测第一操作,通过分别向第一设备发送第二指示消息,以及向第二设备发送第一指示消息,控制第一设备与第二设备之间建立通信连接,进而使得设备之间能够进行数据通信。In this embodiment of the present application, the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window. A first indication message is generated based on the first device information. sending a first indication message to the second device based on the second device information, and sending a second indication message to the first device based on the first device information, so that the second device establishes a communication connection with the first device based on the first indication message, And make the first device send the window display data of the first device to the second device for display after successfully establishing a communication connection with the second device. In this way, the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending the second indication message to the first device and the first indication message to the second device, so that the connection between the devices capable of data communication.
该实施方式通过在目标设备上操作,为第一设备与第二设备建立通信直连,可以解决第一设备的用户A与第二设备的用户B在会议场景下,用户A的手机的界面在展示过程中,用户B想在自己的手机上同步查看A的手机的展示界面,而此时A和B位置距离又比较远(但不影响建立数据通信连接),不方便面对面操作,连接手机的问题。This embodiment establishes a direct communication connection between the first device and the second device by operating on the target device, which can solve the problem that the interface of user A's mobile phone is in a conference scene between user A of the first device and user B of the second device. During the display process, user B wants to view the display interface of A's mobile phone synchronously on his mobile phone. At this time, the distance between A and B is relatively far (but it does not affect the establishment of data communication connection), which is inconvenient for face-to-face operation. question.
请参考图21,图21是根据另一示例性实施例示出的一种设备之间的数据通信方法的流程示意图。这里以多个设备交互为例进行说明。该方法可以包括如下内容:Please refer to FIG. 21 , which is a schematic flowchart of a data communication method between devices according to another exemplary embodiment. Here, the interaction between multiple devices is taken as an example for illustration. The method can include the following:
步骤2101至步骤2103请参见上述图19实施例中的步骤1901至步骤1903。For steps 2101 to 2103, please refer to steps 1901 to 1903 in the embodiment in FIG. 19 above.
步骤2104:目标设备基于第一设备信息,向第一设备发送携带有第二设备信息的第三指示消息。Step 2104: The target device sends a third indication message carrying the second device information to the first device based on the first device information.
第三指示消息用于指示第一设备基于第二设备信息与第二设备建立通信连接,以及在与第二设备建立通信连接后将第一设备的窗口显示数据发送至第二设备中显示。The third indication message is used to instruct the first device to establish a communication connection with the second device based on the information of the second device, and to send the window display data of the first device to the second device for display after the communication connection is established with the second device.
目标设备基于第二设备信息生成第三指示消息,并基于第一设备信息确定目标设备与第一设备之间的通信通道。之后通过目标设备与第一设备之间的通信通道将第三指示消息发送给第一设备。The target device generates a third indication message based on the second device information, and determines a communication channel between the target device and the first device based on the first device information. Then the third indication message is sent to the first device through the communication channel between the target device and the first device.
需要说明的是,上述步骤2104为基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的另一种示例性实现方式。It should be noted that the above step 2104 is another exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
步骤2105:第一设备基于第二设备信息请求与第二设备建立通信连接。Step 2105: The first device requests to establish a communication connection with the second device based on the information of the second device.
第一设备接收第三指示消息后,对第三指示消息进行解析,从第三指示消息中解析出第二设备信息,另外,解析第三指示消息的用意,譬如第三指示消息的用意包括两方面,一方面指示第一设备与第二设备建立通信连接,另一方面指示第一设备在与第二设备成功建立通信连接后将第一设备的窗口显示数据发送至第二设备中显示。所以,第一设备在解析第三指示消息后,首先请求与第二设备建立通信连接。示例性地,第一设备可以基于第二设备信息向第二设备发送建立连接请求。建立连接请求中携带第一设备的第一设备信息。After the first device receives the third indication message, it parses the third indication message, and parses out the information of the second device from the third indication message. In addition, it analyzes the purpose of the third indication message. For example, the purpose of the third indication message includes two On the one hand, on the one hand, instruct the first device to establish a communication connection with the second device; on the other hand, instruct the first device to send the window display data of the first device to the second device for display after successfully establishing a communication connection with the second device. Therefore, after parsing the third indication message, the first device first requests to establish a communication connection with the second device. Exemplarily, the first device may send a connection establishment request to the second device based on the information of the second device. The first device information of the first device is carried in the connection establishment request.
步骤2106:第二设备与第一设备建立通信连接。Step 2106: the second device establishes a communication connection with the first device.
第二设备接收第一设备发送的建立连接请求后,对建立连接请求进行解析,从建立连接请求中解析出第一设备信息。之后,第二设备基于第一设备信息与第一设备之间建立通信连接。After receiving the connection establishment request sent by the first device, the second device parses the connection establishment request, and parses out the first device information from the connection establishment request. Afterwards, the second device establishes a communication connection with the first device based on the first device information.
步骤2107:第一设备将第一设备的窗口显示数据发送给第二设备。Step 2107: the first device sends the window display data of the first device to the second device.
其具体实现可以参见上述图19所示实施例中的步骤1907。For its specific implementation, refer to step 1907 in the above embodiment shown in FIG. 19 .
步骤2108:第二设备对第一设备的窗口显示数据进行显示。Step 2108: The second device displays the window display data of the first device.
其具体实现可以参见上述图19所示实施例中的步骤1908。For its specific implementation, refer to step 1908 in the above embodiment shown in FIG. 19 .
在本申请实施例中,目标设备检测第一操作,获取第一显示窗口对应的第一设备信息和第二显示窗口对应的第二设备信息。基于第二设备信息生成第三指示消息。基于第一设备信息向第一设备发送第三指示消息,使得第一设备基于第三指示消息与第二设备之间建立通信连接,并在与第二设备成功建立通信连接后,将第一设备的窗口显示数据发送至第二设备中显示。如此,目标设备检测第一操作,通过向第一设备发送第三指示消息控制第一设备与第二设备之间建立通信连接,使得设备之间能够实现数据通信。In this embodiment of the present application, the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window. A third indication message is generated based on the second device information. Send a third indication message to the first device based on the first device information, so that the first device establishes a communication connection with the second device based on the third indication message, and after successfully establishing a communication connection with the second device, the first device The window display data is sent to the second device for display. In this way, the target device detects the first operation, and controls the establishment of a communication connection between the first device and the second device by sending a third indication message to the first device, so that data communication can be realized between the devices.
请参考图22,图22是根据另一示例性实施例示出的一种设备之间的数据通信方法的流程示意图。这里以多个设备交互为例进行说明。该方法可以包括如下内容:Please refer to FIG. 22 , which is a schematic flowchart of a data communication method between devices according to another exemplary embodiment. Here, the interaction between multiple devices is taken as an example for illustration. The method can include the following:
步骤2201至步骤2203请参见上述图19实施例中的步骤1901至步骤1903。For steps 2201 to 2203, please refer to steps 1901 to 1903 in the embodiment of FIG. 19 above.
步骤2204:目标设备基于第一设备信息和第二设备信息,将第一设备的窗口显示数据实时转发给第二设备。Step 2204: The target device forwards the window display data of the first device to the second device in real time based on the first device information and the second device information.
在实施中,目标设备基于第一设备信息从第一设备与目标设备之间的通信通道获取来自第一设备的窗口显示数据,以及基于所述第二设备信息,确定目标设备与第二设备之间的通信通道,并将获取的第一设备的窗口显示数据通过目标设备与第二设备之间的通信通道发送给第二设备。In an implementation, the target device obtains the window display data from the first device from the communication channel between the first device and the target device based on the first device information, and determines the relationship between the target device and the second device based on the second device information. and send the acquired window display data of the first device to the second device through the communication channel between the target device and the second device.
也即,在本申请实施例中,目标设备作为第一设备与第二设备之间的中间转发设备,或者可以理解为目标设备是第一设备的代理,用于将第一设备的窗口显示数据实时转发给第二设备。That is to say, in this embodiment of the application, the target device acts as an intermediate forwarding device between the first device and the second device, or it can be understood that the target device is the proxy of the first device, which is used to display data in the window of the first device forwarded to the second device in real time.
需要说明的是,上述步骤2204为基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的另一种示例性实现方式。It should be noted that the above step 2204 is another exemplary implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device.
步骤2205:第二设备对第一设备的窗口显示数据进行显示。Step 2205: the second device displays the window display data of the first device.
其具体实现可以参见图19实施例中的步骤1908,这里不再详细赘述。For its specific implementation, refer to step 1908 in the embodiment in FIG. 19 , which will not be described in detail here.
在本申请实施例中,目标设备检测第一操作,获取第一显示窗口对应的第一设备信息和第二显示窗口对应的第二设备信息。基于第一设备信息和第二设备信息,将第一设备的窗口显示数据实时转发给第二设备。如此,目标设备通过检测第一操作,执行数据转发,以使得设备之间能够快速进行数据通信。第一设备或第二设备的窗口显示数据经由目标设备转发,无需建立第一设备与第二设备之间的数据直连,只需第一设备、第二设备分别与目标设备存在连接即可,但在目标设备与第一设备和第二设备中某一设备断开连接后,第一设备的窗口显示数据也无法在第二设备上显示。In this embodiment of the present application, the target device detects the first operation, and acquires first device information corresponding to the first display window and second device information corresponding to the second display window. Based on the first device information and the second device information, the window display data of the first device is forwarded to the second device in real time. In this way, the target device performs data forwarding by detecting the first operation, so that data communication between devices can be performed quickly. The window display data of the first device or the second device is forwarded via the target device, there is no need to establish a direct data connection between the first device and the second device, only the first device and the second device are connected to the target device respectively, However, after the target device is disconnected from one of the first device and the second device, the window display data of the first device cannot be displayed on the second device.
需要说明的是,上文所述的基于第一设备信息和第二设备信息,控制第一设备与第二设备之间进行数据通信的实现方式仅是示例性的。在另一实施例中,还可以通过其他方式实现。譬如可以包括但不限于如下几种方式:It should be noted that the implementation manner of controlling data communication between the first device and the second device based on the information of the first device and the information of the second device described above is only exemplary. In another embodiment, it can also be implemented in other ways. For example, it may include but not limited to the following methods:
在一个示例中,目标设备还可以基于第二设备信息,将第一设备信息发送给第二设备,以指示第二设备基于第一设备信息与第一设备建立通信连接,并且指示第二设备在与第一设备成功建立通信连接后,请求第一设备发送第一设备的窗口显示数据。In an example, the target device may also send the first device information to the second device based on the second device information, to instruct the second device to establish a communication connection with the first device based on the first device information, and to instruct the second device to After successfully establishing a communication connection with the first device, the first device is requested to send the window display data of the first device.
在一个示例中,目标设备还可以基于第一设备信息将第二设备信息发送给第一设备,以及基于第二设备信息将第一设备信息发送给第二设备,以使得第一设备与第二设备之间建立通信连接。另外,指示第一设备在与第二设备成功建立通信连接后,将第一设备的窗口显示数据发送至第二设备中显示,或者指示第二设备在与第一设备成功建立通信连接后,请求第一设备发送第一设备的窗口显示数据并显示。In an example, the target device may also send the second device information to the first device based on the first device information, and send the first device information to the second device based on the second device information, so that the first device and the second A communication connection is established between the devices. In addition, instruct the first device to send the window display data of the first device to the second device for display after successfully establishing a communication connection with the second device, or instruct the second device to request The first device sends and displays the window display data of the first device.
作为示例而非限定,接下来请参考图23,图23是本申请实施例提供的另一种设备之间的数据通信方法的示意性流程图,这里以该方法通过多个设备交互实现为例进行说明,该方法包括:As an example and not a limitation, please refer to FIG. 23. FIG. 23 is a schematic flow chart of another data communication method between devices provided by the embodiment of the present application. Here, the method is implemented through the interaction of multiple devices as an example. To illustrate, the method includes:
步骤2301至步骤2302可以参见上述图17-图22所示实施例中的任意一个实施例,这里不再重复介绍。For steps 2301 to 2302, reference may be made to any one of the above-mentioned embodiments shown in FIG. 17-FIG. 22 , which will not be repeated here.
步骤2303:在确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示的情况下,在第二显示窗口中叠加显示第一显示窗口。Step 2303: When it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimpose and display the first display window in the second display window.
在一个实施例中,目标设备接收第一设备和/或第二设备发送的数据通信成功通知后,确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示。譬如,第一设备将第一设备的窗口显示数据发送给第二设备后,可以向目标设备发送数据通信成功通知,第二设备接收第一设备的窗口显示数据后,也可以向目标设备发送数据通信成功通知。作为一种示例,目标设备接收到第一设备和第二设备中任意一个设备发送的数据通信成功通知后,确定第一设备成功将第一设备的窗口显示数据发送至第二设备显示。作为另一种示例,目标设备在接收到第一设备发送的数据通信成功通知,以及接收到第二设备发送的数据通信成功通知后,确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示。In one embodiment, after receiving the notification of successful data communication sent by the first device and/or the second device, the target device determines that the first device has successfully sent the window display data of the first device to the second device for display. For example, after the first device sends the window display data of the first device to the second device, it can send a data communication success notification to the target device, and the second device can also send data to the target device after receiving the window display data of the first device. Notification of successful communication. As an example, after receiving a notification of successful data communication sent by any one of the first device and the second device, the target device determines that the first device has successfully sent the window display data of the first device to the second device for display. As another example, after receiving the notification of successful data communication sent by the first device and the notification of successful data communication sent by the second device, the target device determines that the first device has successfully sent the window display data of the first device to displayed on the second device.
在一个实施例中,在确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示的情况下,目标设备可以将第一显示窗口的尺寸和/或形状进行调整,譬如, 对第一显示窗口进行缩小处理,以及将第一显示窗口的形状调整为与第二显示窗口的形状相同,以将第一显示窗口叠加显示至第二显示窗口中。In one embodiment, when it is determined that the first device successfully sends the window display data of the first device to the second device for display, the target device may adjust the size and/or shape of the first display window, for example, The first display window is reduced, and the shape of the first display window is adjusted to be the same as that of the second display window, so as to overlay and display the first display window into the second display window.
如此,目标设备在第二显示窗口中叠加显示第一显示窗口,不仅便于其他用户继续在目标设备中查看第一设备的显示画面和/或第二设备的显示画面,另外,还可以使得其他用户根据叠加显示效果可以获知哪两个设备之间进行了数据通信,以及哪个设备的显示画面显示在哪个设备的屏幕上。In this way, the target device superimposes and displays the first display window in the second display window, which not only facilitates other users to continue viewing the display screen of the first device and/or the display screen of the second device in the target device, but also allows other users to According to the superimposed display effect, it can be known which two devices have performed data communication, and which device's display screen is displayed on which device's screen.
在一个实施例中,在确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示的情况下,除了在第二显示窗口中叠加显示第一显示窗口之外,还继续在第一显示窗口的原位置处显示第一显示窗口,如图6所示。如此,由于将第一显示窗口叠加显示至第二显示窗口中时可能会对第一显示窗口进行缩小处理,所以可能使得第一显示窗口中的内容缩小。所以在第一显示窗口的原位置继续显示第一显示窗口,可以使得用户可以继续看到清晰的第一设备的显示画面。In one embodiment, when it is determined that the first device has successfully sent the window display data of the first device to the second device for display, in addition to superimposing and displaying the first display window in the second display window, the The first display window is displayed at the original position of the first display window, as shown in FIG. 6 . In this way, since the first display window may be shrunk when the first display window is overlaid and displayed in the second display window, the content in the first display window may be reduced. Therefore, continuing to display the first display window at the original position of the first display window allows the user to continue to see a clear display screen of the first device.
在另一实施例中,在确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示的情况下,在第二显示窗口中叠加显示第一显示窗口之后,目标设备可以在第一显示窗口的原位置处删除第一显示窗口,也即目标设备的屏幕显示区域内不再单独显示第一显示窗口,如图7所示,如此可以节省屏幕显示区域的显示空间。In another embodiment, when it is determined that the first device has successfully sent the window display data of the first device to the second device for display, after the first display window is superimposed on the second display window, the target device can The first display window is deleted from the original position of the first display window, that is, the first display window is no longer displayed separately in the screen display area of the target device, as shown in FIG. 7 , so that the display space of the screen display area can be saved.
作为本申请的一个示例,基于显示窗口的叠加显示方案,目标设备还可以执行如下操作步骤。As an example of the present application, based on the superimposed display scheme of display windows, the target device may also perform the following operation steps.
步骤2304:目标设备检测第二操作,控制第一设备与第二设备终止数据通信,第二操作包括将第一显示窗口从第二显示窗口内移动出后释放或者从第一显示窗口开始至指定区域结束的划线操作,指定区域不包括第一显示窗口所在区域和第二显示窗口所在区域。Step 2304: The target device detects the second operation, and controls the first device to terminate the data communication with the second device. The second operation includes moving the first display window out of the second display window and then releasing it or starting from the first display window to a specified The marking operation at the end of the area, the specified area does not include the area where the first display window is located and the area where the second display window is located.
作为一种示例,目标设备检测第二操作是指:目标设备检测到用户将第一显示窗口从第二显示窗口中拖动出后释放。具体地,目标设备检测到用户对第一显示窗口的拖动操作后释放,若第一显示窗口与第二显示窗口之间的重叠面积小于面积阈值,譬如第一显示窗口与第二显示窗口之间的重叠面积为0,则可以确定第一显示窗口被从第二显示窗口内拖出后释放。As an example, the detection of the second operation by the target device refers to: the target device detects that the user drags the first display window from the second display window and then releases it. Specifically, after the target device detects the user's drag operation on the first display window and releases it, if the overlapping area between the first display window and the second display window is smaller than the area threshold, for example, the area between the first display window and the second display window If the overlapping area between them is 0, it can be determined that the first display window is released after being dragged out from the second display window.
需要说明的是,这里所述的拖动操作可以同手指触发,也可以通过手势触发,具体实现可以参见上文,这里不再重复赘述。It should be noted that the drag operation described here can be triggered by a finger or by a gesture. For specific implementation, please refer to the above, and will not repeat it here.
作为另一种示例,目标设备检测第二操作是指:目标设备检测到用户从第一显示窗口所在区域开始,执行划线操作,划线终点位于指定区域内。譬如,目标设备检测到用户从第一显示窗口开始,向第一显示窗口的原位置方向划线,划线终点位于第一显示窗口的原显示区域内或位于第二显示窗口以外的其他区域内,且划线起点与划线终点之间的直线距离大于距离阈值,则可以确定检测到第二操作。As another example, the detection of the second operation by the target device refers to: the target device detects that the user starts from the area where the first display window is located and performs a scribing operation, and the end point of the scribing is within the specified area. For example, the target device detects that the user starts from the first display window and draws a line in the direction of the original position of the first display window, and the end point of the line is located in the original display area of the first display window or in another area outside the second display window , and the straight-line distance between the starting point of the line and the end point of the line is greater than the distance threshold, it can be determined that the second operation is detected.
需要说明的是,这里所述的划线操作可以通过手指触发,也可以通过手势触发,具体可以参见上文,这里不再重复赘述。It should be noted that the scribing operation described here can be triggered by a finger or by a gesture. For details, please refer to the above, which will not be repeated here.
作为本申请的一个示例,控制第一设备与第二设备终止数据通信的具体实现可以包括:向第一设备发送终止指示消息,终止指示消息用于指示终止向第二设备发送第一设备的窗口显示数据。As an example of the present application, the specific implementation of controlling the termination of the data communication between the first device and the second device may include: sending a termination indication message to the first device, where the termination indication message is used to indicate the termination of sending the window of the first device to the second device Display Data.
在一个实施例中,目标设备可以仅指示第一设备终止向第二设备发送第一设备的窗口显示数据,而不断开与第二设备之间的通信连接。在另一个实施例中,目标设备还可以指示第一设备终止向第二设备发送第一设备的窗口显示数据,并断开与第二设备之间的通信连接。In an embodiment, the target device may only instruct the first device to stop sending the window display data of the first device to the second device without disconnecting the communication connection with the second device. In another embodiment, the target device may also instruct the first device to stop sending the window display data of the first device to the second device, and disconnect the communication connection with the second device.
需要说明的是,上述控制第一设备与第二设备终止数据通信的实现方式仅是示例性的。在另一实施例中,目标设备还可以指示第二设备断开与第一设备之间的通信连接,以使得第一设备与第二设备终止数据通信。It should be noted that, the foregoing implementation manner of controlling the first device and the second device to terminate data communication is only exemplary. In another embodiment, the target device may also instruct the second device to disconnect the communication connection with the first device, so that the first device terminates the data communication with the second device.
在又一个实施例中,若目标设备是作为第一设备与第二设备之间的中间转发设备,则控制第一设备与第二设备终止数据通信的具体实现为,目标设备停止将第一设备的窗口显示数据实时转发给第二设备,也即目标设备不再将第一设备的窗口显示数据转发给第二设备。In yet another embodiment, if the target device is an intermediate forwarding device between the first device and the second device, the specific realization of controlling the termination of data communication between the first device and the second device is that the target device stops sending the first device The window display data of the first device is forwarded to the second device in real time, that is, the target device no longer forwards the window display data of the first device to the second device.
作为本申请的一个示例,目标设备在控制第一设备与第二设备之间终止数据通信之后,还可以执行如下操作。As an example of the present application, after the target device controls the termination of the data communication between the first device and the second device, it may further perform the following operations.
步骤2305:目标设备在确定第一设备与第二设备已终止数据通信的情况下,将第一显示窗口恢复至原位置显示。Step 2305: When the target device determines that the data communication between the first device and the second device has terminated, restore the first display window to the original position for display.
作为本申请的一个示例,目标设备接收第一设备和/或第二设备发送的数据通信结束通知,确定第一设备与第二设备已终止数据通信。譬如,第一设备停止向第二设备发送第一设备的窗口显示数据后,向目标设备发送数据通信结束通知,第二设备不再显示第一设备的窗口显示数据后,也可以向目标设备发送数据通信结束通知。作为一种示例,目标设备接收到第一设备和第二设备中任意一个设备发送的数据通信结束通知后,确定第一设备与第二设备已终止数据通信。作为另一种示例,目标设备在接收到第一设备发送的数据通信结束通知,以及接收到第二设备发送的数据通信结束通知后,确定第一设备与第二设备已终止数据通信。As an example of the present application, the target device receives the data communication end notification sent by the first device and/or the second device, and determines that the data communication between the first device and the second device has terminated. For example, after the first device stops sending the window display data of the first device to the second device, it sends a data communication end notification to the target device, and after the second device no longer displays the window display data of the first device, it can also send a notification to the target device Data communication end notification. As an example, after receiving the data communication end notification sent by any one of the first device and the second device, the target device determines that the data communication between the first device and the second device has been terminated. As another example, after receiving the data communication end notification sent by the first device and the data communication end notification sent by the second device, the target device determines that the data communication between the first device and the second device has terminated.
目标设备在确定第一设备与第二设备已终止数据通信的情况下,目标设备不再将第一显示窗口叠加于第二显示窗口中,而是将第一显示窗口恢复至原位置显示,也即,目标设备的显示界面恢复至第一设备与第二设备之间未进行数据通信之前的显示状态,譬如恢复至如图15所示的显示效果。When the target device determines that the data communication between the first device and the second device has terminated, the target device no longer superimposes the first display window on the second display window, but restores the first display window to its original position for display, and also That is, the display interface of the target device returns to the display state before the data communication between the first device and the second device, for example, returns to the display effect as shown in FIG. 15 .
值得一提的是,在确定第一设备成功将第一设备的窗口显示数据发送至第二设备中显示的情况下,在第二显示窗口中叠加显示第一显示窗口,使得其他用户可以继续在目标设备查看第一设备的显示画面,另外可以使得其他用户获知第一设备的显示画面显示于第二设备中,也即可以使得其他用户获知第一设备与第二设备之间的连接情况。It is worth mentioning that when it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is superimposed and displayed in the second display window, so that other users can continue to display in the second display window. The target device views the display screen of the first device, and other users can know that the display screen of the first device is displayed in the second device, that is, other users can know the connection between the first device and the second device.
需要说明的是,上述是以目标设备在确定第一设备与第二设备已终止数据通信的情况下将第一显示窗口恢复至原位置显示为例进行说明。在另一实施例中,在确定第一设备与第二设备已终止数据通信的情况下,还可以将第一显示窗口在拖动停止的位置或者划线终点的位置显示。It should be noted that, the above description is made by taking the target device restoring the first display window to its original position for display when it determines that the data communication between the first device and the second device has terminated. In another embodiment, when it is determined that the data communication between the first device and the second device has terminated, the first display window may also be displayed at the position where the dragging stops or the position where the line ends.
为了便于理解,作为一个示例,接下来基于图24对目标设备、第一设备和第二设备之间的交互流程进行简单介绍。For ease of understanding, as an example, an interaction process among the target device, the first device, and the second device is briefly introduced next based on FIG. 24 .
2401:目标设备检测第一显示窗口被拖动至第二显示窗口后释放。2401: The target device detects that the first display window is dragged to the second display window and releases it.
2402:目标设备显示问询窗口。2402: The target device displays an inquiry window.
2403:目标设备通过问询窗口请求确认是否同意第一设备与第二设备建立数据通信连接。2403: The target device requests confirmation through the inquiry window whether to agree to establish a data communication connection between the first device and the second device.
若基于问询窗口接收确认指令,说明用户同意第一设备与第二设备建立数据通信连接,此时进入如下步骤2404。否则,若基于问询窗口接收取消指令,说明用户不同意第一设备与第二设备建立数据通信连接,此时取消数据通信。If the confirmation instruction is received based on the inquiry window, it means that the user agrees to establish a data communication connection between the first device and the second device, and at this time, enter the following step 2404 . Otherwise, if the cancel instruction is received based on the inquiry window, it means that the user does not agree to establish the data communication connection between the first device and the second device, and the data communication is canceled at this time.
2404:目标设备控制第一设备与第二设备进行数据通信。2404: The target device controls the first device to perform data communication with the second device.
在一个实施例中,目标设备控制控制第一设备与第二设备建立通信连接,以便于通过该通信连接进行数据通信。In one embodiment, the target device controls the first device to establish a communication connection with the second device, so as to perform data communication through the communication connection.
2405:第一设备与第二设备建立通信连接。2405: The first device establishes a communication connection with the second device.
2406:第一设备将第一设备的窗口显示数据发送至第二设备中显示。2406: The first device sends the window display data of the first device to the second device for display.
2407:第一设备和/或第二设备向目标设备反馈。2407: The first device and/or the second device feeds back to the target device.
该反馈的目的是通知目标设备已实现数据通信。譬如,第一设备或第二设备向目标设备发送数据通信成功通知。The purpose of this feedback is to inform the target device that data communication has been achieved. For example, the first device or the second device sends a data communication success notification to the target device.
2408:目标设备将第一显示窗口显示于第二显示窗口中。2408: The target device displays the first display window in the second display window.
需要说明的是,在上述实现过程中,若目标设备基于问询窗口接收取消指令,则说明用户不同意将第一设备的画面显示数据显示于第二设备中,此时目标设备取消数据通信。在实施中,目标设备将第一显示窗口恢复至原位置显示,且目标设备不控制第一设备与第二设备进行数据通信。It should be noted that, in the above implementation process, if the target device receives the cancel instruction based on the inquiry window, it means that the user does not agree to display the screen display data of the first device on the second device, and the target device cancels the data communication at this time. In implementation, the target device restores the first display window to the original position for display, and the target device does not control the first device to perform data communication with the second device.
应理解,上述实施例中各步骤的序号并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the sequence numbers of the steps in the above embodiments do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.
对应于上文实施例所述的设备之间的数据通信方法,图25是本申请实施例提供的一种设备之间的数据通信装置的结构框图,配置于上述目标设备中,为了便于说明,仅示出了与本申请实施例相关的部分。Corresponding to the data communication method between devices described in the above embodiment, Fig. 25 is a structural block diagram of a data communication device between devices provided in the embodiment of the present application, which is configured in the above target device. For the convenience of description, Only the parts related to the embodiments of the present application are shown.
参照图25,该装置包括:Referring to Figure 25, the device includes:
检测模块2510,用于检测第一操作,确定所述第一显示窗口对应的第一设备的第一设备信息和所述第二显示窗口对应的第二设备的第二设备信息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作;The detection module 2510 is configured to detect the first operation, and determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window, the first The operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window;
控制模块2520,用于基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,以通过所述数据通信使得所述第一设备的窗口显示数据显示于所述第二设备中。A control module 2520, configured to control data communication between the first device and the second device based on the first device information and the second device information, so that the first The window display data of the device is displayed in the second device.
作为本申请的一个示例,所述检测模块2510用于:As an example of this application, the detection module 2510 is used to:
检测所述第一显示窗口被移动至所述第二显示窗口的显示区域内后释放,所述第一显示窗口与所述第二显示窗口的重叠面积大于面积阈值;或者,Release after detecting that the first display window is moved into the display area of the second display window, and the overlapping area of the first display window and the second display window is greater than an area threshold; or,
检测以所述第一显示窗口为划线起点的划线操作,划线终点位于所述第二显示窗口的显示区域内,且划线起点与划线终点之间的直线距离处于预设距离范围内。Detecting a scribing operation with the first display window as the scribing start point, the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
作为本申请的一个示例,所述控制模块2520用于:As an example of this application, the control module 2520 is used to:
基于所述第二设备信息向所述第二设备发送携带有所述第一设备信息的第一指示消息,以及基于所述第一设备信息向所述第一设备发送第二指示消息;sending a first indication message carrying the first device information to the second device based on the second device information, and sending a second indication message to the first device based on the first device information;
所述第一指示消息用于指示所述第二设备基于所述第一设备信息与所述第一设备建立通信连接,所述第二指示消息用于指示所述第一设备在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second indication message is used to indicate that the first device is communicating with the first device After establishing the communication connection, the two devices send the window display data of the first device to the second device for display.
作为本申请的一个示例,所述控制模块2520用于:As an example of this application, the control module 2520 is used to:
基于所述第一设备信息,向所述第一设备发送携带有所述第二设备信息的第三指示消息;Sending a third indication message carrying the second device information to the first device based on the first device information;
所述第三指示消息用于指示所述第一设备基于所述第二设备信息与所述第二设备建立通信连接,以及在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
作为本申请的一个示例,所述控制模块2520用于:As an example of this application, the control module 2520 is used to:
基于所述第一设备信息和所述第二设备信息,将所述第一设备的窗口显示数据实时转发给所述第二设备。Based on the first device information and the second device information, forward the window display data of the first device to the second device in real time.
作为本申请的一个示例,所述控制模块2520还用于:As an example of this application, the control module 2520 is also used to:
显示问询窗口,所述问询窗口包括问询信息,所述问询信息用于指示基于所述问询窗口确认是否将所述第一设备的窗口显示数据显示于所述第二设备中;displaying an inquiry window, the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
基于所述问询窗口接收确认指令,执行所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信的操作。Based on the inquiry window receipt confirmation instruction, perform the operation of controlling data communication between the first device and the second device based on the first device information and the second device information.
作为本申请的一个示例,所述控制模块2520还用于:As an example of this application, the control module 2520 is also used to:
在确定所述第一设备成功将所述第一设备的窗口显示数据发送至所述第二设备中显示的情况下,在所述第二显示窗口中叠加显示所述第一显示窗口。In a case where it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimposing and displaying the first display window in the second display window.
作为本申请的一个示例,所述检测模块2510还用于:As an example of this application, the detection module 2510 is also used to:
检测所述第一操作,获取所述第一显示窗口的快照,得到第一快照;Detecting the first operation, acquiring a snapshot of the first display window, and obtaining a first snapshot;
对所述第一快照进行透明化处理,得到第二快照;performing transparent processing on the first snapshot to obtain a second snapshot;
在所述第一显示窗口的原位置处显示所述第二快照,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
作为本申请的一个示例,所述检测模块2510还用于:As an example of this application, the detection module 2510 is also used to:
检测第二操作,控制所述第一设备与所述第二设备终止数据通信,所述第二操作包括将所述第一显示窗口从所述第二显示窗口的显示区域移动出后释放或者从所述第一显示窗口开始至指定区域结束的划线操作,所述指定区域不包括所述第一显示窗口所在区域和所述第二显示窗口所在区域。Detecting a second operation, controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
作为本申请的一个示例,所述控制模块2520用于:As an example of this application, the control module 2520 is used to:
向所述第一设备发送终止指示消息,所述终止指示消息用于指示终止向所述第二设备发送所述第一设备的窗口显示数据。sending a termination indication message to the first device, where the termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
作为本申请的一个示例,所述控制模块2520还用于:As an example of this application, the control module 2520 is also used to:
在确定所述第一设备与所述第二设备已终止数据通信的情况下,将所述第一显示窗口恢复至原位置显示,所述原位置是指未执行所述第一操作前所述第一显示窗口的 显示位置。When it is determined that the data communication between the first device and the second device has terminated, the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
在本申请实施例中,若检测到第一操作,则可以确认用户想将第一显示窗口中的第一设备的窗口显示数据显示于第二显示窗口对应的第二设备中。为此,确定第一显示窗口对应的第一设备信息以及第二显示窗口对应的第二设备信息,基于第一设备信息和第二设备信息,控制第一设备和第二设备进行数据通信,以通过该数据通信使得第一设备的窗口显示数据能够显示于第二设备中。如此,在第一设备和第二设备均连接于目标设备的情况下,用户可以通过在目标设备上进行第一操作,使得目标设备控制第一设备与第二设备进行数据通信,以将第一设备的窗口显示数据显示于第二设备中,提高了操作的便捷性。In the embodiment of the present application, if the first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, determine the first device information corresponding to the first display window and the second device information corresponding to the second display window, and control the first device and the second device to perform data communication based on the first device information and the second device information, so as to Through the data communication, the window display data of the first device can be displayed in the second device. In this way, when both the first device and the second device are connected to the target device, the user may perform the first operation on the target device, so that the target device controls the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
图26是本申请实施例提供的一种设备之间的数据通信装置的结构框图,配置于上述第一设备中,为了便于说明,仅示出了与本申请实施例相关的部分。FIG. 26 is a structural block diagram of an apparatus for data communication between devices provided by an embodiment of the present application, which is configured in the above-mentioned first device. For ease of description, only parts related to the embodiment of the present application are shown.
请参考图26,该装置包括:Please refer to Figure 26, the device includes:
响应模块2610,用于响应于目标指示消息,与所述第二设备建立直接或间接的数据通信连接,通过所述数据通信将所述第一设备的窗口显示数据显示于所述第二设备中;A response module 2610, configured to establish a direct or indirect data communication connection with the second device in response to the target indication message, and display the window display data of the first device in the second device through the data communication ;
其中,所述目标指示消息包括所述目标设备在检测第一操作后发送的指示消息,和/或,所述目标设备在检测所述第一操作后指示所述第二设备发送的指示消息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作。Wherein, the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation, The first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
在本申请实施例中,若目标设备检测到第一操作,则可以确认用户想将第一显示窗口中的第一设备的窗口显示数据显示于第二显示窗口对应的第二设备中。为此,目标设备指示第一设备与第二设备之间建立直接或间接的数据通信连接,使得第一设备通过数据通信将第一设备的窗口显示数据显示于第二设备中。如此,在第一设备和第二设备均连接于目标设备的情况下,用户可以通过在目标设备上进行第一操作,使得目标设备控制第一设备与第二设备进行数据通信,以将第一设备的窗口显示数据显示于第二设备中,提高了操作的便捷性。In this embodiment of the present application, if the target device detects the first operation, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the target device instructs the first device to establish a direct or indirect data communication connection with the second device, so that the first device displays the window display data of the first device in the second device through data communication. In this way, when both the first device and the second device are connected to the target device, the user can perform the first operation on the target device to make the target device control the first device to perform data communication with the second device, so that the first The window display data of the device is displayed in the second device, which improves the convenience of operation.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述***中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used for illustration. In practical applications, the above-mentioned functions can be assigned to different functional units, Completion of modules means that the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit, and the above-mentioned integrated units may adopt hardware It can also be implemented in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above system, reference may be made to the corresponding process in the foregoing method embodiments, and details will not be repeated here.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts that are not detailed or recorded in a certain embodiment, refer to the relevant descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电硬件、或者计算机软件和电硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electrical hardware, or a combination of computer software and electrical hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
在本申请所提供的实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的***实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。In the embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the system embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质至少可以包括:能够将计算机程序代码携带到电子设备的任何实体或装置、记录介质、计算机存储器、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区,根据立法和专利实践,计算机可读介质不可以是电载波信号和电信信号。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the procedures in the methods of the above embodiments in the present application can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a computer-readable storage medium. The computer program When executed by a processor, the steps in the above-mentioned various method embodiments can be realized. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program codes to an electronic device, recording medium, computer memory, read-only memory (read-only memory, ROM), random access memory (random access) memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media. Such as U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.
最后应说明的是:以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。Finally, it should be noted that: the above is only a specific implementation of the application, but the scope of protection of the application is not limited thereto, and any changes or replacements within the technical scope disclosed in the application shall be covered by this application. within the scope of the application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims (15)

  1. 一种设备之间的数据通信方法,其特征在于,应用于目标设备,所述目标设备的屏幕显示区域内至少包括第一显示窗口和第二显示窗口,所述第一显示窗口和所述第二显示窗口中分别显示有不同设备的窗口显示数据,所述方法包括:A data communication method between devices, characterized in that it is applied to a target device, and the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window The window display data of different devices are respectively displayed in the two display windows, and the method includes:
    检测第一操作,确定所述第一显示窗口对应的第一设备的第一设备信息和所述第二显示窗口对应的第二设备的第二设备信息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述第一显示窗口开始至所述第二显示窗口结束的划线操作;Detecting a first operation, determining first device information of a first device corresponding to the first display window and second device information of a second device corresponding to the second display window, the first operation includes converting the first device to A line operation in which a display window is moved to the display area of the second display window or from the first display window to the end of the second display window;
    基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,以通过所述数据通信使得所述第一设备的窗口显示数据显示于所述第二设备中。Based on the first device information and the second device information, controlling data communication between the first device and the second device, so that the window of the first device displays data through the data communication in the second device.
  2. 根据权利要求1所述的方法,其特征在于,所述检测第一操作,包括:The method according to claim 1, wherein the detecting the first operation comprises:
    检测所述第一显示窗口被移动至所述第二显示窗口的显示区域内后释放,所述第一显示窗口与所述第二显示窗口的重叠面积大于面积阈值;或者,Release after detecting that the first display window is moved into the display area of the second display window, and the overlapping area of the first display window and the second display window is greater than an area threshold; or,
    检测以所述第一显示窗口为划线起点的划线操作,划线终点位于所述第二显示窗口的显示区域内,且划线起点与划线终点之间的直线距离处于预设距离范围内。Detecting a scribing operation with the first display window as the scribing start point, the scribing end point is located in the display area of the second display window, and the linear distance between the scribing start point and the scribing end point is within a preset distance range Inside.
  3. 根据权利要求1所述的方法,其特征在于,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:The method according to claim 1, wherein the controlling data communication between the first device and the second device based on the first device information and the second device information comprises:
    基于所述第二设备信息向所述第二设备发送携带有所述第一设备信息的第一指示消息,以及基于所述第一设备信息向所述第一设备发送第二指示消息;sending a first indication message carrying the first device information to the second device based on the second device information, and sending a second indication message to the first device based on the first device information;
    所述第一指示消息用于指示所述第二设备基于所述第一设备信息与所述第一设备建立通信连接,所述第二指示消息用于指示所述第一设备在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The first indication message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second indication message is used to indicate that the first device is communicating with the first device After establishing the communication connection, the two devices send the window display data of the first device to the second device for display.
  4. 根据权利要求1所述的方法,其特征在于,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:The method according to claim 1, wherein the controlling data communication between the first device and the second device based on the first device information and the second device information comprises:
    基于所述第一设备信息,向所述第一设备发送携带有所述第二设备信息的第三指示消息;Sending a third indication message carrying the second device information to the first device based on the first device information;
    所述第三指示消息用于指示所述第一设备基于所述第二设备信息与所述第二设备建立通信连接,以及在与所述第二设备建立通信连接后将所述第一设备的窗口显示数据发送至所述第二设备中显示。The third indication message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and after the communication connection with the second device is established, the first device's The window display data is sent to the second device for display.
  5. 根据权利要求1所述的方法,其特征在于,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:The method according to claim 1, wherein the controlling data communication between the first device and the second device based on the first device information and the second device information comprises:
    基于所述第一设备信息和所述第二设备信息,将所述第一设备的窗口显示数据实时转发给所述第二设备。Based on the first device information and the second device information, forward the window display data of the first device to the second device in real time.
  6. 根据权利要求1-5中任一项所述的方法,其特征在于,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信之前,还包括:The method according to any one of claims 1-5, wherein, based on the information of the first device and the information of the second device, controlling the communication between the first device and the second device Before data communication, also include:
    显示问询窗口,所述问询窗口包括问询信息,所述问询信息用于指示基于所述问 询窗口确认是否将所述第一设备的窗口显示数据显示于所述第二设备中;displaying an inquiry window, the inquiry window including inquiry information for indicating whether to display the window display data of the first device in the second device based on the inquiry window;
    所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信,包括:The controlling the data communication between the first device and the second device based on the first device information and the second device information includes:
    基于所述问询窗口接收确认指令,执行所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信的操作。Based on the inquiry window receipt confirmation instruction, perform the operation of controlling data communication between the first device and the second device based on the first device information and the second device information.
  7. 根据权利要求1-6中任一项所述的方法,其特征在于,所述基于所述第一设备信息和所述第二设备信息,控制所述第一设备与所述第二设备之间进行数据通信之后,还包括:The method according to any one of claims 1-6, wherein, based on the information of the first device and the information of the second device, controlling the communication between the first device and the second device After data communication, it also includes:
    在确定所述第一设备成功将所述第一设备的窗口显示数据发送至所述第二设备中显示的情况下,在所述第二显示窗口中叠加显示所述第一显示窗口。In a case where it is determined that the first device successfully sends the window display data of the first device to the second device for display, superimposing and displaying the first display window in the second display window.
  8. 根据权利要求7所述的方法,其特征在于,所述方法还包括:The method according to claim 7, wherein the method further comprises:
    检测所述第一操作,获取所述第一显示窗口的快照,得到第一快照;Detecting the first operation, acquiring a snapshot of the first display window, and obtaining a first snapshot;
    对所述第一快照进行透明化处理,得到第二快照;performing transparent processing on the first snapshot to obtain a second snapshot;
    在所述第一显示窗口的原位置处显示所述第二快照,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation is performed.
  9. 根据权利要求7所述的方法,其特征在于,所述在所述第二显示窗口中叠加显示所述第一显示窗口之后,还包括:The method according to claim 7, characterized in that, after the superimposed display of the first display window in the second display window, further comprising:
    检测第二操作,控制所述第一设备与所述第二设备终止数据通信,所述第二操作包括将所述第一显示窗口从所述第二显示窗口的显示区域移动出后释放或者从所述第一显示窗口开始至指定区域结束的划线操作,所述指定区域不包括所述第一显示窗口所在区域和所述第二显示窗口所在区域。Detecting a second operation, controlling the first device to terminate data communication with the second device, the second operation includes moving the first display window out of the display area of the second display window and then releasing it or A line marking operation from the beginning of the first display window to the end of the specified area, where the specified area does not include the area where the first display window is located and the area where the second display window is located.
  10. 根据权利要求9所述的方法,其特征在于,所述控制所述第一设备与所述第二设备终止数据通信,包括:The method according to claim 9, wherein the controlling the first device to terminate data communication with the second device comprises:
    向所述第一设备发送终止指示消息,所述终止指示消息用于指示终止向所述第二设备发送所述第一设备的窗口显示数据。sending a termination indication message to the first device, where the termination indication message is used to indicate termination of sending the window display data of the first device to the second device.
  11. 根据权利要求9所述的方法,其特征在于,所述控制所述第一设备与所述第二设备终止数据通信之后,还包括:The method according to claim 9, characterized in that after the control of the first device and the second device to terminate data communication, further comprising:
    在确定所述第一设备与所述第二设备已终止数据通信的情况下,将所述第一显示窗口恢复至原位置显示,所述原位置是指未执行所述第一操作前所述第一显示窗口的显示位置。When it is determined that the data communication between the first device and the second device has terminated, the first display window is restored to the original position for display, and the original position refers to the The display position of the first display window.
  12. 一种设备之间的数据通信方法,其特征在于,应用于第一设备,所述第一设备的窗口显示数据显示在目标设备的屏幕显示区域的第一显示窗口内,所述目标设备的屏幕显示区域内还包括第二显示窗口,所述第二显示窗口中显示有第二设备的窗口显示数据,所述方法包括:A data communication method between devices, characterized in that it is applied to a first device, the window display data of the first device is displayed in the first display window of the screen display area of the target device, and the screen of the target device The display area also includes a second display window, the second display window displays window display data of the second device, and the method includes:
    响应于目标指示消息,与所述第二设备建立直接或间接的数据通信连接,通过所述数据通信将所述第一设备的窗口显示数据显示于所述第二设备中;Responding to the target indication message, establish a direct or indirect data communication connection with the second device, and display the window display data of the first device in the second device through the data communication;
    其中,所述目标指示消息包括所述目标设备在检测第一操作后发送的指示消息,和/或,所述目标设备在检测所述第一操作后指示所述第二设备发送的指示消息,所述第一操作包括将所述第一显示窗口移动至所述第二显示窗口的显示区域或者从所述 第一显示窗口开始至所述第二显示窗口结束的划线操作。Wherein, the target indication message includes an indication message sent by the target device after detecting the first operation, and/or, the target device instructs the second device to send an indication message after detecting the first operation, The first operation includes moving the first display window to the display area of the second display window or a drawing operation from the first display window to the end of the second display window.
  13. 一种电子设备,包括触摸屏,存储器,一个或多个处理器,多个应用程序,以及一个或多个程序;其中所述一个或多个程序被存储在所述存储器中;其特征在于,所述一个或多个处理器在执行所述一个或多个程序时,使得所述电子设备实现如权利要求1至11中任一项所述的方法,或者,实现如权利要求12所述的方法。An electronic device, comprising a touch screen, a memory, one or more processors, multiple application programs, and one or more programs; wherein the one or more programs are stored in the memory; it is characterized in that the When the one or more processors execute the one or more programs, the electronic device realizes the method according to any one of claims 1 to 11, or realizes the method according to claim 12 .
  14. 一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,其特征在于,当其在计算机上运行时,使得计算机执行权利要求1-11任一项所述的方法,或者,执行权利要求12所述的方法。A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, which is characterized in that, when it is run on a computer, it causes the computer to execute the method described in any one of claims 1-11, or, The method of claim 12 is performed.
  15. 一种包含指令的计算机程序产品,其特征在于,当其在计算机上运行时,使得计算机执行权利要求1-11任一项所述的方法,或者,执行权利要求12所述的方法。A computer program product containing instructions, characterized in that, when it is run on a computer, it causes the computer to execute the method according to any one of claims 1-11, or to execute the method according to claim 12.
PCT/CN2022/090301 2021-08-20 2022-04-29 Data communication method between devices, device, storage medium, and program product WO2023020012A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110966346.7 2021-08-20
CN202110966346.7A CN113805825B (en) 2021-08-20 2021-08-20 Method for data communication between devices, device and readable storage medium

Publications (1)

Publication Number Publication Date
WO2023020012A1 true WO2023020012A1 (en) 2023-02-23

Family

ID=78893855

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/090301 WO2023020012A1 (en) 2021-08-20 2022-04-29 Data communication method between devices, device, storage medium, and program product

Country Status (2)

Country Link
CN (2) CN113805825B (en)
WO (1) WO2023020012A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113805825B (en) * 2021-08-20 2022-09-23 荣耀终端有限公司 Method for data communication between devices, device and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6292204B1 (en) * 1993-09-28 2001-09-18 Ncr Corporation Method and apparatus for display of video images in a video conferencing system
CN102595239A (en) * 2012-02-24 2012-07-18 深圳创维-Rgb电子有限公司 Multi-screen interactive method, device and intelligent television for terminal system
CN108174268A (en) * 2017-12-27 2018-06-15 深圳Tcl数字技术有限公司 Data copying method, equipment, system and readable storage medium storing program for executing based on TV
CN111813363A (en) * 2020-07-15 2020-10-23 锐捷网络股份有限公司 Information sharing method, device, medium and equipment
CN113805825A (en) * 2021-08-20 2021-12-17 荣耀终端有限公司 Method, device, storage medium, and program product for data communication between devices

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102085181B1 (en) * 2013-10-23 2020-03-05 삼성전자주식회사 Method and device for transmitting data and method and device for receiving data
CN104331230A (en) * 2014-11-24 2015-02-04 联想(北京)有限公司 Information processing method and electronic equipment
CN105530153B (en) * 2015-12-11 2019-02-05 上海新时达电气股份有限公司 Slave equipment communication means, communication network, main equipment in network and from equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6292204B1 (en) * 1993-09-28 2001-09-18 Ncr Corporation Method and apparatus for display of video images in a video conferencing system
CN102595239A (en) * 2012-02-24 2012-07-18 深圳创维-Rgb电子有限公司 Multi-screen interactive method, device and intelligent television for terminal system
CN108174268A (en) * 2017-12-27 2018-06-15 深圳Tcl数字技术有限公司 Data copying method, equipment, system and readable storage medium storing program for executing based on TV
CN111813363A (en) * 2020-07-15 2020-10-23 锐捷网络股份有限公司 Information sharing method, device, medium and equipment
CN113805825A (en) * 2021-08-20 2021-12-17 荣耀终端有限公司 Method, device, storage medium, and program product for data communication between devices

Also Published As

Publication number Publication date
CN113805825B (en) 2022-09-23
CN113805825A (en) 2021-12-17
CN115708059A (en) 2023-02-21

Similar Documents

Publication Publication Date Title
US11989482B2 (en) Split-screen projection of an image including multiple application interfaces
US11922005B2 (en) Screen capture method and related device
US11669242B2 (en) Screenshot method and electronic device
EP4024193A1 (en) Data transmission method and related devices
WO2020052529A1 (en) Method for quickly adjusting out small window in fullscreen display during video, graphic user interface and terminal
CN113885759B (en) Notification message processing method, device, system and computer readable storage medium
US20230046708A1 (en) Application Interface Interaction Method, Electronic Device, and Computer-Readable Storage Medium
CN115629730A (en) Display method and related device
WO2020156230A1 (en) Method for presenting video on electronic device when incoming call comes, and electronic device
WO2022017393A1 (en) Display interaction system, display method, and device
JP2022547572A (en) callback stream processing method and device
WO2022042326A1 (en) Display control method and related apparatus
WO2021143391A1 (en) Video call-based screen sharing method and mobile device
WO2022143180A1 (en) Collaborative display method, terminal device, and computer readable storage medium
WO2022063159A1 (en) File transmission method and related device
US20230236714A1 (en) Cross-Device Desktop Management Method, First Electronic Device, and Second Electronic Device
CN115016697A (en) Screen projection method, computer device, readable storage medium, and program product
WO2021190524A1 (en) Screenshot processing method, graphic user interface and terminal
CN114185503B (en) Multi-screen interaction system, method, device and medium
WO2023020012A1 (en) Data communication method between devices, device, storage medium, and program product
WO2022002213A1 (en) Translation result display method and apparatus, and electronic device
WO2024012346A1 (en) Task migration method, electronic device, and system
WO2023020528A1 (en) Mirroring method, device, storage medium, and computer program product
WO2024067037A1 (en) Service calling method and system, and electronic device
WO2023116411A1 (en) Management method for application card, electronic device, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22857330

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE