WO2022161128A1 - 一种组合显示方法、移动设备及电子设备 - Google Patents

一种组合显示方法、移动设备及电子设备 Download PDF

Info

Publication number
WO2022161128A1
WO2022161128A1 PCT/CN2022/070384 CN2022070384W WO2022161128A1 WO 2022161128 A1 WO2022161128 A1 WO 2022161128A1 CN 2022070384 W CN2022070384 W CN 2022070384W WO 2022161128 A1 WO2022161128 A1 WO 2022161128A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
display screen
information
display
message
Prior art date
Application number
PCT/CN2022/070384
Other languages
English (en)
French (fr)
Inventor
周鼎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022161128A1 publication Critical patent/WO2022161128A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/16Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor

Definitions

  • the present application relates to the field of communications, and in particular, to a combined display method, a mobile device, and an electronic device.
  • an electronic device with a larger display screen size will bring a better visual impact to the user and a better user experience when in use, compared to an electronic device with a smaller display screen size.
  • electronic devices with larger display sizes are limited in manufacturing technology and cost significantly higher.
  • the present application provides a combined display method, a mobile device and an electronic device.
  • the technical solution provided by this application does not require a dedicated split-screen device; in addition, in a wireless manner, complex wiring between different electronic devices is also not required; since the split-screen device and the wiring between different electronic devices are no longer used, the cost It is also reduced; and, a combined display of multiple different electronic devices is realized.
  • a combined display system in a first aspect, includes a mobile device located in the same local area network, a first electronic device and a second electronic device, the first electronic device includes a first display screen, the second electronic device includes a second display screen; the mobile device is used for responding to The received first input broadcasts a first message; the first message is used to indicate that the display is to be combined; the first electronic device is used to display the first message through the first display screen in response to the received first message information; the first information is used to indicate the address information of the first electronic device; the second electronic device is used to display the second information through the second display screen in response to the received first message; the second electronic device The information is used to indicate the address information of the second electronic device; the mobile device is also used to obtain a first image, and the first image includes the first display screen and the second display screen; the first display screen displays the first display screen.
  • the second display screen displays the second message
  • the mobile device is further used to select the first electronic device corresponding to the first display screen as a master control device, and send a second message to the first electronic device
  • the second message includes the first information obtained by the mobile device according to the first image, the second information, the orientation information between the first display screen and the second display screen, the first information and the The corresponding relationship of the first display screen; the second message is also used to indicate that the first electronic device is selected as the main control device; the first electronic device is also used to respond to the received second message, control the first electronic device A display screen and the second display screen are combined for display.
  • sending the first message by the mobile device triggers the first electronic device to display the first information for indicating its address information and the second electronic device to display the second information for indicating its address information.
  • the mobile device can determine the orientation information and address information of the first electronic device and the second electronic device.
  • the mobile device can indicate the orientation information and address information of the first electronic device and the second electronic device to the first electronic device, so that the first electronic device can control the first electronic device and the second electronic device to perform combined display.
  • the mobile device may only send the first image to the first electronic device; the first electronic device obtains the first information, the second information, and the relationship between the first display screen and the second display screen according to the first image. The corresponding relationship between the orientation information, the first information and the first display screen.
  • the first electronic device may determine that it is the selected master control device according to whether it is the first image sent to itself. Other embodiments of the present application may also adopt this optional manner.
  • the first information, the second information, the orientation information between the first display screen and the second display screen, and the corresponding relationship between the first information and the first display screen may be determined by The second message is carried; the information used to indicate that the first electronic device is selected as the master device may be carried by a third message, and the second message and the third message are different messages.
  • the second message further includes a correspondence between the second information and the second display screen.
  • selecting the first electronic device corresponding to the first display screen to be the main control device includes: the mobile device receives an electronic device corresponding to the first display screen. User selection of the first electronic device; in response to the user selection, the mobile device records the first electronic device as a master device. In this way, it is convenient for a user to select one electronic device from a plurality of electronic devices as a master control device, and the master control device controls a plurality of combined display electronic devices to perform image display.
  • selecting the first electronic device corresponding to the first display screen as a master control device includes: the mobile device randomly selecting the first electronic device corresponding to the first display screen The first electronic device is the main control device.
  • the first electronic device and the second electronic device are further configured to maintain the first state after being turned on until the time after turning on the device reaches a preset time, and the receiving to the second message, or to receive a notification message, or to stop a message; in the first state, the first electronic device and the second electronic device are configured to, after receiving the first message of the mobile device, pass The first display screen and the second display screen display the first information and the second information; the first electronic device is further configured to send the second message to the second electronic device after receiving the second message of the mobile device a notification message, the notification message is used to instruct the second electronic device to stop being in the first state; the second electronic device is also used to enter the second state after receiving the notification message; in the second state, The second electronic device is only controlled by the main control device; the second electronic device is further configured to not display the second information through the second display screen after receiving the stop message.
  • the first state is a state to be discovered.
  • the controlling the first electronic device and the second electronic device to display in combination includes: the first electronic device receives an image frame to be displayed, according to the The orientation information and size ratio of the first display screen and the second display screen, as well as the size of the first display screen, the image frame is divided to obtain the first part of the image and the second part of the image, on the first display screen Displaying the first partial image, sending the second partial image to the second electronic device, and instructing to display the second partial image on the second display screen.
  • the size of the first display screen can be obtained by the first electronic device itself; the first electronic device can obtain the size of the second display screen according to the size ratio relationship between the first display screen and the second display screen.
  • the orientation information of the first display screen and the second display screen may be the relative positional relationship between the first display screen and the second display screen.
  • the image frame is processed according to the orientation information and size ratio relationship of the first display screen and the second display screen, as well as the size of the first display screen.
  • the dividing includes: dividing the image frame according to the orientation information of the first display screen and the second display screen, the size of the first display screen and the size of the second display screen.
  • the image frame comes from screen projection data of the mobile device.
  • the mobile device is specifically configured to: before acquiring the first image, prompt to take a picture of the first display screen and the second display screen that need to be displayed in combination; The first image is acquired in response to the detected photographing operation on the first display screen and the second display screen.
  • the first information is used to indicate the MAC address of the medium access control layer of the first electronic device
  • the second information is used to indicate the MAC address of the second electronic device MAC address.
  • a combined display method is provided, and the method is applied to a mobile device.
  • the mobile device, the first electronic device and the second electronic device are located in the same local area network, the first electronic device includes a first display screen, and the second electronic device includes a second display screen; the method includes: receiving a first input; In response to the first input, broadcast a first message; the first message is used to indicate that the display is to be combined; a first image is acquired, the first image includes the first display screen and the second display screen; the first display The screen displays the first information; the second display screen displays the second information; the first information is used to indicate the address information of the first electronic device; the second information is used to indicate the address information of the second electronic device; Select the first electronic device corresponding to the first display screen as the master device, and send a second message to the first electronic device; the second message includes the first information obtained by the mobile device according to the first image , the second information, the orientation information between the first display screen and the second display screen, the corresponding relationship between the first information and
  • selecting the first electronic device corresponding to the first display screen to be the master control device includes: the mobile device receives an electronic device corresponding to the first display screen. User selection of the first electronic device; in response to the user selection, the mobile device records the first electronic device as the master device.
  • selecting the first electronic device corresponding to the first display screen as a master control device includes: the mobile device randomly selecting the first electronic device corresponding to the first display screen The first electronic device is the main control device.
  • the image frame comes from screen projection data of the mobile device.
  • the first information is used to indicate the MAC address of the medium access control layer of the first electronic device
  • the second information is used to indicate the MAC address of the second electronic device. MAC address.
  • a combined display method is provided, the method is applied to a first electronic device; the first electronic device, the second electronic device and the mobile device are located in the same local area network, the first electronic device includes a first display screen, The second electronic device includes a second display screen; the method includes: the first electronic device receives a first message, the first message is used to indicate that the display is to be combined; in response to the received first message, the first message The display screen displays first information; the first information is used to indicate the address information of the first electronic device; the first electronic device receives a second message sent by the mobile device, and the second message includes the mobile device according to the first information.
  • the method before the first electronic device receives the first message, the method further includes: the first electronic device maintains the first state after the first electronic device is turned on until after the first electronic device is turned on. The duration reaches the preset duration or the second message is received; in the first state, the first electronic device is configured to display the first message through the first display screen after receiving the first message from the mobile device information.
  • the method further includes: after receiving the second message of the mobile device, the first electronic device sends a notification message to the second electronic device, the notification message The message is used to instruct the second electronic device to stop being in the first state.
  • the first electronic device controls the first display screen and the second display screen to display in combination; including: the first electronic device receives an image to be displayed frame, according to the orientation information and size ratio relationship of the first display screen and the second display screen, as well as the size of the first display screen, divide the image frame to obtain the first partial image and the second partial image.
  • the first partial image is displayed on a display screen
  • the second partial image is sent to the second electronic device
  • the second partial image is indicated on the second display screen.
  • the first information is used to indicate the MAC address of the medium access control layer of the first electronic device
  • the second information is used to indicate the MAC address of the second electronic device. MAC address.
  • a mobile device comprising: one or more processors, one or more memories, and one or more computer programs; the one or more computer programs are stored in the memory, and when the mobile device When running, the processor executes one or more computer programs stored in the memory to cause the mobile device to perform the method described in any one of the second aspects above.
  • an electronic device comprising: one or more processors, one or more memories, and one or more computer programs; the one or more computer programs are stored in the memory, and when the electronic device When running, the processor executes one or more computer programs stored in the memory, so that the electronic device executes the method described in any one of the third aspects above.
  • the present application provides a computer storage medium, comprising computer instructions, when the computer instructions are executed on a mobile device, the mobile device causes the mobile device to perform the method described in any one of the second aspects; or, when the computer instructions are in When running on the electronic device, the electronic device is caused to perform the method according to any one of the third aspects.
  • the present application provides a computer program product that, when the computer program product runs on a mobile device, causes the mobile device to execute the method described in any one of the second aspects; or, when the computer program product is run on an electronic device When running on the device, the electronic device is caused to perform the method according to any one of the third aspects.
  • FIG. 1 is a schematic diagram of a scene of a combined display method provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a hardware structure of a mobile device provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a combined display method provided by an embodiment of the present application.
  • FIG. 5 is another schematic flowchart of the combined display method provided by the embodiment of the present application.
  • FIG. 6 is another schematic flowchart of the combined display method provided by the embodiment of the present application.
  • FIG. 7 is another schematic flowchart of the combined display method provided by the embodiment of the present application.
  • FIG. 8 is another schematic flowchart of the combined display method provided by the embodiment of the present application.
  • Fig. 10 is another group of graphical user interfaces provided by the embodiment of the present application.
  • FIG. 11 is another group of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 12 is another group of graphical user interfaces provided by the embodiment of the present application.
  • Fig. 13 is another group of graphical user interfaces provided by the embodiment of the present application.
  • FIG. 14 is another set of graphical user interfaces provided by the embodiments of the present application.
  • 15 is a schematic structural diagram of a mobile device provided by an embodiment of the present application.
  • FIG. 16 is a schematic structural composition diagram of an electronic device provided by an embodiment of the present application.
  • references in this specification to "one embodiment” or “some embodiments” and the like mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • the term “connected” includes both direct and indirect connections unless otherwise specified. "First” and “second” are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the number of indicated technical features.
  • words such as “exemplarily” or “for example” are used to represent examples, illustrations or illustrations. Any embodiment or design described in the embodiments of the present application as “exemplarily” or “such as” should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as “exemplarily” or “such as” is intended to present the related concepts in a specific manner.
  • an electronic device with a larger display screen size will bring a better visual impact to the user and a better user experience when in use, compared to an electronic device with a smaller display screen size.
  • electronic devices with larger display sizes are limited in manufacturing technology and cost significantly higher.
  • the joint display of multiple electronic devices with smaller display screen sizes can be realized, so that audiences far away can also Feel a better display effect, or achieve the same display effect as an electronic device with a larger display screen.
  • this requires complicated wiring and a dedicated screen splitting device (eg, a screen splitter) to control the combination and image display of different display screens of different electronic devices, thereby increasing the hardware cost. Therefore, how to realize the combined display of the above-mentioned multiple different electronic devices by using different electronic devices with smaller display screen size under the premise of reducing the hardware cost has become a technical problem to be solved.
  • the present application provides a combined display method, a mobile device, an electronic device and a combined display system.
  • the technical solution provided by this application does not require a dedicated split-screen device; in addition, in a wireless manner, complex wiring between different electronic devices is also not required; since the split-screen device and the wiring between different electronic devices are no longer used, the cost It is also reduced; and, a combined display of multiple different electronic devices is realized.
  • FIG. 1 shows a scenario of a combined display method provided by an embodiment of the present application.
  • the mobile device 100 and multiple electronic devices eg, electronic device 200 , electronic device 201 , electronic device 202 , etc.
  • the mobile device 100 may send a broadcast message to the plurality of electronic devices, where the broadcast message is used to instruct the plurality of electronic devices in the local area network to enter the combined display state.
  • a plurality of electronic devices may display information indicating their addresses on their respective display screens.
  • the mobile device 100 can determine the orientation information of each electronic device in the plurality of electronic devices and the address information of each electronic device through the first image information.
  • the mobile device 100 may send indication information to a certain electronic device (for example, the electronic device 200 ) among the plurality of electronic devices, where the indication information is used to indicate the orientation information of each electronic device among the plurality of electronic devices and the location information of each electronic device. Address information.
  • the electronic device 200 that has received the instruction information can divide the image information to be displayed according to the instruction information, so as to display part of the image information through the display screen of the electronic device 200 and send the other part of the image information to other electronic devices.
  • the mobile devices in the embodiments of the present application include, but are not limited to, smart phones, tablet computers, wearable electronic devices with wireless communication functions (eg, smart watches, smart bracelets, smart rings, smart glasses), and the like.
  • Exemplary embodiments of mobile devices include, but are not limited to, piggybacks Portable electronic devices with Windows, Linux, or other operating systems.
  • the above-mentioned mobile device may also be other portable devices, such as a laptop computer (Laptop) or the like. It should also be understood that, in some other embodiments, the above-mentioned mobile device may not be a portable device, but a desktop computer.
  • FIG. 2 shows the hardware structure of the mobile device 100 provided by this embodiment of the present application.
  • the mobile device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the mobile device 100 .
  • the mobile device 100 may include more or less components than shown, or some components may be combined, or some components may be split, or different component arrangements.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the wireless communication function of the mobile device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in mobile device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the mobile device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the mobile device 100 may send a broadcast message through the wireless communication module 160, and the broadcast message is used for the electronic device in the local area network to enter the combined display state.
  • the mobile device 100 may also send indication information to the electronic device 200 through the wireless communication module 160, where the indication information is used to indicate the position information of each electronic device and the address information of each electronic device in the plurality of electronic devices.
  • the antenna 1 of the mobile device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the mobile device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • global positioning system global positioning system, GPS
  • global navigation satellite system global navigation satellite system, GLONASS
  • Beidou navigation satellite system beidou navigation satellite system, BDS
  • quasi-zenith satellite system quadsi -zenith satellite system, QZSS
  • SBAS satellite based augmentation systems
  • the mobile device 100 can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile device 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • the mobile device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • FIG. 3 shows the hardware structure of the electronic device 200 provided by this embodiment of the present application.
  • the electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charge management module 240, a power management module 241, a battery 242, an antenna 3, wireless communication Module 250, sensor module 260, input module 270, output module 280, display screen 290, etc.
  • a processor 210 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charge management module 240, a power management module 241, a battery 242, an antenna 3, wireless communication Module 250, sensor module 260, input module 270, output module 280, display screen 290, etc.
  • USB universal serial bus
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 200 .
  • the electronic device 200 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the electronic device 200 may be a smart light, a smart TV, a smart speaker, and the like.
  • Processor 210 may include one or more processing units.
  • the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video Codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc.
  • application processor application processor
  • AP application processor
  • modem processor graphics processor
  • image signal processor image signal processor
  • ISP image signal processor
  • controller a video Codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural-network processing unit neural-network processing unit
  • NPU neural-network processing unit
  • different processing units may be independent components, or may be integrated in one or more processors.
  • electronic device 200 may also include one or more processors 210 .
  • the controller can generate an operation control signal according to the instruction operation code and
  • the processor 210 may include one or more interfaces.
  • the interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM card interface, and/or USB interface, etc.
  • the USB interface 230 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 230 can be used to connect a charger to charge the electronic device 200, and can also be used to transmit data between the electronic device 200 and peripheral devices.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 200 .
  • the electronic device 200 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 240 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 240 may receive charging input from the wired charger through the USB interface 230 .
  • the charging management module 240 may receive wireless charging input through the wireless charging coil of the electronic device 200 . While the charging management module 240 charges the battery 242 , the power management module 241 can also supply power to the electronic device.
  • the power management module 241 is used to connect the battery 242 , the charging management module 240 and the processor 210 .
  • the power management module 241 receives input from the battery 242 and/or the charging management module 240, and supplies power to the processor 210, the internal memory 221, the external memory interface 220, the wireless communication module 250, and the like.
  • the power management module 241 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance).
  • the power management module 241 may also be provided in the processor 210 .
  • the power management module 241 and the charging management module 240 may also be provided in the same device.
  • the wireless communication function of the electronic device 200 may be implemented by the antenna 3 and the wireless communication module 250 and the like.
  • the wireless communication module 250 may provide wireless communication solutions including Wi-Fi, Bluetooth (BT), and wireless data transmission modules (eg, 433MHz, 868MHz, 915MHz) applied to the electronic device 200 .
  • the wireless communication module 250 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 250 receives electromagnetic waves via the antenna 3 , filters and frequency modulates the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 250 can also receive the signal to be sent from the processor 210 , perform frequency modulation on the signal, amplify the signal, and then convert it into an electromagnetic wave for radiation through the antenna 3 .
  • the electronic device 200 may receive the broadcast message sent by the mobile device 100 through the wireless communication module. In response to receiving the broadcast message sent by the mobile device 100 , the electronic device 200 may display information indicating the address of the electronic device 200 through the display screen 290 . The electronic device 200 can also receive the indication information sent by the mobile device 100 through the wireless communication module, where the indication information is used to indicate the orientation information of each electronic device and the address information of each electronic device in the plurality of electronic devices.
  • the external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200.
  • the external memory card communicates with the processor 210 through the external memory interface 220 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 221 may be used to store one or more computer programs including instructions.
  • the processor 210 may execute the above-mentioned instructions stored in the internal memory 221, thereby causing the electronic device 200 to execute the automatic unlocking method, various applications and data processing provided in some embodiments of the present application.
  • the internal memory 221 may include a code storage area and a data storage area. Among them, the code storage area can store the operating system.
  • the data storage area may store data and the like created during the use of the electronic device 200 .
  • the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage components, flash memory components, universal flash storage (UFS), and the like.
  • the processor 210 may cause the electronic device 200 to execute the instructions provided in the embodiments of the present application by executing the instructions stored in the internal memory 221 and/or the instructions stored in the memory provided in the processor 210 . Combining display methods, and other applications and data processing.
  • the input module 270 includes, but is not limited to, a keyboard, a touch screen (which may also be a touch display screen), a mouse, a camera, a laser pointer, a handwriting input pad, a microphone, and the like.
  • the microphone includes a single microphone, and also includes a microphone array.
  • the output module 280 includes, but is not limited to, a display screen, an LED light, a speaker, an earphone, a motor that generates vibration and its auxiliary devices, a heating device that generates heat, and the like.
  • the electronic device 200 includes, but is not limited to, a tablet computer, a desktop computer, a portable electronic device (such as a laptop computer, Laptop), a smart TV (such as a smart screen), a car computer, an augmented reality (AR) device, a virtual reality ( virtual reality, VR) devices, other smart devices with displays, etc.
  • exemplary embodiments of electronic devices include, but are not limited to, onboard Portable or non-portable electronic devices with Linux or other operating systems.
  • FIG. 4 shows a schematic flow of a combined display method provided by an embodiment of the present application.
  • the combined display method includes:
  • the mobile device 100 In response to receiving the first input, the mobile device 100 sends a broadcast message, where the broadcast message is used to instruct the electronic devices in the local area network to enter a combined display state.
  • electronic device 200 - electronic device 203 may be in a state to be discovered.
  • the mobile device may search for electronic devices to be discovered in the local area network, so as to prompt the user to perform screen projection on the electronic device 200 to the electronic device 203 .
  • the mobile phone, smart TV 1, smart TV 2, smart TV 3 and smart TV 4 are located in the same local area network, and the mobile phone displays a video playback interface, which includes a video display window 901 and a projection screen.
  • On-screen controls 902. Smart TV 1, Smart TV 2, Smart TV 3, and Smart TV 4 are in a state to be discovered.
  • the cell phone can display a GUI as shown in (b) of FIG. 9 .
  • the mobile phone can display a prompt box 903, wherein the prompt box 903 includes the device information of the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 in the to-be-discovered state in the local area network .
  • the electronic device 200 - the electronic device 203 may enter the to-be-discovered state when detecting the user's power-on operation.
  • the electronic device 200 to the electronic device 203 may also be in a to-be-discovered state within a preset period of time (for example, 10 minutes) after the user's power-on operation is detected.
  • the mobile device when the mobile device detects the first operation of the user, the mobile device sends the broadcast message to the devices in the local area network.
  • the mobile phone when the mobile phone detects that the user clicks on the control 1002, the mobile phone can send the broadcast message to the devices in the local area network.
  • the mobile phone when the mobile phone detects that the user clicks on the control 1102, the mobile phone can send the broadcast message to the devices in the local area network.
  • the broadcast message is used to instruct the electronic devices in the local area network to enter the combined display state, that is, to instruct the electronic devices in the local area network to perform combined display;
  • the displays form a larger display.
  • the broadcast message may be a user datagram protocol (user datagram protocol, UDP) data packet.
  • a UDP packet includes the data portion of an IP datagram.
  • the data portion of an IP datagram may include extensible bits.
  • the electronic device 200 - the electronic device 203 may agree with the mobile device 100 on the content of a certain extensible bit. When a certain extensible bit is 1, the electronic device 200-electronic device 203 can know that the mobile device 100 wants it to enter the combined display state.
  • both devices that support combined display eg, electronic device 200-electronic device 203
  • devices that do not support combined display eg, tablet, smart watch, speaker
  • a device that supports combined display can respond to the broadcast message after receiving the broadcast message sent by the mobile device 100 (for example, displaying address information through the display screen), and a device that does not support combined display can ignore the broadcast message after receiving the broadcast message. information.
  • the electronic device 200 in response to receiving the broadcast message, displays first information on the display screen, where the first information is used to indicate the address of the electronic device 200 .
  • the electronic device 201 in response to receiving the broadcast message, displays second information on the display screen, where the second information is used to indicate the address of the electronic device 201 .
  • the electronic device 202 in response to receiving the broadcast message, displays third information on the display screen, where the third information is used to indicate the address of the electronic device 202 .
  • the electronic device 203 in response to receiving the broadcast message, displays fourth information on the display screen, where the fourth information is used to indicate the address of the electronic device 203 .
  • the electronic device 200 takes the electronic device 200 to the electronic device 203 as smart TV 1, smart TV 2, smart TV 3, and smart TV 4 as an example.
  • the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 receive the broadcast message, they can display the two-dimensional code through their respective display screens. to indicate the MAC address.
  • each smart TV can also display its MAC address on the display screen.
  • smart TV 1 can display "3E-57-48-00" on the display screen. -F8-ED".
  • the mobile device acquires first image information in response to the received second input, where the first image information includes the display screen of the electronic device 200, the display screen of the electronic device 201, the display screen of the electronic device 202, and the display of the electronic device 203 Screen.
  • the first image information includes the display screen of the electronic device 200, and the display screen of the electronic device 200 displays the first information; the first image information includes the display screen of the electronic device 201, and the display screen of the electronic device 201 Display the second information; the first image information includes the display screen of the electronic device 202, and the display screen of the electronic device 202 displays the third information; the first image information includes the display screen of the electronic device 203, and the display screen of the electronic device 203 display fourth information;
  • the mobile device acquires the first image information when detecting that the user performs a photographing operation on the electronic device 200 to the electronic device 203 .
  • the mobile phone when the mobile phone detects that the user clicks on the control 1006, the mobile phone can obtain image information in the preview box, and the image information includes smart TV 1, smart TV 2, QR code information displayed on Smart TV 3 and Smart TV 4.
  • the first image information may include one frame or multiple frames of images.
  • the mobile device may prompt the user to take a picture of the electronic device to be displayed in combination to obtain one frame of image information, or the mobile device may also prompt the user to record a video of the electronic device to be displayed in combination to obtain multiple frames of image information.
  • images of several electronic devices are always located in the preview frame, and no images of other electronic devices are added to the preview frame. , to obtain the first image information.
  • the mobile device may further prompt the user to obtain image information including multiple electronic devices that need to be displayed in combination.
  • the electronic device 200-electronic device 203 may also send a response to the mobile device in response to receiving the broadcast message. If the mobile device receives responses from multiple electronic devices, the mobile device may prompt the user that multiple electronic devices are found in the local area network, and prompt the user whether to display the multiple electronic devices in combination. In response to the user determining the operation of performing combined display on multiple electronic screen devices in the local area network, the mobile device may prompt the user to obtain image information including the multiple electronic devices that need to be displayed in combination.
  • the mobile device determines, according to the first image information, the orientation information of each electronic device and the address information of each electronic device in the plurality of electronic devices.
  • the mobile device can determine the address information of the electronic device 200-electronic device 203 through the first information to the fourth information displayed on the display screens of the electronic device 200-electronic device 203, and can use the electronic device in the first image information to determine the address information of the electronic device 200-electronic device 203.
  • the location of the device 200 - the electronic device 203 determines the orientation information of the electronic device 200 - the electronic device 203 .
  • the mobile phone can determine that the address information of the upper left device (smart TV 1) is MAC address 1, and the address information of the upper right device (smart TV 2) is the MAC address. 2.
  • the address information of the lower left device (smart TV 3) is MAC address 3
  • the address information of the lower right device (smart TV 4) is MAC address 4.
  • the mobile device sends indication information to the electronic device 200, where the indication information is used to indicate the orientation information of each electronic device and the address information of each electronic device in the plurality of electronic devices.
  • the indication information may include the first information, the second information, the third information, the fourth information, orientation information between the display screen of the electronic device 200 and the display screen of the electronic device 203, The correspondence between the first information and the display screen of the electronic device 200 , the correspondence between the second information and the display screen of the electronic device 201 , the correspondence between the third information and the display screen of the electronic device 202 , and the correspondence between the fourth information and the display screen of the electronic device 203 . The corresponding relationship of the display screen.
  • the indication information may include the first information, the second information, the display screen of the electronic device 200 and the orientation of the display screen of the electronic device 201. Information and the corresponding relationship between the first information and the display screen of the electronic device 200 .
  • the mobile device may also send another indication information to the electronic device 200, where the other indication information is used to instruct the electronic device 200 to be the master device.
  • the indication information and the other indication information may be carried in the same message, or may be carried in different messages.
  • the mobile device may carry matrix information in the indication information, where the matrix information is used to indicate position information of each electronic device in the plurality of electronic devices and address information of each electronic device in the plurality of electronic devices.
  • the matrix information M carried in the indication information may be shown in formula (1):
  • the electronic device 200 can obtain the matrix M after receiving the indication information.
  • the MAC address 1 shown in the first row and the first column of the matrix M can indicate that the MAC address of the electronic device in the upper left is MAC address 1, and the first column of the matrix M is MAC address 1.
  • the MAC address 2 shown in the second row of the row and the second column may indicate that the MAC address of the electronic device at the upper right is MAC address 2, and the MAC address 3 shown in the second row and the first column of the matrix M may indicate the electronic device at the lower left.
  • the MAC address is MAC address 3, and the MAC address 4 shown in the second row and second column of the matrix M may indicate that the MAC address of the electronic device at the lower right is MAC address 4. Since the MAC address of the electronic device 200 is MAC address 1, the electronic device 200 can determine that it is located at the upper left of multiple electronic devices, and the electronic device 200 can also determine the orientation information and the MAC addresses of other electronic devices.
  • the mobile device when it determines that there are multiple electronic devices that need to be displayed in combination, it can arbitrarily select one electronic device (eg, the electronic device 200 ) and send indication information to the electronic device.
  • one electronic device eg, the electronic device 200
  • the electronic device 200 may prompt the user through the display screen that the electronic device 200 can control the electronic device 200-electronic device 203 to perform image information.
  • the mobile device may first determine whether the distribution of the plurality of electronic devices in the first image information is regular.
  • the mobile phone when the mobile phone detects that the user clicks on the control 1202, the mobile phone can acquire the first image information in the preview box.
  • the mobile phone can determine the orientation information and address information of the smart TV 1 to the smart TV 5 through the first image information. For example, the mobile phone can determine from the first image information that the MAC address of the electronic device at the uppermost left is MAC address 5; the MAC address of the electronic device at the upper middle is MAC address 1; the MAC address of the electronic device at the lower middle is MAC address 1 is MAC address 3; the MAC address of the electronic device at the uppermost right is MAC address 2; the MAC address of the electronic device at the lowermost right is MAC address 4.
  • the mobile phone can convert the orientation information and address information of the smart TV 1 to the smart TV 5 into a matrix N, and the matrix information N can be shown in formula (2):
  • the mobile phone can determine that the matrix N is an irregular matrix, so that the mobile phone can determine that the distribution of the smart TV 1 to the smart TV 5 is irregular.
  • the electronic device may prompt the user to select some electronic devices from the plurality of electronic devices for combined display.
  • the mobile phone when the mobile phone determines that the smart TV 1-smart TV 5 are irregularly distributed, the mobile phone can select the regular smart TV 1-smart TV 4 for the user to display in combination.
  • the mobile phone can prompt the user "It is detected that there are currently 5 electronic devices that need to be displayed in combination. In order to ensure the display effect of the image, it is recommended that you select the combined display of the devices in the dotted box".
  • the electronic device 200 controls the electronic device 200 to the electronic device 203 to display images according to the instruction information.
  • the mobile device may not send the indication information to the electronic device, but send the first image to the electronic device 200 .
  • the electronic device 200 can determine the first information, the second information, the third information, the fourth information, the display screen of the electronic device 200 - the display of the electronic device 203 according to the first image
  • the electronic device 200 may segment the image frame, and then control the electronic device 200 to the electronic device 203 to display images.
  • the mobile device may arbitrarily select an electronic device (for example, the electronic device 200 ) from multiple electronic devices and send the instruction information to the electronic device, or the mobile device may detect that the user has When the operation of the electronic device 200 is selected among the plurality of electronic devices, the instruction information is sent to the electronic device 200 .
  • FIG. 5 shows another schematic flow of the combined display method provided by the embodiment of the present application. As shown in Figure 5, the method includes:
  • the mobile device in response to determining the location information of each electronic device and the address information of each electronic device in the plurality of electronic devices, the mobile device prompts the user to select one electronic device (for example, electronic device 200) from the plurality of electronic devices as the master controller equipment.
  • one electronic device for example, electronic device 200
  • the main control device can be discovered by a device in the local area network (for example, a device that needs to perform screen projection), and the main control device can be used to display the image to be displayed.
  • the information is divided into images, and the plurality of electronic devices are controlled to display the divided image information respectively.
  • the mobile phone when the mobile phone detects that the user selects the electronic device whose MAC address is MAC address 1 and clicks the control 1008, the mobile phone can determine that the MAC address is the electronic device with MAC address 1. as the master device.
  • the mobile device sends the indication information to the electronic device 200 in response to the operation of the user selecting the electronic device 200 as the master control device.
  • FIG. 6 shows another schematic flow of the combined display method provided by the embodiment of the present application. As shown in Figure 6, the method includes:
  • the electronic device 200 in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 201 to turn off device discovery.
  • the electronic device 200 notifying the electronic device 201 to turn off device discovery includes: the electronic device 200 sends a notification message to the electronic device 201, where the notification message is used to instruct the electronic device 201 to stop being in the to-be-discovered state.
  • the electronic device 201 turns off device discovery.
  • the electronic device 200 in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 202 to turn off device discovery.
  • the electronic device 200 notifying the electronic device 202 to turn off device discovery includes: the electronic device 200 sends a notification message to the electronic device 202, where the notification message is used to instruct the electronic device 202 to stop being in the to-be-discovered state.
  • the electronic device 202 turns off device discovery.
  • the electronic device 200 in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 203 to turn off device discovery.
  • the electronic device 200 notifying the electronic device 203 to turn off device discovery includes: the electronic device 200 sends a notification message to the electronic device 203, where the notification message is used to instruct the electronic device 203 to stop being in the to-be-discovered state.
  • the electronic device 203 turns off device discovery.
  • the electronic device 200 notifying the electronic device 201-electronic device 203 to turn off device discovery may also be understood as the electronic device 200 notifying the electronic device 201-electronic device 203 to stop being in the to-be-discovered state.
  • the mobile phone when the mobile phone detects that the user selects the electronic device (smart TV 1) whose MAC address is MAC address 1 and clicks on the control 1008, the mobile phone can send a message to the smart TV 1. Send this indication.
  • the smart TV 1 can notify the smart TV 2, the smart TV 3 and the smart TV 4 to turn off the device discovery.
  • the only device in the local area network searched by the mobile phone that can cast a screen is the smart TV 1 .
  • FIG. 7 shows another schematic flow of the combined display method provided by the embodiment of the present application. As shown in Figure 7, the method includes:
  • the mobile device in response to receiving the third input, finds an electronic device 200 in the local area network that can perform screen projection.
  • the mobile phone can prompt the user to select a screen-casting device and display the searched device list, where the smart TV 1 is included in the device list.
  • the mobile device in S4091 may be the same device as the mobile device in FIG. 4 to FIG. 6 above, or may be a different device, which is not limited in this embodiment of the present application.
  • the mobile device in response to the user selecting the electronic device 200 to perform screen projection, the mobile device may send image information to be displayed to the electronic device 200 .
  • the mobile phone when the mobile phone detects that the user selects the smart TV 1 , the mobile phone can send the image information of the video display window 1009 to the smart TV 1 .
  • the electronic device 200 divides the image information according to the indication information.
  • the electronic device 200 divides the image information according to the indication information to obtain the first part of the image information, the second part of the image information, the third part of the image information and the fourth part of the image information.
  • the electronic device 200 divides the image information according to the indication information, including: the electronic device 200 divides the image information according to the display screen of the electronic device 200 , the display screen of the electronic device 201 , the display screen of the electronic device 202 , and the display screen of the electronic device 203 .
  • the orientation information of the display screen is divided, and the image information is divided.
  • the electronic device 200 divides the image information according to the indication information, including: the electronic device 200 divides the image information according to the display screen of the electronic device 200 , the display screen of the electronic device 201 , the display screen of the electronic device 202 , and the display screen of the electronic device 203 .
  • the orientation information of the display screen and the size of the display screen of the electronic device 200 , the display screen of the electronic device 201 , the display screen of the electronic device 202 , and the display screen of the electronic device 203 are divided into the image information.
  • the electronic device 200 displays the first part of the image information according to the instruction information.
  • the electronic device 200 displays the first part of the image information according to the orientation information of the electronic device 200 .
  • the electronic device 200 sends the second part of the image information to the electronic device 201 according to the instruction information and instructs to display the second part of the image information on the display screen of the electronic device 201, and sends the third part of the image information to the electronic device 202 and Instructing to display the third part of the image information on the display screen of the electronic device 202 , and sending the fourth part of the image information to the electronic device 203 and instructing to display the fourth part of the image information on the display screen of the electronic device 203 .
  • the electronic device 200 determines to send the second part of the image information to the electronic device 201 according to the orientation information of the electronic device 201; the electronic device 200 determines to send the third part of the image information to the electronic device according to the orientation information of the electronic device 202.
  • Device 202 the electronic device 200 determines to send the fourth part of the image information to the electronic device 203 according to the orientation information of the electronic device 203 .
  • the image information can be segmented according to the number of electronic devices in the matrix M and the orientation information.
  • the inclusion of MAC addresses 1 to 4 in the matrix M indicates that four electronic devices are displayed in combination, and the four electronic devices are located at the upper left, upper right, lower left and lower right, respectively.
  • the electronic device 200 can divide one frame of image information sent by the mobile device into four frames of images according to the orientations of the four electronic devices.
  • the electronic device 200 can display the image information on the upper left; the electronic device 200 can send the image information on the upper right to the electronic device corresponding to the MAC address 2 in the first row and the second column in the matrix M, so that it displays the image information on the upper right
  • the electronic device 200 can send the image information of the lower left to the electronic device corresponding to the MAC address 3 of the second row and the first column in the matrix M, so that it displays the image information of the lower left;
  • the electronic device corresponding to the MAC address 4 in the second column of the row sends the image information at the lower right, so that it displays the image information at the lower right.
  • the image information can be divided into image information 1012 , image information 1013 , image information 1014 and image information 1015 .
  • the smart TV 1 can display the image information 1012 at the upper left; the smart TV 1 can also send the image information 1013 to the smart TV 2, so that the smart TV 2 displays the image information 1013 at the upper right; the smart TV 1 can also send the image information 1014 Send to the smart TV 3, so that the smart TV 3 displays the image information 1014 at the lower left; the smart TV 1 can also send the image information 1015 to the smart TV 4, so that the smart TV 4 displays the image information 1015 at the lower right.
  • FIG. 8 shows another schematic flow of the combined display method provided by the embodiment of the present application. As shown in Figure 8, the method includes:
  • the electronic device 200 in response to detecting that the user operates the electronic device 200 to play the local content or the live content, the electronic device 200 performs image segmentation on the local content or the live content.
  • the electronic device 200 divides the image information according to the indication information to obtain the first part of the image information, the second part of the image information, the third part of the image information and the fourth part of the image information.
  • the electronic device 200 displays the first part of the image information according to the instruction information.
  • the electronic device 200 displays the first part of the image information according to the orientation information of the electronic device 200 .
  • the electronic device 200 sends the second part of the image information to the electronic device 201 according to the instruction information and instructs to display the second part of the image information on the display screen of the electronic device 201, and sends the third part of the image information to the electronic device 202 and Instructing to display the third part of the image information on the display screen of the electronic device 202 , and sending the fourth part of the image information to the electronic device 203 and instructing to display the fourth part of the image information on the display screen of the electronic device 203 .
  • the electronic device 200 determines to send the second part of the image information to the electronic device 201 according to the orientation information of the electronic device 201; the electronic device 200 determines to send the third part of the image information to the electronic device according to the orientation information of the electronic device 202.
  • Device 202 the electronic device 200 determines to send the fourth part of the image information to the electronic device 203 according to the orientation information of the electronic device 203 .
  • S4096 and S4093 the difference between S4096 and S4093 is that in S4093 the electronic device 200 needs to receive the image information sent by the mobile device and control the electronic device 200-electronic device 203 to display the image; while in S4096 the electronic device 200 does not need to receive other devices in the local area network For the image information sent, the electronic device 200 controls and controls the electronic device 200-electronic device 203 to display images when playing the local content or the live content.
  • the image information corresponding to the channel display interface can be divided into image information 1301 , image information 1302 , and image information 1303 . and image information 1304.
  • the smart TV 1 can display the image information 1301 at the upper left; the smart TV 1 can also send the image information 1302 to the smart TV 2, so that the smart TV 2 displays the image information 1302 at the upper right; the smart TV 1 can also send the image information 1303 Send to the smart TV 3, so that the smart TV 3 displays the upper right image information 1303; the smart TV 1 can also send the image information 1304 to the smart TV 4, so that the smart TV 4 displays the upper right image information 1304.
  • the technical solution provided by this application does not require a dedicated split-screen device; in addition, in a wireless manner, complex wiring between different electronic devices is also not required; since the split-screen device and the wiring between different electronic devices are no longer used, the cost It is also reduced; and, a combined display of multiple different electronic devices is realized.
  • FIG. 9 shows a set of GUIs provided by the embodiments of the present application.
  • the mobile phone, smart TV 1, smart TV 2, smart TV 3 and smart TV 4 are located in the same local area network, and the mobile phone displays a video playback interface, which includes a video display window 901 and Screen projection control 902 .
  • Smart TV 1, Smart TV 2, Smart TV 3, and Smart TV 4 are in a state to be discovered.
  • the cell phone can display a GUI as shown in (b) of FIG. 9 .
  • the mobile phone can display a prompt box 903, wherein the prompt box 903 includes the devices of the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 that are in the state to be discovered in the local area network information.
  • the mobile phone when the mobile phone detects that the user selects the smart TV 2, the mobile phone can send the image information in the video display window 901 to the smart TV 2.
  • FIG. 10 is another set of GUIs provided by the embodiments of the present application.
  • the living room includes a smart TV 1 , a smart TV 2 , a smart TV 3 , and a smart TV 4 .
  • the phone displays the phone's desktop.
  • the desktop of the mobile phone includes icons of multiple applications, and the multiple applications include a clock, a calendar, a gallery, a memo, and a smart life.
  • an input eg, click, etc.
  • an APP eg, smart life icon
  • the mobile phone may display a GUI as shown in (b) of FIG. 10 .
  • the mobile phone, the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 can be connected to the same router.
  • a central device such as a mobile phone, between the mobile phone, smart TV 1, smart TV 2, smart TV 3, and smart TV 4.
  • a router can act as an access point (AP) to provide a signal source for the network.
  • the mobile phone, the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 can be connected to the router as a station (station, STA).
  • the router can communicate with each electronic device through a wired network or a wireless network.
  • a Wi-Fi link is established between various electronic devices through a wireless fidelity (Wi-Fi) protocol, so as to implement communication between the devices.
  • Wi-Fi wireless fidelity
  • the specific implementation can be that a peer-to-peer (P2P) connection (or called Wi-Fi Direct) is established between the electronic devices, or each electronic device is connected to the same router, so that the device can be connected to the same router. communication between.
  • P2P peer-to-peer
  • a Wi-Fi P2P GO on a central device (such as a mobile phone), that is, Group Owner, and other devices connect to this GO as a P2P GC, that is, Group Client, and a one-to-many combination display is formed between these devices. communicate with each other.
  • a central device such as a mobile phone
  • Group Owner and other devices connect to this GO as a P2P GC, that is, Group Client
  • a one-to-many combination display is formed between these devices. communicate with each other.
  • the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 can be turned on for a preset time period (for example, 10 minutes) in the waiting state, other devices in the local area network can discover the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4.
  • a preset time period for example, 10 minutes
  • other devices in the local area network can discover the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4.
  • the mobile phone can search for devices in the local area network, so as to prompt the user to perform screen projection on the smart TV 1 , smart TV 2 , smart TV 3 or smart TV 4 .
  • the mobile phone can display the display interface of smart life.
  • the mobile phone can display a function list, wherein the function list includes functions such as discovering devices, creating intelligence, sharing devices, and connecting to third-party platforms.
  • the mobile phone in response to detecting that the user clicks on the discovery device function 1002, the mobile phone may send a broadcast message to a device located in the same local area network as the mobile phone, where the broadcast message is used to instruct the electronic device to enter the combined display state.
  • the smart TV 1 , the smart TV 2 , the smart TV 3 and the smart TV 4 can display the two-dimensional code through the display screen in response to receiving the broadcast message.
  • the two-dimensional code displayed by each smart TV is used to indicate its address information (for example, a media access control (media access control, MAC) address).
  • the two-dimensional code information displayed by the smart TV 1 indicates that the address information of the smart TV 1 is MAC address 1
  • the two-dimensional code information displayed by the smart TV 2 indicates that the address information of the smart TV 2 is the MAC address 2
  • the smart TV 3 displays
  • the two-dimensional code information of the smart TV 3 indicates that the address information of the smart TV 3 is the MAC address 3
  • the two-dimensional code information displayed by the smart TV 4 indicates that the address information of the smart TV 4 is the MAC address 4.
  • the mobile phone can display another display interface of smart life.
  • the display interface includes a prompt box 1003, wherein the prompt box 1003 includes prompt information "it is detected that there are multiple electronic devices in the local area network, whether to perform combined display of the multiple electronic devices".
  • the mobile phone may display a GUI as shown in (d) of FIG. 10 .
  • smart TV 1, smart TV 2, smart TV 3, and smart TV 4 can send responses to the mobile phone. 2. Smart TV 3 and Smart TV 4), then the mobile phone can display the prompt box 1003.
  • the mobile phone can activate the camera and display a prompt message "Please place the electronic device that needs to be displayed in combination in the following preview box".
  • the mobile phone can display the information of multiple devices collected by the camera of the mobile phone in the preview frame 1005 .
  • the mobile phone detects that the user clicks on the control 1006, the mobile phone can display the GUI as shown in (e) of FIG. 10 .
  • the mobile phone when the mobile phone detects that the user clicks on the control 1006, the mobile phone can determine the address information of the multiple smart TVs through the QR code information displayed on the multiple smart TVs in the preview frame 1005.
  • the image information in the preview box 1005 determines the orientation information of each smart TV. For example, the phone can determine that devices with MAC address 1 are in the upper left, devices with MAC address 2 are in the upper right, devices with MAC address 3 are in the lower left, and devices with MAC address 4 are in the lower right.
  • the mobile phone can display a prompt message "It is detected that there are currently 4 electronic devices that need to be displayed in combination, please select an electronic device as the master device".
  • the mobile phone can determine that the device whose address information is MAC address 1 is the master device.
  • the mobile phone when the mobile phone determines that the user selects the smart TV 1 as the main control device, the mobile phone can send indication information to the smart TV 1, and the indication information is used to indicate other smart TVs (smart TV 2, smart TV 3 and smart TV 4). ) and the location information between other smart devices and the smart TV 1.
  • the indication information sent by the mobile phone to the smart TV 1 may be used for image segmentation of the smart TV 1 .
  • the smart TV 1 can determine which devices the user displays in combination, and which device the segmented image should be sent to for display.
  • the smart TV 1 can learn that the user has displayed 4 devices in combination, and the smart TV 1 is located at the upper left of the 4 devices, the device whose address information is MAC address 2 is located at the upper right of the 4 devices, and the address The device whose information is MAC address 3 is located at the lower left of the 4 devices, and the device whose address information is MAC address 4 is located at the lower right of the 4 devices.
  • the smart TV 1 can divide the image information into 4 pieces of image information (the upper left image, the upper right image, the lower left image and the lower right image), and the smart TV 1 can display the image information through the display screen.
  • the upper left image, the upper right image is sent to the device whose address information is MAC address 2 for display
  • the lower left image is sent to the device whose address information is MAC address 3 for display
  • the lower right image is sent to the address information Displayed for devices with MAC address 4.
  • the smart TV 1 after receiving the indication information, can determine that the smart TV 1 is the master device, and the smart TV 1 can notify other smart TVs to turn off device discovery (or notify other smart devices to stop entering the to-be-discovered state) . Other smart TVs can turn off device discovery after receiving the notification from smart TV 1.
  • the GUI is a video playback interface
  • the video playback interface includes a video display window 1009 and a screen projection control 1010 .
  • the cell phone may display a GUI as shown in (g) of FIG. 10 .
  • the mobile phone shown in (f) in FIG. 10 and the mobile phone shown in (a) to (e) in FIG. 10 may be the same mobile phone, or may be different mobile phones.
  • the mobile phone can display a prompt box 1011 , wherein the prompt box 1011 includes a list of devices found by the mobile phone that can perform screen projection. Since Smart TV 2, Smart TV 3, and Smart TV 4 have turned off device discovery, only Smart TV 1 is in the device list.
  • the mobile phone can send the image information in the video display window 1009 to the smart TV 1 .
  • the mobile phone may transmit the image information in the video display window 1009 to the smart TV 1 .
  • the smart TV 1 can segment the image information according to the orientation information between the smart TV 1 and other smart TVs.
  • the smart TV 1 can cut each frame of the image information into 4 frames of images, for example, the cut 4 frames of images are divided into the upper left image 1012, the upper right image 1013, Image 1014 and bottom right image 1015.
  • the smart TV 1 can send the upper right image 1013 to the smart TV 2 according to the orientation information of the smart TV 2 and the address information of the smart TV 2, so that the smart TV 2 can display the image 1013; the smart TV 1 can display the image 1013 according to the orientation information of the smart TV 3 and the address information of the smart TV 3, send the image 1014 in the lower left to the smart TV 3, so that the smart TV 3 can display the image 1014; the smart TV 1 can send the smart TV 4 to the smart TV 4 sends the lower right image 1015 so that smart TV 4 can display the image 1015; smart TV 1 can display the upper left image 1012.
  • multiple small display screens can be completed to form a large display screen without any other hardware device, and there is no requirement for the installation of the display screen, which helps to save hardware costs. Users can select one display screen from multiple small display screens as the main control display screen, and then the main control display screen can be used for image segmentation and distribution display, which helps to improve the user experience.
  • FIG. 11 shows another set of GUIs provided by the embodiments of the present application.
  • the mobile phone when the mobile phone detects that the user clicks on the control 1101, the mobile phone can display a function list, wherein the function list includes the functions of discovering devices, large-screen combined display, sharing devices, and connecting to three-party platforms.
  • the mobile phone detects that the user clicks the operation of the large-screen combined display function 1102, the mobile phone can display the GUI shown in (b) of FIG. 11 .
  • the mobile phone in response to detecting that the user clicks the large-screen combined display function 1102, can send a broadcast message to a device located in the same local area network as the mobile phone, where the broadcast message is used to instruct the electronic device to enter the combined display state.
  • Smart TV 1, Smart TV 2, Smart TV 3 and Smart TV 4 can display a two-dimensional code through the display screen in response to receiving the broadcast message, wherein the two-dimensional code displayed by each smart TV is used to indicate its address information (e.g. MAC address).
  • the mobile phone in response to the user's operation of selecting the large-screen combined display function 1102, the mobile phone can activate the camera and display a prompt message "Please put the electronic device to be displayed in combination in the following preview box".
  • the mobile phone can display the information of multiple devices collected by the camera of the mobile phone in the preview box 1103 .
  • the mobile phone detects that the user clicks the control 1104, the mobile phone can determine the address information of the multiple smart TVs through the QR code information displayed on the multiple smart TVs in the preview box 1103.
  • the image information determines the orientation information of each smart TV.
  • FIG. 12 shows another set of GUIs provided by the embodiments of the present application.
  • the living room includes a smart TV 1 , a smart TV 2 , a smart TV 3 , a smart TV 4 , and a smart TV 5 .
  • the mobile phone when the mobile phone determines that the user wishes to perform combined display on a large screen, the mobile phone can activate the camera and display a prompt message "Please place the electronic device that needs combined display in the following preview box".
  • the mobile phone can display the information of multiple devices collected by the camera of the mobile phone in the preview frame 1201 .
  • the mobile phone detects that the user clicks on the control 1202
  • the mobile phone can determine the address information of the multiple smart TVs through the QR code information displayed on the multiple smart TVs in the preview box 1201.
  • the image information determines the orientation information of each smart TV.
  • the mobile phone when the mobile phone determines that the five devices in the preview frame 1201 are irregularly distributed, the mobile phone can prompt the user "It is detected that there are five electronic devices that need to be displayed in combination. In order to ensure the image display effect , it is recommended that you select the device combination shown in the dotted box".
  • the mobile phone may prompt the user to select the four devices in the dotted box 1203 for combined display.
  • the mobile phone detects that the user clicks on the control 1204
  • the mobile phone can display the smart TV 1, smart TV 2, smart TV 3 and smart TV 4 in combination, and prompt the user to select one of the devices as the master device.
  • the mobile phone when the mobile phone detects that the user has selected the smart TV 1 as the master control device, the mobile phone can send indication information to the smart TV 1, and the description of the indication information can refer to the description in the above embodiments.
  • the GUI is a video playback interface
  • the video playback interface includes a video display window 1205 and a screen projection control 1206 .
  • the cell phone may display a GUI as shown in (e) of FIG. 12 .
  • the mobile phone can display a prompt box 1207, wherein the prompt box 1207 includes a list of devices found by the mobile phone that can perform screen projection.
  • the list of devices includes Smart TV 1 and Smart TV 5.
  • the smart TV 1 also includes prompt information "in combination display”.
  • the mobile phone can send the image information in the video display window 1205 to the smart TV 1 .
  • the mobile phone may transmit the image information in the video display window 1205 to the smart TV 1 .
  • the smart TV 1 can segment the image information according to the orientation information between the smart TV 1 and other smart TVs.
  • the smart TV 1 can cut each frame of image in the image information into 4 frames of images, for example, the cut 4 frames of images are divided into the upper left image 1208, the upper right image 1209, the lower left image 1208 Image 1210 and bottom right image 1211.
  • the smart TV 1 can send the upper right image 1209 to the smart TV 2 according to the orientation information of the smart TV 2 and the address information of the smart TV 2, so that the smart TV 2 can display the image 1209; the smart TV 1 can display the image 1209 according to the orientation information of the smart TV 3 and the address information of the smart TV 3, send the image 1210 in the lower left to the smart TV 3, so that the smart TV 3 can display the image 1210; the smart TV 1 can send the smart TV 4 to the smart TV 4 sends the lower right image 1211 so that smart TV 4 can display the image 1211; smart TV 1 can display the upper left image 1208.
  • the mobile phone in response to the operation of the user selecting to display the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 in combination, can also instruct the smart TV 5 to enter the screen-off state, thereby avoiding the display of the smart TV 1-
  • the smart TV 4 displays image information
  • the influence of the smart TV 5 on the user helps to improve the user's experience when watching videos.
  • the mobile phone can prompt the user to select an appropriate display screen distribution mode for device combined display, which can ensure that the user can see the best image effect when using the mobile phone to cast the screen. , which helps to improve the user experience.
  • the GUI shown in FIG. 10 and FIG. 12 above is a process of displaying image information on the smart TV 1 , the smart TV 2 , the smart TV 3 and the smart TV 4 in the form of screen projection of the mobile phone.
  • the following describes the process of playing the image information displayed by the smart TV 1 through the smart TV 1 , the smart TV 2 , the smart TV 3 and the smart TV 4 after the smart TV 1 receives the indication information with reference to FIG. 13 .
  • FIG. 13 shows another GUI provided by the embodiment of the present application.
  • the smart TV can perform image segmentation on the channel switching interface according to the instruction information sent by the mobile phone to obtain image information 1301 , image information 1302 , image information 1303 and images information 1304, so that a part of the divided images is displayed on the smart TV 1, and the other divided images are respectively sent to the smart TV 2, the smart TV 3 and the smart TV 4 for display.
  • the process of displaying image information on the smart TV 1 , the smart TV 2 , the smart TV 3 , and the smart TV 4 may refer to the descriptions in the foregoing embodiments, which are not repeated here for brevity.
  • FIG. 14 shows another set of GUIs provided by the embodiments of the present application.
  • the GUI is another display interface of smart life.
  • the device information of the combined display device can be added to the display interface. display box 1401.
  • the mobile phone detects the user's long-press operation on the display box 1401, the mobile phone can display the GUI as shown in (b) of FIG. 14 .
  • the GUI is another display interface of smart life.
  • the handset may display controls 1402.
  • the mobile phone detects that the user clicks on the control 1402
  • the mobile phone can send another indication information to the smart TV, and the other indication information is used to instruct the smart TV 1 to cancel the connection between the smart TV 2, the smart TV 3, and the smart TV 4.
  • the smart TV 1 can notify the smart TV 2, the smart TV 3, and the smart TV 4 to cancel the combined display.
  • the mobile phone may further prompt the user to select a screen projection device among the smart TV 1 , the smart TV 2 , the smart TV 3 , and the smart TV 4 .
  • the GUI is another display interface of smart life.
  • the mobile phone deletes the display frame 1401 on the display interface.
  • the combined display method provided by the embodiments of the present application is applicable to the following mobile devices and electronic devices.
  • FIG. 15 shows a mobile device 1500 provided by the present application.
  • mobile device 1500 includes at least one processor 1510 , memory 1520 and display screen 1530 .
  • the processor 1510 is coupled with the memory 1520 and the display screen 1530, and the coupling in this embodiment of the present application may be a communication connection, an electrical connection, or other forms.
  • the memory 1520 is used to store program instructions.
  • Display screen 1530 is used to display a user interface.
  • the processor 1510 is configured to invoke the program instructions stored in the memory 1520, so that the mobile device 1500 executes the steps performed by the mobile device in the combined display method provided by the embodiments of the present application.
  • the mobile device 1500 can be used to implement the combined display method provided by the embodiments of the present application, and the relevant features can be referred to the above, which will not be repeated here.
  • the display screen when the display screen has a touch function, the display screen is also referred to as a touch display screen.
  • the operation on the touch screen can be realized by virtual keys.
  • the display When the display does not have a touch function, the display is also called a non-touch display. Operations on the non-touch display can be achieved through physical buttons.
  • the present application provides a computer program product containing instructions, when the computer program product runs on a mobile device, the mobile device causes the mobile device to perform the steps performed by the mobile device in the combined display method provided by the embodiments of the present application.
  • the present application provides a computer-readable storage medium, including instructions, which, when the instructions are executed on a mobile device, cause the mobile device to perform the steps performed by the mobile device in the combined display method provided by the embodiments of the present application.
  • the embodiments of the present application may be implemented in hardware, or in a manner of hardware and software.
  • the above-described functions can be stored in a computer-readable medium.
  • the medium includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.
  • FIG. 16 shows an electronic device 1600 provided by the present application.
  • the electronic device 1600 includes at least one processor 1610 , a memory 1620 and a display screen 1630 .
  • the processor 1610 is coupled with the memory 1620 and the display screen 1630, and the coupling in this embodiment of the present application may be a communication connection, an electrical connection, or other forms.
  • the memory 1620 is used to store program instructions.
  • Display screen 1630 is used to display a user interface.
  • the processor 1610 is configured to invoke the program instructions stored in the memory 1620, so that the electronic device 1600 executes the steps performed by the electronic device in the combined display method provided by the embodiment of the present application.
  • the electronic device 1600 can be used to implement the combined display method provided by the embodiments of the present application, and the relevant features can be referred to above, and details are not repeated here.
  • the display screen when the display screen has a touch function, the display screen is also referred to as a touch display screen.
  • the operation on the touch screen can be realized by virtual keys.
  • the display When the display does not have a touch function, the display is also called a non-touch display. Operations on the non-touch display can be achieved through physical buttons.
  • the present application provides a computer program product containing instructions, which, when the computer program product runs on an electronic device, causes the electronic device to execute the steps performed by the electronic device in the method provided by the embodiments of the present application.
  • the present application provides a computer-readable storage medium, including a computer program, which, when the computer program runs on an electronic device, causes the electronic device to perform the steps performed by the electronic device in the method provided by the embodiments of the present application.
  • the disclosed system, apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium.
  • the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution.
  • the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Human Computer Interaction (AREA)
  • Pure & Applied Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Telephone Function (AREA)

Abstract

一种组合显示方法、移动设备及电子设备。该方法包括:移动设备响应于接收到第一输入,广播第一消息,第一消息用于指示要组合显示;移动设备获取的第一图像,该第一图像中包括第一显示屏和第二显示屏,第一显示屏显示第一信息,第二显示屏显示第二信息;移动设备向第一电子设备发送第二消息,第二消息包括第一信息、第二信息、第一显示屏与第二显示屏之间的方位信息及尺寸比例关系、第一信息与第一显示屏的对应关系。第一电子设备响应于接收到的第二消息,控制多个电子设备进行组合显示。不再使用分屏设备以及不同电子设备之间的布线,可以降低多个电子设备进行组合显示时的成本;并且实现了组合显示。

Description

一种组合显示方法、移动设备及电子设备
本申请要求于2021年1月31日提交中国专利局、申请号为202110132290.5、发明名称为“一种组合显示方法、移动设备及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信领域,具体涉及一种组合显示方法、移动设备及电子设备。
背景技术
通常来说,显示屏尺寸较大的电子设备,相较于显示屏尺寸较小的电子设备,在使用时,会给用户带来更好的视觉冲击效果,更佳的用户体验。不过,显示屏尺寸较大的电子设备,在制造技术上有所受限,并且成本也显著提高。
在诸如舞台表演或者家用观看等的场合下,通过不同电子设备之间的有线连接以及分屏设备,能够实现多个显示屏尺寸较小的电子设备的共同显示,使得距离较远的观众也能感受到较好的显示效果,或者,实现与显示屏尺寸较大的电子设备同样的显示效果。不过,这都需要复杂的布线,以及专用的分屏设备(比如,分屏器),来控制不同电子设备的不同显示屏的组合及图像显示,从而增加了硬件成本。
因此,如何在降低硬件成本的前提下,利用显示屏尺寸较小的不同电子设备,实现上述多个不同电子设备的组合显示,成为我们要解决的技术问题。
发明内容
为了解决上述的技术问题,本申请提供了一种组合显示方法、移动设备及电子设备。本申请提供的技术方案,无需专用的分屏设备;另外,通过无线的方式,也不需要不同电子设备之间的复杂布线;由于不再使用分屏设备以及不同电子设备之间的布线,成本也得到了降低;并且,实现了多个不同电子设备的组合显示。
第一方面,提供一种组合显示***。该***包括位于同一局域网的移动设备、第一电子设备和第二电子设备,该第一电子设备包括第一显示屏,该第二电子设备包括第二显示屏;该移动设备,用于响应于接收到的第一输入,广播第一消息;该第一消息用于指示要组合显示;该第一电子设备,用于响应于接收到的该第一消息,通过该第一显示屏显示第一信息;该第一信息用于指示该第一电子设备的地址信息;该第二电子设备,用于响应于接收到的该第一消息,通过该第二显示屏显示第二信息;该第二信息用于指示该第二电子设备的地址信息;该移动设备,还用于获取第一图像,该第一图像包括该第一显示屏和该第二显示屏;该第一显示屏显示该第一信息;该第二显示屏显示该第二信息;该移动设备,还用于选择该第一显示屏对应的该第一电子设备为主控设备,并向该第一 电子设备发送第二消息;该第二消息包括该移动设备根据该第一图像获取到的该第一信息、该第二信息、该第一显示屏与该第二显示屏之间的方位信息、该第一信息与该第一显示屏的对应关系;该第二消息还用于指示该第一电子设备被选择为主控设备;该第一电子设备,还用于响应于接收到的该第二消息,控制该第一显示屏和该第二显示屏组合显示。
这样,通过移动设备发送第一消息,触发第一电子设备显示用于指示其地址信息的第一信息以及第二电子设备显示用于指示其地址信息的第二信息。移动设备在获取第一图像后就可以确定第一电子设备和第二电子设备的方位信息和地址信息。移动设备可以向第一电子设备指示第一电子设备和第二电子设备的方位信息和地址信息,从而使得第一电子设备可以控制第一电子设备和第二电子设备进行组合显示。无需专用的分屏设备;另外,通过无线的方式,也不需要不同电子设备之间的复杂布线;由于不再使用分屏设备以及不同电子设备之间的布线,成本也得到了降低;并且,实现了多个不同电子设备的组合显示。
可选地,移动设备可以只将第一图像发送给第一电子设备;由第一电子设备根据第一图像,获取到第一信息、第二信息、第一显示屏与第二显示屏之间的方位信息、第一信息与第一显示屏的对应关系。第一电子设备可根据是否是向自己发送的第一图像,来确定自己是被选择的主控设备。本申请的其他实施例也可采用该可选方式。
在一些可能的实现方式中,该第一信息、该第二信息、该第一显示屏与该第二显示屏之间的方位信息、该第一信息与该第一显示屏的对应关系可以由第二消息承载;用于指示该第一电子设备被选择为主控设备的信息可以由第三消息承载,该第二消息和该第三消息为不同的消息。
在一些可能的实现方式中,该第二消息中还包括第二信息与第二显示屏的对应关系。
结合第一方面,在第一方面的某些实现方式中,该选择该第一显示屏对应的该第一电子设备为主控设备;包括:该移动设备接收到对该第一显示屏对应的该第一电子设备的用户选择;响应于该用户选择,该移动设备记录该第一电子设备为主控设备。这样,方便用户从多个电子设备中选择一个电子设备作为主控设备,并由主控设备控制多个组合显示的电子设备进行图像显示。
结合第一方面,在第一方面的某些实现方式中,该选择该第一显示屏对应的该第一电子设备为主控设备;包括:该移动设备随机选择该第一显示屏对应的该第一电子设备为主控设备。
结合第一方面,在第一方面的某些实现方式中,该第一电子设备和该第二电子设备,还用于在开机后保持第一状态,直至开机后的时长达到预设时长,收到该第二消息,或收到通知消息,或停止消息;在该第一状态下,该第一电子设备和该第二电子设备用于在接收到该移动设备的第一消息后,分别通过该第一显示屏和该第二显示屏显示该第一信息和该第二信息;该第一电子设备,还用于在接收到该移动设备的第二消息后,向该第二电子设备发送通知消息,该通知消息用于指示该第二电子设备停止处于该第一状态;该第二电子设备,还用于在接收到该通知消息后,进入第二状态;在该第二状态下,该第二电子设备只受该主控设备的控制;该第二电子设备,还用于在接收到该停止消息后, 不再通过该第二显示屏显示该第二信息。
在一些可能的实现方式中,该第一状态为待发现状态。
结合第一方面,在第一方面的某些实现方式中,该控制该第一电子设备和该第二电子设备组合显示;包括:该第一电子设备接收到待显示的一个图像帧,根据该第一显示屏和该第二显示屏的方位信息及尺寸比例关系,以及第一显示屏的尺寸,对该图像帧进行分割,得到第一部分图像和第二部分图像,在该第一显示屏上显示该第一部分图像,将该第二部分图像发送给该第二电子设备,并指示在该第二显示屏上显示该第二部分图像。第一显示屏的尺寸可以由第一电子设备自身获取到;第一电子设备再根据第一显示屏和第二显示屏的尺寸比例关系,即可获取到第二显示屏的尺寸。
在一些可能的实现方式中,该第一显示屏和该第二显示屏的方位信息可以为该第一显示屏和该第二显示屏的相对位置关系。
结合第一方面,在第一方面的某些实现方式中,该根据该第一显示屏和该第二显示屏的方位信息及尺寸比例关系,以及第一显示屏的尺寸,对该图像帧进行分割,包括:根据该第一显示屏和该第二显示屏的方位信息、该第一显示屏的尺寸以及该第二显示屏的尺寸,对该图像帧进行分割。
结合第一方面,在第一方面的某些实现方式中,该图像帧来自于该移动设备的投屏数据。
结合第一方面,在第一方面的某些实现方式中,该移动设备具体用于:在获取该第一图像之前,提示对需要组合显示的该第一显示屏和该第二显示屏拍照;响应于检测到的对该第一显示屏和该第二显示屏的拍照操作,获取到该第一图像。
结合第一方面,在第一方面的某些实现方式中,该第一信息用于指示该第一电子设备的媒体接入控制层MAC地址,该第二信息用于指示该第二电子设备的MAC地址。
第二方面,提供了一种组合显示方法,该方法应用于移动设备。该移动设备、第一电子设备和第二电子设备位于同一局域网内,该第一电子设备包括第一显示屏,该第二电子设备包括第二显示屏;该方法包括:接收到第一输入;响应于该第一输入,广播第一消息;该第一消息用于指示要组合显示;获取到第一图像,该第一图像包括该第一显示屏和该第二显示屏;该第一显示屏显示该第一信息;该第二显示屏显示该第二信息;该第一信息用于指示该第一电子设备的地址信息;该第二信息用于指示该第二电子设备的地址信息;选择该第一显示屏对应的该第一电子设备为主控设备,并向该第一电子设备发送第二消息;该第二消息包括该移动设备根据该第一图像获取到的该第一信息、该第二信息、该第一显示屏与该第二显示屏之间的方位信息、该第一信息与该第一显示屏的对应关系;该第二消息还用于指示该第一电子设备被选择为主控设备;将一个图像帧发送给该第一电子设备,或者,将一个链接地址发送给该第一电子设备。
结合第二方面,在第二方面的某些实现方式中,该选择该第一显示屏对应的该第一电子设备为主控设备;包括:该移动设备接收到对该第一显示屏对应的该第一电子设备的用户选择;响应于该用户选择,该移动设备记录该第一电子设备为主控设备。
结合第二方面,在第二方面的某些实现方式中,该选择该第一显示屏对应的该第一电子设备为主控设备;包括:该移动设备随机选择该第一显示屏对应的该第一电子设备 为主控设备。
结合第二方面,在第二方面的某些实现方式中,该图像帧来自于该移动设备的投屏数据。
结合第二方面,在第二方面的某些实现方式中,该第一信息用于指示该第一电子设备的媒体接入控制层MAC地址,该第二信息用于指示该第二电子设备的MAC地址。
第三方面,提供了一种组合显示方法,该方法应用于第一电子设备;该第一电子设备、第二电子设备和移动设备位于同一局域网内,该第一电子设备包括第一显示屏,该第二电子设备包括第二显示屏;该方法包括:该第一电子设备接收到第一消息,该第一消息用于指示要组合显示;响应于接收到的该第一消息,该第一显示屏显示第一信息;该第一信息用于指示该第一电子设备的地址信息;该第一电子设备接收到该移动设备发送的第二消息,该第二消息包括该移动设备根据该第一图像获取到的该第一信息、该第二信息、该第一显示屏与该第二显示屏之间的方位信息、该第一信息与该第一显示屏的对应关系;该第二消息还用于指示该第一电子设备被选择为主控设备;响应于接收到的该第二消息,该第一电子设备控制该第一显示屏和该第二显示屏组合显示。
结合第三方面,在第三方面的某些实现方式中,在该第一电子设备接收到第一消息之前,该方法还包括:该第一电子设备在开机后保持第一状态,直至开机后的时长达到预设时长或收到该第二消息;在该第一状态下,该第一电子设备用于在接收到该移动设备的第一消息后,通过该第一显示屏显示该第一信息。
结合第三方面,在第三方面的某些实现方式中,该方法还包括:在接收到该移动设备的第二消息后,该第一电子设备向该第二电子设备发送通知消息,该通知消息用于指示该第二电子设备停止处于该第一状态。
结合第三方面,在第三方面的某些实现方式中,该第一电子设备控制该第一显示屏和该第二显示屏组合显示;包括:该第一电子设备接收到待显示的一个图像帧,根据该第一显示屏和该第二显示屏的方位信息及尺寸比例关系,以及第一显示屏的尺寸,对该图像帧进行分割,得到第一部分图像和第二部分图像,在该第一显示屏上显示该第一部分图像,将该第二部分图像发送给该第二电子设备,并指示在该第二显示屏上该第二部分图像。
结合第三方面,在第三方面的某些实现方式中,该第一信息用于指示该第一电子设备的媒体接入控制层MAC地址,该第二信息用于指示该第二电子设备的MAC地址。
第四方面,提供了一种移动设备,包括:一个或多个处理器、一个或多个存储器、以及一个或多个计算机程序;上述一个或多个计算机程序被存储在存储器中,当移动设备运行时,该处理器执行该存储器存储的一个或多个计算机程序,以使移动设备执行上述第二方面任一项所述的方法。
第五方面,提供了一种电子设备,包括:一个或多个处理器、一个或多个存储器、以及一个或多个计算机程序;上述一个或多个计算机程序被存储在存储器中,当电子设备运行时,该处理器执行该存储器存储的一个或多个计算机程序,以使电子设备执行上述第三方面任一项所述的方法。
第六方面,本申请提供一种计算机存储介质,包括计算机指令,当计算机指令在移 动设备上运行时,使得移动设备执行如第二方面中任一项所述的方法;或者,当计算机指令在电子设备上运行时,使得电子设备执行如第三方面中任一项所述的方法。
第七方面,本申请提供一种计算机程序产品,当计算机程序产品在移动设备上运行时,使得移动设备执行如第二方面中任一项所述的方法;或者,当计算机程序产品在电子设备上运行时,使得电子设备执行如第三方面中任一项所述的方法。
可以理解地,上述提供移动设备、电子设备、计算机存储介质以及计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
附图说明
图1是本申请实施例提供的组合显示方法的场景示意图;
图2是本申请实施例提供的移动设备的硬件结构示意图;
图3是本申请实施例提供的电子设备的硬件结构示意图;
图4是本申请实施例提供的组合显示方法的示意性流程图;
图5是本申请实施例提供的组合显示方法的另一示意性流程图;
图6是本申请实施例提供的组合显示方法的另一示意性流程图;
图7是本申请实施例提供的组合显示方法的另一示意性流程图;
图8是本申请实施例提供的组合显示方法的另一示意性流程图;
图9是本申请实施例提供的一组图形用户界面;
图10是本申请实施例提供的另一组图形用户界面;
图11是本申请实施例提供的另一组图形用户界面;
图12是本申请实施例提供的另一组图形用户界面;
图13是本申请实施例提供的另一组图形用户界面;
图14是本申请实施例提供的另一组图形用户界面。
图15是本申请实施例提供的一种移动设备的结构组成示意图;
图16是本申请实施例提供的一种电子设备的结构组成示意图。
具体实施方式
下面结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一种”、“所述”、“上述”、“该”和“这一”旨在也包括例如“一个或多个”这种表达形式,除非其上下文中明确地有相反指示。还应当理解,在本申请以下各实施例中,“至少一个”、“一个或多个”是指一个或两个以上(包含两个)。术语“和/或”,用于描述关联对象的关联关系,表示可以存在三种关系;例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一 个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是以其他方式另外特别强调。术语“连接”包括直接连接和间接连接,除非另外说明。“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。
在本申请实施例中,“示例性地”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性地”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性地”或者“例如”等词旨在以具体方式呈现相关概念。
通常来说,显示屏尺寸较大的电子设备,相较于显示屏尺寸较小的电子设备,在使用时,会给用户带来更好的视觉冲击效果,更佳的用户体验。不过,显示屏尺寸较大的电子设备,在制造技术上有所受限,并且成本也显著提高。在诸如舞台表演或者家用观看等的场合下,通过不同电子设备之间的有线连接以及分屏设备,能够实现多个显示屏尺寸较小的电子设备的共同显示,使得距离较远的观众也能感受到较好的显示效果,或者,实现与显示屏尺寸较大的电子设备同样的显示效果。不过,这都需要复杂的布线,以及专用的分屏设备(比如,分屏器),来控制不同电子设备的不同显示屏的组合及图像显示,从而增加了硬件成本。因此,如何在降低硬件成本的前提下,利用显示屏尺寸较小的不同电子设备,实现上述多个不同电子设备的组合显示,成为我们要解决的技术问题。
为了解决上述的技术问题,本申请提供了一种组合显示方法、移动设备、电子设备及组合显示***。本申请提供的技术方案,无需专用的分屏设备;另外,通过无线的方式,也不需要不同电子设备之间的复杂布线;由于不再使用分屏设备以及不同电子设备之间的布线,成本也得到了降低;并且,实现了多个不同电子设备的组合显示。
示例性地,图1示出了本申请实施例提供的组合显示方法的场景。如图1所示,移动设备100和多个电子设备(例如,电子设备200、电子设备201、电子设备202等)位于同一局域网下。在接收到第一输入时,移动设备100可以向多个电子设备发送广播消息,该广播消息用于指示局域网内的多个电子设备进入组合显示状态。多个电子设备在接收到该广播消息后,可以在各自的显示屏上显示用于指示其地址的信息。移动设备100可以通过第一图像信息,确定多个电子设备中每个电子设备的方位信息,以及每个电子设备的地址信息。移动设备100可以向多个电子设备中的某一个电子设备(例如,电子设备200)发送指示信息,该指示信息用于指示多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息。接收到指示信息的电子设备200可以根据该指示信息,对需要显示的图像信息进行分割,从而通过电子设备200的显示屏显示一部分图像信息,并将另一部分图像信息发送给其余电子设备。
本申请实施例的移动设备包括但不限于智能手机、平板电脑、具备无线通讯功能的可穿戴电子设备(如智能手表、智能手环、智能戒指、智能眼镜)等。移动设备的示例性 实施例包括但不限于搭载
Figure PCTCN2022070384-appb-000001
Windows、Linux或者其它操作***的便携式电子设备。上述移动设备也可为其它便携式设备,诸如膝上型计算机(Laptop)等。还应当理解的是,在其他一些实施例中,上述移动设备也可以不是便携式设备,而是台式计算机。
示例性地,图2示出了本申请实施例提供的移动设备100的硬件结构。如图2所示,移动设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本申请实施例示意的结构并不构成对移动设备100的具体限定。在本申请另一些实施例中,移动设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142,充电管理模块140与处理器110。移动设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。移动设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在移动设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在移动设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
本申请实施例中,移动设备100可以通过无线通信模块160发送广播消息,该广播消息用于局域网内的电子设备进入组合显示状态。移动设备100还可以通过无线通信模块160向电子设备200发送指示信息,该指示信息用于指示多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息。
在一些实施例中,移动设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得移动设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system,GPS),全球导航卫星***(global navigation satellite system,GLONASS),北斗卫星导航***(beidou navigation satellite system,BDS),准天顶卫星***(quasi-zenith satellite system,QZSS)和/或星基增强***(satellite based augmentation systems,SBAS)。
移动设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展移动设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
移动设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
示例性地,图3示出了本申请实施例提供的电子设备200的硬件结构。电子设备200可包括处理器210,外部存储器接口220,内部存储器221,通用串行总线(universal serial bus,USB)接口230,充电管理模块240,电源管理模块241,电池242,天线3,无线通信模块250,传感器模块260,输入模块270,输出模块280以及显示屏290等。
可以理解的是,本申请实施例示意的结构并不构成对电子设备200的具体限定。在本申请另一些实施例中,电子设备200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。比如,电子设备200可以为智能灯、智能电视、智能音箱等。
处理器210可以包括一个或多个处理单元。例如:处理器210可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的部件,也可以集成在一个或多个处理器中。在一些实施例中,电子设备200也可以包括一个或多个处理器210。其中,控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
在一些实施例中,处理器210可以包括一个或多个接口。接口可以包括集成电路间(inter-integrated circuit,I2C)接口,集成电路间音频(integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,SIM卡接口,和/或USB接口等。其中,USB接口230是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口230可以用于连接充电器为电子设备200充电,也可以用于电子设备200与***设备之间传输数据。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备200的结构限定。在本申请另一些实施例中,电子设备200也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块240用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块240可以通过USB接口230接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块240可以通过电子设备200的无线充电线圈接收无线充电输入。充电管理模块240为电池242充电的同时,还可以通过电源管理模块241为电子设备供电。
电源管理模块241用于连接电池242,充电管理模块240与处理器210。电源管理模块241接收电池242和/或充电管理模块240的输入,为处理器210,内部存储器221,外部存储器接口220和无线通信模块250等供电。电源管理模块241还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块241也可以设置于处理器210中。在另一些实施例中,电源管理模块241和充电管理模块240也可以设置于同一个器件中。
电子设备200的无线通信功能可以通过天线3以及无线通信模块250等实现。
无线通信模块250可以提供应用在电子设备200上的包括Wi-Fi,蓝牙(bluetooth,BT),无线数传模块(例如,433MHz,868MHz,915MHz)等无线通信的解决方案。无线通信模块250可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块250经由天线3接收电磁波,将电磁波信号滤波以及调频处理,将处理后的信号发送到处理器210。无线通信模块250还可以从处理器210接收待发送的信号,对其进行调频,放大,经天线3转为电磁波辐射出去。
本申请实施例中,电子设备200可以通过无线通信模块接收移动设备100发送的广 播消息。响应于接收到移动设备100发送的广播消息,电子设备200可以通过显示屏290显示用于指示电子设备200的地址的信息。电子设备200也可以通过无线通信模块接收移动设备100发送的指示信息,该指示信息用于指示多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息。
外部存储器接口220可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备200的存储能力。外部存储卡通过外部存储器接口220与处理器210通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器221可以用于存储一个或多个计算机程序,该一个或多个计算机程序包括指令。处理器210可以通过运行存储在内部存储器221的上述指令,从而使得电子设备200执行本申请一些实施例中所提供的自动开锁的方法,以及各种应用以及数据处理等。内部存储器221可以包括代码存储区和数据存储区。其中,代码存储区可存储操作***。数据存储区可存储电子设备200使用过程中所创建的数据等。此外,内部存储器221可以包括高速随机存取存储器,还可以包括非易失性存储器,例如一个或多个磁盘存储部件,闪存部件,通用闪存存储器(universal flash storage,UFS)等。在一些实施例中,处理器210可以通过运行存储在内部存储器221的指令,和/或存储在设置于处理器210中的存储器的指令,来使得电子设备200执行本申请实施例中所提供的组合显示方法,以及其他应用及数据处理。
输入模块270包括但不限于键盘、触摸屏(也可以为触摸显示屏)、鼠标、摄像头、激光笔、手写输入板、麦克风等。其中,麦克风包括单个麦克风,也包括麦克风阵列。
输出模块280包括但不限于显示屏、LED灯、扬声器、耳机、产生振动的电机及其辅助器件、产生热量的发热器件等。
电子设备200包括但不限于平板电脑、台式计算机、便携式电子设备(如膝上型计算机,Laptop)、智能电视(如智慧屏)、车载电脑、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、其他带有显示屏的智能设备等。电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2022070384-appb-000002
Linux或者其它操作***的便携式或非便携式的电子设备。
下面以局域网内包括电子设备200-电子设备203为例,结合图4至图7为本申请实施例提供的组合显示方法的示意性流程图。图4示出了本申请实施例提供的组合显示方法的示意性流程。如图4所示,该组合显示方法包括:
S401,移动设备100响应于接收到第一输入,发送广播消息,该广播消息用于指示局域网内的电子设备进入组合显示状态。
一个实施例中,电子设备200-电子设备203可以处于待发现状态。
示例性的,当移动设备需要进行投屏时,移动设备可以对局域网内的处于待发现的设电子备进行搜索,从而提示用户可以在电子设备200-电子设备203上进行投屏。如图9中的(a)所示,手机、智能电视1、智能电视2、智能电视3和智能电视4位于同一局域网内,手机显示视频播放界面,该视频播放界面包括视频显示窗口901和投屏控件902。智能电视1、智能电视2、智能电视3和智能电视4处于待发现状态。响应于检测到用户点击控件902的操作,手机可以显示如图9中的(b)所示的GUI。如图9中的(b)所 示的GUI,手机可以显示提示框903,其中提示框903包括局域网内处于待发现状态的智能电视1、智能电视2、智能电视3和智能电视4的设备信息。
一个实施例中,电子设备200-电子设备203在检测到用户的开机操作时,可以进入待发现状态。
一个实施例中,电子设备200-电子设备203也可以是在检测到用户的开机操作起的预设时长(例如,10分钟)内处于待发现状态。
一个实施例中,当移动设备检测到用户的第一操作时,移动设备向局域网内的设备发送该广播消息。
示例性的,如图10中的(b)所示,当手机检测到用户点击控件1002的操作时,手机可以向局域网内的设备发送该广播消息。
示例性的,如图11中的(a)所示,当手机检测到用户点击控件1102的操作时,手机可以向局域网内的设备发送该广播消息。
应理解,在本申请实施例中,该广播消息用于指示局域网内的电子设备进入组合显示状态,即指示局域网内的电子设备进行组合显示;也可以理解为指示局域网内的多个电子设备的显示屏组成一个更大的显示屏。
示例性的,该广播消息可以为用户数据报协议(user datagram protocol,UDP)数据包。UDP数据包包括IP数据报的数据部分。IP数据报的数据部分可以包括可扩展的比特位。电子设备200-电子设备203可以和移动设备100约定某个可扩展比特位的内容。当某个可扩展的比特位为1时,电子设备200-电子设备203就可以获知移动设备100希望其进入组合显示状态。
一个实施例中,支持组合显示的设备(例如,电子设备200-电子设备203)和不支持组合显示的设备(例如,平板、智能手表、音箱)都可以接入同一局域网。支持组合显示的设备可以在接收到移动设备100发送的广播消息后对该广播消息进行响应(例如通过显示屏显示地址信息),不支持组合显示的设备在接收到该广播消息后可以忽略该广播消息。
S402,电子设备200响应于接收到该广播消息,通过显示屏显示第一信息,该第一信息用于指示电子设备200的地址。
S403,电子设备201响应于接收到该广播消息,通过显示屏显示第二信息,该第二信息用于指示电子设备201的地址。
S404,电子设备202响应于接收到该广播消息,通过显示屏显示第三信息,该第三信息用于指示电子设备202的地址。
S405,电子设备203响应于接收到该广播消息,通过显示屏显示第四信息,该第四信息用于指示电子设备203的地址。
应理解,S402-S405之间并没有实际的先后顺序。
示例性的,以电子设备200-电子设备203为智能电视1、智能电视2、智能电视3和智能电视4为例。如图10中的(b)所示,当智能电视1、智能电视2、智能电视3和智能电视4接收到该广播消息后,可以通过各自的显示屏显示二维码,该二维码用于指示MAC地址。
应理解,上述在每个智能电视上显示二维码来指示其MAC地址的方式仅仅是示意性的,本申请实施例并不限于此。例如,每个智能电视在接收到该广播消息后,也可以在显示屏上显示其MAC地址,如智能电视1接收到该广播消息后,可以在显示屏上显示“3E-57-48-00-F8-ED”。
S406,移动设备响应于接收到的第二输入,获取第一图像信息,第一图像信息包括电子设备200的显示屏、电子设备201的显示屏、电子设备202的显示屏以及电子设备203的显示屏。
一个实施例中,该第一图像信息中包括电子设备200的显示屏,电子设备200的显示屏显示第一信息;该第一图像信息中包括电子设备201的显示屏,电子设备201的显示屏显示第二信息;该第一图像信息中包括电子设备202的显示屏,电子设备202的显示屏显示第三信息;该第一图像信息中包括电子设备203的显示屏,电子设备203的显示屏显示第四信息;
一个实施例中,移动设备检测到用户对电子设备200-电子设备203进行拍摄的操作时获取该第一图像信息。
示例性的,如图10中的(d)所示,当手机检测到用户点击控件1006的操作时,手机可以获取预览框中的图像信息,该图像信息中包括智能电视1、智能电视2、智能电视3和智能电视4上显示的二维码信息。
应理解,该第一图像信息可以包括一帧或者多帧图像。移动设备可以提示用户对需要组合显示的电子设备进行拍照从而获得一帧图像信息,或者,移动设备也可以提示用户对需要组合显示的电子设备录制视频,从而获得多帧图像信息。
一个实施例中,移动设备在检测到预设时长内,若干电子设备(比如电子设备200-电子设备203)的图像一直位于预览框中,且没有其他的电子设备的图像补入该预览框中,获取该第一图像信息。
一个实施例中,在移动设备检测到用户的第二输入之前,移动设备还可以提示用户获取包括需要组合显示的多个电子设备的图像信息。
一个实施例中,电子设备200-电子设备203响应于接收到该广播消息,还可以向移动设备发送响应。若移动设备接收到多个电子设备的响应,那么移动设备可以提示用户在局域网内发现了多个电子设备,并提示用户是否对多个电子设备进行组合显示。响应于用户确定对局域网内的多个电子屏设备进行组合显示的操作,移动设备可以提示用户获取包括需要组合显示的多个电子设备的图像信息。
S407,移动设备根据所述第一图像信息,确定多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息。
本申请实施例中,移动设备可以通过电子设备200-电子设备203的显示屏显示的第一信息至第四信息确定电子设备200-电子设备203的地址信息,并且可以通过第一图像信息中电子设备200-电子设备203的位置确定电子设备200-电子设备203的方位信息。
示例性的,如图10中的(d)所示,手机可以确定左上方的设备(智能电视1)的地址信息为MAC地址1,右上方的设备(智能电视2)的地址信息为MAC地址2,左下方的设备(智能电视3)的地址信息为MAC地址3,右下方的设备(智能电视4)的地址 信息为MAC地址4。
S408,移动设备向电子设备200发送指示信息,该指示信息用于指示多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息。
一个实施例中,该指示信息中可以包括该第一信息、该第二信息、该第三信息、该第四信息,电子设备200的显示屏-电子设备203的显示屏之间的方位信息、第一信息与电子设备200的显示屏的对应关系、第二信息与电子设备201的显示屏的对应关系、第三信息与电子设备202的显示屏的对应关系以及第四信息与电子设备203的显示屏的对应关系。
一个实施例中,若需要进行组合显示的设备包括电子设备200和电子设备201,那么该指示信息可以包括第一信息、第二信息、电子设备200的显示屏和电子设备201的显示屏的方位信息以及第一信息与电子设备200的显示屏的对应关系。
一个实施例中,移动设备还可以向电子设备200发送另一指示信息,该另一指示信息用于指示电子设备200为主控设备。
一个实施例中,该指示信息和该另一指示信息可以承载在同一个消息中,也可以承载在不同的消息中。
示例性的,移动设备可以在指示信息中携带矩阵信息,该矩阵信息用于指示多个电子设备中每个电子设备在多个电子设备中的方位信息以及每个电子设备的地址信息。
示例性的,该指示信息携带的矩阵信息M可以如公式(1)所示:
Figure PCTCN2022070384-appb-000003
电子设备200在接收到该指示信息可以获得矩阵M,该矩阵M的第一行第一列所示的MAC地址1可以表示左上方的电子设备的MAC地址为MAC地址1,该矩阵M的第一行第二列所示的MAC地址2可以表示右上方的电子设备的MAC地址为MAC地址2,该矩阵M中的第二行第一列所示的MAC地址3可以表示左下方的电子设备的MAC地址为MAC地址3,该矩阵M的第二行第二列所示的MAC地址4可以表示右下方的电子设备的MAC地址为MAC地址4。由于电子设备200的MAC地址为MAC地址1,那么电子设备200可以确定自己位于多个电子设备的左上方,同时电子设备200还可以确定其他电子设备的方位信息以及其MAC地址。
一个实施例中,移动设备在确定有多个电子设备需要组合显示时,可以从中任意选择一个电子设备(例如,电子设备200)并向该电子设备发送指示信息。
一个实施例中,电子设备200响应于接收到该指示信息,可以通过显示屏提示用户电子设备200可以控制电子设备200-电子设备203进行图像信息。
一个实施例中,移动设备向电子设备200发送该指示信息之前,可以先判断该第一图像信息中的多个电子设备分布是否规则。
示例性的,如图12中的(b)所示,当手机检测到用户点击控件1202的操作时,手机可以获取预览框中的第一图像信息。手机可以通过第一图像信息确定智能电视1-智能电视5的方位信息以及地址信息。例如,手机可以从第一图像信息中确定位于最左侧上方的电子设备的MAC地址为MAC地址5;位于中间上方的电子设备的MAC地址为 MAC地址1;位于中间下方的电子设备的MAC地址为MAC地址3;位于最右侧上方的电子设备的MAC地址为MAC地址2;位于最右侧下方的电子设备的MAC地址为MAC地址4。
手机可以将智能电视1-智能电视5的方位信息以及地址信息转化为矩阵N,矩阵信息N可以如公式(2)所示:
Figure PCTCN2022070384-appb-000004
手机可以确定该矩阵N为不规则矩阵,从而手机可以确定智能电视1-智能电视5的分布不规则。
一个实施例中,若移动设备确定该多个电子设备分布不规则,那么电子设备可以提示用户从该多个电子设备中选择部分电子设备进行组合显示。
示例性的,如图12中的(c)所示,手机在确定智能电视1-智能电视5分布不规则时,手机可以为用户选择分布规则的智能电视1-智能电视4进行组合显示。手机可以提示用户“检测到当前有5台电子设备需要组合显示,为保证图像显示效果,建议您选择虚线框中的设备组合显示”。S409,电子设备200根据该指示信息,控制电子设备200-电子设备203进行图像显示。
应理解,S409的过程可以参考图7-图8所示的过程,此处不再赘述。
一个实施例中,移动设备也可以不向电子设备发送该指示信息,而是向电子设备200发送该第一图像。电子设备200接收到该第一图像后,可以根据该第一图像确定该第一信息、该第二信息、该第三信息、该第四信息、电子设备200的显示屏-电子设备203的显示屏之间的方位信息、第一信息与电子设备200的显示屏的对应关系、第二信息与电子设备201的显示屏的对应关系、第三信息与电子设备202的显示屏的对应关系以及第四信息与电子设备203的显示屏的对应关系。电子设备200在确定上述信息后,可以对图像帧进行分割,进而控制电子设备200-电子设备203进行图像显示。
以上图4所示的S408中,移动设备可以是从多个电子设备中任意选择一个电子设备(例如,电子设备200)并向该电子设备发送指示信息,也可以是移动设备在检测到用户从多个电子设备中选择了电子设备200的操作时,向电子设备200发送该指示信息。图5示出了本申请实施例提供的组合显示方法的另一示意性流程。如图5所示,该方法包括:
S4081,响应于确定多个电子设备中每个电子设备的方位信息以及每个电子设备的地址信息,移动设备提示用户从多个电子设备中选择一个电子设备(例如,电子设备200)作为主控设备。
应理解,本申请实施例中,在多个电子设备组合显示后,主控设备可以被局域网内的设备(例如,需要进行投屏的设备)发现,主控设备可以用于对需要显示的图像信息进行图像分割,并控制该多个电子设备分别显示分割后的图像信息。
示例性的,如图10中的(e)所示,当手机检测到用户选择MAC地址为MAC地址1的电子设备并点击控件1008的操作时,手机可以确定MAC地址为MAC地址1的电子设备为主控设备。
S4082,移动设备响应于用户选择电子设备200为主控设备的操作,向电子设备200发送该指示信息。
应理解,移动设备向电子设备200发送该指示信息的过程可以参考上述S408的描述,此处不再赘述。
本申请实施例中,电子设备200在接收到移动设备发送的指示信息后,还可以通知电子设备201-电子设备203关闭设备发现状态。图6示出了本申请实施例提供的组合显示方法的另一示意性流程。如图6所示,该方法包括:
S4083,响应于接收到移动设备发送的指示信息,电子设备200通知电子设备201关闭设备发现。
一个实施例中,电子设备200通知电子设备201关闭设备发现,包括:电子设备200向电子设备201发送通知消息,该通知消息用于指示电子设备201停止处于待发现状态。
S4084,电子设备201关闭设备发现。
S4085,响应于接收到移动设备发送的指示信息,电子设备200通知电子设备202关闭设备发现。
一个实施例中,电子设备200通知电子设备202关闭设备发现,包括:电子设备200向电子设备202发送通知消息,该通知消息用于指示电子设备202停止处于待发现状态。
S4086,电子设备202关闭设备发现。
S4087,响应于接收到移动设备发送的指示信息,电子设备200通知电子设备203关闭设备发现。
一个实施例中,电子设备200通知电子设备203关闭设备发现,包括:电子设备200向电子设备203发送通知消息,该通知消息用于指示电子设备203停止处于待发现状态。
S4088,电子设备203关闭设备发现。
应理解,本申请实施例中,电子设备200通知电子设备201-电子设备203关闭设备发现还可以理解为电子设备200通知电子设备201-电子设备203停止处于待发现状态。
还应理解,本申请实施例中,电子设备201-电子设备203在关闭设备发现后,局域网内的其他设备(例如,移动设备)在搜索局域网内的可以投屏的设备时,将不会搜索到电子设备201-电子设备203。
还应理解,S4083-S4084,S4085-S4086和S4087-S4088之间并没有实际的先后顺序。
示例性的,如图10中的(e)所示,当手机检测到用户选择MAC地址为MAC地址1的电子设备(智能电视1)且点击了控件1008的操作时,手机可以向智能电视1发送该指示信息。智能电视1可以在接收到该指示信息后,通知智能电视2、智能电视3和智能电视4关闭设备发现。如图10中的(g)所示,手机搜索到的局域网内的可以投屏的设备只有智能电视1。
下面结合图7和图8,对上述S409中电子设备200根据该指示信息,控制电子设备200-电子设备203进行图像显示进行具体描述。图7示出了本申请实施例提供的组合显示方法的另一示意性流程。如图7所示,该方法包括:
S4091,移动设备响应于接收到第三输入,发现局域网内可以进行投屏的电子设备200。
示例性的,如图10中的(g)所示,手机可以提示用户选择投屏设备并显示搜索到 的设备列表,该设备列表中包括智能电视1。
应理解,S4091中的移动设备可以与上述图4-图6中的移动设备为同一个设备,也可以是不同的设备,本申请实施例中对此并不作限定。
S4092,响应于用户选择电子设备200进行投屏的操作,移动设备可以向电子设备200发送需要显示的图像信息。
示例性的,如图10中的(g)所示,手机检测到用户选择智能电视1的操作时,手机可以向智能电视1发送视频显示窗口1009的图像信息。
S4093,响应于接收到该图像信息,电子设备200根据该指示信息,对该图像信息进行分割。
一个实施例中,电子设备200根据该指示信息,对该图像信息进行分割得到第一部分图像信息、第二部分图像信息、第三部分图像信息和第四部分图像信息。
一个实施例中,电子设备200根据该指示信息,对该图像信息进行分割,包括:电子设备200根据电子设备200的显示屏、电子设备201的显示屏、电子设备202的显示屏以及电子设备203的显示屏的方位信息,对该图像信息进行分割。
一个实施例中,电子设备200根据该指示信息,对该图像信息进行分割,包括:电子设备200根据电子设备200的显示屏、电子设备201的显示屏、电子设备202的显示屏以及电子设备203的显示屏的方位信息和电子设备200的显示屏、电子设备201的显示屏、电子设备202的显示屏以及电子设备203的显示屏的尺寸,对该图像信息进行分割。
S4094,电子设备200根据该指示信息,显示第一部分图像信息。
一个实施例中,电子设备200根据电子设备200的方位信息,显示该第一部分图像信息。
S4095,电子设备200根据该指示信息,将第二部分图像信息发送给电子设备201并指示在电子设备201的显示屏上显示第二部分图像信息,将第三部分图像信息发送给电子设备202并指示在电子设备202的显示屏上显示第三部分图像信息,以及将第四部分图像信息发送给电子设备203并指示在电子设备203的显示屏上显示第四部分图像信息。
一个实施例中,电子设备200根据电子设备201的方位信息,确定将第二部分图像信息发送给电子设备201;电子设备200根据电子设备202的方位信息,确定将第三部分图像信息发送给电子设备202;电子设备200根据电子设备203的方位信息,确定将第四部分图像信息发送给电子设备203。
示例性的,当电子设备200获取到移动设备发送的图像信息后,可以根据矩阵M中电子设备的个数以及方位信息对该图像信息进行分割。例如,矩阵M中包括MAC地址1~4表示有4个电子设备进行了组合显示,且该4个电子设备分别位于左上方、右上方、左下方和右下方。那么电子设备200可以根据4个电子设备的方位将移动设备发送的一帧图像信息分割为4帧图像。从而电子设备200可以显示左上方的图像信息;电子设备200可以向矩阵M中第一行第二列的MAC地址2对应的电子设备发送右上方的图像信息,从而使得其显示右上方的图像信息;电子设备200可以向矩阵M中第二行第一列的MAC地址3对应的电子设备发送左下方的图像信息,从而使得其显示左下方的图像信 息;电子设备200可以向矩阵M中第二行第二列的MAC地址4对应的电子设备发送右下方的图像信息,从而使得其显示右下方的图像信息。
应理解,S4094和S4095之间并没有实际的先后顺序。
示例性的,如图10中的(h)所示,当智能电视1接收到手机发送的图像信息后,可以将该图像信息分割为图像信息1012、图像信息1013、图像信息1014和图像信息1015。智能电视1可以显示处于左上方的图像信息1012;智能电视1还可以将图像信息1013发送给智能电视2,从而使得智能电视2显示右上方的图像信息1013;智能电视1还可以将图像信息1014发送给智能电视3,从而使得智能电视3显示左下方的图像信息1014;智能电视1还可以将图像信息1015发送给智能电视4,从而使得智能电视4显示右下方的图像信息1015。
图8示出了本申请实施例提供的组合显示方法的另一示意性流程。如图8所示,该方法包括:
S4096,电子设备200响应于检测到用户操作电子设备200播放本地内容或者直播内容的操作,对本地内容或者直播内容进行图像分割。
一个实施例中,电子设备200根据该指示信息,对该图像信息进行分割得到第一部分图像信息、第二部分图像信息、第三部分图像信息和第四部分图像信息。
S4097,电子设备200根据该指示信息,显示第一部分图像信息。
一个实施例中,电子设备200根据电子设备200的方位信息,显示该第一部分图像信息。
S4098,电子设备200根据该指示信息,将第二部分图像信息发送给电子设备201并指示在电子设备201的显示屏上显示第二部分图像信息,将第三部分图像信息发送给电子设备202并指示在电子设备202的显示屏上显示第三部分图像信息,以及将第四部分图像信息发送给电子设备203并指示在电子设备203的显示屏上显示第四部分图像信息。
一个实施例中,电子设备200根据电子设备201的方位信息,确定将第二部分图像信息发送给电子设备201;电子设备200根据电子设备202的方位信息,确定将第三部分图像信息发送给电子设备202;电子设备200根据电子设备203的方位信息,确定将第四部分图像信息发送给电子设备203。
应理解,S4096和S4093的区别在于,S4093中电子设备200需要接收移动设备发送的图像信息,并控制电子设备200-电子设备203进行图像显示;而S4096中电子设备200无需接收局域网内的其他设备发送的图像信息,电子设备200在播放本地内容或者直播内容时,控制控制电子设备200-电子设备203进行图像显示。
还应理解,S4091~S4095与S4096~S4098是并列的关系。
还应理解,S4096~S4098中电子设备200控制电子设备200-电子设备203进行图像显示的过程可以参考上述S4093~S4095的过程,为了简洁,在此不再赘述。
示例性的,如图13所示,当智能电视1检测到用户通过遥控器切换到频道显示界面后,可以将该频道显示界面对应的图像信息分割为图像信息1301、图像信息1302、图像信息1303和图像信息1304。智能电视1可以显示处于左上方的图像信息1301;智能电视1还可以将图像信息1302发送给智能电视2,从而使得智能电视2显示右上方的图像 信息1302;智能电视1还可以将图像信息1303发送给智能电视3,从而使得智能电视3显示右上方的图像信息1303;智能电视1还可以将图像信息1304发送给智能电视4,从而使得智能电视4显示右上方的图像信息1304。
本申请提供的技术方案,无需专用的分屏设备;另外,通过无线的方式,也不需要不同电子设备之间的复杂布线;由于不再使用分屏设备以及不同电子设备之间的布线,成本也得到了降低;并且,实现了多个不同电子设备的组合显示。
下面结合图9至图14所示的图形用户界面(graphical user interface,GUI)对本申请实施例的组合显示方法进行进一步阐述。图9示出了本申请实施例提供的一组GUI。
如图9中的(a)所示,手机、智能电视1、智能电视2、智能电视3和智能电视4位于同一局域网内,手机显示视频播放界面,该视频播放界面上包括视频显示窗口901和投屏控件902。智能电视1、智能电视2、智能电视3和智能电视4处于待发现状态。响应于检测到用户点击控件902的操作,手机可以显示如图9中的(b)所示的GUI。
如图9中的(b)所示的GUI,手机可以显示提示框903,其中提示框903中包括局域网内处于待发现状态的智能电视1、智能电视2、智能电视3和智能电视4的设备信息。
示例性的,当手机检测到用户选择智能电视2的操作时,手机可以将视频显示窗口901中的图像信息发送给智能电视2。
图10是本申请实施例提供的另一组GUI。
如图10中的(a)所示,客厅中包括智能电视1、智能电视2、智能电视3和智能电视4。手机显示手机的桌面。其中,手机的桌面上包括多个应用程序的图标,该多个应用程序包括时钟、日历、图库、备忘录以及智慧生活等。响应于检测到针对一个APP(比如,智慧生活)图标的输入(比如,点击等),手机可以显示如图10中的(b)所示的GUI。
本申请实施例中,手机、智能电视1、智能电视2、智能电视3和智能电视4可以连接同一路由器。或者,手机、智能电视1、智能电视2、智能电视3和智能电视4之间有一个中心设备,例如手机。
例如,路由器可作为接入点(access point,AP),用于提供网络的信号源。进而,手机、智能电视1、智能电视2、智能电视3和智能电视4可作为站点(station,STA)接入路由器。路由器可以通过有线网络方式或无线网络方式分别与各电子设备进行通信。示例性的,各电子设备之间通过无线保真(wireless fidelity,Wi-Fi)协议建立Wi-Fi链路,以实现设备之间的通信。具体实现可以是,各电子设备之间建立点对点(peer-to-peer,P2P)连接(或称为Wi-Fi直连(Wi-Fi Direct)),或各接入同一个路由器,以实现设备之间的通信。
又例如,在中心设备(例如,手机)上创建Wi-Fi P2P的GO,即Group Owner,其他设备作为P2P GC即Group Client来连接这个GO,这些设备间也就形成一对多组合显示,可相互通信。
一个实施例中,当智能电视1、智能电视2、智能电视3和智能电视4开机后,智能电视1、智能电视2、智能电视3和智能电视4可以从开机起的预设时长(例如,10分钟)内处于待发现状态,局域网内的其他设备可以发现智能电视1、智能电视2、智能电 视3和智能电视4。示例性的,当手机需要进行投屏时,手机可以对局域网内的设备进行搜索,从而提示用户可以在智能电视1、智能电视2、智能电视3或智能电视4上进行投屏。
如图10中的(b)所示,手机可以显示智慧生活的显示界面。响应于检测到用户点击控件1001的操作,手机可以显示功能列表,其中功能列表包括发现设备、创建智能、共享设备以及连接三方平台等功能。
一个实施例中,响应于检测到用户点击发现设备功能1002的操作,手机可以向与手机位于同一局域网内的设备发送广播消息,该广播消息用于指示电子设备进入组合显示状态。智能电视1、智能电视2、智能电视3和智能电视4响应于接收到该广播消息,可以通过显示屏显示二维码。其中,每个智能电视显示的二维码用于指示其地址信息(例如,媒体接入控制(media access control,MAC)地址)。示例性的,智能电视1显示的二维码信息指示智能电视1的地址信息为MAC地址1,智能电视2显示的二维码信息指示智能电视2的地址信息为MAC地址2,智能电视3显示的二维码信息指示智能电视3的地址信息为MAC地址3,智能电视4显示的二维码信息指示智能电视4的地址信息为MAC地址4。
如图10中的(c)所示,手机可以显示智慧生活的另一显示界面。该显示界面上包括提示框1003,其中该提示框1003包括提示信息“检测到局域网内有多个电子设备,是否进行多个电子设备的组合显示”。响应于手机检测到用户点击控件1004的操作,手机可以显示如图10中的(d)所示的GUI。
一个实施例中,手机在发送广播消息后,智能电视1、智能电视2、智能电视3和智能电视4可以向手机发送响应,若手机接收到多个电子设备(例如,智能电视1、智能电视2、智能电视3和智能电视4),那么手机可以显示该提示框1003。
如图10中的(d)所示,手机可以启动摄像头并显示提示信息“请将需要组合显示的电子设备置于以下预览框中”。手机可以在预览框1005中显示手机摄像头采集的多个设备的信息。当手机检测到用户点击控件1006的操作时,手机可以显示如图10中的(e)所示的GUI。
一个实施例中,当手机检测到用户点击控件1006的操作时,手机可以通过预览框1005中多个智能电视上显示的二维码信息确定多个智能电视的地址信息,同时,手机也可以通过预览框1005中的图像信息确定各个智能电视的方位信息。例如,手机可以确定MAC地址为1的设备位于左上方,MAC地址为2的设备位于右上方,MAC地址为3的设备位于左下方,MAC地址为4的设备位于右下方。
如图10中的(e)所示,手机可以显示提示信息“检测到当前有4台电子设备需要组合显示,请您选择一台电子设备作为主控设备”。响应于手机检测到用户选择位于左上方的设备1007,并检测到用户点击控件1008的操作时,手机可以确定地址信息为MAC地址1的设备为主控设备。
一个实施例中,当手机确定用户选择智能电视1为主控设备时,手机可以向智能电视1发送指示信息,该指示信息用于指示其他智能电视(智能电视2、智能电视3和智能电视4)的地址信息以及其他智能设备与智能电视1之间的方位信息。
本申请实施例中,手机向智能电视1发送的指示信息可以用于智能电视1的图像分割。智能电视1在获取该指示信息后,可以确定用户将哪些设备进行组合显示,分割后的图像应该发送给哪个设备进行显示。示例性的,智能电视1根据指示信息可以获知用户将4台设备进行了组合显示且智能电视1位于4台设备的左上方,地址信息为MAC地址2的设备位于4台设备的右上方,地址信息为MAC地址3的设备位于4台设备的左下方,地址信息为MAC地址4的设备位于4台设备的右下方。那么智能电视1在获取图像信息后可以将该图像信息分割为4个图像信息(左上方的图像、右上方的图像、左下方的图像和右下方的图像),智能电视1可以通过显示屏显示左上方的图像,将右上方的图像发送给地址信息为MAC地址2的设备进行显示,将左下方的图像发送给地址信息为MAC地址3的设备进行显示,将右下方的图像发送给地址信息为MAC地址4的设备进行显示。
一个实施例中,智能电视1在接收到该指示信息后可以确定智能电视1为主控设备,且智能电视1可以通知其他智能电视关闭设备发现(或者,通知其他智能设备停止进入待发现状态)。其他智能电视在接收到智能电视1的通知后,可以关闭设备发现。
如图10中的(f)所示的GUI,该GUI为视频播放界面,该视频播放界面上包括视频显示窗口1009和投屏控件1010。响应于检测到用户点击控件1010的操作,手机可以显示如图10中的(g)所示的GUI。
应理解,图10中的(f)所示的手机和图10中的(a)至(e)中所示的手机可以为同一手机,或者,也可以是不同的手机。
如图10中的(g)所示的GUI,手机可以显示提示框1011,其中提示框1011中包括手机发现的可以进行投屏的设备列表。由于智能电视2、智能电视3和智能电视4已经关闭了设备发现,所以该设备列表中只有智能电视1。响应于检测到用户选择智能电视1进行投屏的操作,手机可以向智能电视1发送视频显示窗口1009中的图像信息。
如图10中的(h)所示,响应于用户选择智能电视1的操作,手机可以向智能电视1发送视频显示窗口1009中的图像信息。智能电视1在接收到手机发送的图像信息后,可以根据智能电视1与其他智能电视之间的方位信息对该图像信息进行分割。示例性的,智能电视1可以将该图像信息中的每一帧图像切割成4帧图像,例如,切割后的4帧图像分为为左上方的图像1012、右上方的图像1013、左下方的图像1014以及右下方的图像1015。
智能电视1可以根据智能电视2的方位信息以及智能电视2的地址信息,向智能电视2发送右上方的图像1013,从而智能电视2可以显示图像1013;智能电视1可以根据智能电视3的方位信息以及智能电视3的地址信息,向智能电视3发送左下方的图像1014,从而智能电视3可以显示图像1014;智能电视1可以根据智能电视4的方位信息以及智能电视4的地址信息,向智能电视4发送右下方的图像1015,从而智能电视4可以显示图像1015;智能电视1可以显示左上方的图像1012。
本申请实施例中不需要其他的硬件设备就可以完成多个小显示屏组成一个大显示屏且对显示屏安装没有任何要求,有助于节省硬件成本。用户可以从多个小显示屏选择一个显示屏作为主控显示屏,后续可以通过主控显示屏进行图像分割和分发显示,有助于 提升用户的体验。
图11示出了本申请实施例提供的另一组GUI。
如图11中的(a)所示,当手机检测到用户点击控件1101的操作时,手机可以显示功能列表,其中功能列表中包括发现设备、大屏组合显示、共享设备以及连接三方平台功能。当手机检测到用户点击大屏组合显示功能1102的操作时,手机可以显示如图11中的(b)所示的GUI。
一个实施例中,响应于检测到用户点击大屏组合显示功能1102的操作,手机可以向与手机位于同一局域网内的设备发送广播消息,该广播消息用于指示电子设备进入组合显示状态。智能电视1、智能电视2、智能电视3和智能电视4响应于接收到该广播消息,可以通过显示屏显示二维码,其中,每个智能电视显示的二维码用于指示其地址信息(例如,MAC地址)。
如图11中的(b)所示,响应于用户选择大屏组合显示功能1102的操作,手机可以启动摄像头并显示提示信息“请将需要组合显示的电子设备置于以下预览框中”。手机可以在预览框1103中显示手机摄像头采集的多个设备的信息。当手机检测到用户点击控件1104的操作时,手机可以通过预览框1103中多个智能电视上显示的二维码信息确定多个智能电视的地址信息,同时,手机也可以通过预览框1103中的图像信息确定各个智能电视的方位信息。
应理解,手机检测到用户点击控件1104后的过程可以参考上述图10中的(e)至(h),为了简洁,在此不再赘述。
图12示出了本申请实施例提供的另一组GUI。
如图12中的(a)所示,客厅中包括智能电视1、智能电视2、智能电视3、智能电视4和智能电视5。
如图12中的(b)所示,当手机确定用户希望进行大屏组合显示时,手机可以启动摄像头并显示提示信息“请将需要组合显示的电子设备置于以下预览框中”。
应理解,手机确定用户希望进行大屏组合显示的过程可以参考上述图10中的(a)至(d)所示的GUI。或者,也可以参考图11中的(a)至(b)所示的GUI。
手机可以在预览框1201中显示手机摄像头采集的多个设备的信息。当手机检测到用户点击控件1202的操作时,手机可以通过预览框1201中多个智能电视上显示的二维码信息确定多个智能电视的地址信息,同时,手机也可以通过预览框1201中的图像信息确定各个智能电视的方位信息。
应理解,手机检测到用户点击控件1104后的过程可以参考上述图10中的(e)至(h),此处不再赘述。
如图12中的(c)所示,当手机确定预览框1201中的5台设备呈不规则分布时,手机可以提示用户“检测到当前有5台电子设备需要组合显示,为保证图像显示效果,建议您选择虚线框中的设备组合显示”。手机可以提示用户选择虚线框1203中的4台设备进行组合显示。当手机检测到用户点击控件1204的操作时,手机可以将智能电视1、智能电视2、智能电视3和智能电视4进行组合显示,并提示用户选择其中一个设备为主控设备。
应理解,手机提示用户选择其中一个设备为主控设备的过程可以参考上述图10中的(e)所示的GUI,为了简洁,在此不再赘述。
还应理解,当手机检测到用户选择了智能电视1为主控设备时,手机可以向智能电视1发送指示信息,该指示信息的描述可以参考上述实施例中的描述。
如图12中的(d)所示,该GUI为视频播放界面,该视频播放界面上包括视频显示窗口1205和投屏控件1206。响应于检测到用户点击控件1206的操作,手机可以显示如图12中的(e)所示的GUI。
如图12中的(e)所示的GUI,手机可以显示提示框1207,其中提示框1207中包括手机发现的可以进行投屏的设备列表。该设备列表中包括智能电视1和智能电视5。其中,智能电视1后还包括提示信息“处于组合显示中”。
响应于检测到用户选择智能电视1进行投屏的操作,手机可以向智能电视1发送视频显示窗口1205中的图像信息。
如图12中的(f)所示,响应于用户选择智能电视1的操作,手机可以向智能电视1发送视频显示窗口1205中的图像信息。智能电视1在接收到手机发送的图像信息后,可以根据智能电视1与其他智能电视之间的方位信息对该图像信息进行分割。示例性的,智能电视1可以将该图像信息中的每一帧图像切割成4帧图像,例如,切割后的4帧图像分为为左上方的图像1208、右上方的图像1209、左下方的图像1210以及右下方的图像1211。
智能电视1可以根据智能电视2的方位信息以及智能电视2的地址信息,向智能电视2发送右上方的图像1209,从而智能电视2可以显示图像1209;智能电视1可以根据智能电视3的方位信息以及智能电视3的地址信息,向智能电视3发送左下方的图像1210,从而智能电视3可以显示图像1210;智能电视1可以根据智能电视4的方位信息以及智能电视4的地址信息,向智能电视4发送右下方的图像1211,从而智能电视4可以显示图像1211;智能电视1可以显示左上方的图像1208。
一个实施例中,响应于用户选择将智能电视1、智能电视2、智能电视3和智能电视4进行组合显示的操作,手机还可以指示智能电视5进入熄屏状态,从而避免在智能电视1-智能电视4显示图像信息时,智能电视5对用户的影响,有助于提升用户观看视频时的体验。
本申请实施例中,当多个小显示屏分布不规则时,手机可以提示用户选择合适的显示屏分布方式进行设备组合显示,这样可以保证用户在使用手机投屏时观看到最佳的图像效果,有助于提升用户的体验。
以上图10和图12所示的GUI中均是以手机投屏的方式在智能电视1、智能电视2、智能电视3和智能电视4中显示图像信息的过程。下面结合图13介绍智能电视1在接收到指示信息后,通过智能电视1、智能电视2、智能电视3和智能电视4播放智能电视1显示的图像信息的过程。图13示出了本申请实施例提供的另一GUI。
如图13所示,当智能电视1需要显示频道切换界面时,智能电视可以根据手机发送的指示信息,对该频道切换界面进行图像分割,得到图像信息1301、图像信息1302、图像信息1303和图像信息1304,从而在智能电视1上显示分割后的一部分图像,将其他分 割后的图像分别发送给智能电视2、智能电视3和智能电视4进行显示。应理解,智能电视1、智能电视2、智能电视3和智能电视4显示图像信息的过程可以参考上述实施例中的描述,为了简洁,在此不再赘述。
图14示出了本申请实施例提供的另一组GUI。
如图14中的(a)所示的GUI,该GUI为智慧生活的另一显示界面。相比于图3中的(b)所示的GUI,当手机将智能电视1、智能电视2、智能电视3和智能电视4进行组合显示后,该显示界面上可以增加组合显示设备的设备信息的显示框1401。当手机检测到用户在显示框1401上的长按操作时,手机可以显示如图14中的(b)所示的GUI。
如图14中的(b)所示的GUI,该GUI为智慧生活的另一显示界面。响应于检测到用户在显示框1401上的长按操作,手机可以显示控件1402。当手机检测到用户点击控件1402的操作时,手机可以向智能电视发送另一指示信息,该另一指示信息用于指示智能电视1取消和智能电视2、智能电视3、智能电视4之间的组合显示。智能电视1在接收到该另一指示信息后,可以通知智能电视2、智能电视3、智能电视4取消组合显示。此后,当手机检测到用户的投屏操作时,手机还可以提示用户在智能电视1、智能电视2、智能电视3和智能电视4中选择一个投屏设备。
如图14中的(c)所示的GUI,该GUI为智慧生活的另一显示界面。响应于用户点击控件1402的操作,手机在该显示界面上删除显示框1401。
需要说明的是,本申请提供的上述各个实施例的全部或部分,均可以自由地、任意地相互组合。
本申请实施例提供的组合显示方法适用于以下的移动设备和电子设备。
图15所示为本申请提供的一种移动设备1500。示例的,移动设备1500包括至少一个处理器1510、存储器1520和显示屏1530。其中,处理器1510与存储器1520和显示屏1530耦合,本申请实施例中的耦合可以是通信连接,可以是电性,或其它的形式。具体的,存储器1520用于存储程序指令。显示屏1530用于显示用户界面。处理器1510用于调用存储器1520中存储的程序指令,使得移动设备1500执行本申请实施例提供的组合显示方法中由移动设备所执行的步骤。应理解,该移动设备1500可以用于实现本申请实施例提供的组合显示方法,相关特征可以参照上文,此处不再赘述。
在一些实施例中,在显示屏具有触摸功能时,显示屏又称为触摸显示屏。在触摸显示屏上的操作可以通过虚拟按键实现。在显示屏不具有触摸功能时,显示屏又称为非触摸显示屏。在非触摸显示屏上的操作可以通过物理按键实现。
本申请提供一种包含指令的计算机程序产品,当所述计算机程序产品在移动设备上运行时,使得所述移动设备执行本申请实施例提供的组合显示方法中由移动设备所执行的步骤。
本申请提供一种计算机可读存储介质,包括指令,当所述指令在移动设备上运行时,使得所述移动设备执行本申请实施例提供的组合显示方法中由移动设备所执行的步骤。
所属领域的技术人员可以清楚地了解到本申请实施例可以用硬件实现,或硬件与软件的方式实现。当使用硬件与软件实现,可以将上述功能存储在计算机可读介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者 该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
图16所示为本申请提供的一种电子设备1600。示例的,电子设备1600包括至少一个处理器1610、存储器1620和显示屏1630。其中,处理器1610与存储器1620和显示屏1630耦合,本申请实施例中的耦合可以是通信连接,可以是电性,或其它的形式。具体的,存储器1620用于存储程序指令。显示屏1630用于显示用户界面。处理器1610用于调用存储器1620中存储的程序指令,使得电子设备1600执行本申请实施例提供的组合显示方法中由电子设备所执行的步骤。应理解,该电子设备1600可以用于实现本申请实施例提供的组合显示方法,相关特征可以参照上文,此处不再赘述。
在一些实施例中,在显示屏具有触摸功能时,显示屏又称为触摸显示屏。在触摸显示屏上的操作可以通过虚拟按键实现。在显示屏不具有触摸功能时,显示屏又称为非触摸显示屏。在非触摸显示屏上的操作可以通过物理按键实现。
本申请提供一种包含指令的计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行本申请实施例提供的方法中由电子设备执行的步骤。
本申请提供一种计算机可读存储介质,包括计算机程序,当所述计算机程序在电子设备上运行时,使得所述电子设备执行本申请实施例提供的方法中由电子设备执行的步骤。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的***、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的***、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以 是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (21)

  1. 一种组合显示***,其特征在于,所述***包括位于同一局域网的移动设备、第一电子设备和第二电子设备,所述第一电子设备包括第一显示屏,所述第二电子设备包括第二显示屏;
    所述移动设备,用于响应于接收到的第一输入,广播第一消息;所述第一消息用于指示要组合显示;
    所述第一电子设备,用于响应于接收到的所述第一消息,通过所述第一显示屏显示第一信息;所述第一信息用于指示所述第一电子设备的地址信息;
    所述第二电子设备,用于响应于接收到的所述第一消息,通过所述第二显示屏显示第二信息;所述第二信息用于指示所述第二电子设备的地址信息;
    所述移动设备,还用于获取第一图像,所述第一图像包括所述第一显示屏和所述第二显示屏;所述第一显示屏显示所述第一信息;所述第二显示屏显示所述第二信息;
    所述移动设备,还用于选择所述第一显示屏对应的所述第一电子设备为主控设备,并向所述第一电子设备发送第二消息;所述第二消息包括所述移动设备根据所述第一图像获取到的所述第一信息、所述第二信息、所述第一显示屏与所述第二显示屏之间的方位信息及尺寸比例关系、所述第一信息与所述第一显示屏的对应关系;所述第二消息还用于指示所述第一电子设备被选择为主控设备;
    所述第一电子设备,还用于响应于接收到的所述第二消息,控制所述第一显示屏和所述第二显示屏组合显示。
  2. 根据权利要求1所述的***,其特征在于,所述选择所述第一显示屏对应的所述第一电子设备为主控设备;包括:
    所述移动设备接收到对所述第一显示屏对应的所述第一电子设备的用户选择;
    响应于所述用户选择,所述移动设备记录所述第一电子设备为主控设备。
  3. 根据权利要求1所述的***,其特征在于,所述选择所述第一显示屏对应的所述第一电子设备为主控设备;包括:
    所述移动设备随机选择所述第一显示屏对应的所述第一电子设备为主控设备。
  4. 根据权利要求1-3中任意一项所述的***,其特征在于,
    所述第一电子设备和所述第二电子设备,还用于在开机后保持第一状态,直至开机后的时长达到预设时长,收到所述第二消息,或收到通知消息,或停止消息;在所述第一状态下,所述第一电子设备和所述第二电子设备用于在接收到所述移动设备的第一消息后,分别通过所述第一显示屏和所述第二显示屏显示所述第一信息和所述第二信息;
    所述第一电子设备,还用于在接收到所述移动设备的第二消息后,向所述第二电子设备发送通知消息,所述通知消息用于指示所述第二电子设备停止处于所述第一状态;
    所述第二电子设备,还用于在接收到所述通知消息后,进入第二状态;在所述第二状态下,所述第二电子设备只受所述主控设备的控制;
    所述第二电子设备,还用于在接收到所述停止消息后,不再通过所述第二显示屏显 示所述第二信息。
  5. 根据权利要求1-4中任意一项所述的***,其特征在于,所述控制所述第一电子设备和所述第二电子设备组合显示;包括:
    所述第一电子设备接收到待显示的一个图像帧,根据所述第一显示屏和所述第二显示屏的方位信息及尺寸比例关系,以及所述第一显示屏的尺寸,对所述图像帧进行分割,得到第一部分图像和第二部分图像,在所述第一显示屏上显示所述第一部分图像,将所述第二部分图像发送给所述第二电子设备,并指示在所述第二显示屏上显示所述第二部分图像。
  6. 根据权利要求5所述的***,其特征在于,所述根据所述第一显示屏和所述第二显示屏的方位信息及尺寸比例关系,以及所述第一显示屏的尺寸,对所述图像帧进行分割,包括:
    根据所述第一显示屏和所述第二显示屏的方位信息、所述第一显示屏的尺寸以及所述第二显示屏的尺寸,对所述图像帧进行分割。
  7. 根据权利要求5或6所述的***,其特征在于,所述图像帧来自于所述移动设备的投屏数据。
  8. 根据权利要求1-7中任意一项所述的***,其特征在于,所述移动设备具体用于:
    在获取所述第一图像之前,提示对需要组合显示的所述第一显示屏和所述第二显示屏拍照;
    响应于检测到的对所述第一显示屏和所述第二显示屏的拍照操作,获取到所述第一图像。
  9. 根据权利要求1-8中任意一项所述的***,其特征在于,所述第一信息用于指示所述第一电子设备的媒体接入控制层MAC地址,所述第二信息用于指示所述第二电子设备的MAC地址。
  10. 一种组合显示方法,其特征在于,所述方法应用于移动设备;所述移动设备、第一电子设备和第二电子设备位于同一局域网内,所述第一电子设备包括第一显示屏,所述第二电子设备包括第二显示屏;所述方法包括:
    接收到第一输入;
    响应于所述第一输入,广播第一消息;所述第一消息用于指示要组合显示;
    获取到第一图像,所述第一图像包括所述第一显示屏和所述第二显示屏;所述第一显示屏显示所述第一信息;所述第二显示屏显示所述第二信息;所述第一信息用于指示所述第一电子设备的地址信息;所述第二信息用于指示所述第二电子设备的地址信息;
    选择所述第一显示屏对应的所述第一电子设备为主控设备,并向所述第一电子设备发送第二消息;所述第二消息包括所述移动设备根据所述第一图像获取到的所述第一信息、所述第二信息、所述第一显示屏与所述第二显示屏之间的方位信息、所述第一信息与所述第一显示屏的对应关系;所述第二消息还用于指示所述第一电子设备被选择为主控设备;
    将一个图像帧发送给所述第一电子设备,或者,将一个链接地址发送给所述第一电子设备。
  11. 根据权利要求10所述的方法,其特征在于,所述选择所述第一显示屏对应的所述第一电子设备为主控设备;包括:
    所述移动设备接收到对所述第一显示屏对应的所述第一电子设备的用户选择;
    响应于所述用户选择,所述移动设备记录所述第一电子设备为主控设备。
  12. 根据权利要求10所述的方法,其特征在于,所述选择所述第一显示屏对应的所述第一电子设备为主控设备;包括:
    所述移动设备随机选择所述第一显示屏对应的所述第一电子设备为主控设备。
  13. 根据权利要求10-12中任意一项所述的方法,其特征在于,所述图像帧来自于所述移动设备的投屏数据。
  14. 一种组合显示方法,其特征在于,所述方法应用于第一电子设备;所述第一电子设备、第二电子设备和移动设备位于同一局域网内,所述第一电子设备包括第一显示屏,所述第二电子设备包括第二显示屏;所述方法包括:
    所述第一电子设备接收到第一消息,所述第一消息用于指示要组合显示;
    响应于接收到的所述第一消息,所述第一显示屏显示第一信息;所述第一信息用于指示所述第一电子设备的地址信息;
    所述第一电子设备接收到所述移动设备发送的第二消息,所述第二消息包括所述移动设备根据所述第一图像获取到的所述第一信息、所述第二信息、所述第一显示屏与所述第二显示屏之间的方位信息、所述第一信息与所述第一显示屏的对应关系;所述第二消息还用于指示所述第一电子设备被选择为主控设备;
    响应于接收到的所述第二消息,所述第一电子设备控制所述第一显示屏和所述第二显示屏组合显示。
  15. 根据权利要求14所述的方法,其特征在于,在所述第一电子设备接收到第一消息之前,所述方法还包括:
    所述第一电子设备在开机后保持第一状态,直至开机后的时长达到预设时长或收到所述第二消息;
    在所述第一状态下,所述第一电子设备用于在接收到所述移动设备的第一消息后,通过所述第一显示屏显示所述第一信息。
  16. 根据权利要求14或15所述的方法,其特征在于,所述方法还包括:
    在接收到所述移动设备的第二消息后,所述第一电子设备向所述第二电子设备发送通知消息,所述通知消息用于指示所述第二电子设备停止处于第一状态。
  17. 根据权利要求14-16中任意一项所述的方法,其特征在于,所述第一电子设备控制所述第一显示屏和所述第二显示屏组合显示;包括:
    所述第一电子设备接收到待显示的一个图像帧,根据所述第一显示屏和所述第二显示屏的方位信息及尺寸比例关系,以及所述第一显示屏的尺寸,对所述图像帧进行分割,得到第一部分图像和第二部分图像,在所述第一显示屏上显示所述第一部分图像,将所述第二部分图像发送给所述第二电子设备,并指示在所述第二显示屏上所述第二部分图像。
  18. 一种移动设备,其特征在于,包括:
    处理器;
    存储器;
    以及计算机程序,其中所述计算机程序被存储在所述存储器中,当所述计算机程序被所述处理器执行时,使得所述移动设备执行如权利要求10-13中任意一项所述的方法。
  19. 一种第一电子设备,其特征在于,包括:
    第一显示屏;
    处理器;
    存储器;
    以及计算机程序,其中所述计算机程序被存储在所述存储器中,当所述计算机程序被所述处理器执行时,使得所述第一电子设备执行如权利要求14-17中任意一项所述的方法。
  20. 一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,其特征在于,当所述计算机程序在移动设备上运行时,使得所述移动设备执行如权利要求10-13中任意一项所述的方法;或者,当所述计算机程序在第一电子设备上运行时,使得所述第一电子设备执行如权利要求14-17中任意一项所述的方法。
  21. 一种计算机程序产品,其特征在于,当所述计算机程序产品在移动设备上运行时,使得所述移动设备执行如权利要求10-13中任意一项所述的方法;或者,当所述计算机程序产品在第一电子设备上运行时,使得所述第一电子设备执行如权利要求14-17中任意一项所述的方法。
PCT/CN2022/070384 2021-01-31 2022-01-05 一种组合显示方法、移动设备及电子设备 WO2022161128A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110132290.5 2021-01-31
CN202110132290.5A CN114840157A (zh) 2021-01-31 2021-01-31 一种组合显示方法、移动设备及电子设备

Publications (1)

Publication Number Publication Date
WO2022161128A1 true WO2022161128A1 (zh) 2022-08-04

Family

ID=82561108

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/070384 WO2022161128A1 (zh) 2021-01-31 2022-01-05 一种组合显示方法、移动设备及电子设备

Country Status (2)

Country Link
CN (1) CN114840157A (zh)
WO (1) WO2022161128A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106227480A (zh) * 2016-07-22 2016-12-14 深圳天珑无线科技有限公司 一种服务器、客户端和多屏互动方法、***
US20170330359A1 (en) * 2014-10-27 2017-11-16 Zte Corporation Method, device and mcu for adjusting and controlling sub-picture in multiple pictures
CN109271125A (zh) * 2018-11-05 2019-01-25 Oppo广东移动通信有限公司 分体式终端设备的屏显控制方法、装置及存储介质
CN109992231A (zh) * 2019-03-28 2019-07-09 维沃移动通信有限公司 投屏方法及终端
CN110515572A (zh) * 2018-05-21 2019-11-29 腾讯科技(深圳)有限公司 投屏方法、装置、存储介质和计算机设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170330359A1 (en) * 2014-10-27 2017-11-16 Zte Corporation Method, device and mcu for adjusting and controlling sub-picture in multiple pictures
CN106227480A (zh) * 2016-07-22 2016-12-14 深圳天珑无线科技有限公司 一种服务器、客户端和多屏互动方法、***
CN110515572A (zh) * 2018-05-21 2019-11-29 腾讯科技(深圳)有限公司 投屏方法、装置、存储介质和计算机设备
CN109271125A (zh) * 2018-11-05 2019-01-25 Oppo广东移动通信有限公司 分体式终端设备的屏显控制方法、装置及存储介质
CN109992231A (zh) * 2019-03-28 2019-07-09 维沃移动通信有限公司 投屏方法及终端

Also Published As

Publication number Publication date
CN114840157A (zh) 2022-08-02

Similar Documents

Publication Publication Date Title
CN110622123B (zh) 一种显示方法及装置
CN112714214B (zh) 一种内容接续方法、设备、***、gui及计算机可读存储介质
WO2020216156A1 (zh) 投屏方法和计算设备
WO2020098437A1 (zh) 一种播放多媒体数据的方法及电子设备
WO2020151385A1 (zh) 一种控制智能家居设备连网的方法及设备
WO2022121775A1 (zh) 一种投屏方法及设备
WO2021104114A1 (zh) 一种提供无线保真WiFi网络接入服务的方法及电子设备
EP4318199A1 (en) Method for interaction between electronic devices and electronic device
WO2022068513A1 (zh) 无线通信方法和终端设备
WO2022116974A1 (zh) 接入方法、***及电子设备
WO2022135527A1 (zh) 一种视频录制方法及电子设备
CN112130788A (zh) 一种内容分享方法及其装置
WO2022052791A1 (zh) 一种多媒体流的播放方法和电子设备
WO2022135163A1 (zh) 一种投屏显示方法及电子设备
US20230208790A1 (en) Content sharing method, apparatus, and system
WO2022262387A1 (zh) 音量管理的方法及电子设备
WO2022028537A1 (zh) 一种设备识别方法及相关装置
WO2021027623A1 (zh) 一种设备能力发现方法及p2p设备
CN114285938B (zh) 一种设备推荐方法、装置及计算机可读存储介质
CN114363678A (zh) 一种投屏方法及设备
CN116980059A (zh) 一种用于检测视频监控设备的方法和电子设备
WO2022161128A1 (zh) 一种组合显示方法、移动设备及电子设备
WO2022206848A1 (zh) 一种应用小部件的显示方法及设备
CN110324791B (zh) 进行组网的方法、装置、计算机设备和存储介质
WO2023025059A1 (zh) 一种通信***及通信方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22745006

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18263692

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22745006

Country of ref document: EP

Kind code of ref document: A1