WO2023088459A1 - 设备协同方法及相关装置 - Google Patents

设备协同方法及相关装置 Download PDF

Info

Publication number
WO2023088459A1
WO2023088459A1 PCT/CN2022/133172 CN2022133172W WO2023088459A1 WO 2023088459 A1 WO2023088459 A1 WO 2023088459A1 CN 2022133172 W CN2022133172 W CN 2022133172W WO 2023088459 A1 WO2023088459 A1 WO 2023088459A1
Authority
WO
WIPO (PCT)
Prior art keywords
capability
icon
electronic device
input operation
coordinated
Prior art date
Application number
PCT/CN2022/133172
Other languages
English (en)
French (fr)
Inventor
梅晓村
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023088459A1 publication Critical patent/WO2023088459A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/14Direct-mode setup

Definitions

  • the present application relates to the field of electronic technology, and in particular to a device collaboration method and related devices.
  • terminals such as smart phones and tablet computers begin to support users to share pictures, documents and other data with other devices, which improves the user's office efficiency and office experience.
  • a TV has a large-area display screen but does not have a portable camera and a microphone
  • a mobile phone does not have a large-area display screen but has a portable camera and a microphone.
  • the existing technology supports the sharing of pictures, videos, music, documents and other data between different devices through data transmission, it cannot support the sharing of various capabilities supported by the device between different devices, and the capabilities and advantages of each device cannot be fully utilized.
  • users want to use the capabilities of different devices they need to switch devices, and the user experience is poor.
  • the present application provides a device coordination method.
  • the first electronic device can specifically select the capability that the user intends to connect cooperatively, and establish a cooperative connection with the candidate device, so that each candidate device Capabilities can be effectively and fully applied on the first electronic device, improving user experience.
  • the present application provides a device coordination method applied to a first electronic device, the method comprising: displaying a first user interface, the first user interface including a first icon of the first electronic device and at least one detected An icon of a candidate device, the at least one icon of a candidate device includes a second icon of a second electronic device; the second electronic device supports at least two synergizable capabilities, and the at least two synergizable capabilities include the first capability; A first input operation for selecting the first capability is received; a second input operation is received; and in response to the second input operation, a cooperative connection supporting the first capability is established with the second electronic device.
  • the user when the second electronic device has multiple synergistic capabilities, the user can select any one of the above-mentioned multiple synergistic capabilities through the first electronic device to establish a collaborative connection with the second electronic device; After a capability cooperative connection is successful, the user can invoke the first capability of the second electronic device through the first electronic device.
  • the ability of the user to intend coordinated connection can be selected in a targeted manner, and a coordinated connection can be established with the candidate device, so that the capabilities of each candidate device can be obtained on the first electronic device.
  • Targeted and full application give full play to the capabilities and advantages of each candidate device, and improve the user experience.
  • the first user interface further includes: a capability subtitle corresponding to the synergizable capability supported by the second electronic device; the capability subscript corresponding to the synergizable capability supported by the second electronic device includes The first capability badge of , the first input operation acts on the first capability badge.
  • a capability badge corresponding to a capability supported by the second electronic device that can be coordinated is displayed in a surrounding area close to the second icon.
  • the method before receiving the first input operation for selecting the first capability, the method further includes: receiving a third input operation acting on the second icon; in response to the third input operation, at the The capability badges corresponding to the collaborative capabilities supported by the second electronic device are displayed in a user interface.
  • the user can see the capability badge corresponding to the collaborative capability of the candidate device.
  • the method further includes: in response to the first input operation, additionally displaying the first capability badge on the second icon.
  • the user may select an additionally displayed capability icon for the icon of the candidate device, and the first electronic device may establish a collaborative connection for the capability corresponding to the additionally displayed capability icon.
  • the first input operation includes an operation acting on the first capability icon;
  • the second input operation includes: dragging the second icon toward the first icon until the second icon touches the area where the first icon is located; or , drag the second icon toward the first icon until the distance between the second icon and the first icon is less than or equal to the preset threshold; or, drag the first icon toward the second icon until the first icon touches the position of the second icon or, drag the first icon toward the second icon until the distance between the first icon and the second icon is less than or equal to a preset threshold.
  • the second input operation acts on the first capability badge.
  • a cooperative connection supporting the first capability can be established.
  • the first input operation includes an operation acting on the first ability icon;
  • the second input operation includes: dragging the first ability icon to the first icon until the first ability icon touches the first icon or, drag the first ability icon to the first icon until the distance between the first ability icon and the first icon is less than or equal to the preset threshold.
  • the at least two coordinated capabilities further include a second capability; after successfully establishing a coordinated connection with the second electronic device that supports the first capability, the method further includes: receiving an icon that acts on the second icon The fifth input operation; in response to the fifth input operation, the capability subtitle corresponding to the synergizable capability supported by the second electronic device is displayed, and the capability subscript corresponding to the synergizable capability supported by the second electronic device includes the first capability corresponding to The first capability logo, and the second capability logo corresponding to the second capability; receiving the sixth input operation acting on the second capability logo; in response to the sixth input operation, establishing a second capability support with the second electronic device collaborative connection.
  • the at least two cooperative capabilities further include a second capability; the establishment of a cooperative connection supporting the first capability with the second electronic device in response to the second input operation specifically includes: responding to The second input operation is to establish a cooperative connection supporting the first capability and the second capability with the second electronic device.
  • a cooperative connection supporting multiple capabilities may be established with the second electronic device.
  • the second icon when the second input operation is received, the second icon is additionally displayed with a first capability subscript corresponding to the first capability and a second capability subscript corresponding to the second capability.
  • a collaborative connection supporting multiple capabilities corresponding to the multiple capability badges may be established with the second electronic device.
  • the method further includes: receiving a seventh input operation acting on the second icon; responding to the seventh input Operation, display the capability subscript corresponding to the synergizable capability supported by the second electronic device, the capability subscript corresponding to the synergistic capability supported by the second electronic device includes the first capability subscript corresponding to the first capability, and the second capability subscript Corresponding to the second capability badge; receiving an eighth input operation acting on the first capability badge; in response to the eighth input operation, canceling the coordinated connection with the second electronic device supporting the first capability.
  • the coordinated connection for this capability can be canceled through the capability badge of any of the coordinated capabilities ; In this way, it is convenient for the user to selectively cancel the coordinated connection of the specified capability, thereby improving the user experience.
  • the first user interface further includes capability subscripts corresponding to at least two capabilities; the at least two capabilities include all synergizable capabilities supported by the at least one candidate device, and the at least two capabilities
  • the corresponding capability badge includes a first capability badge corresponding to the first capability, and the first input operation acts on the first capability badge.
  • the first input operation for selecting the first capability before receiving the first input operation for selecting the first capability, it further includes: receiving a ninth input operation acting on the first icon; in response to the ninth input operation, on the first user interface The ability superscripts corresponding to the at least two abilities are displayed in .
  • the ninth input operation acting on the icon of the first electronic device that is, this device
  • the user can see the capability badges corresponding to the synergizable capabilities of all candidate devices.
  • the method further includes: additionally displaying a first capability badge on the first icon in response to the first input operation.
  • the method further includes: in response to the first input operation, stopping displaying icons of candidate devices that cannot cooperate with the first capability on the first user interface.
  • stopping displaying icons of candidate devices that cannot cooperate with the first capability on the first user interface when the user selects the capability to be coordinated as the first capability through the first capability icon, stop displaying the icons of the candidate devices that cannot cooperate with the first capability, so that the user can subsequently select the candidate device for cooperative connection with the first capability .
  • the method further includes: in response to the first input operation, switching the first ability icon displayed around the second icon from the unselected state to the selected state; the method further includes: in response to the fourth input operation, switching the second icon The secondary ability badges displayed around switch from the selected state to the unselected state.
  • the method further includes: when successfully establishing a cooperative connection supporting the first capability with the second electronic device, the second icon switches from the uncoordinated state to the coordinated state, and the second icon additionally displays the first The first capability icon corresponding to the capability; when the coordinated connection supporting the first capability fails to be established with the second electronic device, the second icon remains in an uncoordinated state.
  • the first icon is displayed in the first preset area, and the icon of the at least one candidate device is displayed in the second preset area; the uncoordinated state of the second icon is presented as Displayed in the second preset area in the first state; the coordinated state of the second icon appears as being adsorbed to the first icon in the second state and displayed in the first preset area, or, the second The coordinated state of the icon is displayed in the second preset area in a second state.
  • the first state and the second state refer to different icon colors.
  • the first electronic device executes the step of "establishing a cooperative connection supporting the first capability and the second capability with the second electronic device"
  • the second icon is switched from the uncoordinated state to the coordinated state, and the second icon additionally displays the first and second ability symbols
  • the coordinated connection does not support the second capability
  • the second icon is switched from the uncoordinated state to the coordinated state, and the second icon is additionally displayed with the first capability subtitle, and is not additionally displayed with the second capability subtitle.
  • the capability subtitle corresponding to the capability supported by the cooperative connection established by the second electronic device (that is, the first capability subtitle and the second capability subtitle) appear in a selected state, and the capability subtitle corresponding to a capability not supported by the coordinated connection established by the second electronic device appears in an unselected state.
  • the method further includes: receiving a tenth input operation acting on the second icon; responding to the first Ten input operations, cancel the coordinated connection with the second electronic device for any capability.
  • the second icon in response to the third input operation, displaying in the first region the capability subscripts corresponding to the capabilities that can be coordinated by the second electronic device; the at least two capabilities that can be coordinated also include the second capability,
  • the third input operation acting on the second icon is received, the second icon is additionally displayed with the second ability superscript corresponding to the second ability; after receiving the third input operation acting on the second icon, it also includes: receiving the action A fourth input operation of the second capability icon in the first area; in response to the fourth input operation, stop additionally displaying the second capability icon on the second icon.
  • the present application also provides a device coordination method applied to a first electronic device, the method comprising: displaying a first user interface, the first user interface including a first icon of the first electronic device and at least An icon of a candidate device, the icon of the at least one candidate device includes a second icon of the second electronic device; the second electronic device supports at least two synergizable capabilities, and the at least two synergizable capabilities include the first capability ; Receiving an eleventh input operation; in response to the eleventh input operation, based on the first application program recently running in the foreground and/or the coordination state of the second electronic device, establish a cooperative connection supporting the first capability with the second electronic device.
  • the first electronic device can adaptively select one or more capabilities for coordination based on the current application scenario (that is, the first application program running in the foreground recently and/or the coordination status of the second electronic device)
  • the connection enables the capability of each candidate device to be fully and targetedly applied on the first electronic device, and the capability advantages of each candidate device are brought into play to improve user experience.
  • the coordination state of the second electronic device includes one or more of the following: the number of coordinated connections of each capability that the first electronic device and the second electronic device have coordinated with each other, The capability of the latest coordinated connection of the device, and the priority of each capability of the second electronic device that can be coordinated.
  • the embodiment of the present application does not specifically limit the coordination state of the second electronic device.
  • establishing a cooperative connection to the first capability of the second electronic device based on the first application program running in the foreground recently and/or the cooperative state of the second electronic device includes: when the second electronic device's When the cooperative capability includes the first capability required by the first application program, a cooperative connection is established to the first capability of the second electronic device.
  • the first electronic device can adaptively select the capability to be coordinated based on the capability required by the first application running in the foreground recently, so as to effectively improve user experience.
  • establishing a cooperative connection to the first capability of the second electronic device based on the first application program running in the foreground recently and/or the cooperative state of the second electronic device includes: coordinating with the second electronic device Among the connected capabilities, the first capability with the largest number of coordinated connections establishes a coordinated connection; or, performs a coordinated connection with the first capability that is most recently coordinated with the second electronic device; The first ability with the highest level is for cooperative connection.
  • the first electronic device can adaptively select the capability to be coordinated based on the coordination status of the coordination capability of the second electronic device, so as to effectively improve user experience.
  • the present application provides an electronic device, including one or more processors and one or more memories.
  • the one or more memories are coupled with one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device performs A device coordination method in any possible implementation manner of any of the foregoing aspects.
  • an embodiment of the present application provides a computer storage medium, including computer instructions, which, when the computer instructions are run on the electronic device, cause the electronic device to execute the device coordination method in any possible implementation of any of the above aspects .
  • an embodiment of the present application provides a computer program product, which, when running on a computer, causes the computer to execute the device coordination method in any possible implementation manner of any one of the above aspects.
  • FIG. 1A is a schematic diagram of a system architecture of a communication system provided by an embodiment of the present application.
  • FIG. 1B is a schematic diagram of a collaborative connection system provided by an embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
  • Figure 3A to Figure 3D are a way of calling out the cooperative connection interface provided by the embodiment of the present application.
  • Figures 4A to 4D are another way to call out the cooperative connection interface provided by the embodiment of the present application.
  • Figures 5A to 5D are another way to call out the cooperative connection interface provided by the embodiment of the present application.
  • Fig. 6A to Fig. 6E are related user interfaces of cooperative connection in case 1 provided by the embodiment of the present application;
  • Fig. 7A to Fig. 7C are user interfaces related to the cooperative connection of Case 1 provided by the embodiment of the present application;
  • Fig. 8A to Fig. 8G are related user interfaces of switching ability subscripts provided by the embodiment of the present application.
  • FIG. 9A to FIG. 9C are user interfaces related to the collaborative connection of Case 1 provided by the embodiment of the present application.
  • FIG. 10A to FIG. 10F are user interfaces related to the cooperative connection of Case 1 provided by the embodiment of the present application.
  • Figures 11A to 11D are related user interfaces for canceling coordinated connection provided by the embodiment of the present application.
  • Fig. 12A to Fig. 12G are related user interfaces of switching ability subscripts in case 2 provided by the embodiment of the present application;
  • Fig. 13A to Fig. 13J are related user interfaces of cooperative connection in case 2 provided by the embodiment of the present application;
  • Fig. 14A to Fig. 14E are related user interfaces of coordinated connection in case 2 provided by the embodiment of the present application;
  • Fig. 15A to Fig. 15D are related user interfaces for canceling coordinated connection in case 2 provided by the embodiment of the present application;
  • 16A to 16D are related user interfaces for establishing cooperative connections with multiple devices provided by the embodiment of the present application.
  • Figure 17A to Figure 17F are the related user interfaces of the switching capability corner mark in the third case provided by the embodiment of the present application.
  • Fig. 18A to Fig. 18C are related user interfaces of coordinated connection in case 3 provided by the embodiment of the present application;
  • Fig. 19A to Fig. 19J are related user interfaces of cooperative connection in case 3 provided by the embodiment of the present application;
  • Fig. 20A to Fig. 20D are related user interfaces of switching ability subscripts in Case 4 provided by the embodiment of the present application;
  • Fig. 21A to Fig. 21D are related user interfaces of collaborative connection in case 4 provided by the embodiment of the present application;
  • Fig. 22A to Fig. 22D are related user interfaces of cooperative connection in case 4 provided by the embodiment of the present application;
  • Figure 23A to Figure 23C are user interfaces related to collaborative connection in Case 4 provided by the embodiment of the present application.
  • 24A to 24F are related user interfaces for establishing cooperative connections with multiple devices provided by the embodiment of the present application.
  • Fig. 25A to Fig. 25D are related user interfaces of coordinated connection in case 5 provided by the embodiment of the present application;
  • Fig. 26A to Fig. 26D are the related user interfaces of the cooperatively connected capability application provided by the embodiment of the present application.
  • FIG. 27 is a schematic diagram of a software architecture of an electronic device provided by an embodiment of the present application.
  • FIG. 28 is a schematic diagram of the software architecture of another electronic device provided by the embodiment of the present application.
  • FIG. 29 is a schematic diagram of the software architecture of a tablet computer provided by the embodiment of the present application.
  • FIG. 30 is a schematic diagram of a software architecture of a notebook computer provided by an embodiment of the present application.
  • Fig. 31 is a schematic diagram of the software architecture of a printer provided by the embodiment of the present application.
  • FIG. 32 is a schematic flowchart of a device coordination method provided by an embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • FIG. 1A exemplarily shows a schematic diagram of a communication system 10 provided in an embodiment of the present application.
  • the communication system 10 includes an electronic device 100 , and one or more candidate devices (eg, candidate device 200 ) that can establish a connection with the electronic device 100 .
  • candidate device 200 e.g., candidate device 200
  • the electronic device 100 and the candidate device 200 may be mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (ultra-mobile personal computer, UMPC), netbooks, or Cellular phone, personal digital assistant (PDA), augmented reality (augmented reality, AR) device, virtual reality (virtual reality, VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device (smart wristbands), vehicle-mounted devices, smart home devices (smart TVs, smart screens, large-screen devices, etc.) and/or smart city devices, the embodiments of the present application do not specifically limit the specific types of electronic devices.
  • PDA personal digital assistant
  • augmented reality augmented reality, AR
  • virtual reality virtual reality
  • AI artificial intelligence
  • wearable device smart wristbands
  • vehicle-mounted devices smart home devices (smart TVs, smart screens, large-screen devices, etc.) and/or smart city devices
  • smart home devices smart home devices (smart TVs, smart screens, large-screen devices, etc.)
  • the candidate device 200 may also be a projector, a speaker, a Bluetooth headset, a monitor, a mouse, a keyboard, a printer, and other devices.
  • the electronic device 100 and the candidate device 200 may be equipped with the same operating system, or may be equipped with different operating systems, such as iOS, Android, Microsoft, Hongmeng and other operating systems.
  • the electronic device 100 can establish a collaborative connection with the capability 1 of the candidate device 200, so that the electronic device 100 can share the capability 1 of the candidate device 200, and the functional modules corresponding to the shared capability in the candidate device 200 can be indirectly regarded as Functional modules of the electronic device 100 .
  • the candidate device 200 can also share the capability 2 of the electronic device 100, and the functional module corresponding to the shared capability in the electronic device 100 can also be viewed indirectly. It is a functional module of the candidate device 200 to realize capability mutual assistance and resource sharing between the electronic device 100 and the candidate device 200 .
  • the electronic device 100 and the above-mentioned one or more candidate devices can be regarded as a distributed and coordinated hyperterminal.
  • the electronic device 100 is a mobile phone, through which the user can realize communication connection and capability coordination with devices such as tablet computers, notebook computers, projectors, mice, keyboards, printers, speakers, and Bluetooth headsets.
  • devices such as tablet computers, notebook computers, projectors, mice, keyboards, printers, speakers, and Bluetooth headsets.
  • the above capabilities can refer to hardware functional modules (such as cameras, microphones, speakers, display screens, printers, etc.), software functional modules (such as payment, image processing, wifi connection, screen projection, etc.), or a combination of hardware and software Function modules (for example, a camera function with image processing, an audio output function with audio processing, an audio input function with audio processing, etc.), which are not specifically limited in this embodiment of the present application.
  • hardware functional modules such as cameras, microphones, speakers, display screens, printers, etc.
  • software functional modules such as payment, image processing, wifi connection, screen projection, etc.
  • a combination of hardware and software Function modules for example, a camera function with image processing, an audio output function with audio processing, an audio input function with audio processing, etc.
  • the user interface ((User Interface, UI) layer of the electronic device 100 can display the icon of the device in the cooperative connection interface, and the detected candidate device (such as a tablet) computers, laptops, projectors, speakers, earphones, printers, etc.), and can also display the synergistic capabilities supported by candidate devices (such as cameras, audio output functions, screen projection functions, audio input functions, printing functions, etc.) Capability subscript.
  • the detected candidate device such as a tablet computers, laptops, projectors, speakers, earphones, printers, etc.
  • candidate devices such as cameras, audio output functions, screen projection functions, audio input functions, printing functions, etc.
  • the user can select a suitable candidate device (for example, candidate device 200) from among the icons of candidate devices displayed on the electronic device 100 according to their own needs, and select the capability to be coordinated from the capability subscript corresponding to the candidate device ( For example, the capability subtitle of capability 1); then, through a preset input operation (such as dragging the icon of the candidate device 200 close to the icon of the device), to realize the coordinated connection of the electronic device 100 to the capability 1 of the candidate device 200.
  • a suitable candidate device for example, candidate device 200
  • the capability to be coordinated from the capability subscript corresponding to the candidate device For example, the capability subtitle of capability 1
  • a preset input operation such as dragging the icon of the candidate device 200 close to the icon of the device
  • the electronic device After the 100 detects the above-mentioned preset input operation, it monitors the connection status of the underlying service; after the electronic device 100 detects that the capability 1 cooperative connection of the candidate device 200 is successful, it switches the display status of the icon of the candidate device 200 to the coordinated state at the UI layer , and the icon of the candidate device 200 additionally displays a capability subtitle with capability 1; when the business layer needs to call capability 1, it can call the capability 1 of the candidate device 200 based on the user selection. In this way, the electronic device 100 can obtain the required candidate device 200 One or more of the specified capabilities.
  • the candidate device 200 can support at least one capability, and the candidate device 200 or the user can set some or all of the above at least one capability as the capability of the candidate device 200 to be able to connect cooperatively (in this embodiment of the application, it can also be referred to as synergistic capabilities).
  • the candidate device 200 supports capabilities such as a camera, audio output function, screen projection function, and audio input function, and the candidate device 200 can only set the camera and audio output functions as the collaborative capabilities of the candidate device 200, while other capabilities are candidate devices. 200; correspondingly, the icon of the candidate device 200 in the UI layer of the above-mentioned electronic device 100 can only display the capability subscript of the camera and/or audio output function, and cannot display other capability subscripts.
  • the cooperative connection between the electronic device 100 and the candidate device 200 for the capability 1 of the candidate device 200 means that the electronic device 100 and the candidate device 200 also establish a communication connection (that is, a data connection) or after the communication connection.
  • the business connection of the capability 1 so that the electronic device 100 obtains the use authorization of the capability 1 of the candidate device 200 .
  • the user can realize the coordinated connection between the electronic device 100 and the candidate device 200 for capability 1 through the coordinated connection interface provided in the embodiment of the present application.
  • the aforementioned coordinated connection may refer to a service connection for capability 1;
  • the communication connection has not been established yet, and the above cooperative connection may refer to the communication connection between the electronic device 100 and the candidate device 200 and the service connection for capability 1.
  • the electronic device 100 establishes a coordinated connection to the capability 1 of the candidate device 200, which may include: after the electronic device 100 establishes a communication connection with the candidate device 200, sends a coordinated connection request to the candidate device 200, and the coordinated connection request carries the candidate device The identification of capability 1 in 200; after the candidate device 200 receives the above collaborative connection request, it determines the capability that the electronic device 100 intends to cooperate with based on the identification of capability 1, and the candidate device 200 can send to the electronic device 100 a coordinated connection for agreeing to the coordinated connection of capability 1. Connection response.
  • the cooperative connection response may include a capability parameter of the capability 1 of the candidate device 200; after the coordinated connection is successful, the electronic device 100 may call the capability 1 of the candidate device 200 based on the capability parameter.
  • establishing a coordinated connection to (or with) the capability 1 of the candidate device 200 refers to establishing a coordinated connection with the candidate device 200 that supports the capability 1.
  • the electronic device 100 when the electronic device 100 itself has the capability 1, it may also obtain the capability 1 of the candidate device 200 through the cooperative connection, and process related services through the capability 1 of the candidate device 200 .
  • the electronic device 100 may also obtain the right to use the camera of the candidate device 200 through the cooperative connection, and collect images through the camera of the candidate device 200 .
  • the electronic device 100 may be directly connected to the candidate device 200 through a short-range wireless communication connection or a local wired connection.
  • the electronic device 100 and the candidate device 200 may have a wireless fidelity (wireless fidelity, WiFi) communication module, an ultra wide band (ultra wide band, UWB) communication module, a bluetooth (bluetooth) communication module, a near field communication (near field communication, NFC) communication module, one or more short-distance communication modules in the ZigBee communication module.
  • the electronic device 100 can detect and scan electronic devices near the electronic device 100 by transmitting signals through a short-range communication module (such as a Bluetooth communication module), so that the electronic device 100 can discover nearby electronic devices through a short-range wireless communication protocol.
  • a short-range communication module such as a Bluetooth communication module
  • An electronic device (such as the candidate device 200), establishes a wireless communication connection with a nearby electronic device, and transmits data to the nearby electronic device.
  • the electronic device 100 and the candidate device 200 may be connected to a local area network (local area network, LAN) through the electronic device 300 based on a wired or wireless fidelity (Wireless Fidelity, WiFi) connection.
  • the electronic device 300 may be a third-party device such as a router, a gateway, or a smart device controller.
  • the electronic device 100 and the candidate device 200 may also be indirectly connected through at least one electronic device 400 in a wide area network (such as the Internet).
  • the electronic device 400 may be a hardware server, or a cloud server embedded in a virtualized environment. It can be understood that, through the electronic device 300 and/or the electronic device 400 , the electronic device 100 can indirectly perform wireless communication connection and data transmission with the candidate device 200 .
  • the electronic device 100 and the candidate device 200 are electronic devices connected to the same local area network. In some embodiments, the electronic device 100 and the candidate device 200 are electronic devices logged into the same account; or, the electronic device 100 and the candidate device 200 are logged into different accounts, but the above-mentioned different accounts (such as account 1 and account 2) are in a preset
  • An electronic device with a relationship, for example, the above-mentioned preset relationship means that account 1 and account 2 are friends, account 1 has authorization for collaborative connection to account 2, or account 1 and account 2 are in the same family group. The embodiments of the present application do not specifically limit this.
  • the structure shown in this embodiment does not constitute a specific limitation on the communication system 10 .
  • the communication system 10 may include more or less devices than those shown.
  • FIG. 2 shows a schematic structural diagram of the electronic device 100 .
  • Electronic device 100 may be a mobile phone, tablet computer (PAD), desktop computer, laptop computer, handheld computer, notebook computer (Laptop), ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook, and cellular phone , personal digital assistant (personal digital assistant, PDA), augmented reality (augmented reality, AR) device, virtual reality (virtual reality, VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device, vehicle-mounted device,
  • PDA personal digital assistant
  • augmented reality augmented reality, AR
  • VR virtual reality
  • AI artificial intelligence
  • wearable device wearable device
  • vehicle-mounted device For smart home devices and/or smart city devices, the embodiment of the present application does not specifically limit the specific type of the electronic devices.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be disposed in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves and radiate them through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194 .
  • the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100.
  • System global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also optimize the algorithm for image noise and brightness.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG moving picture experts group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (non-volatile memory, NVM).
  • RAM random access memory
  • NVM non-volatile memory
  • Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (synchronous dynamic random access memory, SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as the fifth generation DDR SDRAM is generally called DDR5SDRAM), etc.; non-volatile memory can include disk storage devices, flash memory (flash memory).
  • SRAM static random-access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • DDR SDRAM double data rate synchronous dynamic random access memory
  • non-volatile memory can include disk storage devices, flash memory (flash memory).
  • flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.
  • it can include single-level storage cells (single-level cell, SLC), multi-level storage cells (multi-level cell, MLC), triple-level cell (TLC), quad-level cell (QLC), etc.
  • SLC single-level storage cells
  • MLC multi-level storage cells
  • TLC triple-level cell
  • QLC quad-level cell
  • UFS universal flash storage
  • embedded multimedia memory card embedded multi media Card
  • the random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of an operating system or other running programs, and can also be used to store data of users and application programs.
  • the non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for the processor 110 to directly read and write.
  • the external memory interface 120 can be used to connect an external non-volatile memory, so as to expand the storage capacity of the electronic device 100 .
  • the external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external non-volatile memory.
  • the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
  • Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the receiver 170B can be placed close to the human ear to receive the voice.
  • the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
  • the microphone 170C can be used to collect sound signals, reduce noise, identify sound sources, and perform directional recording functions.
  • the earphone interface 170D is used for connecting wired earphones.
  • the earphone interface 170D may be the USB interface 130 or other standard interfaces.
  • the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • pressure sensor 180A may be disposed on display screen 194 .
  • the gyro sensor 180B can be used to determine the motion posture of the electronic device 100 .
  • the angular velocity of the electronic device 100 around three axes ie, x, y and z axes
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary.
  • the distance sensor 180F is used to measure the distance.
  • the electronic device 100 may measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F for distance measurement to achieve fast focusing.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 100 emits infrared light through the light emitting diode.
  • the ambient light sensor 180L is used for sensing ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like.
  • the temperature sensor 180J is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy.
  • the touch sensor 180K is also called “touch device”.
  • the touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the motor 191 can generate a vibrating reminder.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, messages, notifications and the like.
  • the SIM card interface 195 is used for connecting a SIM card.
  • FIG. 3A to FIG. 3D show a related schematic diagram of calling out a coordinated connection interface of the electronic device 100 .
  • FIG. 3A shows the main interface 11 on the electronic device 100 for displaying the application programs installed on the electronic device 100 .
  • the main interface 11 may include: a status bar 101 , a calendar indicator 102 , a weather indicator 103 , a tray 104 with commonly used application icons, and other application icons 105 . in:
  • the status bar 101 may include: one or more signal strength indicators for a mobile communication signal (also known as a cellular signal), an operator name (such as "China Mobile"), a wireless fidelity (Wi-Fi) signal One or more of the signal strength indicator, battery status indicator, time indicator.
  • a mobile communication signal also known as a cellular signal
  • an operator name such as "China Mobile”
  • Wi-Fi wireless fidelity
  • the main interface 11 may also include a page indicator 106 .
  • Icons of other application programs may be distributed on multiple pages, and the page indicator 106 may be used to indicate the application program in which page the user is currently viewing. Users can swipe the area of other application icons left and right to view application icons in other pages.
  • the electronic device 100 receives a user's sliding operation on the status bar 101.
  • the electronic device 100 displays the control center interface 12 shown in FIG.
  • Shortcut icons 201 such as WLAN icons, Bluetooth icons, NFC icons, brightness adjustment bars, etc. shown in FIG. 3B ).
  • the control center interface 12 may also include a cooperatively connected card 1 , where prompt information 202 and controls 203 are displayed.
  • the prompt information 202 can be used to prompt the user that there is currently no available device that has been coordinated and connected, and the user can search for other devices by clicking the control 203 .
  • the control 203 may receive a user's input operation (such as a click operation), and in response to the above input operation, the electronic device 100 displays the cooperative connection interface 13 shown in FIG. 3C .
  • the coordinated connection interface 13 includes an icon 301 of the electronic device 100 , an icon of a candidate device for coordinated connection detected by the electronic device 100 , and the name and/or model of the candidate device.
  • Each candidate device displayed in the user interface 13 supports at least one synergizable capability.
  • the icon of the electronic device 100 is located in the preset area 1 of the coordinated connection interface 13 (such as the circular area shown in FIG. (such as the annular region shown in Figure 3C).
  • the embodiment of the present application does not specifically limit the shape and position of the preset area 1 and the preset area 2.
  • the preset area 1 is the circular area shown in the figure and the preset area 2 is the circular area shown in the picture. Take this as an example.
  • the icons of the above candidate devices may include the icon 302 of a tablet computer whose model is AAA, the icon 303 of a notebook computer whose model is YYY, the icon 304 of a speaker whose model is ZZZ, the icon 305 of a projector whose model is DDD, and the icon 305 of a projector whose model is EEE.
  • Icon 306 of a printer may include the icon 302 of a tablet computer whose model is AAA, the icon 303 of a notebook computer whose model is YYY, the icon 304 of a speaker whose model is ZZZ, the icon 305 of a projector whose model is DDD, and the icon 305 of a projector whose model is EEE.
  • the electronic device 100 before displaying the coordinated connection interface 13, after responding to an input operation (such as clicking this operation) on the control 203, the electronic device 100 detects candidate devices for coordinated connection, and obtains relevant information of each candidate device, as described above
  • the relevant information may indicate the interoperable capability supported by the candidate device, part or all of the device identifier, device name, device model, and device type.
  • the electronic device 100 can determine the icon of the candidate device based on the relevant information of each candidate device, and display it in the coordinated connection interface 13 .
  • the electronic device 100 may acquire electronic devices under the same local area network through signal detection, and use the electronic devices under the same local area network as candidate devices for coordinated connection.
  • the electronic device 100 may query the server for electronic devices logged into the same account as the electronic device 100, and use the queried electronic device as a candidate device for coordinated connection.
  • the relevant information of the candidate device may be requested by the electronic device 100 from the candidate device after detecting the candidate device this time, or may be obtained and stored by the electronic device 100 in the previous coordinated connection with the candidate device.
  • the icon of each candidate device in the coordination connection interface 13 is additionally displayed with a capability badge corresponding to at least one capability that the candidate device can coordinate with.
  • the above related information includes synergizable capabilities supported by the candidate device, and based on the related information of the candidate device, the electronic device 100 may also determine a capability icon to be additionally displayed on the icon of the candidate device.
  • the icon 302 of the tablet computer additionally displays the capability subscript corresponding to the camera
  • the icon 303 of the notebook computer additionally displays the capability subscript corresponding to the audio input function
  • the icon 304 of the speaker additionally displays The capability subscript corresponding to the audio output function
  • the projector icon 305 additionally displays the capability subscript corresponding to the screen projection
  • the printer icon 306 additionally displays the capability subscript corresponding to the printing function.
  • the icon of the candidate device in the collaborative connection interface 13 invoked by the electronic device 100 only additionally displays one kind of capability icon.
  • the above-mentioned capability subscript may be the capability subscript corresponding to the capability of the candidate device for the most recent cooperative connection, or the capability corresponding to the capability of the candidate device for the most frequent cooperative connection
  • the corner mark is not specifically limited here.
  • the icon of the candidate device in the coordinated connection interface 13 rotates slowly relative to the icon of the electronic device 100 .
  • icons of zero candidate devices are displayed in the circular area of the coordinated connection interface 13 shown in FIG. 3C and FIG. 3D , and the electronic device 100 can A prompt message is displayed on the connection interface 13 to prompt the user that no candidate device for cooperative connection has been detected.
  • the candidate devices displayed in the collaborative connection interface 13 invoked in different ways may be different, and the icon of the candidate devices may also have different capability subscripts displayed additionally.
  • the electronic device 100 when the electronic device 100 runs the application program 1 in the foreground, an input operation for calling out the cooperative connection interface 13 is detected; in response to the above input operation, the electronic device 100 determines at least one preset capability required by the application program 1, The electronic device 100 detects candidate devices capable of cooperating with the aforementioned preset capabilities, and displays icons of candidate devices capable of cooperating with the aforementioned preset capabilities on the coordinated connection interface 13 . In some embodiments, the icons of the candidate devices in the aforementioned cooperative connection interface 13 are all additionally displayed with a capability badge of the aforementioned preset capability.
  • the application program 1 is a music application (application, APP), and FIG. 4A to FIG. 4D show another way of calling out the cooperative connection interface 13 .
  • the electronic device 100 When the electronic device 100 displays the music playing interface 14 of the music APP shown in FIG. 4A, it receives a slide operation acting on the status bar; in response to the above slide operation, the electronic device 100 displays the control center interface 12 shown in FIG. 4B; The above-mentioned input operation of the control 203 in the control center interface 12; in response to the above-mentioned input operation, the electronic device 100 confirms that the capabilities required by the music APP include an audio output function, and the electronic device 100 detects a candidate device that can cooperate with the audio output function, and displays in the figure 4C or the cooperative connection interface 13 shown in FIG. 4D displays the icons of the above-mentioned candidate devices capable of cooperative audio output functions.
  • FIG. 4A When the electronic device 100 displays the music playing interface 14 of the music APP shown in FIG. 4A, it receives a slide operation acting on the status bar; in response to the above slide operation, the electronic device 100 displays the control center interface 12 shown in FIG. 4B; The above-mentioned input
  • the icons of the candidate devices are all additionally displayed with a capability subtitle of an audio output function.
  • the electronic device 100 detects that the devices under the same local area network include: a tablet computer with model AAA, a notebook computer with model YYY, a speaker with model ZZZ, a projector with model DDD, and a printer with model EEE; Computers, laptops and speakers support the coordinated connection of the audio output function, and other devices do not support the coordinated connection of the audio output function; the coordinated connection interface 13 shown in Figure 4C or Figure 4D includes the icon 302 of the tablet computer, the icon 303 of the notebook computer and Icon 304 of a speaker.
  • the above-mentioned input operation for calling out the cooperative connection interface 13 may include: a sliding operation for calling up the control center interface 12, and a click operation for the control 203 in the above-mentioned control center interface 12 .
  • the electronic device 100 runs the application program 1 in the foreground, and the user interface 1 of the application program 1 includes a control 1, and the control 1 is used for invoking preset capabilities of coordinated available devices. Detecting an input operation (such as a click operation) acting on control 1; if there is currently no available device with coordinated preset capabilities, in response to the above input operation, the electronic device 100 displays control 2; detecting an input operation acting on control 2 ( For example, click operation), the electronic device 100 detects candidate devices that can cooperate with the above-mentioned preset capabilities, and displays icons of candidate devices that can cooperate with the above-mentioned preset capabilities in the coordinated connection interface 13 .
  • an input operation such as a click operation
  • the icons of the candidate devices in the aforementioned cooperative connection interface 13 are all additionally displayed with a capability badge of the aforementioned preset capability. It can be understood that the above-mentioned input operations for calling out the collaborative connection interface 13 may include: the above-mentioned input operations acting on the control 1 , and the above-mentioned input operations acting on the control 2 .
  • the application program 1 is a music APP
  • FIG. 5A to FIG. 5D show another way of calling out the cooperative connection interface 13 .
  • User interface 1 is the music playback interface 14 shown in FIG. 5A
  • control 1 is the switch control 311 in the music playback interface 14, and the switch control 311 is used to call the audio output function of the coordinated available equipment
  • control 2 is shown in FIG. 5B controls 312 .
  • the electronic device 100 displays the music playing interface 14 of the music application shown in FIG. 5A, and the music playing interface 14 includes a switching control 311; the electronic device 100 detects an input operation acting on the switching control 311; if there is currently no coordinated audio output function available device, in response to the above-mentioned input operation, the electronic device 100 displays the card 2 for cooperative connection; the card 2 includes a control 312 and a prompt information 313, and the prompt information 313 is used to prompt that there is currently no available device with a coordinated audio output function, and the user can search for other devices.
  • An input operation for the control 312 is detected; in response to the above input operation, the electronic device 100 detects a candidate device that can cooperate with the audio output function, and displays the coordinated audio output function in the coordinated connection interface 13 shown in FIG. 5C or FIG. 5D icons of candidate devices.
  • the icons of the candidate devices are all additionally displayed with a capability subtitle of the audio output function.
  • the electronic device 100 runs the application program 1 in the foreground; an input operation performed by the user on the application program 1 is detected, and the input operation is used to execute the preset capability of the application program 1; if the electronic device 100 does not have the above preset Capability, in response to the above-mentioned input operation, the electronic device 100 displays the control 2; upon detecting an input operation (such as a click operation) acting on the control 2, the electronic device 100 detects a candidate device that can cooperate with the above-mentioned preset capability, and displays it on the cooperative connection interface 13 The icons of candidate devices that can cooperate with the above preset capabilities are displayed in .
  • the icons of the candidate devices in the aforementioned cooperative connection interface 13 are all additionally displayed with a capability badge of the aforementioned preset capability. It can be understood that the above-mentioned input operations for calling the cooperative connection interface 13 may include: the above-mentioned input operations for the application program 1 and the above-mentioned input operations for the control 2 .
  • the application program 1 is Word APP
  • the above preset capability is a printing function. If the electronic device 100 detects the input operation of calling the printing function of Word APP, the electronic device 100 can display the card for cooperative connection after determining that the device does not have the printing function, and call out the cooperative connection interface 13 through the card. Specifically, refer to the foregoing embodiments, and details are not repeated here.
  • FIG. 3A to Fig. 5D exemplarily introduce several ways of calling out the cooperative connection interface 13, which are not limited to the above way of calling out, the embodiment of the present application can also call up the user interface 13 in other ways, here There is no specific limit.
  • the collaborative connection interface 13 involved in FIG. 3A to FIG. 5D is an exemplary description of the embodiment of the present application, and should not be construed as limiting the present application.
  • the following describes how to realize the coordinated connection between devices for specified capabilities through the coordinated connection interface.
  • the embodiment of the present application provides five situations for realizing cooperative connection.
  • the cooperative connection between two electronic devices supports only one capability; the candidate device 200 supports at least one capability that can be coordinated, and the icon of the candidate device 200 can additionally display any one of the above at least one capability (such as capability 1) Ability corner mark.
  • the icon of the candidate device 200 is additionally displayed with a capability subscript corresponding to capability 1, drag the icon of the candidate device 200 close to the icon of the electronic device 100 or drag the icon of the electronic device 100 close to the icon of the candidate device 200, the electronic device 100 can realize A coordinated connection of capability 1 of the candidate device 200 .
  • FIG. 6A to FIG. 7C show relevant user interfaces of the cooperative connection in case 1.
  • the icon 302 of the tablet computer in the collaborative connection interface 13 additionally displays a capability corner mark 501 corresponding to the camera, and the icon 302 of the tablet computer can receive the sliding operation of the user, and the sliding direction of the above-mentioned sliding operation points to the electronic device icon 301 of 100; in response to the above sliding operation, the electronic device 100 moves the icon 302 of the tablet computer to the icon 301 of the electronic device 100 .
  • the electronic device 100 displays a prompt message 401 and performs a cooperative connection to the camera of the tablet computer.
  • the prompt information 401 is used to prompt that the device is being coordinated with the camera of the tablet computer.
  • the electronic device 100 when the electronic device 100 detects that the icon 302 touches the preset area 1 where the icon 301 is located, it can display the prompt message 401 and execute the cooperative connection, or it can only trigger when it detects that the icon 302 touches the icon 301 Display prompt information 401 and perform coordinated connection, which is not specifically limited here.
  • the above-mentioned electronic device 100 performing the coordinated connection to the camera of the tablet computer includes: sending a coordinated connection request for the camera to the tablet computer, and the coordinated connection request may include an identification of the electronic device 100 and an identification of the camera.
  • the tablet computer after the tablet computer receives the collaborative connection request sent by the electronic device 100 , it displays a selection box, and the selection box includes a prompt message 402 , a confirmation control 403 and a rejection control 404 .
  • the prompt information 402 is used to prompt that the electronic device 100 receives a collaborative connection request for the camera.
  • the confirmation control 403 may receive a user's input operation, and in response to the above input operation, the tablet computer sends a coordinated connection response 1 agreeing to the coordinated connection to the electronic device 100 .
  • the electronic device 100 After the electronic device 100 receives the coordinated connection response 1 sent by the tablet computer, it displays the prompt information 404 shown in FIG.
  • This device has established a collaborative connection with the tablet's camera.
  • the coordinated state shown in FIG. 6D means that the icon 302 of the tablet computer has a darker color and is attached to the icon 301 of the device. In this embodiment of the present application, there is no specific limitation on the uncoordinated state and the coordinated state of the icon of the candidate device.
  • the capability badge additionally displayed on the icon of the candidate device also includes an uncoordinated state and a coordinated state.
  • the camera's capability corner mark 501 presents an uncoordinated state (for example, the display is not deepened); as shown in Figure 6D, after the camera's cooperative connection is successful, the camera's capability corner mark 501 appears Synergized state (eg darkened display).
  • the uncoordinated state and the coordinated state of the capability badge there is no specific limitation on the uncoordinated state and the coordinated state of the capability badge.
  • the electronic device 100 displays icons of available coordinated devices (such as the icon of the tablet computer) on the card 1 of the collaborative connection. icon 412), and icons of uncoordinated candidate devices (for example, an icon 413 of a laptop, an icon 414 of a sound box, and an icon 415 of a projector) may also be displayed.
  • the icon 412 of the available device may be attached with a capability superscript corresponding to the coordinated capability (that is, the camera).
  • the display state of the icon 412 (for example, a darkened display) and/or the prompt information 416 (for example, the text "already coordinated" can indicate that the electronic device corresponding to the icon is an available coordinated device; Capability badges indicate the coordinated capabilities of the tablet.
  • the card 1 shown in FIG. 6E may further include a control 411 through which the user can call out the collaborative connection interface 13 shown in FIG. 6D .
  • the rejection control 404 may receive a user's input operation, and in response to the above input operation, the tablet computer sends a coordinated connection response 2 rejecting the coordinated connection to the electronic device 100 .
  • the electronic device 100 displays the prompt message 405 shown in FIG. 7B , and bounces the icon 301 of the tablet computer back to the preset area 2 (ie, the circular area) where the candidate device is located.
  • the above prompt information 405 is used to prompt that the cooperative connection between the device and the camera of the tablet computer fails.
  • the electronic device 100 displays the icon of the detected candidate device on the card 1 of the cooperative connection, so that the user can know the currently available What are the candidate devices for cooperative connection.
  • the cooperative connection failure is not limited to the failure caused by the user refusing the input operation of the cooperative connection, and other reasons may also cause the cooperative connection failure, which are not specifically limited herein.
  • the electronic device 100 determines that the coordinated connection fails, and displays the coordinated connection interface 13 shown in FIG. 7B .
  • the cooperative connection interface 13 before the cooperative connection interface 13 receives the sliding operation of the user dragging the icon, the icons of the candidate devices (such as the icon 302) slowly rotate around the icon 301 of the device; the cooperative connection interface 13 receives the sliding operation of the user dragging the icon During operation, the icon of the candidate device stops rotating slowly; during the process of the electronic device 100 executing the cooperative connection, the electronic device 100 can also play the in-connection animation; after determining that the cooperative connection is successful or the cooperative connection fails, the electronic device 100 can terminate the above-mentioned in-connection animation , and the icons of each candidate device resume rotating.
  • the tablet computer after the tablet computer receives the coordinated connection request from the electronic device 100, it can decide whether to agree to the coordinated connection request from the electronic device 100 based on a preset method, without displaying the selection box shown in FIG. 6C .
  • the embodiment of the present application does not specifically limit the foregoing preset manner.
  • the electronic device 100 before the electronic device 100 sends the collaborative connection request to the tablet computer, it also displays a verification information input box, which is used to input the verification information (such as a password) of the collaborative connection of the tablet computer.
  • the tablet computer determines to log in with the same account as the electronic device 100 , it agrees to the coordinated connection request of the electronic device 100 , otherwise it rejects the coordinated connection request of the electronic device 100 .
  • the tablet computer determines that it is located in the same local area network as the electronic device 100 , it agrees to the coordinated connection request of the electronic device 100 , otherwise it rejects the coordinated connection request of the electronic device 100 .
  • the user can switch the capability icon additionally displayed on the icon of the candidate device, and then establish a coordinated connection based on the switched capability icon.
  • FIG. 8A to FIG. 8D show a user interface for switching the capability icon additionally displayed by the icon 302 of the tablet computer.
  • the icon of the candidate device in the collaborative connection interface 13 (for example, the icon 302 of a tablet computer) additionally displays a capability corner mark 501 corresponding to the camera, and the icon 302 can receive user input operations (for example, a click operation ), in response to the above input operation, the electronic device 100 displays around the icon 302, the capability subscript corresponding to the collaborative capability other than the camera supported by the tablet computer, for example, the capability subscript 502 corresponding to the audio input function corresponds to the audio output function Capability subscript 503. It can be understood that if the tablet computer supports only the camera, and the user clicks on the icon 302 , no other capability icons can be displayed around the icon 302 .
  • the capability badge 502 may receive an input operation (such as a click operation) from the user, and in response to the above operation, the capability badge 501 additionally displayed on the icon 302 of the tablet computer is switched to the capability badge 502, The capability subscript 501 corresponding to the camera is displayed around the icon 302 .
  • the electronic device 100 stops displaying the capability badge around the icon 302 .
  • the electronic device 100 may also directly display the collaborative connection interface 13 shown in FIG. 8D .
  • the icon 302 of the tablet computer shown in FIG. 8D is additionally displayed with the ability corner mark 502 of the audio input function, and the user drags the icon 302 to the icon 301 of the device to realize the cooperative connection of the audio input function of the tablet computer.
  • the size of the capability badge 501 displayed around the icon 302 and the capability badge 501 additionally displayed on the icon 302 may be different.
  • FIG. 8E to FIG. 8G show another user interface for switching the capability icon additionally displayed by the icon 302 of the tablet computer.
  • the electronic device 100 displays the collaborative connection interface 13 shown in FIG.
  • the capability subtitle corresponding to the capability of the icon 302 indicates the capability subtitle that is currently additionally displayed by the icon 302 through the selected state.
  • the ability subscript 501 that is currently additionally displayed by the icon 302 is selected (for example, it is highlighted), and the ability subtitle 502 that is not currently displayed by the icon 302 is not selected (for example, it is not displayed in depth).
  • the ability badge 502 can receive the user's input operation (such as a click operation), in response to the above operation, the ability badge 501 is switched from the selected state to the unselected state, and the ability badge 502 is switched from unselected to The state is switched to the selected state, that is, the ability icon 501 additionally displayed on the icon 302 of the tablet computer is switched to the ability icon 502 .
  • the electronic device 100 stops displaying the capability icon around the icon 302 .
  • the electronic device 100 may also directly display the collaborative connection interface 13 shown in FIG. 8G .
  • the user may also drag the capability icon around the icon 302 to the area where the icon 301 of the electronic device 100 is located, so as to realize the cooperative connection of the capability corresponding to the capability icon.
  • the electronic device 100 moves the ability icon 502 along the sliding direction of the sliding operation; as shown in Figure 9C
  • the electronic device 100 displays the icon of the tablet computer with the capability icon 502 in the preset area 1 (ie, the aforementioned circular area). 302, and prompt message 406.
  • the prompt information 406 is used to prompt that the device is being coordinated with the audio input function of the tablet computer. Specifically, reference may be made to the relevant content of the cooperative connection described in FIG. 6B to FIG. 7C later, and details are not repeated here.
  • the user can also select the additionally displayed capability badge for the icon of the candidate device, for details, refer to the related descriptions in Figure 8A to Figure 8F ; After the icon of the candidate device is attached with the displayed capability subscript, how to realize the coordinated connection can refer to the related descriptions in FIG. 6A to FIG. 7C and FIG. 9A to FIG.
  • the coordinated connection of the capability corresponding to the capability icon additionally displayed by the candidate device 200 can be realized.
  • FIG. 10A to FIG. 10F show related user interfaces of the collaborative connection in this embodiment.
  • the icon 302 of the tablet computer in the collaborative connection interface 13 additionally displays the capability corner mark 501 corresponding to the camera, and the icon 301 of this device can receive the sliding operation of the user, and the sliding direction of the above-mentioned sliding operation points to the tablet computer icon 302 ; in response to the above sliding operation, the electronic device 100 moves the icon 301 to the icon 302 .
  • the electronic device 100 displays a prompt message 401 and performs a cooperative connection to the camera of the tablet computer.
  • the electronic device 100 displays prompt information 404 and changes the display state of the icon of the tablet computer from an uncoordinated state to a coordinated state.
  • the electronic device 100 displays the prompt information 405 shown in FIG. 10E , and bounces the icon 302 of the tablet computer back to the circular area where the candidate device is located.
  • the coordinated state shown in FIG. 10D means that the icon 302 of the tablet computer is darkened and is attached to the icon 301 of the device.
  • the electronic device 100 displays the coordinated connection interface shown in FIG. 10F.
  • FIG. 10F shows another coordinated state of the icon 302, that is, the color of the icon 302 is darkened, and the candidate device is bounced back The preset area 2 where it is located (that is, the circular area shown in the figure); the uncoordinated state of other candidate devices in the circular area is displayed as the color is not deepened.
  • the user may cancel the coordinated connection with the capability 1 of the candidate device 200 .
  • the icon 302 of the coordinated state of the tablet computer additionally displays the capability subscript of the camera; the icon 302 of the coordinated state of the tablet computer can receive the cancel operation 1 of the user; in response to the above Canceling operation 1, the electronic device 100 may cancel the cooperative connection with the camera of the tablet computer, and switch the display state of the icon 302 to an uncoordinated state.
  • the cancellation operation 1 there is no specific limitation on the cancellation operation 1 above, and the cancellation operation 1 corresponding to different coordinated states may be different.
  • the coordinated icon 302 shown in FIG. 11A is attached to the icon 301 of the device, and the above cancel operation 1 may include dragging the icon 302 away from the icon 301 of the device through a sliding operation acting on the icon 302 and then letting go.
  • the electronic device 100 displays a prompt message prompting to cancel the cooperative connection, and cancels the cooperative connection with the camera of the tablet computer.
  • FIG. 11D after the coordinated connection is canceled, the display state of the icon 302 is switched from the coordinated state to the uncoordinated state, and the icon 302 is bounced back to the circular area.
  • the electronic device 100 may also directly display the cooperative connection interface shown in FIG. 11D without displaying the above prompt information.
  • the icon 302 is displayed in a circular area, and the above cancel operation may include long pressing the icon 302 .
  • the above cancel operation may also include gestures such as double-tap, which is not specifically limited in the present invention.
  • the coordinated connection interface 13 when the coordinated connection interface 13 receives the user's input operation of canceling the coordinated connection (such as the above-mentioned cancel operation 1), the icon of the candidate device stops slowly rotating; during the process of canceling the coordinated connection, the electronic device 100 can also Play the connection cancellation animation; when it is determined that the collaborative connection has been cancelled, the electronic device 100 may terminate the above connection cancellation animation, and the icons of each candidate device resume rotation.
  • the coordinated connection interface 13 receives the user's input operation of canceling the coordinated connection (such as the above-mentioned cancel operation 1)
  • the icon of the candidate device stops slowly rotating
  • the electronic device 100 can also Play the connection cancellation animation; when it is determined that the collaborative connection has been cancelled, the electronic device 100 may terminate the above connection cancellation animation, and the icons of each candidate device resume rotation.
  • the electronic device 100 and the candidate device 200 support coordinated connection of multiple capabilities; the candidate device 200 supports at least one capability that can be coordinated, and the icon of the candidate device 200 additionally displays one or more of the above at least one capability Ability badges for abilities such as ability 1 and ability 2.
  • the icon of candidate device 200 additionally displays the capability subscripts corresponding to capability 1 and capability 2, drag the icon of candidate device 200 close to the icon of electronic device 100 or drag the icon of candidate device 200 close to the icon of electronic device 100 to realize electronic Cooperative connection of device 100 to capability 1 and capability 2 of candidate device 200 .
  • FIGS. 6A to 7C and FIGS. 9A to 10F For the cooperative connection of one capability in the second case, reference may be made to the relevant descriptions in FIGS. 6A to 7C and FIGS. 9A to 10F , which will not be repeated here.
  • FIG. 12A to FIG. 12G show user interfaces for adding multiple capability badges.
  • the user can add capability badges corresponding to multiple capabilities on the icon 302 of the tablet computer.
  • the ability corner mark 502 corresponding to the audio output function is currently additionally displayed, and the icon 302 can receive the user's input operation (such as a click operation); in response to the above
  • the electronic device 100 displays around the icon 302 the capability subscripts corresponding to all the synergizable capabilities supported by the tablet computer, for example, the capability subscript 501 corresponding to the camera, the capability subscript 502 corresponding to the audio input function, and the corresponding audio output function Capability subscript 503.
  • the capability subscript 501 corresponding to the camera
  • the capability subscript 502 corresponding to the audio input function
  • the corresponding audio output function Capability subscript 503. As shown in FIG.
  • the ability subscript 502 currently additionally displayed by the icon 302 is selected (for example, displayed in a darkened state), and the ability subscript 501 not currently additionally displayed by the icon 302 is displayed in an unselected state (for example, displayed without deepening).
  • the user can switch the display status of the ability badge to selected or unselected. As shown in FIG. 12B and FIG. 12C , the user can switch the display state of the capability badge 501 to the selected state, and add the capability badge 501 as the capability badge additionally displayed by the icon 302 . Similarly, as shown in FIG. 12C and FIG. 12D , the user can also switch the display status of the capability badge 503 to the selected state, and add the capability badge 503 as the capability badge additionally displayed by the icon 302 .
  • the ability subscript 502 in the selected state can receive the user's input operation (such as a click operation); in response to the above-mentioned input operation, the display state of the capability subscript 502 is switched to an unselected state, and stop.
  • a capability subscript 502 is additionally displayed on the icon 302 .
  • the icon 302 can receive user input operations (such as touch operations). , in response to the input operation, the electronic device 100 stops displaying the capability badge around the icon 302 .
  • the icon 302 may not additionally display the capability badge .
  • the electronic device 100 starts to display the capability subscript on the icon 302 in FIG. 12F .
  • FIG. 12G when the user selects the capability badge 501 and the capability badge 503 displayed around the icon 302 , the above two capability badges do not need to be additionally displayed on the icon 302 .
  • FIG. 13A to FIG. 13J show related user interfaces for implementing collaborative connection in case two.
  • the icon 302 with the additional capability corner mark 501 and the capability corner mark 503 can receive the user's sliding operation, and the sliding direction of the above-mentioned sliding operation points to the icon 301 of the electronic device 100; it is detected that the icon 302 touches the area where the icon 301 is located , in response to the user's sliding operation, the electronic device 100 displays prompt information 601, and performs a coordinated connection to the camera and audio output functions of the tablet computer.
  • the prompt information 601 is used to prompt that the device is being coordinated with the camera and audio output functions of the tablet computer.
  • the electronic device 100 performing the coordinated connection to the camera and audio output functions of the tablet computer may include: the electronic device 100 sending a coordinated connection request for the camera and audio output functions to the tablet computer.
  • the tablet computer after the tablet computer receives the collaborative connection request sent by the electronic device 100, it displays a selection box, the selection box includes prompt information 602, a camera selection control 603, an audio output function selection control 604, Confirm control 605 and reject control 606 .
  • the prompt information 602 is used to prompt that the coordinated connection request for the camera and audio output functions of the electronic device 100 is received.
  • the confirmation control 605 can receive the user's input operation.
  • the electronic device 100 sends a coordinated connection response 3, which is used to indicate approval of the coordinated connection of the camera and audio output functions.
  • the electronic device 100 displays the prompt information 607 shown in FIG. 13D , and changes the display state of the icon of the tablet computer from the uncoordinated state to the coordinated state.
  • the ability corner indicator and prompt information 607 additionally displayed on the icon 412 of the coordinated state are used to prompt that the device has established a coordinated connection with the camera of the tablet computer, and has established a coordinated connection with the audio output function of the tablet computer.
  • the electronic device 100 displays icons of coordinated available devices in the cooperatively connected card 1 (such as the icon 412 of tablet computer), and the icon 412 of tablet computer additionally shows the corresponding ability corner mark of camera and audio output function; Through icon 412 additionally displayed ability corner mark indication and the camera of tablet computer, audio output function have established cooperative connection .
  • the confirmation control 605 can receive the user's input operation.
  • 100 sends a coordinated connection response 4, where the coordinated connection response 4 is used to indicate approval of the coordinated connection of the camera and rejection of the coordinated connection of the audio output function.
  • the electronic device 100 displays the prompt information 608 shown in FIG. 13G , changes the display state of the icon 302 of the tablet computer from the uncoordinated state to the coordinated state, and stops additionally displaying the audio output function on the icon 302.
  • the prompt information 607 is used to prompt that the device has established a cooperative connection with the camera of the tablet computer, and that the cooperative connection with the audio output function of the tablet computer has failed.
  • the rejection control 404 may receive an input operation from the user, and in response to the above input operation, the tablet computer sends a coordinated connection response 5 to the electronic device 100 to reject the coordinated connection.
  • the electronic device 100 displays the prompt message 609 shown in FIG. 13J , and bounces the icon 301 of the tablet computer back to the circular area where the candidate device is located.
  • the above prompt information 609 is used to prompt that the coordinated connection between the camera and the audio output function of the device and the tablet computer fails.
  • the user may also select other capabilities of the candidate device to perform the coordinated connection.
  • FIG. 14A to FIG. 14E show relevant user interfaces for continued coordinated connection of coordinated tablet computers.
  • the electronic device 100 has currently established a cooperative connection with the audio input function of the tablet computer, and the icon 302 of the tablet computer in the coordinated state additionally displays a capability icon 502 corresponding to the audio input function.
  • the icon 302 can receive the user's input operation (such as a click operation), and in response to the above input operation, the electronic device 100 will display around the icon 302, and the corresponding capability of the collaborative capability supported by the tablet computer Subtitles, for example, the capability subtitle 502 corresponding to the audio output function and the capability subtitle 501 corresponding to the camera.
  • the capability badge 501 can receive an input operation (such as a click operation) from the user; in response to the above input operation, the electronic device 100 stops displaying the capability around the icon 302 The corner mark displays a prompt message 610 indicating that a cooperative connection is in progress, and executes a cooperative connection to the camera of the tablet computer.
  • the electronic device 100 in response to the above input operation, the electronic device 100 additionally displays a camera capability subscript 501 on the icon 302 .
  • the electronic device 100 displays prompt information 611 prompting that the coordinated connection is successful.
  • the capability subscript 501 of the camera additionally displayed by the icon 302 presents an uncoordinated state (for example, the display is not deepened);
  • the electronic device 100 also switches the capability icon 501 of the camera to the coordinated state (for example, the display is darkened).
  • the electronic device 100 displays a prompt message 612 indicating that the coordinated connection fails, and stops additionally displaying the camera capability icon 501 above the coordinated icon 302 .
  • the icon of the candidate device 200 for example, the icon 302 of the tablet computer
  • FIG. 10A to FIG. 10F which will not be repeated here.
  • the electronic device 100 after the electronic device 100 establishes a coordinated connection with multiple capabilities (such as capability 1 and capability 2) of the candidate device 200, the user can cancel the above multiple capabilities or one of the above multiple capabilities with the candidate device 200.
  • the tablet computer is taken as an example for description below.
  • the icon 302 of the coordinated state of the tablet computer additionally displays the capability subscripts of the camera and audio output functions.
  • the icon 302 of the coordinated state of the tablet computer can receive the cancel operation 1 of the user; in response to the above cancel operation 1, the electronic device 100 can cancel the coordinated connection of all the coordinated capabilities (that is, camera and audio output functions) of the tablet computer, and set The display state of the icon 302 is switched to the uncoordinated state.
  • cancellation operation 1 refer to the relevant description in case 1, and details are not repeated here.
  • the coordinated status icon 302 of the tablet computer is attached with multiple capability badges, and the user can individually cancel the coordinated connection of one of the multiple coordinated capabilities.
  • FIG. 15A to FIG. 15D show related user interfaces for separately canceling the coordinated connection of the camera of the tablet computer.
  • the icon 302 of the coordinated state of the tablet computer can also receive the user's input operation (such as a click operation);
  • Capability subscripts the capability subscripts corresponding to all the above synergistic capabilities include those corresponding to the coordinated capabilities (such as the capability subscript 501 of the camera and the capability subscript 502 of the audio input function) and those corresponding to the uncoordinated capabilities (such as the ability corner mark 503 of the audio output function), the ability corner mark corresponding to the coordinated ability (such as the ability corner mark 501) is selected, and the ability corner mark corresponding to the uncoordinated capability (such as the ability corner mark Mark 503) is presented as an unselected state.
  • Capability subscripts the capability subscripts corresponding to all the above synergistic capabilities include those corresponding to the coordinated capabilities (such as the capability subscript 501 of the camera and the capability subscript 502 of the audio input function) and those corresponding to the uncoordinated capabilities (such as the ability corner mark 503 of the audio output function), the ability corner mark corresponding to
  • the capability badge 501 can receive an input operation (such as a click operation) from the user.
  • the electronic device 100 can cancel the collaborative connection to the camera of the tablet computer, and display a prompt to cancel the coordinated connection.
  • Prompt information as shown in FIG. 15D , after canceling the cooperative connection to the camera of the tablet computer, the icon of the tablet computer in the coordinated state stops displaying the camera capability icon 501 .
  • the electronic device 100 may support establishing coordinated connections with multiple devices at the same time.
  • FIG. 16A to FIG. 16D show related user interfaces for the electronic device 100 to establish a collaborative connection with two devices.
  • the electronic device 100 may simultaneously establish coordinated connections with the same capability of multiple candidate devices.
  • the electronic device 100 has established a cooperative connection with the audio output function of the tablet computer and the camera; the icon 303 of the notebook computer additionally displays the capability corner mark 501 corresponding to the camera, and the user can drag the icon by sliding operation 303 to the area where the icon 301 of the electronic device 100 is located; when it is detected that the icon 302 is dragged to the area where the icon 301 is located, in response to the above-mentioned sliding operation, the electronic device 100 displays a prompt message 616 that prompts that the collaborative connection is in progress, and executes the update of the notebook. Collaborative connection of the camera of the computer.
  • a prompt message 617 indicating that the coordinated connection is successful is displayed, and the display state of the icon 303 of the notebook computer is converted from an uncoordinated state to a coordinated state;
  • a prompt message 618 is displayed indicating that the cooperative connection fails, and the icon 303 of the laptop is bounced back to the circular area where the candidate device is located.
  • the electronic device 100 establishes a coordinated connection with at most one device.
  • the reason for the cooperative connection failure in FIG. 16D may be that the cameras of multiple devices cannot be cooperatively connected at the same time, and the electronic device 100 may prompt through the prompt message 618 in FIG. 16D that the cameras of multiple devices cannot be cooperatively connected at the same time.
  • Case 3 The electronic device 100 and the candidate device 200 support at most one kind of coordinated connection; the candidate device 200 supports at least one coordinated capability, and the icon of the electronic device 100 can additionally display any of the at least one capability Ability badge for abilities (e.g. ability 1).
  • the icon of the electronic device 100 is attached with a capability subscript corresponding to capability 1, drag the icon of the candidate device 200 close to the icon of the electronic device 100 or drag the icon of the electronic device 100 close to the icon of the candidate device 200 , the coordinated connection of the electronic device 100 to the capability 1 of the candidate device 200 can be realized.
  • FIGS. 17A to 17B show a related user interface in which a capability icon is added to the icon 301 of the electronic device 100 .
  • the icon 301 of the electronic device 100 may receive a user's input operation (such as a click operation), and in response to the above input operation, the electronic device 100 displays at least one capability icon around the icon 301 .
  • the above at least one capability badge includes the coordinated capabilities supported by all candidate devices displayed on the coordinated connection interface 13 .
  • the above at least one capability subscript includes the capability subscript 501 of the camera, the capability subscript 503 of the audio output function, the capability subscript 502 of the audio input function, the capability subscript 504 of the screen projection function and the capability of the printing function Corner mark 505.
  • the capability subtitle 503 corresponding to the audio output function may receive an input operation (such as a click operation) from the user; as shown in FIG. 17C , in response to the above input operation, the electronic device 100 switches the capability The display state of the superscript 503 is the selected state, and the superscript 503 of display capability is attached to the icon 301 .
  • the icon 301 shown in FIG. 17C may receive a user's input operation; as shown in FIG. 17D , in response to the above input operation, the electronic device 100 stops displaying the capability badge around the icon 301 .
  • the electronic device 100 may directly display the collaborative connection interface 13 shown in FIG. 17D .
  • the electronic device 100 may display only candidate device icons that can cooperate with the capability corresponding to the capability icon in the circular area.
  • the printer and the projector do not support the audio output function that can be coordinated; as shown in FIG. 17E, different from the coordinated connection interface 13 shown in FIG.
  • An icon 306 of a printer and an icon 305 of a projector are displayed in a circular area.
  • the icon 301 may receive a user's input operation, and in response to the above input operation, the electronic device 100 stops displaying the capability badge around the icon 301 .
  • the electronic device 100 may also directly display the coordinated connection interface 13 shown in FIG. 17F .
  • FIG. 18A to FIG. 18C show a related user interface of a cooperative connection of a capability in the third case.
  • the user can drag the icon 302 to the area where the icon 301 is located through a sliding operation;
  • area 1 is set, in response to the above sliding operation, the electronic device 100 displays a prompt message 701 indicating that a cooperative connection is in progress, and performs a cooperative connection with the audio output function of the tablet computer.
  • the electronic device 100 displays a prompt message 702 indicating that the coordinated connection is successful, switches the icon 302 from the uncoordinated state to the coordinated state, and additionally displays the audio output on the icon 302 Capability subscript 503 of the function.
  • the electronic device 100 stops attaching and displaying the capability corner mark 503 on the icon 301 of the device; candidate devices.
  • the electronic device 100 displays a prompt message 703 prompting that the coordinated connection fails, and bounces the icon 302 back to the circular area where the candidate device is located.
  • how to cancel the coordinated connection of the coordinated capability in case three can refer to the relevant description in case one, and will not be repeated here. It should be noted that, taking the camera of the tablet computer as an example, if the cooperative connection to the camera of the tablet computer is canceled in the third case, after the cooperative connection is cancelled, the icon 302 of the tablet computer will no longer be attached with a display of the capability of the camera.
  • the coordinated connection of the capability corresponding to the capability icon additionally displayed on the icon 302 can be realized.
  • FIG. 19A to FIG. 19E show related user interfaces of the collaborative connection in this embodiment.
  • the user can drag the icon 301 of the device to the icon 302 of the tablet computer through a sliding operation;
  • the prompt information 701 of the cooperative connection and execute the cooperative connection with the audio output function of the tablet computer.
  • FIG. 19C when it is determined that the coordinated connection of the audio output function is successful, the electronic device 100 displays a prompt message 702 prompting that the coordinated connection is successful, switches the icon 302 of the tablet computer from the uncoordinated state to the coordinated state, and additionally displays on the icon 302
  • the capability of the audio output function is marked 503, and the icon 301 of the device is bounced back to the circular area.
  • FIG. 19D shows the coordinated state of another icon 302 provided by the embodiment of the present application. As shown in FIG. 19D , the icon 302 in the coordinated state is darkened and displayed, and bounces back to the circular area together with the icon 301 of the device. In one implementation manner, as shown in FIG. 19C and FIG. 19D , after the icon 301 bounces back to the circular area, the additional display of the capability badge is stopped.
  • the electronic device 100 displays a prompt message 703 indicating that the cooperative connection fails, and bounces the icon 301 of the device back to the circular area, and the icon 301 can continue to additionally display the audio output Capability subscript 503 of the function.
  • the user can also drag the capability icon (such as capability icon 503 ) displayed around the icon 301 of the device to the icon 302 of the tablet computer, so as to realize the capability icon 503 Cooperative connection of the corresponding audio output function.
  • the capability icon such as capability icon 503
  • the user can drag the capability icon 503 to the icon 302 of the tablet computer through a sliding operation; as shown in FIG. 19H , it is detected that the capability icon 503 touches the icon 302 and the user lets go , in response to the above sliding operation, the electronic device 100 displays the prompt information 701 shown in FIG. 19H , and performs a cooperative connection with the audio output function of the tablet computer.
  • the electronic device 100 displays a prompt message 702 prompting that the coordinated connection is successful, switches the icon 302 of the tablet computer from the uncoordinated state to the coordinated state, and attaches Capability badge 503 showing the audio output function.
  • the electronic device 100 displays a prompt message 703 indicating that the coordinated connection fails, and the icon 301 may additionally display a capability subscript 503 of the audio output function.
  • the electronic device 100 and the candidate device 200 support coordinated connection of multiple capabilities; the candidate device 200 supports at least one capability that can be coordinated, and the icon of the electronic device 100 can additionally display one or more of the above at least one capability Ability badges for different abilities (such as ability 1 and ability 2).
  • the icon of the electronic device 100 when the icon of the electronic device 100 is attached with the capability subscript corresponding to capability 1 and capability 2, drag the icon of the candidate device 200 close to the icon of the electronic device 100 or drag the icon of the electronic device 100 close to the icon of the candidate device 200
  • the icon can realize the coordinated connection of the electronic device 100 to the capability 1 and capability 2 of the candidate device 200 .
  • FIGS. 20A to 20D show related user interfaces that additionally display two kinds of capability icons for the icon 302 of the electronic device 100 .
  • the icon 301 of the electronic device 100 additionally displays a capability subscript 503 of the audio output function; the icon 301 can receive an input operation (such as a click operation) from the user, and in response to the above input operation, the electronic device 100 At least one capability badge is displayed around the icon 301 .
  • the above at least one capability badge includes a capability that can be coordinated by the currently displayed candidate device in the coordinated connection interface 13 .
  • the candidate device in FIG. 20B does not support the printing function, and the at least one capability subtitle does not include the capability subtitle 505 of the printing function.
  • the capability badge 501 corresponding to the camera can receive an input operation (such as a click operation) from the user; as shown in FIG. 501 Add a capability subscript that is additionally displayed on the icon 301 of the device.
  • the electronic device 100 in response to the above-mentioned input operation, the electronic device 100 also stops displaying the icons of candidate devices that do not support the camera corresponding to the capability icon 501 (for example, the speaker icon 304), and/or displays the icon of the capability corner
  • the mark 501 is switched from the unselected state to the selected state.
  • the icon 301 shown in FIG. 20C may receive a user's input operation (for example, a click operation); as shown in FIG.
  • the electronic device 100 in response to the above input operation, stops displaying the at least one capability icon around the icon 301 . In one implementation manner, in response to an input operation on the capability badge 503 shown in FIG. 20B , the electronic device 100 may directly display the coordinated connection interface 13 shown in FIG. 20D .
  • How to switch the capability subtitle attached to the electronic device 100 in Case 4 can also refer to the implementation of switching the capability subtitle attached to the icon 302 of the tablet computer in FIG. 12A to FIG. 12F , which will not be repeated here.
  • FIG. 21A to FIG. 21D show related user interfaces of the cooperative connection of the two capabilities in case four.
  • the user can drag the icon 302 to the area where the icon 301 is located through a sliding operation; it is detected that the icon 302 touches the icon 301 or
  • the electronic device 100 displays a prompt message 711 indicating that a cooperative connection is in progress, and performs a cooperative connection with the audio output function and the camera of the tablet computer.
  • the electronic device 100 displays a prompt message 712 indicating that the cooperative connection is successful, switches the icon 302 from the uncoordinated state to the coordinated state, and attaches The capability subtitle 501 of the camera and the capability subtitle 503 of the audio output function are displayed.
  • the icon 301 of the device stops additionally displaying the icon 503 of the audio output function and the icon 501 of the camera, and displays all detected uncoordinated candidate devices in a circular area.
  • the electronic device 100 displays the speaker icon 304 , the projector icon 305 , and the printer icon 306 again in the circular area.
  • the electronic device 100 displays a prompt message 713, switches the icon 302 from the uncoordinated state to the coordinated state, and additionally displays the camera on the icon 302. Capability subscript 501.
  • the prompt message 713 is used to prompt that the cooperative connection with the camera of the tablet computer is successful, but the cooperative connection with the audio output function of the tablet computer fails.
  • the icon 301 of the device stops additionally displaying the icon 501 of the camera, and displays the detected uncoordinated candidates supporting the audio output function in the circular area equipment.
  • the electronic device 100 displays the speaker icon 304 again in the circular area.
  • the electronic device 100 displays a prompt message 714 indicating that the coordinated connection fails, and pops the icon 302 back to the ring area where the candidate device is located.
  • the user may also select other capabilities of the candidate device to perform the coordinated connection.
  • FIG. 22A to FIG. 23C show related user interfaces for continued coordinated connection of coordinated tablet computers.
  • the electronic device 100 has currently established a cooperative connection with the audio output function of the tablet computer.
  • FIG. 22B , FIG. 22C and FIG. 22D taking the capability badge 501 as an example, the user can select the capability badge 501 and add the capability badge 501 as a capability badge additionally displayed on the icon 301 .
  • FIG. 20B to FIG. 20D which will not be repeated here.
  • the user can drag the icon 301 of the device to the area where the icon 302 is located through a sliding operation; it is detected that the icon 301 touches the icon 302 , the electronic device 100 displays the prompt information 721 prompting that the coordinated connection is in progress, and executes the coordinated connection with the camera of the tablet computer.
  • the electronic device 100 displays a prompt message 722 prompting that the coordinated connection is successful, and displays a camera capability icon 501 on the icon 302 in the coordinated state, and bounces back the icon 301 of the device. In circular area 1.
  • the electronic device 100 displays a prompt message 723 prompting that the cooperative connection fails, and bounces the icon 301 of the device back into the circular area.
  • the electronic device 100 can establish a coordinated connection with multiple devices at the same time, or establish a coordinated connection with at most one device, which is not specifically limited here.
  • FIG. 24A to FIG. 24E show related user interfaces for the electronic device 100 to establish a cooperative connection with two devices.
  • the electronic device 100 has established a cooperative connection with the audio output function and camera of the tablet computer; the user can add at least one capability angle corresponding to the collaborative capability of the candidate device to the icon 301 of the device (for example, the capability subtitle 503 corresponding to the audio output function).
  • the user can drag the icon 301 of the device to the area where the icon 303 of the notebook computer is located through a sliding operation; in response to the above sliding operation, the electronic device 100 executes the coordination of the audio output function of the notebook computer connect.
  • the electronic device 100 and the candidate device 200 only support one synergistic capability. Put the icon close to the icon of the electronic device 100 or drag the icon of the electronic device 100 close to the icon of the candidate device, the electronic device 100 can automatically select a capability from the collaborative capabilities supported by the candidate device 200 based on the current application scenario for collaborative connection .
  • the electronic device 100 and the candidate device 200 support at least one synergistic capability. If the user does not select an additionally displayed capability icon for the candidate device 200 or the electronic device 100, drag the candidate device 200 The icon is close to the icon of the electronic device 100 or the icon of the electronic device 100 is dragged close to the icon of the candidate device, and the electronic device 100 can automatically select at least one capability for collaboration from the supported capabilities of the candidate device 200 based on the current application scenario connect.
  • the candidate device 200 in the collaborative connection interface 13 supports at least one collaborative capability, and when the icon 301 of the candidate device 200 and the electronic device 100 does not display a capability icon, the user drags the candidate device through a sliding operation.
  • the icon of the device 200 is close to the icon of the electronic device 100 or the icon of the electronic device 100 is dragged close to the icon of the candidate device; in response to the above sliding operation, the electronic device 100 is based on the application program 1 running in the foreground recently, and the candidate device 200 that has been cooperatively connected
  • One or more of the ranking of the number of times of each capability, the capability of the latest collaborative connection with the candidate device 200, the priority of each capability that can be coordinated by the candidate device 200, etc. automatically select at least one from the capabilities that can be coordinated by the candidate device 200
  • Capabilities for example, capability 1 perform cooperative connections.
  • the electronic device 100 determines the capability (for example, capability 1) required by the application program 1 running in the foreground recently, and automatically selects the capability 1 from the cooperative capabilities of the candidate device 200 for cooperative connection; when the candidate When the synergistic capabilities of the device 200 do not include the capabilities required by the application program 1, the electronic device 100 ranks based on the number of times of each capability that has been coordinated with the candidate device 200, the capability of the latest coordinated connection with the candidate device 200, and the candidate device 200's ability. One or more of the priorities of each capability that can be coordinated, at least one capability (for example, capability 1) is automatically selected from the capabilities that can be coordinated by the candidate device 200 to perform a coordinated connection.
  • capability 1 for example, capability 1
  • the electronic device 100 selects at least one capability (for example, capability 1) that ranks first in the number of times among the capabilities that have been connected with the candidate device 200 to perform the coordinated connection;
  • the ranking of the coordinated connection times of each capability within a time period may also be the ranking of the coordinated connection times of each capability within the latest preset total connection times (for example, the last 10 times).
  • the electronic device 100 selects at least one capability that is most recently coordinated with the candidate device 200 to perform the coordinated connection.
  • the electronic device 100 selects at least one capability with the highest priority among the capabilities that can be coordinated with the candidate device 200 to perform coordinated connection; wherein, the priority of each capability can be preset by the electronic device 100, or can be It is preset by the user and is not specifically limited here.
  • the capabilities required by the application program 1 include capability 1.
  • the coordinated connection interface 13 is called out; the candidate devices (such as the candidate device 200) in the coordinated connection interface 13 all support Capability 1, when neither the icon 301 of the candidate device 200 nor the electronic device 100 is attached with a display capability corner mark, the user drags the icon of the candidate device 200 close to the icon of the electronic device 100 or drags the icon of the electronic device 100 close to the candidate device through a sliding operation 200; in response to the above sliding operation, the electronic device 100 automatically selects the capability required by the application 1 (for example, capability 1) from the capabilities supported by the candidate device 200 for collaborative connection.
  • capability 1 for example, capability 1
  • FIG. 25A to FIG. 25D show user interfaces for determining the capability of cooperative connection based on the current application scenario.
  • the cooperative connection interface 13 is displayed in response to the user's input operation; the capabilities required by the music APP include audio output function, cooperative connection
  • the candidate devices displayed in the circular area on the interface 13 all support the audio output function.
  • FIG. 25B and FIG. 25C in the collaborative connection interface 13, neither the icon 302 of the tablet computer nor the icon 301 of the electronic device 100 is attached with a display capability icon, and the user drags the icon 301 of the tablet computer to be close to the icon of the device through a sliding operation.
  • Icon 301 in response to the above-mentioned sliding operation, select the capability required by the music APP (such as the audio output function) from the collaborative capabilities of the tablet computer for collaborative connection.
  • the capability required by the music APP such as the audio output function
  • the icon 302 of the tablet computer is switched to the coordinated state, and the icon 302 is attached with a superscript 503 displaying the ability of the audio output function.
  • the electronic device 100 may also support establishing coordinated connections with multiple devices at the same time, which will not be repeated here.
  • the coordinated connection interface 13 shown in FIG. 26A is taken as an example for illustration.
  • the audio output function and camera of the tablet computer, the audio output function of the notebook computer, and the printing function of the printer have established a cooperative connection with the electronic device 100 .
  • the electronic device 100 displays a selection box, which includes options for currently available devices that have cooperated with the audio output function (i.e. Tablet PC option 801 and Laptop PC option 802), and an OK control 803 and a Deny control 804.
  • a selection box which includes options for currently available devices that have cooperated with the audio output function (i.e. Tablet PC option 801 and Laptop PC option 802), and an OK control 803 and a Deny control 804.
  • FIG. 26D after the user selects at least one option of an available device (such as the option 801 of a notebook computer), an input operation (such as a click operation) acting on the determination control 803 is detected, and in response to the above input operation, the electronic device 100 can Call the audio output function of the laptop to play music.
  • the rejection control 804 may receive a user's input operation (such as a click operation), and in response to the above input operation, the electronic device 100 stops displaying the above selection box.
  • the electronic device 100 can coordinately connect to the same capability (for example, capability 1) of multiple devices.
  • the electronic device 100 only supports invoking the capability 1 of one available device at the same time.
  • the electronic device 100 supports calling the capability 1 of multiple available devices at the same time. For example, after the user selects the option 801 of the tablet computer and the option 802 of the notebook computer shown in FIG. 26D, the electronic device 100 detects an input operation acting on the determination control 803; Play music with the audio output function of the laptop.
  • the electronic device 100 may automatically select at least one available device from the coordinated available devices without displaying the options of the available devices that have been coordinated, And invoke capability 1 of at least one of the above available devices.
  • the electronic device 100 may automatically select the available device that performs capability 1 from the available devices that have coordinated the audio output function (that is, a tablet computer and a notebook computer). device; for example, the electronic device 100 automatically selects an available device with a larger number of collaborative connections of the audio output function, or an available device that has recently performed a coordinated connection of the audio output function.
  • the selection strategy of the electronic device 100 is not specifically limited here.
  • the electronic device 100 if the electronic device 100 is only cooperatively connected to the capability 1 of one available device, when the electronic device 100 needs to call the capability 1 of other devices, there is no need to display the options of the available devices that have been coordinated and connected for the user to choose.
  • the electronic device 100 Ability to directly call available equipment that has been coordinated1.
  • FIG. 26A to FIG. 26D are exemplary illustrations of application of capabilities of coordinated available devices in this embodiment of the present application, and should not limit this embodiment of the present application.
  • the coordinated connection interface 13 adopts a two-layer ring layout design.
  • the ring layout on the first layer reflects the relationship between other devices and this device, that is, the first ring shows the icons of the candidate devices detected by the machine that can be coordinated, and the coordinated status of the icons of the candidate devices (uncoordinated state or Coordinated state) may indicate whether the capabilities of the current device and the candidate device have established a coordinated connection.
  • the user can intuitively see one or more candidate devices that can be coordinated with the current device, as well as the coordination status of the candidate devices, so that the user can select the candidate device to be coordinated.
  • the circular layout on the second layer reflects the synergizable capabilities supported by the candidate devices, that is, displays the capability badges corresponding to the synergizable capabilities.
  • the user can intuitively see the various capabilities of the candidate devices that can be coordinated, and the user can select and switch the additional capability angle displayed by the icon of the candidate device through the capability icon displayed in the second layer of the ring. Standard, and then realize the selection and switching of the cooperative connection capability.
  • the icon of the candidate device 200 in the coordinated state is additionally displayed with a capability subtitle, which can also visually indicate the coordinated capability of the candidate device 200 to the user.
  • the page style of the two-layer circular layout design in the cooperative connection interface 13 is coordinated and unified, and the visual effect is good.
  • the user selects the ability to be coordinated, implements the collaborative connection, and cancels the collaborative connection interface interaction, which is highly playable and interesting, and effectively improves the user experience.
  • the electronic device 100 supports at least one capability that can be coordinated, and the additional icon displayed by the electronic device 100 is the capability corner mark of any one of the at least one capability (such as capability 1) of the electronic device 100 .
  • the user drags the icon of the candidate device close to the icon of the electronic device 100 or drags the icon of the electronic device 100 close to the icon of the candidate device through a sliding operation, and the collaborative connection of the candidate device 200 to the capability 1 of the electronic device 100 can be realized; the cooperative connection is successful After that, the candidate device 200 may call the capability 1 of the electronic device 100 .
  • the user clicks on the icon 301 of the electronic device 100, and the electronic device 100 may display a capability badge of at least one capability of the electronic device 100 around the icon 301; refer to FIG. 17B to FIG. 17D, the user may select one or more capability icons to be additionally displayed for the icon 301 .
  • the user drags the icon of the candidate device 200 (for example, the icon 302 of the tablet computer) to the icon 301 by acting on the sliding operation; in response to the above sliding operation, the electronic device 100 executes the cooperative connection of the candidate device 200 to the capability 1 of the electronic device 100 Process: After the coordinated connection is successful, the electronic device 100 may switch the display state of the candidate device 200 to the coordinated state.
  • the electronic device 100 executes the coordinated connection process of the candidate device 200 for the capability 1 of the electronic device 100, which may include: the electronic device 100 sends a coordinated connection request 5 to the candidate device 200, and the coordinated connection request is used to request the candidate device 1 Perform a coordinated connection to capability 1 of the electronic device 100, and the coordinated connection request 5 may carry a coordinated connection parameter of the electronic device 100's capability 1; the candidate device 200 may establish a coordinated connection with the electronic device 100's capability 1 based on the above coordinated connection parameter, and A coordinated connection response indicating that the coordinated connection is successful is sent to the electronic device 100 .
  • the icon of the candidate device 200 in the coordinated connection interface will appear as coordinated state 1; , then in the coordinated connection interface, the icon of the candidate device 200 presents the coordinated state 2; the coordinated state 1 is different from the coordinated state 2.
  • FIG. 19D shows the coordinated state 1 of the icon 302 of the tablet computer
  • FIG. 19C shows the coordinated state 2 of the icon 302 of the tablet computer.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • the embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 .
  • the functions implemented by each functional module are similar to the embodiments of the present application.
  • FIG. 27 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into five layers, from top to bottom are application program layer, application program framework layer, Android runtime (Android runtime) and system library, HAL (hardware abstraction layer, hardware abstraction layer) layer and kernel layer.
  • the application layer can consist of a series of application packages.
  • APPs applications
  • games such as games, camera, navigation, calendar, gallery, bluetooth, music, SMS, and Word
  • the electronic device 100 runs the application installed in the application layer, it may need to invoke a specific capability.
  • the music APP needs to call the audio output function when playing music
  • the camera APP needs to call the camera when taking pictures
  • the Word APP needs to call the printing function when printing word documents.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a display module, a content provider, a view system, a resource manager, a notification manager, and so on.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • prompting text information in the status bar issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.
  • the application framework layer may also include an audio playback module and an image acquisition module.
  • the audio player may be a player such as AudioTrack or MediaPlayer.
  • the audio app can call the audio player and input corresponding audio data to the audio player.
  • an audio app can input original audio data to an audio player, and the audio player will analyze, decapsulate, or decode the original audio data to obtain a frame of PCM (pulse code modulation, pulse code modulation) data.
  • the audio APP can also directly output PCM data to the audio player.
  • the audio player is used to call the speaker to output audio.
  • the camera APP When the camera APP needs to collect, it can call the image acquisition module, and input the instruction of image acquisition to the image acquisition module.
  • the image acquisition module is used to call the camera to acquire images.
  • the Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • HAL hardware abstraction layer, hardware abstraction layer
  • the HAL is responsible for interacting with each hardware device of the electronic device 100.
  • the HAL hides the implementation details of each hardware device, and on the other hand, it can provide an interface for calling each hardware device to the Android system.
  • HALs corresponding to different hardware devices are provided in the HAL, for example, audio (Audio) HAL, camera (Camera) HAL, display (Display) HAL, etc.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the audio playback module can call the audio HAL to send the audio data to the audio HAL, and the audio HAL calls the audio driver of the kernel layer to send the audio data to the audio output device (such as a loudspeaker) of the device to drive the audio output of the device.
  • the audio output device plays the above audio data.
  • the image acquisition module can call the camera HAL, and send the instruction of image acquisition to the camera HAL, and the camera HAL will drive the camera of the device to acquire images by calling the camera driver of the kernel layer.
  • a device virtualization (DeviceVirtualization) APP for realizing capability coordination may be installed in the application layer of the electronic device 100, which may be called DV APP subsequently.
  • the DV APP can be resident and run in the electronic device 100 as a system application.
  • the capabilities implemented by the DV APP can also be resident and run in the electronic device 100 in the form of system services.
  • the electronic device 100 successfully connects with the capability 1 of the candidate device 200 (such as audio output function, camera, etc.)
  • the electronic device 100 obtains the capability parameter of the capability 1 of the candidate device 200, and the DV APP can follow the capability parameter of the candidate device 200.
  • capability parameter create a virtual device corresponding to the candidate device 200 in the electronic device 100, and the virtual device has the capability 1; in this way, the electronic device 100 can invoke the capability 1 of the candidate device 200 through the virtual device.
  • the HAL layer shown in FIG. 28 also includes the tablet DV HAL created by the DV APP.
  • the DV APP acquires relevant information of the tablet computer (such as the ability to coordinate, device identification, device name, device model, and device type, etc.) and the capability parameters of the camera of the tablet computer, and create the call interface of the virtual device corresponding to the tablet computer at the HAL layer (for ease of description, the call interface is referred to as the tablet DV HAL for short); the tablet DV HAL includes the tablet computer The corresponding camera HAL.
  • the DV APP acquires the tablet The capability parameter (such as playback delay, audio sampling rate, etc.) of the audio output function of the computer, and create the corresponding audio HAL of the tablet computer in the tablet computer DV HAL based on the capability parameter.
  • the capability parameter such as playback delay, audio sampling rate, etc.
  • the camera APP After the electronic device 100 detects that the user calls the input operation of the camera of the tablet computer, the camera APP sends an instruction 2 to the image acquisition module, and the instruction 2 is used to instruct to call the camera of the tablet computer to collect images; the image acquisition module calls the DV HAL of the tablet computer The camera HAL sends a call request of the camera to the tablet computer.
  • a collaboration APP for realizing capability collaboration can be installed in the application program layer of the tablet computer.
  • the electronic device 100 When the electronic device 100 establishes a cooperative connection with the camera of the tablet computer, it may obtain the capability parameter of the camera of the tablet computer from the cooperation APP of the tablet computer.
  • the collaborative APP can receive the calling request of the camera sent by the tablet computer; in response to the above calling request, the collaborative APP can send instructions to the image acquisition module of the application framework layer of the tablet computer to instruct the image acquisition module to call the tablet computer
  • the camera HAL of the HAL layer of the computer collects images; the camera HAL can call the camera driver to drive the camera of the tablet computer to collect the image 1; cooperate with the APP to obtain the above image 1, and send the image 1 to the camera APP of the electronic device 100; the camera APP can The above-mentioned image 1 is displayed in the image preview area of the shooting interface 15 .
  • the HAL layer shown in FIG. 28 also includes the notebook computer DV HAL created by the DV APP.
  • the DV APP obtains the relevant information of the notebook computer and the capability parameters of the audio output function of the notebook computer, and based on the notebook computer The relevant information and the ability parameters of the audio output function of the notebook computer, the call interface of the virtual device corresponding to the notebook computer is created at the HAL layer (for ease of description, the call interface is referred to as the notebook computer DV HAL); the notebook computer DV HAL includes The audio HAL generated by the capability parameter of the above audio output function.
  • the music APP sends an instruction 1 and audio data 1 to the audio playback module, and the instruction 1 is used to instruct to call the audio output function of the notebook computer to play the audio data 1;
  • the playback module sends a call request of the audio output function to the notebook computer by calling the audio HAL in the DV HAL of the notebook computer, and the call request includes audio data 1.
  • the collaborative APP can also be installed in the application program layer of the notebook computer.
  • the capability parameter of the audio output function may be obtained from the cooperative APP of the notebook computer.
  • the cooperative APP can receive the call request of the audio output function sent by the electronic device 100; in response to the above call request, the cooperative APP can send instructions to the audio playback module of the application framework layer of the notebook computer to instruct the audio playback module
  • the audio data 1 is played by calling the audio HAL of the HAL layer of the notebook computer; the camera HAL can call the audio driver to drive the speaker of the tablet computer to play the audio data 1 .
  • the HAL layer shown in FIG. 28 also includes the printer DV HAL created by the DV APP.
  • the DV APP obtains the relevant information of the printer and the capability parameters of the printing function, and creates a virtual device call interface corresponding to the printer at the HAL layer (for ease of description, The calling interface is referred to as the printer DV HAL for short); the printer DV HAL includes the printing HAL generated based on the capability parameters of the above-mentioned printing function.
  • the application framework layer of the electronic device 100 may also include a printing management module.
  • the Word APP sends instruction 3 and document data 1 to the printing management module, and the instruction 3 is used to instruct to call the printing function of the printer to print the document data 1;
  • the printing HAL in the printer DV HAL sends a calling request of the printing function to the printer, and the calling request includes document data 1.
  • the collaborative APP can also be installed in the application program layer of the printer.
  • the capability parameter of the printing function may be obtained from the cooperative APP of the printer.
  • the cooperative APP can receive the calling request of the printing function sent by the electronic device 100; in response to the above calling request, the cooperative APP can send an instruction to the printing management module of the application framework layer of the printer to instruct the printing management module to pass the calling request.
  • the print HAL of the printer's HAL layer prints document data1.
  • FIG. 32 is a schematic flowchart of a device coordination method provided in an embodiment of the present application, the method is applied to a first electronic device, and the method includes:
  • S101 Display a first user interface; the first user interface includes a first icon of the first electronic device and an icon of at least one detected candidate device, where the icon of the at least one candidate device includes a second icon of the second electronic device,
  • the second electronic device supports at least two synergizable capabilities, and the at least two synergizable capabilities include the first capability.
  • the first electronic device may be the electronic device 100 described in the foregoing embodiments
  • the second electronic device may be the candidate device 200 (such as a tablet computer) described in the foregoing embodiments
  • the first user interface may be the user interface described in the foregoing embodiments 13.
  • the first icon may be the icon 301 in the user interface 13
  • the second icon may be the icon 302 in the user interface 13.
  • the second electronic device is the tablet computer described in the foregoing embodiments, and the collaboratable capabilities of the tablet computer include supporting a camera, an audio input function, and an audio output function.
  • the first capability may be any one of the above-mentioned synergistic capabilities of the tablet computer.
  • the first user interface further includes: a capability subscript corresponding to the synergizable capability supported by the second electronic device; the capability subscript corresponding to the synergizable capability supported by the second electronic device includes The first capability badge, the first input operation acts on the first capability badge.
  • a capability badge corresponding to a capability that can be coordinated supported by the second electronic device is displayed in a surrounding area close to the second icon.
  • the area around the icon 302 in the user interface 13 is displayed with a capability badge corresponding to the collaborative capability of the tablet computer.
  • the first capability badge may be the capability badge 502 corresponding to the audio input function, and the first input operation for selecting the audio input function acts on the capability badge 502 .
  • the method before receiving the first input operation for selecting the first capability, the method further includes: receiving a third input operation acting on the second icon; in response to the third input operation, during the first The capability badges corresponding to the collaborative capabilities supported by the second electronic device are displayed on the user interface.
  • the third input operation may include an input operation (such as a click operation) acting on the icon 302 .
  • an input operation such as a click operation
  • the electronic device 100 displays on the user interface 13 a capability icon corresponding to a capability that the tablet computer can cooperate with.
  • the method further includes: in response to the first input operation, additionally displaying the first capability badge on the second icon.
  • the capability badge 502 is additionally displayed on the icon 302 .
  • the capability badge 501 or the capability badge 503
  • a capability superscript 501 or capability superscript 503 is additionally displayed on the icon 302 .
  • the at least two synergizable capabilities also include the second capability, receiving When the third input operation acts on the second icon, the second icon is additionally displayed with the second ability superscript corresponding to the second ability; after receiving the third input operation acting on the second icon, it also includes: receiving the third input operation acting on the second icon; A fourth input operation of the second capability badge in the first area; in response to the fourth input operation, stop additionally displaying the second capability badge on the second icon.
  • the icon 302 when the third input operation acting on the icon 302 is received, the icon 302 is additionally displayed with a capability subscript 502 ; as shown in FIG. 12D , the receiving action A fourth input operation (such as a touch operation) of the ability subscript 502 in the first area (such as the surrounding area close to the icon 302); as shown in FIG. 12E , in response to the fourth input operation, the additional display on the icon 302 is stopped Ability subscript 502.
  • the method also includes: in response to the first input operation, switching the first capability icon displayed around the second icon from the unselected state to the selected state; the method also includes: in response to the fourth input operation, switching the The displayed second ability icon is switched from the selected state to the unselected state.
  • the ability subscripts that have been additionally displayed by the icon 302 are in the selected state, and the ability subscripts that are not additionally displayed by the icon 302 are in the unselected state.
  • State in response to the first input operation acting on the ability badge 501, the ability badge 501 displayed around the icon 302 is switched from an unselected state to a selected state; as shown in Figure 12D and Figure 12E
  • the capability badge 502 displayed around the icon 302 is switched from a selected state to an unselected state.
  • the first input operation includes an operation acting on the first capability icon;
  • the second input operation includes: dragging the second icon toward the first icon until the second icon touches the area where the first icon is located; or, Drag the second icon towards the first icon until the distance between the second icon and the first icon is less than or equal to the preset threshold; or drag the first icon towards the second icon until the first icon touches the area where the second icon is located ; Or, drag the first icon toward the second icon until the distance between the first icon and the second icon is less than or equal to a preset threshold.
  • the second input operation may include: dragging the icon 302 toward the icon 301 until the icon 302 touches the area where the icon 301 is located; or, dragging the icon 302 toward the icon 301 until The distance between icon 302 and icon 301 is less than or equal to a preset threshold.
  • the second input operation may include: dragging the icon 301 toward the icon 302 until the icon 301 touches the area where the icon 302 is located; or, dragging the icon 301 toward the icon 302 until The distance between icon 302 and icon 301 is less than or equal to a preset threshold.
  • the aforementioned preset threshold is a length of 5 pixels.
  • the second input operation acts on the first capability badge.
  • the first input operation includes an operation acting on the first ability icon; the second input operation includes: dragging the first ability icon to the first icon until the first ability icon touches the position of the first icon or, drag the first ability icon to the first icon until the distance between the first ability icon and the first icon is less than or equal to the preset threshold.
  • the first capability badge is the capability badge 502 .
  • both the first input operation and the second input operation act on the capability badge 502 .
  • the first input operation includes a touch operation on the ability icon 502;
  • the second input operation includes: dragging the ability icon 502 toward the icon 301 until the ability icon 502 touches the area where the icon 301 is located; or, dragging the ability icon 502 to the icon 301 Drag the ability icon 502 until the distance between the ability icon 502 and the icon 301 is less than or equal to a preset threshold.
  • the aforementioned preset threshold is a length of 5 pixels.
  • the at least two coordinated capabilities further include a second capability; after successfully establishing a coordinated connection with the second electronic device that supports the first capability, the method further includes: receiving an action on the second icon
  • the fifth input operation In response to the fifth input operation, display the capability subscripts corresponding to the synergizable capabilities supported by the second electronic device, and the capability subscripts corresponding to the synergizable capabilities supported by the second electronic device include the The first capability badge, and the second capability badge corresponding to the second capability; receiving a sixth input operation acting on the second capability badge; in response to the sixth input operation, establishing cooperation with the second electronic device to support the second capability connect.
  • the electronic device 100 and the candidate device 200 (such as a tablet computer) establish a cooperative connection supporting the audio input function (that is, the first capability), the receiving function
  • the fifth input operation (such as a touch operation) on the icon 302; as shown in FIG. 14B , in response to the fifth input operation, the capability subscript corresponding to the collaborative capability supported by the tablet computer is displayed, such as the capability subscript 501 corresponding to the camera.
  • the at least two cooperative capabilities further include a second capability; the establishment of a cooperative connection supporting the first capability with the second electronic device in response to the second input operation specifically includes: responding to the second input operation Two input operations, establishing a cooperative connection supporting the first capability and the second capability with the second electronic device.
  • the cooperable capabilities of the tablet computer include the camera and audio output functions (ie, the first capability and the second capability), and respond to the second input operation acting on the icon 302 (such as drag icon 301 to icon 302), the electronic device 100 establishes a cooperative connection with the tablet computer supporting camera and audio output functions.
  • the second icon when the second input operation is received, is additionally displayed with a first capability badge corresponding to the first capability and a second capability badge corresponding to the second capability.
  • the icon 302 when receiving the second input operation acting on the icon 302 (for example, dragging from the icon 301 to the icon 302), the icon 302 is additionally displayed with a camera corresponding capability subtitle 501 and audio Output the capability subscript 503 corresponding to the function.
  • the method further includes: receiving a seventh input operation acting on the second icon; responding to the seventh input operation , displaying the capability subscript corresponding to the synergizable capability supported by the second electronic device, the capability subscript corresponding to the synergistic capability supported by the second electronic device includes the first capability subscript corresponding to the first capability, and the second capability corresponding to receiving the eighth input operation acting on the first capability icon; in response to the eighth input operation, canceling the coordinated connection with the second electronic device supporting the first capability.
  • the icon 302 can receive the user's seventh input operation (such as touch operation); as shown in FIG. 15A .
  • the ability subscripts corresponding to the collaborative capabilities supported by the tablet computer are displayed in the user interface 13, including the capability subscripts 501 corresponding to the coordinated cameras and the The ability badge 502 corresponding to the coordinated audio input function; as shown in Figure 15B, receiving the eighth input operation (such as a touch operation) acting on the capability badge 501; as shown in Figure 15C and Figure 15D, responding to the eighth input Operate to cancel the collaborative connection with the supported camera of the tablet.
  • the eighth input operation such as a touch operation
  • the capability subtitles corresponding to the capabilities supported by the cooperative connection established by the second electronic device appears as a selected state
  • the capability icon corresponding to a capability not supported by the cooperative connection established by the second electronic device appears as an unselected state.
  • the capability badge displayed around the coordinated state icon 302 after the electronic device 100 establishes a cooperative connection with the tablet computer that supports camera and audio input functions, the capability badge displayed around the coordinated state icon 302 , the capability subscript 501 corresponding to the coordinated camera and the capability subscript 502 corresponding to the audio input function appear as a selected state, and the capability subscript 503 corresponding to an uncoordinated audio output function appears as an unselected state.
  • the method further includes: receiving a tenth input operation acting on the second icon; responding to the tenth The input operation cancels the coordinated connection with the second electronic device for any capability.
  • the tenth input operation is the cancel operation 1 described in the foregoing embodiments.
  • the electronic device 100 After the electronic device 100 establishes a cooperative connection with the tablet computer, it receives a tenth input operation acting on the icon 301 (such as dragging the icon 302 away from the icon 301 input operation); in response to the tenth input operation, cancel the cooperative connection with the tablet computer for any capability.
  • a tenth input operation acting on the icon 301 such as dragging the icon 302 away from the icon 301 input operation
  • the first user interface further includes capability subscripts corresponding to at least two capabilities; the at least two capabilities include all synergizable capabilities supported by the at least one candidate device, and the at least two capabilities correspond to
  • the capability badge includes a first capability badge corresponding to the first capability, and the first input operation acts on the first capability badge.
  • the first capability subtitle may correspond to the audio output function.
  • the capability subtitle 503 of the the first input operation for selecting the audio output function acts on the capability subtitle 503 .
  • the first input operation for selecting the first capability before receiving the first input operation for selecting the first capability, it further includes: receiving a ninth input operation acting on the first icon; in response to the ninth input operation, in the first user interface Displaying the capability superscripts corresponding to the at least two capabilities.
  • a capability badge corresponding to a capability supported by the second electronic device that can be coordinated is displayed in a surrounding area close to the first icon.
  • the electronic device 100 displays all available information supported by all detected candidate devices around the icon 301.
  • the ability badge corresponding to the collaborative ability.
  • the method further includes: additionally displaying a first capability badge on the first icon in response to the first input operation.
  • the first capability subtitle is the capability subtitle 503 corresponding to the audio output function.
  • the capability badge 503 is additionally displayed on the icon 301 .
  • the method further includes: in response to the first input operation, stopping displaying icons of candidate devices that cannot cooperate with the first capability in the first user interface.
  • the electronic device 100 stops displaying icons of candidate devices that cannot cooperate with the audio output function on the user interface 13 .
  • the method further includes: when the cooperative connection supporting the first capability is successfully established with the second electronic device, the second icon is switched from the uncoordinated state to the coordinated state, and the second icon additionally displays the first capability Corresponding first capability icon; when establishing a coordinated connection supporting the first capability with the second electronic device fails, the second icon remains in an uncoordinated state.
  • the first icon before receiving the second input operation, the first icon is displayed in the first preset area, and the icon of the at least one candidate device is displayed in the second preset area; the uncoordinated state of the second icon is presented as The first state is displayed in the second preset area; the coordinated state of the second icon is displayed as being adsorbed to the first icon in the second state and displayed in the first preset area, or the second icon
  • the coordinated status of is displayed in the second preset area in the second status.
  • the first state and the second state refer to different icon colors.
  • the icon 301 is displayed in the first preset area (for example, the aforementioned preset area 1), and the icon of the candidate device is displayed in the second A preset area (such as the aforementioned preset area 2); as shown in Figure 3C, the uncoordinated state of the icon 302 appears to be displayed in the preset area 2 in the first state (such as a light-colored icon); as shown in Figure 6D and Figure 10D , as shown in FIG. 18B and FIG.
  • the coordinated state of the icon 302 appears to be adsorbed to the icon 301 in the second state (for example, a dark icon) and displayed in the preset area 1; or, as shown in FIG. 10F and FIG. 19C As shown, the coordinated state of the icon 302 is displayed in the preset area 2 in the second state (for example, a dark icon).
  • the embodiment of the present application does not specifically limit the coordinated state, the uncoordinated state, the first state, and the second state.
  • the first electronic device executes the step of "establishing a cooperative connection supporting the first capability and the second capability with the second electronic device"
  • the first electronic device and the second electronic device successfully establish a
  • the second icon switches from the uncoordinated state to the coordinated state, and the second icon additionally displays the first and second capability icons
  • the second icon switches from the uncoordinated state to the coordinated state, and the second icon additionally displays the first capability subtitle, but does not additionally display the second capability subtitle.
  • the electronic device 100 establishes a coordinated connection with the tablet computer that supports camera and audio output functions; as shown in FIG.
  • the icon 302 is switched from the uncoordinated state to the coordinated state, and the icon 302 additionally displays a capability subscript 501 corresponding to the camera and a capability subscript 503 corresponding to the audio output function;
  • the icon 302 is switched from the non-coordinated state to the coordinated state, and the icon 302 additionally displays the ability mark 501, and does not display the capability mark 503; as shown in the figure
  • the coordinated connection with the tablet computer is not established successfully, the icon 302 remains in the uncoordinated state.
  • the present application also provides a device collaboration method, which is applied to a first electronic device, and the method includes: displaying a first user interface, where the first user interface includes a first icon of the first electronic device and at least one detected candidate device icon, the icon of the at least one candidate device includes a second icon of the second electronic device; the second electronic device supports at least two synergizable capabilities, and the at least two synergizable capabilities include the first capability; receiving the tenth An input operation; in response to the eleventh input operation, based on the first application program recently running in the foreground and/or the coordination state of the second electronic device, establish a cooperative connection supporting the first capability with the second electronic device.
  • the first electronic device may be the electronic device 100 described in the foregoing embodiments
  • the second electronic device may be the candidate device 200 (such as a tablet computer) described in the foregoing embodiments
  • the first user interface may be the user interface described in the foregoing embodiments 13.
  • the first icon may be the icon 301 in the user interface 13
  • the second icon may be the icon 302 in the user interface 13.
  • the first capability may be any one of the above-mentioned synergistic capabilities of the tablet computer.
  • the eleventh input operation may include an input operation of dragging the icon 302 to the icon 301 .
  • the coordinated state of the second electronic device includes one or more of the following: the number of coordinated connections of each capability that the first electronic device and the second electronic device have coordinated with each other, the first electronic device and the second electronic device The capability of the latest cooperative connection, the priority of each capability of the second electronic device that can be coordinated.
  • the embodiment of the present application does not specifically limit the coordination state of the second electronic device.
  • the establishment of a cooperative connection to the first capability of the second electronic device based on the first application program running in the foreground recently and/or the cooperative state of the second electronic device includes: when the second electronic device is available When the coordinated capability includes the first capability required by the first application program, a coordinated connection is established to the first capability of the second electronic device.
  • the first application program is a music APP
  • the collaborative capability of the tablet computer includes the audio output capability required by the music APP
  • the electronic device 100 establishes an audio output capability with the tablet computer. collaborative connection.
  • establishing a cooperative connection to the first capability of the second electronic device based on the first application program running in the foreground recently and/or the cooperative state of the second electronic device includes: cooperatively connecting with the second electronic device Among the previous capabilities, the first capability with the largest number of coordinated connections can be used to establish a coordinated connection; or, the coordinated connection can be performed with the first capability of the second electronic device that has the latest coordinated connection; or, the priority among the coordinated capabilities of the second electronic device The highest first ability to perform cooperative connections.
  • all or part of them may be implemented by software, hardware, firmware or any combination thereof.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application will be generated in whole or in part.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media.
  • the available medium may be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (solid state disk, SSD)), etc.
  • the processes can be completed by computer programs to instruct related hardware.
  • the programs can be stored in computer-readable storage media.
  • When the programs are executed may include the processes of the foregoing method embodiments.
  • the aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk, and other various media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了设备协同方法,应用于第一电子设备,所述方法包括:显示第一用户界面,第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标;第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力;接收用于选择所述第一能力的第一输入操作;接收第二输入操作;响应于第二输入操作,与第二电子设备建立支持第一能力的协同连接。这样,针对每个可协同连接的候选设备,可以针对性地选择用户意图协同连接的能力,与该候选设备建立协同连接,使得各候选设备的能力在第一电子设备上能得到针对性的充分应用,提高用户的使用体验。

Description

设备协同方法及相关装置
本申请要求于2021年11月22日提交中国专利局、申请号为202111385754.X、申请名称为“一种分布式设备交互方式即电子设备”的中国专利申请的优先权,以及要求于2022年2月28日提交中国专利局、申请号为202210191311.5、申请名称为“设备协同方法及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子技术领域,尤其涉及设备协同方法及相关装置。
背景技术
随着无线通讯技术的发展,智能手机、平板电脑等终端开始支持用户分享图片、文档等数据给其他设备,提高了用户的办公效率和办公体验。
受自身硬件结构和***性能的限制,不同类型的设备所具备的能力优势通常有所不同。例如,电视机具备大面积的显示屏,不具备便携的摄像头和麦克风,手机具备不具备大面积的显示屏,但具备便携的摄像头和麦克风。虽然现有技术支持不同设备间通过数据传输共享图片、视频、音乐、文档等数据,但并不能支持不同设备间共享本设备支持的各种能力,各设备的能力优势不能得到充分应用。用户想要使用不同设备具备的能力时需要切换设备,用户使用体验差。
发明内容
本申请提供了设备协同方法,针对检测到的每个可协同连接的候选设备,第一电子设备可以针对性地选择用户意图协同连接的能力,与该候选设备建立协同连接,使得各候选设备的能力能在第一电子设备上得到有效而充分的应用,提高用户的使用体验。
第一方面,本申请提供一种设备协同方法,应用于第一电子设备,所述方法包括:显示第一用户界面,第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标;第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力;接收用于选择所述第一能力的第一输入操作;接收第二输入操作;响应于第二输入操作,与第二电子设备建立支持第一能力的协同连接。
实施本申请实施例,第二电子设备具备多种可协同的能力时,用户可以通过第一电子设备选择上述多种可协同的能力中的任一种与第二电子设备建立协同连接;针对第一能力协同连接成功后,用户可以通过第一电子设备调用第二电子设备的第一能力。这样,针对当前检测到的每个可协同连接的候选设备,可以针对性地选择用户意图协同连接的能力,与该候选设备建立协同连接,使得各候选设备的能力在第一电子设备上能得到针对性的充分应用,发挥各候选设备的能力优势,提高用户的使用体验。
在一种实现方式中,第一用户界面还包括:第二电子设备支持的可协同的能力对应的能力角标;第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,第一输入操作作用于第一能力角标。示例性的,所述第一用户界面中,在靠近所述第二图标的周围区域显示有第二电子设备支持的可协同的能力对应的能力角标。实施本申请实施 例,通过第一用户界面中所述第二电子设备支持的可协同的能力对应的能力角标,用户可以直观地看到第二电子设备可协同的能力有哪些,进而可以选择指定能力角标对应的能力为待协同的能力。
在一种实现方式中,所述接收用于选择第一能力的第一输入操作之前,所述方法还包括:接收作用于第二图标的第三输入操作;响应于第三输入操作,在第一用户界面中显示第二电子设备支持的可协同的能力对应的所述能力角标。实施本申请实施例,通过作用于候选设备的图标的第三输入操作,用户即可以看到该候选设备的可协同的能力对应的能力角标。
在一种实现方式中,所述方法还包括:响应于第一输入操作,在第二图标上附加显示第一能力角标。实施本申请实施例,用户可以为候选设备的图标选择附加显示的能力角标,第一电子设备可以针对附加显示的能力角标对应的能力建立协同连接。
在一种实现方式中,第一输入操作包括作用于第一能力角标的操作;第二输入操作包括:向第一图标拖动第二图标,直至第二图标接触第一图标的所在区域;或者,向第一图标拖动第二图标,直至第二图标与第一图标的距离小于或等于预设阈值;或者,向第二图标拖动第一图标,直至第一图标接触第二图标的所在区域;或者,向第二图标拖动第一图标,直至第一图标与第二图标的距离小于或等于预设阈值。
在一种实现方式中,第二输入操作作用于第一能力角标。实施本申请实施例,通过作用于第一能力角标的输入操作,即可以建立支持第一能力的协同连接。
在一种实现方式中,第一输入操作包括作用于第一能力角标的操作;第二输入操作包括:向第一图标拖动第一能力角标,直至第一能力角标接触第一图标的所在区域;或者,向第一图标拖动第一能力角标,直至第一能力角标与第一图标的距离小于或等于预设阈值。
在一种实现方式中,所述至少两种可协同的能力还包括第二能力;与第二电子设备成功建立支持第一能力的协同连接之后,所述方法还包括:接收作用于第二图标的第五输入操作;响应于第五输入操作,显示第二电子设备支持的可协同的能力对应的能力角标,第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,以及第二能力对应的第二能力角标;接收作用于第二能力角标的第六输入操作;响应于第六输入操作,与第二电子设备建立支持第二能力的协同连接。实施本申请实施例,与第二电子设备已建立针对第一能力的协同连接时,通过选择第二电子设备的可协同的能力对应的能力角标中的第二能力角标,还可以与第二电子设备继续建立支持第二能力的协同连接。
在一种实现方式中,所述至少两种可协同的能力还包括第二能力;所述响应于第二输入操作,与第二电子设备建立支持第一能力的协同连接,具体包括:响应于第二输入操作,与第二电子设备建立支持第一能力和第二能力的协同连接。实施本申请实施例,可以与第二电子设备建立支持多种能力的协同连接。
在一种实现方式中,接收第二输入操作时,第二图标附加显示有第一能力对应的第一能力角标和第二能力对应的第二能力角标。实施本申请实施例,基于第二图标附加显示的多个能力角标,可以与第二电子设备建立支持上述多个能力角标对应的多种能力的协同连接。
在一种实现方式中,与第二电子设备成功建立支持第一能力和第二能力的协同连接后,所述方法还包括:接收作用于第二图标的第七输入操作;响应于第七输入操作,显示第二电子设备支持的可协同的能力对应的能力角标,第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,以及第二能力对应的第二能力角标;接收作用于第一能力角标的第八输入操作;响应于第八输入操作,取消与第二电子设备的支持第一能力的 协同连接。实施本申请实施例,第一电子设备与第二电子设备建立支持多种能力的协同连接后,通过已协同的上述多种能力中任一能力的能力角标,可以取消针对该能力的协同连接;这样,便于用户有选择地取消指定能力的协同连接,提高用户的使用体验。
在一种实现方式中,第一用户界面还包括至少两种能力对应的能力角标;所述至少两种能力包括所述至少一个候选设备支持的所有可协同的能力,所述至少两种能力对应的能力角标包括第一能力对应的第一能力角标,第一输入操作作用于第一能力角标。实施本申请实施例,可以显示所有候选设备的所有可协同的能力对应的能力角标,用户可以针对性地选择意图协同的能力,以及意图协同连接的候选设备。这样,使得各候选设备的能力在本设备上能得到针对性的充分应用,发挥各候选设备的特长,提高用户的使用体验。
在一种实现方式中,所述接收用于选择第一能力的第一输入操作之前,还包括:接收作用于第一图标的第九输入操作;响应于第九输入操作,在第一用户界面中显示所述至少两种能力对应的能力角标。实施本申请实施例,通过作用于第一电子设备(即本设备)的图标的第九输入操作,用户即可以看到所有候选设备的可协同的能力对应的能力角标。
在一种实现方式中,所述方法还包括:响应于第一输入操作,在第一图标上附加显示第一能力角标。
在一种实现方式中,所述方法还包括:响应于第一输入操作,在第一用户界面中停止显示不可协同第一能力的候选设备的图标。实施本申请实施例,用户通过第一能力角标选择待协同的能力为第一能力时,停止显示不可协同第一能力的候选设备的图标,以便于用户后续选择协同连接第一能力的候选设备。
在一种实现方式中,第二图标周围显示的能力角标中,第二图标已附加显示的能力角标呈现为选中状态,第二图标未附加显示的能力角标呈现为未选中状态;所述方法还包括:响应于第一输入操作,将第二图标周围显示的第一能力角标由未选中状态切换为选中状态;所述方法还包括:响应于第四输入操作,将第二图标周围显示的第二能力角标由选中状态切换为未选中状态。
在一种实现方式中,所述方法还包括:与第二电子设备建立支持第一能力的协同连接成功时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力对应的第一能力角标;与第二电子设备建立支持第一能力的协同连接失败时,第二图标保持未协同状态。
在一种实现方式中,接收第二输入操作前,第一图标显示在第一预设区域,所述至少一个候选设备的图标显示在第二预设区域;第二图标的未协同状态呈现为以第一状态显示在所述第二预设区域中;第二图标的已协同状态呈现为以第二状态吸附于第一图标,且显示在所述第一预设区域中,或者,第二图标的已协同状态呈现为以第二状态显示在所述第二预设区域中。例如,第一状态和第二状态指不同的图标颜色。
在一种实现方式中,第一电子设备执行“与第二电子设备建立支持第一能力和第二能力的协同连接”的步骤后,当与第二电子设备成功建立支持第一能力和第二能力的协同连接时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力角标和第二能力角标;当与第二电子设备成功建立支持第一能力的协同连接,且该协同连接不支持第二能力时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力角标,未附加显示第二能力角标。
在一种实现方式中,响应于第七输入操作,在第二图标周围显示的能力角标中,与第二电子设备建立的协同连接支持的能力对应的能力角标(即第一能力角标和第二能力角标)呈 现为选中状态,与第二电子设备建立的协同连接不支持的能力对应的能力角标呈现为未选中状态。
在一种实现方式中,与第二电子设备成功建立支持第一能力和第二能力的协同连接后,所述方法还包括:接收作用于第二图标的第十输入操作;响应于所述第十输入操作,取消与第二电子设备的针对任意能力的协同连接。
在一种实现方式中,响应于第三输入操作,在第一区域显示第二电子设备支持的可协同的能力对应的能力角标;所述至少两种可协同的能力还包括第二能力,接收作用于第二图标的第三输入操作时,第二图标附加显示有第二能力对应的第二能力角标;所述接收作用于第二图标的第三输入操作之后,还包括:接收作用于所述第一区域中的第二能力角标的第四输入操作;响应于第四输入操作,停止在第二图标上附加显示第二能力角标。
第二方面,本申请还提供一种设备协同方法,应用于第一电子设备,所述方法包括:显示第一用户界面,第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标;第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力;接收第十一输入操作;响应于第十一输入操作,基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,与第二电子设备建立支持第一能力的协同连接。
实施本申请实施例,第一电子设备可以基于当前的应用场景(即最近前台运行的第一应用程序和/或第二电子设备的协同状态),自适应地选择一种或多种能力进行协同连接,使得各候选设备的能力在第一电子设备上能得到针对性的充分应用,发挥各候选设备的能力优势,提高用户的使用体验。
在一种实现方式中,第二电子设备的协同状态包括以下一项或多项:第一电子设备与第二电子设备协同连接过的各能力的协同连接次数,第一电子设备与第二电子设备最近协同连接的能力,第二电子设备的可协同的各能力的优先级。本申请实施例对第二电子设备的协同状态不做具体限定。
在一种实现方式中,所述基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,对第二电子设备的第一能力建立协同连接,包括:当第二电子设备的可协同的能力包括所述第一应用程序所需的第一能力时,对第二电子设备的第一能力建立协同连接。实施本申请实施例,第一电子设备可以基于最近前台运行的第一应用程序所需能力,自适应地选择待协同的能力,有效提高用户的使用体验。
在一种实现方式中,所述基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,对第二电子设备的第一能力建立协同连接,包括:与第二电子设备协同连接过的各能力中协同连接次数最多的第一能力建立协同连接;或者,与第二电子设备最近协同连接的第一能力进行协同连接;或者,与第二电子设备的可协同的能力中优先级最高的第一能力进行协同连接。实施本申请实施例,第一电子设备可以基于第二电子设备的可协同能力的协同状态,自适应地选择待协同的能力,有效提高用户的使用体验。
第三方面,本申请提供了一种电子设备,包括一个或多个处理器和一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得电子设备执行上述任一方面任一项可能的实现方式中的设备协同方法。
第四方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令 在电子设备上运行时,使得电子设备执行上述任一方面任一项可能的实现方式中的设备协同方法。
第五方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述任一方面任一项可能的实现方式中的设备协同方法。
附图说明
图1A为本申请实施例提供的通信***的***架构示意图;
图1B为本申请实施例提供的协同连接***的示意图;
图2为本申请实施例提供的电子设备的结构示意图;
图3A至图3D为本申请实施例提供的协同连接界面的一种调出方式;
图4A至图4D为本申请实施例提供的协同连接界面的另一种调出方式;
图5A至图5D为本申请实施例提供的协同连接界面的另一种调出方式;
图6A至图6E为本申请实施例提供的情况一的协同连接的相关用户界面;
图7A至图7C为本申请实施例提供的情况一的协同连接的相关用户界面;
图8A至图8G为本申请实施例提供的情况一的切换能力角标的相关用户界面;
图9A至图9C为本申请实施例提供的情况一的协同连接的相关用户界面;
图10A至图10F为本申请实施例提供的情况一的协同连接的相关用户界面;
图11A至图11D为本申请实施例提供的取消协同连接的相关用户界面;
图12A至图12G为本申请实施例提供的情况二的切换能力角标的相关用户界面;
图13A至图13J为本申请实施例提供的情况二的协同连接的相关用户界面;
图14A至图14E为本申请实施例提供的情况二的协同连接的相关用户界面;
图15A至图15D为本申请实施例提供的情况二的取消协同连接的相关用户界面;
图16A至图16D为本申请实施例提供的与多个设备建立协同连接的相关用户界面;
图17A至图17F为本申请实施例提供的情况三的切换能力角标的相关用户界面;
图18A至图18C为本申请实施例提供的情况三的协同连接的相关用户界面;
图19A至图19J为本申请实施例提供的情况三的协同连接的相关用户界面;
图20A至图20D为本申请实施例提供的情况四的切换能力角标的相关用户界面;
图21A至图21D为本申请实施例提供的情况四的协同连接的相关用户界面;
图22A至图22D为本申请实施例提供的情况四的协同连接的相关用户界面;
图23A至图23C为本申请实施例提供的情况四的协同连接的相关用户界面;
图24A至图24F为本申请实施例提供的与多个设备建立协同连接的相关用户界面;
图25A至图25D为本申请实施例提供的情况五的协同连接的相关用户界面;
图26A至图26D为本申请实施例提供的协同连接后的能力应用的相关用户界面;
图27为本申请实施例提供的一种电子设备的软件架构示意图;
图28为本申请实施例提供的另一种电子设备的软件架构示意图;
图29为本申请实施例提供的一种平板电脑的软件架构示意图;
图30为本申请实施例提供的一种笔记本电脑的软件架构示意图;
图31为本申请实施例提供的一种打印机的软件架构示意图;
图32为本申请实施例提供的一种设备协同方法的流程示意图。
具体实施方式
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
首先介绍本申请实施例提供涉及的通信***10。
图1A示例性地示出了本申请实施例中提供的一种通信***10示意图。如图1A所示,该通信***10包括电子设备100,以及可以与电子设备100建立连接一个或多个候选设备(例如候选设备200)。
其中,电子设备100和候选设备200可以是手机、平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,还可以是蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备(智能手环)、车载设备、智能家居设备(智能电视机、智慧屏、大屏设备等)和/或智慧城市设备,本申请实施例对该电子设备的具体类型不作特殊限制。候选设备200还可以是投影仪、音箱、蓝牙耳机、显示器、鼠标、键盘、打印机等设备。电子设备100和候选设备200可以搭载相同的操作***,也可以搭载不同的操作***,例如iOS、Android、Microsoft、鸿蒙等操作***。
本申请实施例中,电子设备100可以与候选设备200的能力1建立协同连接,使得电子设备100可以共享候选设备200的能力1,候选设备200中被共享的能力对应的功能模块可以间接视为电子设备100的功能模块。在一些实施例中,电子设备100的能力2和候选设备200进行能力协同后,候选设备200也可以共享电子设备100的能力2,电子设备100中被共享的能力对应的功能模块也可以间接视为候选设备200的功能模块,以实现电子设备100和候选设备200间的能力互助和资源共享。这样,可以将电子设备100以及上述一个或多个候选设备视为一个分布式协同的超级终端。例如,电子设备100为手机,用户可以通过手机实现与平板电脑、笔记本电脑、投影仪、鼠标、键盘、打印机、音箱、蓝牙耳机等设备的通信连接和能力协同,手机可以间接具备其他设备所具备的能力。
上述能力可以指硬件功能模块(例如摄像头、麦克风、扬声器、显示屏、打印机等),也可以指软件功能模块(例如支付、图像处理、wifi连接、投屏等),还可以是硬件和软件结合的功能模块(例如附带图像处理的相机功能、附带音频处理的音频输出功能、附带音频处理的音频输入功能等),本申请实施例对此不做具体限定。
示例性的,如图1B所示,本申请实施例中,电子设备100的用户界面((User Interface,UI)层可以在协同连接界面中显示本设备的图标,检测到的候选设备(例如平板电脑、笔记本电脑、投影仪、音箱、耳机、打印机等)的图标,还可以显示候选设备支持的可协同的能力(例如摄像头、音频输出功能、投屏功能、音频输入功能、打印功能等)的能力角标。用户可以根据自身需求,在电子设备100显示的候选设备的图标中选择合适的候选设备(例如 候选设备200),并从该候选设备对应的能力角标中选择待协同的能力(例如能力1)的能力角标;然后,通过预设输入操作(例如拖动候选设备200的图标贴近本设备的图标),以实现电子设备100对候选设备200的能力1的协同连接。电子设备100检测到上述预设输入操作后,监听底层业务的连接状态;电子设备100监听到候选设备200的能力1协同连接成功后,在UI层将候选设备200的图标的显示状态切换为已协同状态,且候选设备200的图标附加显示有能力1的能力角标;业务层需要调用能力1时,可以基于用户选择调用候选设备200的能力1。这样,电子设备100可以获取所需的候选设备200的一种或多种指定能力。
需要说明的是,候选设备200可以支持至少一种能力,候选设备200或用户可以设置上述至少一种能力中部分或全部能力为候选设备200的可协同连接的能力(本申请实施例中也可以简称为可协同的能力)。例如,候选设备200支持摄像头、音频输出功能、投屏功能、音频输入功能等能力,候选设备200可以仅将摄像头、音频输出功能设置为候选设备200的可协同的能力,而其他能力是候选设备200的不可协同的能力;相应的,上述电子设备100的UI层中候选设备200的图标仅能附加显示摄像头和/或音频输出功能的能力角标,不能附加显示其他能力的能力角标。
在一些实施例中,电子设备100和候选设备200对候选设备200的能力1进行协同连接指,电子设备100和候选设备200在建立通信连接(即数据连接)时或通信连接后,还建立针对能力1的业务连接,以使电子设备100获取候选设备200的能力1的使用授权。本申请实施例中,用户可以通过本申请实施例提供的协同连接界面,实现电子设备100与候选设备200间针对能力1的协同连接。需要说明的是,若建立协同连接时,电子设备100与候选设备200间已建立通信连接,上述协同连接可以指针对能力1的业务连接;若建立协同连接时,电子设备100与候选设备200间还未建立通信连接,上述协同连接可以指电子设备100与候选设备200间的通信连接以及针对能力1的业务连接。
在一些实施例中,电子设备100对候选设备200的能力1建立协同连接,可以包括:电子设备100与候选设备200建立通信连接后,向候选设备200发送协同连接请求,协同连接请求携带候选设备200的能力1的标识;候选设备200接收上述协同连接请求后,基于能力1的标识确定电子设备100意图协同的能力,候选设备200可以向电子设备100发送用于同意能力1的协同连接的协同连接响应。在一种实现方式中,上述协同连接响应可以包括候选设备200的能力1的能力参数;协同连接成功后,电子设备100可以基于上述能力参数调用候选设备200的能力1。可以理解,本申请实施例中,对(或与)候选设备200的能力1建立协同连接,即指与候选设备200建立支持能力1的协同连接。
需要说明的是,电子设备100本身具备能力1时,也可以通过协同连接获取候选设备200的能力1,并通过候选设备200的能力1处理相关业务。例如,电子设备100具备摄像头,电子设备100也可以通过协同连接获取候选设备200的摄像头的使用权,并通过候选设备200的摄像头采集图像。
本申请的实施例中,电子设备100可以通过近距离无线通信连接或本地有线连接与候选设备200进行直接连接。示例性的,电子设备100和候选设备200可以具有无线保真(wireless fidelity,WiFi)通信模块、超宽带(ultra wide band,UWB)通信模块、蓝牙(bluetooth)通信模块、近场通信(near field communication,NFC)通信模块、ZigBee通信模块中的一项或多项近距离通信模块。以电子设备100为例,电子设备100可以通过近距离通信模块(例如蓝牙通信模块)发射信号来探测、扫描电子设备100附近的电子设备,使得电子设备100可以 通过近距离无线通信协议发现附近的电子设备(例如候选设备200),并与附近的电子设备建立无线通信连接,以及传输数据至附近的电子设备。
在一些实施例中,电子设备100和候选设备200可以基于有线或无线保真(wireless fidelity,WiFi)连接的方式,通过电子设备300连接至局域网(local area network,LAN)。例如,电子设备300可以是路由器、网关、智能设备控制器等第三方设备。在一些实施例中,电子设备100和候选设备200还可以通过广域网(例如互联网)中的至少一个电子设备400进行间接连接。例如,电子设备400可以是硬件服务器,也可以是植入虚拟化环境中的云端服务器。可以理解,通过电子设备300和/或电子设备400,电子设备100可以和候选设备200间接进行无线通信连接以及数据传输。
在一些实施例中,电子设备100和候选设备200为接入同一局域网的电子设备。在一些实施例中,电子设备100和候选设备200为登录同一账号的电子设备;或者,电子设备100和候选设备200为登录不同账号,但上述不同账号(例如账号1和账号2)间处于预设关系的电子设备,例如上述预设关系指账号1和账号2为好友关系、账号1对账号2有协同连接的授权,或者,账号1和账号2在同一家庭群组内。本申请实施例对此均不做具体限定。
可以理解的,本实施例示出的结构并不构成对通信***10的具体限定。在本申请另一些实施例中,通信***10可以包括比图示更多或更少的设备。
图2示出了电子设备100的结构示意图。
电子设备100可以是手机、平板电脑(PAD)、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑(Laptop)、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备,本申请实施例对该电子设备的具体类型不作特殊限制。
电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit, NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了***的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信 号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号解调以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system,GPS),全球导航卫星***(global navigation satellite system,GLONASS),北斗卫星导航***(beidou navigation satellite system,BDS),准天顶卫星***(quasi-zenith satellite system,QZSS)和/或星基增强***(satellite based augmentation systems,SBAS)。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电 信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
内部存储器121可以包括一个或多个随机存取存储器(random access memory,RAM)和一个或多个非易失性存储器(non-volatile memory,NVM)。
随机存取存储器可以包括静态随机存储器(static random-access memory,SRAM)、动态随机存储器(dynamic random access memory,DRAM)、同步动态随机存储器(synchronous dynamic random access memory,SDRAM)、双倍资料率同步动态随机存取存储器(double data rate synchronous dynamic random access memory,DDR SDRAM,例如第五代DDR SDRAM一般称为DDR5SDRAM)等;非易失性存储器可以包括磁盘存储器件、快闪存储器(flash memory)。
快闪存储器按照运作原理划分可以包括NOR FLASH、NAND FLASH、3D NAND FLASH等,按照存储单元电位阶数划分可以包括单阶存储单元(single-level cell,SLC)、多阶存储单元(multi-level cell,MLC)、三阶储存单元(triple-level cell,TLC)、四阶储存单元(quad-level cell,QLC)等,按照存储规范划分可以包括通用闪存存储(英文:universal flash storage,UFS)、嵌入式多媒体存储卡(embedded multi media Card,eMMC)等。
随机存取存储器可以由处理器110直接进行读写,可以用于存储操作***或其他正在运行中的程序的可执行程序(例如机器指令),还可以用于存储用户及应用程序的数据等。
非易失性存储器也可以存储可执行程序和存储用户及应用程序的数据等,可以提前加载到随机存取存储器中,用于处理器110直接进行读写。
外部存储器接口120可以用于连接外部的非易失性存储器,实现扩展电子设备100的存储能力。外部的非易失性存储器通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部的非易失性存储器中。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。麦克风170C可以用于实现采集声音信号,降噪,识别声音来源,定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是其他标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即,x,y和z轴)的角速度。
气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备100可以利用距离传感器180F测距以实现快速对焦。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器180J检测的温度,执行温度处理策略。
触摸传感器180K,也称“触控器件”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。
骨传导传感器180M可以获取振动信号。
按键190包括电源键,音量键等。按键190可以是机械按键。也可以是触摸式按键。
马达191可以产生振动提示。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,消息,通知等。
SIM卡接口195用于连接SIM卡。
下面对本申请实施例提供的设备协同方法的应用场景进行介绍。
首先介绍本申请实施例涉及的几种协同连接的用户界面。
示例性的,图3A至图3D示出了一种调出电子设备100的协同连接界面相关示意图。
图3A示出了电子设备100上的用于展示电子设备100安装的应用程序的主界面11。主界面11可以包括:状态栏101,日历指示符102,天气指示符103,具有常用应用程序图标的托盘104,以及其他应用程序图标105。其中:
状态栏101可以包括:移动通信信号(又可称为蜂窝信号)的一个或多个信号强度指示 符、运营商名称(例如“***”)、无线高保真(wireless fidelity,Wi-Fi)信号的一个或多个信号强度指示符,电池状态指示符、时间指示符。
主界面11还可包括页面指示符106。其他应用程序图标可分布在多个页面,页面指示符106可用于指示用户当前查看的是哪一个页面中的应用程序。用户可以左右滑动其他应用程序图标的区域,来查看其他页面中的应用程序图标。
如图3A所示,电子设备100接收用户作用于状态栏101的滑动操作,响应于上述滑动操作,电子设备100显示图3B所示的控制中心界面12,控制中心界面12包括多个常用功能的快捷图标201(例如图3B所示的WLAN图标、蓝牙图标、NFC图标、亮度调节条等)。
如图3B所示,控制中心界面12还可以包括协同连接的卡片1,卡片1中显示有提示信息202和控件203。提示信息202可以用于提示用户当前没有已协同连接的可用设备,可以通过点击控件203搜索其他设备。
在一些实施例中,控件203可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100显示图3C所示协同连接界面13。协同连接界面13包括电子设备100的图标301,电子设备100检测到的协同连接的候选设备的图标,以及上述候选设备的名称和/或型号。用户界面13中显示的每个候选设备支持至少一种可协同的能力。
示例性的,电子设备100的图标位于协同连接界面13预设区域1(例如图3C所示的圆形区域),上述候选设备的图标可以位于环绕于电子设备100的图标的预设区域2内(例如图3C所示的环形区域)中。本申请实施例对上述预设区域1和预设区域2的形状和位置不做具体限定,后续实施例以预设区域1为图示的圆形区域且预设区域2为图示的环形区域为例进行说明。上述候选设备的图标可以包括型号为AAA的平板电脑的图标302、型号为YYY的笔记本电脑的图标303、型号为ZZZ的音箱的图标304、型号为DDD的投影仪的图标305、型号为EEE的打印机的图标306。
本申请实施例中,显示协同连接界面13之前,响应于针对控件203的输入操作(例如点击这操作)后,电子设备100检测协同连接的候选设备,并获取每个候选设备的相关信息,上述相关信息可以指示该候选设备支持的可协同的能力,设备标识、设备名称、设备型号和设备类型中的部分或全部。电子设备100基于各候选设备的相关信息可以确定该候选设备的图标,并显示在协同连接界面13中。在一种实现方式中,电子设备100可以通过信号探测获取位于同一局域网下的电子设备,并将位于同一局域网下的电子设备作为协同连接的候选设备。在一种实现方式中,电子设备100可以在服务器中查询与电子设备100登录同一账号的电子设备,并将查询到的电子设备作为协同连接的候选设备。而候选设备的相关信息,可以是电子设备100在本次检测到候选设备后向候选设备请求获取的,也可以是电子设备100在之前与候选设备的协同连接中已经获取并存储的。
在一些实施例中,上述协同连接界面13中每个候选设备的图标上附加显示有该候选设备所能协同的至少一种能力对应的能力角标。在一种实现方式中,上述相关信息包括候选设备所能支持的可协同的能力,电子设备100基于候选设备的相关信息还可以确定该候选设备的图标附加显示的能力角标。
示例性的,参见图3D所示的协同连接界面13,平板电脑的图标302附加显示摄像头对应的能力角标,笔记本电脑的图标303附加显示音频输入功能对应的能力角标,音箱的图标304附加显示音频输出功能对应的能力角标,投影仪的图标305附加显示投屏对应的能力角标,打印机的图标306附加显示打印功能对应的能力角标。
在一种实现方式中,电子设备100调出的协同连接界面13的候选设备的图标仅附加显示一种能力角标。若候选设备支持多种可协同的能力,上述能力角标可以是与该候选设备最近进行协同连接的能力对应的能力角标,也可以是与该候选设备最常进行协同连接的能力对应的能力角标,此处不做具体限定。
在一些实施例中,协同连接界面13中候选设备的图标相对于电子设备100的图标缓慢转动。
在一些实施例中,当电子设备100未检测到协同连接的候选设备时,图3C和图3D所示的协同连接界面13的环形区域内显示零个候选设备的图标,电子设备100可以在协同连接界面13中显示提示信息,以提示用户未检测到协同连接的候选设备。
本申请实施例中,同样的通信环境下,通过不同方式调出的协同连接界面13中显示的候选设备可能不同,候选设备的图标附加显示的能力角标也可能不同。
在一些实施例中,电子设备100前台运行应用程序1时,检测到调出协同连接界面13的输入操作;响应上述输入操作,电子设备100确定应用程序1所需的至少一种预设能力,电子设备100检测可协同上述预设能力的候选设备,并将可协同上述预设能力的候选设备的图标显示在协同连接界面13。在一些实施例中,上述协同连接界面13中候选设备的图标均附加显示上述预设能力的能力角标。
示例性的,应用程序1为音乐应用(application,APP),图4A至图4D示出了另一种协同连接界面13的调出方式。
电子设备100显示图4A所示的音乐APP的音乐播放界面14时,接收作用于状态栏的滑动操作;响应于上述滑动操作,电子设备100显示图4B所示的控制中心界面12;检测到针对上述控制中心界面12中的控件203的输入操作;响应于上述输入操作,电子设备100确音乐APP所需的能力包括音频输出功能,电子设备100检测可协同音频输出功能的候选设备,并在图4C或图4D所示的协同连接界面13中显示上述可协同音频输出功能的候选设备的图标。在一些实施例中,参见图4D,候选设备的图标均附加显示音频输出功能的能力角标。例如,电子设备100检测到同一局域网下的设备包括:型号为AAA的平板电脑、型号为YYY的笔记本电脑、型号为ZZZ的音箱、型号为DDD的投影仪、型号为EEE的打印机;其中,平板电脑、笔记本电脑和音箱支持音频输出功能的协同连接,其他设备不支持音频输出功能的协同连接;图4C或图4D所示的协同连接界面13包括平板电脑的图标302、笔记本电脑的图标303和音箱的图标304。
可以理解,图4A至图4D的示例中,上述调出协同连接界面13的输入操作可以包括:调出控制中心界面12的滑动操作,以及作用于上述控制中心界面12中的控件203的点击操作。
在一些实施例中,电子设备100前台运行应用程序1,应用程序1的用户界面1包括控件1,控件1用于调用已协同的可用设备的预设能力。检测到作用于控件1的输入操作(例如点击操作);若当前没有已协同预设能力的可用设备,响应于上述输入操作,电子设备100显示控件2;检测到作用于控件2的输入操作(例如点击操作),电子设备100检测可协同上述预设能力的候选设备,并在协同连接界面13中显示可协同上述预设能力的候选设备的图标。在一些实施例中,上述协同连接界面13中候选设备的图标均附加显示上述预设能力的能力角标。可以理解,上述调出协同连接界面13的输入操作可包括:上述作用于控件1的输入操作,以及上述作用于控件2的输入操作。
示例性的,应用程序1为音乐APP,图5A至图5D示出了另一种协同连接界面13的调出方式。用户界面1为图5A所示的音乐播放界面14,控件1为音乐播放界面14中的切换控件311,切换控件311用于调用已协同的可用设备的音频输出功能,控件2为图5B所示的控件312。
电子设备100显示图5A所示的音乐应用的音乐播放界面14,音乐播放界面14包括切换控件311;电子设备100检测到作用于切换控件311的输入操作;若当前没有已协同音频输出功能的可用设备,响应于上述输入操作,电子设备100显示用于协同连接的卡片2;卡片2包括控件312和提示信息313,提示信息313用于提示当前没有已协同音频输出功能的可用设备,用户可以搜索其他设备。检测到针对上述控件312的输入操作;响应于上述输入操作,电子设备100检测可协同音频输出功能的候选设备,并在图5C或图5D所示的协同连接界面13中显示可协同音频输出功能的候选设备的图标。在一些实施例中,参见图5D,候选设备的图标均附加显示音频输出功能的能力角标。
在一些实施例中,电子设备100前台运行应用程序1;检测到用户作用于应用程序1的输入操作,该输入操作用于执行应用程序1的预设能力;若电子设备100不具备上述预设能力,响应于上述输入操作,电子设备100显示控件2;检测到作用于控件2的输入操作(例如点击操作),电子设备100检测可协同上述预设能力的候选设备,并在协同连接界面13中显示可协同上述预设能力的候选设备的图标。在一些实施例中,上述协同连接界面13中候选设备的图标均附加显示上述预设能力的能力角标。可以理解,上述调出协同连接界面13的输入操作可包括:上述作用于应用程序1的输入操作,以及上述作用于控件2的输入操作。
示例性的,应用程序1为Word APP,上述预设能力为打印功能。若电子设备100检测到调用Word APP的打印功能的输入操作,则电子设备100确定本设备不具备打印功能后可以显示用于协同连接的卡片,并通过该卡片调出协同连接界面13。具体的,参考前述实施例,此处不再赘述。
需要说明的是,图3A至图5D示例性的介绍了几种协同连接界面13的调出方式,不限于以上述调出方式,本申请实施例还可以通过其他方式调出用户界面13,此处不做具体限定。此外,图3A至图5D涉及的协同连接界面13是本申请实施例的示例性说明,不应对本申请构成限定。
下面介绍如何通过协同连接界面实现设备间针对指定能力的协同连接。
本申请实施例提供了实现协同连接的五种情况。
情况一:两电子设备间仅支持一种能力的协同连接;候选设备200支持可协同的至少一种能力,候选设备200的图标可以附加显示上述至少一种能力中的任一种能力(例如能力1)的能力角标。候选设备200的图标附加显示能力1对应的能力角标时,拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备200的图标,可以实现电子设备100对候选设备200的能力1的协同连接。
示例性的,以图6A所示的协同连接界面13为例,图6A至图7C示出了情况1的协同连接的相关用户界面。
如图6A和图6B所示,协同连接界面13中平板电脑的图标302附加显示摄像头对应的能力角标501,平板电脑的图标302可以接收用户的滑动操作,上述滑动操作的滑动方向指向电子设备100的图标301;响应于上述滑动操作,电子设备100将平板电脑的图标302向 电子设备100的图标301移动。如图6B所示,检测到图标302被拖动至图标301的所在区域时,响应于上述滑动操作,电子设备100显示提示信息401,并执行对平板电脑的摄像头的协同连接。提示信息401用于提示本设备与平板电脑的摄像头协同连接中。本申请实施例中,电子设备100可以在检测到图标302接触图标301所在的预设区域1时,即显示提示信息401并执行协同连接,也可以在检测到图标302接触图标301时,才触发显示提示信息401并执行协同连接,此处不做具体限定。
在一些实施例中,上述电子设备100执行对平板电脑的摄像头的协同连接,包括:向平板电脑发送针对摄像头的协同连接请求,协同连接请求可以包括电子设备100的标识和摄像头的标识。
在一些实施例中,如图6C所示,平板电脑接收电子设备100发送的协同连接请求后,显示选择框,选择框包括提示信息402、确认控件403和拒绝控件404。提示信息402用于提示收到电子设备100针对摄像头的协同连接请求。
如图6C所示,确认控件403可以接收用户的输入操作,响应于上述输入操作,平板电脑向电子设备100发送同意协同连接的协同连接响应1。电子设备100接收到平板电脑发送的协同连接响应1后,显示图6D所示的提示信息404,并将平板电脑的图标的显示状态由未协同状态转化为已协同状态,提示信息404用于提示本设备与平板电脑的摄像头已建立协同连接。图6D所示的已协同状态指平板电脑的图标302颜色加深且吸附于本设备的图标301。本申请实施例,对候选设备的图标的未协同状态和已协同状态不做具体限定。
在一些实施例中,候选设备的图标附加显示的能力角标也包括未协同状态和已协同状态。如图6A所示,针对摄像头协同连接成功前,摄像头的能力角标501呈现未协同状态(例如未加深显示);如图6D所示,针对摄像头协同连接成功后,摄像头的能力角标501呈现已协同状态(例如加深显示)。本申请实施例,对能力角标的未协同状态和已协同状态也不做具体限定。
在一些实施例中,参考图6E所示的控制中心界面12,针对平板电脑的摄像头建立协同连接后,电子设备100在协同连接的卡片1中显示已协同的可用设备的图标(例如平板电脑的图标412),还可以显示未协同的候选设备的图标(例如笔记本电脑的图标413、音箱的图标414和投影仪的图标415)。其中,可用设备的图标412附加已协同的能力(即摄像头)对应的能力角标。本申请实施例可以通过图标412的显示状态(例如加深显示)和/或提示信息416(例如文字“已协同”)来指示该图标对应的电子设备为已协同的可用设备;通过图标412附加的能力角标指示平板电脑的已协同的能力。此外,图6E所示的卡片1还可以包括控件411,用户通过控件411可以调出图6D所示的协同连接界面13。
如图7A所示,拒绝控件404可以接收用户的输入操作,响应于上述输入操作,平板电脑向电子设备100发送拒绝协同连接的协同连接响应2。基于协同连接响应2,确协同连接失败后,电子设备100显示图7B所示的提示信息405,并将平板电脑的图标301弹回候选设备所在的预设区域2(即环形区域)。上述提示信息405用于提示本设备与平板电脑的摄像头协同连接失败。在一些实施例中,参考图7C所示的控制中心界面12,与平板电脑协同连接失败后,电子设备100在协同连接的卡片1中显示检测到的候选设备的图标,以便于用户获知当前可进行协同连接的候选设备有哪些。
需要说明的是,本申请实施例中,不限于用户拒绝协同连接的输入操作导致的协同连接失败,还可以是其他原因导致协同连接失败,此处对上述其他原因不做具体限定。在一种实 现方式中,电子设备100在发送协同连接请求后的预设时长内未接收到协同连接响应1时,电子设备100确定协同连接失败,显示图7B所示的协同连接界面13。
在一些实施例中,协同连接界面13接收用户拖动图标的滑动操作前,候选设备的图标(例如图标302)均围绕本设备的图标301缓慢转动;协同连接界面13接收用户拖动图标的滑动操作时,候选设备的图标停止缓慢转动;电子设备100执行协同连接的过程中,电子设备100还可以播放连接中动画;确定协同连接成功或协同连接失败后,电子设备100可以终止上述连接中动画,且各候选设备的图标恢复转动。
在一些实施例中,平板电脑接收电子设备100的协同连接请求后,可以基于预设方式自行决定是否同意电子设备100的协同连接请求,无需显示图6C所示的选择框。本申请实施例对于上述预设方式不做具体限定。在一种实现方式中,电子设备100向平板电脑发送协同连接请求前,还显示验证信息输入框,验证信息输入框用于输入平板电脑的协同连接的验证信息(例如密码),上述协同连接请求可以携带用户在验证信息输入框中输入的验证信息;平板电脑确定上述验证信息正确时,同意电子设备100的协同连接请求,否则拒绝电子设备100的协同连接请求。在一种实现方式中,平板电脑确定与电子设备100登录同一账号时,同意电子设备100的协同连接请求,否则拒绝电子设备100的协同连接请求。在一种实现方式中,平板电脑确定与电子设备100位于同一局域网时,同意电子设备100的协同连接请求,否则拒绝电子设备100的协同连接请求。
本申请实施例中,用户可以切换候选设备的图标附加显示的能力角标,进而基于切换后的能力角标建立协同连接。
示例性的,图8A至图8D示出了一种切换平板电脑的图标302附加显示的能力角标的用户界面。
如图8A和图8B所示,协同连接界面13中的候选设备的图标(例如平板电脑的图标302)附加显示了摄像头对应的能力角标501,图标302可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100在图标302的周围显示,平板电脑支持的摄像头之外的可协同能力对应的能力角标,例如音频输入功能对应的能力角标502和音频输出功能对应的能力角标503。可以理解,若平板电脑仅支持的可协同的能力仅包括摄像头,则用户点击图标302,图标302的周围不能显示其他能力角标。
如图8B和图8C所示,能力角标502可以接收用户的输入操作(例如点击操作),响应于上述操作,平板电脑的图标302附加显示的能力角标501被切换为能力角标502,摄像头对应的能力角标501显示在图标302的周围。如图8C和图8D所示,平板电脑的图标302可以接收用户的输入操作(例如触摸操作)后,电子设备100在图标302的周围停止显示能力角标。在一些实施例中,图8B中的能力角标502接收用户的输入操作后,电子设备100也可以直接显示图8D所示的协同连接界面13。可以理解,图8D所示的平板电脑的图标302附加显示音频输入功能的能力角标502,用户拖动图标302至本设备的图标301,可以实现对平板电脑的音频输入功能的协同连接。如图8B和图8C所示,针对同一能力角标(例如能力角标501),图标302周围显示的能力角标501和图标302上附加显示的能力角标501的大小可以不同。
示例性的,图8E至图8G示出了另一种切换平板电脑的图标302附加显示的能力角标的用户界面。
响应于针对图8A所示的平板电脑的图标302的输入操作(例如点击操作),电子设备100 显示图8E所示的协同连接界面13,即在图标302的周围显示平板电脑支持的所有可协同的能力对应的能力角标,通过选中状态指示当前被图标302附加显示的能力角标。如图8E所示,图标302当前附加显示的能力角标501表现为选中状态(例如加深显示),图标302当前未附加显示的能力角标502表现为未选中状态(例如未加深显示)。
如图8E和图8F所示,能力角标502可以接收用户的输入操作(例如点击操作),响应于上述操作,能力角标501由选中状态切换为未选中状态,能力角标502由未选中状态切换为选中状态,即平板电脑的图标302附加显示的能力角标501被切换为能力角标502。如图8F和图8G所示,平板电脑的图标302可以接收用户的输入操作(例如触摸作)后,电子设备100停止在图标302的周围显示能力角标。在一些实施例中,图8E中的能力角标502接收用户的输入操作后,电子设备100也可以直接显示图8G所示的协同连接界面13。
本申请实施例中,用户也可以通过拖动图标302周围的能力角标至电子设备100的图标301的所在区域,来实现该能力角标对应的能力的协同连接。
示例性的,以图9A所示的协同连接界面13为例,如图9A和图9B所示,用户通过滑动操作将音频输入功能的能力角标502拖动至图标301所在区域(即前述预设区域1,或图标301的显示区域)后松手;如图9C所示,响应于针对能力角标502的滑动操作,电子设备100沿滑动操作的滑动方向移动能力角标502;如图9C所示,检测到能力角标502拖动至图标301的所在区域且用户手指离开屏幕时,电子设备100在预设区域1(即前述圆形区域)显示附加显示能力角标502的平板电脑的图标302,以及提示信息406。提示信息406用于提示本设备与平板电脑的音频输入功能协同连接中。具体的,后续可参考图6B至图7C描述的协同连接的相关内容,此处不再赘述。
此外,针对图3A至图5D所示的未附加显示能力角标的协同连接界面13,用户也可以为候选设备的图标选择附加显示的能力角标,具体的,可以参考图8A至图8F相关描述;候选设备的图标附加显示的能力角标后,如何实现协同连接,可以参考图6A至图7C以及图9A至图9C的相关描述,此处均不再赘述。
在一些实施例中,也可以通过将本设备的图标301拖动至候选设备200的图标的所在区域,来实现候选设备200附加显示的能力角标对应的能力的协同连接。
示例性的,以图10A所示的协同连接界面13为例,图10A至图10F示出了该实施例中协同连接的相关用户界面。
如图10A和图10B所示,协同连接界面13中平板电脑的图标302附加显示摄像头对应的能力角标501,本设备的图标301可以接收用户的滑动操作,上述滑动操作的滑动方向指向平板电脑的图标302;响应于上述滑动操作,电子设备100将图标301向图标302移动。如图10C所示,检测到图标301接触图标302时,响应于上述滑动操作,电子设备100显示提示信息401,并执行对平板电脑的摄像头的协同连接。
如图10D所示,当确定协同连接成功时,电子设备100显示提示信息404,并将平板电脑的图标的显示状态由未协同状态转化为已协同状态。当确定协同连接失败时,电子设备100显示图10E所示的提示信息405,并将平板电脑的图标302弹回候选设备所在的环形区域。
图10D所示的已协同状态指平板电脑的图标302颜色加深且吸附于本设备的图标301。本申请实施例,对图标的未协同状态和已协同状态不做具体限定。示例性的,当确定协同连接成功时,电子设备100显示图10F所示的协同连接界面,图10F示出了另一种图标302的已协同状态,即图标302颜色加深,且弹回候选设备所在的预设区域2(即图示的环形区域); 环形区域内其他候选设备的未协同状态表现为颜色未加深。
本申请实施例中,电子设备100针对候选设备200的能力1建立协同连接后,用户可以取消与候选设备200的能力1的协同连接。
下面以平板电脑的摄像头为例进行说明。在一些实施例中,参见图10D和图10F,平板电脑的已协同状态的图标302附加显示摄像头的能力角标;平板电脑的已协同状态的图标302可以接收用户的取消操作1;响应于上述取消操作1,电子设备100可以取消与平板电脑的摄像头的协同连接,并将图标302的显示状态切换为未协同状态。本申请实施例中对上述取消操作1不做具体限定,不同已协同状态对应的取消操作1可能不同。
示例性的,图11A所示的已协同状态的图标302吸附于本设备的图标301,上述取消操作1可以包括通过作用于图标302的滑动操作将图标302拖离本设备的图标301后松手。如图11B和图11C所示,检测到上述取消操作1时,电子设备100显示提示取消协同连接的提示信息,并取消与平板电脑的摄像头的协同连接。如图11D所示,取消协同连接后,将图标302的显示状态由已协同状态切换为未协同状态,图标302被弹回环形区域。在一种实现方式中,检测到用户实施上述取消操作1时,电子设备100也可以直接显示图11D所示的协同连接界面,无需显示上述提示信息。
示例性的,参考图10F所示的已协同状态的图标302,图标302显示在环形区域中,上述取消操作可以包括长按图标302。上述取消操作还可以包括双击等手势,本发明不做具体限制。
在一些实施例中,协同连接界面13接收用户取消协同连接的输入操作(例如上述取消操作1)时,候选设备的图标停止缓慢转动;电子设备100取消协同连接的过程中,电子设备100还可以播放取消连接动画;确定已取消协同连接时,电子设备100可以终止上述取消连接动画,且各候选设备的图标恢复转动。
情况二:电子设备100与候选设备200间支持多种能力的协同连接;候选设备200支持可协同的至少一种能力,候选设备200的图标附加显示上述至少一种能力中的一种或多种能力(例如能力1和能力2)的能力角标。候选设备200的图标附加显示能力1和能力2对应的能力角标时,拖动候选设备200的图标贴近电子设备100的图标或者拖动候选设备200的图标贴近电子设备100的图标,可以实现电子设备100对候选设备200的能力1和能力2的协同连接。
情况二下针对一种能力的协同连接可以参考前述图6A至图7C以及图9A至图10F的相关描述,此处不再赘述。
示例性的,以图12A所示的协同连接界面13为例,图12A至图12G示出了添加多个能力角标的用户界面。
在一些实施例中,用户可以在平板电脑的图标302上添加多个能力对应的能力角标。如图12A和图12B所示,协同连接界面13中平板电脑的图标302上当前附加显示音频输出功能对应的能力角标502,图标302可以接收用户的输入操作(例如点击操作);响应于上述输入操作,电子设备100在图标302周围显示平板电脑支持的所有可协同的能力对应的能力角标,例如,摄像头对应的能力角标501、音频输入功能对应的能力角标502和音频输出功能对应的能力角标503。如图12B所示,图标302当前附加显示的能力角标502表现为选中状态(例如加深显示),图标302当前未附加显示的能力角标501表现为未选中状态(例如未加 深显示)。
用户可以切换能力角标的显示状态为选中状态或未选中状态。如图12B和图12C所示,用户可以切换能力角标501的显示状态为选中状态,将能力角标501添加为图标302附加显示的能力角标。类似的,如图12C和图12D所示,用户还可以切换能力角标503的显示状态为选中状态,将能力角标503添加为图标302附加显示的能力角标。如图12D和图12E所示,选中状态的能力角标502可以接收用户的输入操作(例如点击操作);响应于上述输入操作,将能力角标502的显示状态切换为未选中状态,并停止在图标302上附加显示能力角标502。
在一些实施例中,如图12E和图12F所示,用户选择附加显示的能力角标(即能力角标501和能力角标503)后,图标302可以接收用户的输入操作(例如触摸操作),响应于该输入操作,电子设备100停止在图标302的周围显示能力角标。
在一些实施例中,图12B至图12E的能力角标选择过程中,用户选中一个能力角标(即切换该能力角标的显示状态为选中状态)时,图标302可以不附加显示该能力角标。用户选择完毕后,电子设备100在图12F中才开始在图标302上附加显示能力角标。示例性的,如图12G所示,用户选中图标302周围显示的能力角标501和能力角标503时,图标302上无需附加显示以上两个能力角标。
示例性的,图13A至图13J示出了情况二的实现协同连接的相关用户界面。
如图13A所示,附加能力角标501和能力角标503的图标302可以接收用户的滑动操作,上述滑动操作的滑动方向指向电子设备100的图标301;检测到图标302接触图标301的所在区域时,响应于用户的滑动操作,电子设备100显示提示信息601,并执行对平板电脑的摄像头和音频输出功能的协同连接。提示信息601用于提示本设备与平板电脑的摄像头、音频输出功能协同连接中。
在一些实施例中,电子设备100执行对平板电脑的摄像头和音频输出功能的协同连接,可以包括:电子设备100向平板电脑发送针对摄像头和音频输出功能的协同连接请求。
在一些实施例中,如图13B所示,平板电脑接收电子设备100发送的协同连接请求后,显示选择框,选择框包括提示信息602、摄像头的选择控件603、音频输出功能的选择控件604、确认控件605和拒绝控件606。提示信息602用于提示收到电子设备100针对摄像头和音频输出功能的协同连接请求。
如图13C所示,摄像头的选择控件603和音频输出功能的选择控件604接收用户的选择操作(例如点击操作)后,确认控件605可以接收用户的输入操作,响应于上述输入操作,平板电脑向电子设备100发送协同连接响应3,协同连接响应3用于指示同意摄像头和音频输出功能的协同连接。电子设备100接收到平板电脑发送的协同连接响应3后,显示图13D所示的提示信息607,并将平板电脑的图标的显示状态由未协同状态转化为已协同状态。已协同状态的图标412附加显示的能力角标指以及提示信息607,均用于提示本设备与平板电脑的摄像头已建立协同连接,与平板电脑的音频输出功能已建立协同连接。
在一些实施例中,参考图13E所示的控制中心界面12,针对平板电脑的摄像头和音频输出功能建立协同连接后,电子设备100在协同连接的卡片1中显示已协同的可用设备的图标(例如平板电脑的图标412),且平板电脑的图标412附加显示摄像头和音频输出功能对应的能力角标;通过图标412附加显示的能力角标指示与平板电脑的摄像头、音频输出功能已建立协同连接。
在一些实施例中,如图13F所示,摄像头的选择控件603接收用户的选择操作(例如点 击操作)后,确认控件605可以接收用户的输入操作,响应于上述输入操作,平板电脑向电子设备100发送协同连接响应4,协同连接响应4用于指示同意摄像头的协同连接以及拒绝音频输出功能的协同连接。电子设备100接收协同连接响应4后,显示图13G所示的提示信息608,将平板电脑的图标302的显示状态由未协同状态转化为已协同状态,停止在图标302上附加显示音频输出功能的能力角标。提示信息607用于提示本设备与平板电脑的摄像头已建立协同连接,以及与平板电脑的音频输出功能协同连接失败。
相比于图13E所示的协同连接的卡片1,摄像头协同连接成功,音频输出功能协同连接失败后,图13H所示的协同连接的卡片1中,已协同的平板电脑的图标412仅附加显示摄像头对应的能力角标。
如图13I所示,拒绝控件404可以接收用户的输入操作,响应于上述输入操作,平板电脑向电子设备100发送拒绝协同连接的协同连接响应5。电子设备100接收到平板电脑发送的协同连接响应5后,显示图13J所示的提示信息609,并将平板电脑的图标301弹回候选设备所在的环形区域。上述提示信息609用于提示本设备与平板电脑的摄像头、音频输出功能均协同连接失败。
在一些实施例中,当电子设备100与候选设备200(例如平板电脑)的至少一个能力建立协同连接后,用户还可以选择该候选设备的其他能力进行协同连接。
示例性的,图14A至图14E示出了已协同的平板电脑继续进行协同连接的相关用户界面。
如图14A所示,电子设备100当前已与平板电脑的音频输入功能建立协同连接,已协同状态的平板电脑的图标302附加显示了音频输入功能对应的能力角标502。如图14A和图14B所示,图标302可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100在图标302的周围显示,平板电脑支持的可协同的能力对应的能力角标,例如音频输出功能对应的能力角标502和摄像头对应的能力角标501。
如图14B和图14C所示,以能力角标501为例,能力角标501可以接收用户的输入操作(例如点击操作);响应于上述输入操作,电子设备100停止在图标302的周围显示能力角标,显示提示正在协同连接的提示信息610,并执行对平板电脑的摄像头的协同连接。在一些实施例中,如图14C所示,响应于上述输入操作,电子设备100还在图标302上附加显示摄像头的能力角标501。
如图14D所示,电子设备100确定协同连接成功后,显示提示协同连接成功的提示信息611。在一些实施例中,如图14C所示,针对摄像头协同连接成功前,图标302附加显示的摄像头的能力角标501呈现未协同状态(例如未加深显示);如图14D所示,确定摄像头协同连接成功后,电子设备100还将摄像头的能力角标501切换为已协同状态(例如加深显示)。
如图14E所示,电子设备100确定摄像头的协同连接失败后,显示提示协同连接失败的提示信息612,并在已协同状态的图标302上述停止附加显示摄像头的能力角标501。
在一些实施例中,环形区域中候选设备200的图标(例如平板电脑的图标302)附加显示多个能力角标时,也可以通过将本设备的图标301拖动至候选设备200的图标的所在区域,来实现上述多个能力角标对应的能力的协同连接。具体的,可以参考图10A至图10F的相关描述,此处不再赘述。
本申请实施例中,电子设备100与候选设备200的多种能力(例如能力1和能力2)建立协同连接后,用户可以取消与候选设备200的上述多种能力或上述多种能力中的一种能力 的协同连接。下面以平板电脑为例进行说明。
在一些实施例中,参见图14D,平板电脑的已协同状态的图标302附加显示摄像头和音频输出功能的能力角标。平板电脑的已协同状态的图标302可以接收用户的取消操作1;响应于上述取消操作1,电子设备100可以取消平板电脑的所有已协同能力(即摄像头和音频输出功能)的协同连接,并将图标302的显示状态切换为未协同状态。取消操作1可以参考情况一中的相关描述,此处不再赘述。
在一些实施例中,平板电脑的已协同状态的图标302附加多个能力角标,用户可以单独取消多种已协同能力中某一种能力的协同连接。示例性的,以图15A所示的已协同状态为例,图15A至图15D示出了单独取消平板电脑的摄像头的协同连接的相关用户界面。
如图15A所示,平板电脑的已协同状态的图标302还可以接收用户的输入操作(例如点击操作);如图15B所示,响应于上述输入操作,显示平板电脑的所有可协同的能力对应的能力角标,上述所有可协同的能力对应的能力角标包括已协同的能力对应的能力角标(例如摄像头的能力角标501和音频输入功能的能力角标502)和未协同的能力对应的能力角标(例如音频输出功能的能力角标503),已协同的能力对应的能力角标(例如能力角标501)呈现为选中状态,未协同的能力对应的能力角标(例如能力角标503)呈现为未选中状态。如图15C所示,能力角标501可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100可以取消对平板电脑的摄像头的协同连接,并显示提示取消协同连接中的提示信息;如图15D所示,取消对平板电脑的摄像头的协同连接后,已协同状态的平板电脑的图标停止附加显示摄像头的能力角标501。
本申请实施例中,前述情况一和情况二中,电子设备100可以支持同时与多个设备建立协同连接。
示例性的,图16A至图16D示出了电子设备100与两个设备建立协同连接的相关用户界面。
在一些实施例中,电子设备100可以同时与多个候选设备的同一种能力建立协同连接。
如图16A和图16B所示,电子设备100与平板电脑的音频输出功能和摄像头已建立协同连接;笔记本电脑的图标303附加显示摄像头对应的能力角标501,用户通过滑动操作,可以拖动图标303至电子设备100的图标301的所在区域;检测到图标302被拖动至图标301的所在区域时,响应于上述滑动操作,电子设备100显示提示正在协同连接的提示信息616,并执行对笔记本电脑的摄像头的协同连接。
如图16C所示,当确定对笔记本电脑的摄像头的协同连接成功时,显示提示协同连接成功的提示信息617,并将笔记本电脑的图标303的显示状态由未协同状态转化为已协同状态;如图16D所示,当确定对笔记本电脑的摄像头的协同连接失败时,显示提示协同连接失败的提示信息618,并将笔记本电脑的图标303弹回候选设备所在的环形区域。
具体的,可以参考图6A至图7C的相关描述,此处不再赘述。
在一些实施例中,针对同一种能力,电子设备100最多与一个设备建立协同连接。图16D协同连接失败的原因可以是无法同时协同连接多个设备的摄像头,电子设备100可以在图16D中通过提示信息618提示无法同时协同连接多个设备的摄像头。
情况三:电子设备100与候选设备200间最多支持一种能力的协同连接;候选设备200支持可协同的至少一种能力,电子设备100的图标可以附加显示上述至少一种能力中的任一 种能力(例如能力1)的能力角标。在一些实施例中,电子设备100的图标上附加显示能力1对应的能力角标时,拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备200的图标,可以实现电子设备100对候选设备200的能力1的协同连接。
示例性的,以图17A所示的协同连接界面13为例,图17A至图17B示出了为电子设备100的图标301附加一种能力角标的相关用户界面。
如图17A和图17B所示,电子设备100的图标301可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100在图标301的周围显示至少一个能力角标。在一种实现方式中,上述至少一个能力角标包括协同连接界面13中显示的所有候选设备支持的可协同的能力。如图17B所示,上述至少一个能力角标包括摄像头的能力角标501、音频输出功能的能力角标503、音频输入功能的能力角标502、投屏的能力角标504和打印功能的能力角标505。
在一些实施例中,如图17B所示,音频输出功能对应的能力角标503可以接收用户的输入操作(例如点击操作);如图17C所示,响应于上述输入操作,电子设备100切换能力角标503的显示状态为选中状态,并在图标301上附加显示能力角标503。图17C所示的图标301可以接收用户的输入操作;如图17D所示,响应于上述输入操作,电子设备100停止在图标301周围显示能力角标。在一种实现方式中,响应于针对图17B所示的能力角标503的输入操作,电子设备100可以直接显示图17D所示的协同连接界面13。
在一些实施例中,用户点击图17B所示的能力角标503后,电子设备100可以在环形区域仅显示可协同该能力角标对应的能力的候选设备图标。示例性的,打印机和投影仪不支持可协同的音频输出功能;如图17E所示,不同于图17C所示的协同连接界面13,响应于针对能力角标503的输入操作,电子设备100停止在环形区域显示打印机的图标306和投影仪的图标305。如图17E和图17F所示,图标301可以接收用户的输入操作,响应于上述输入操作,电子设备100停止在图标301周围显示能力角标。在一种实现方式中,响应于针对图17B所示的能力角标503的输入操作,电子设备100也可以直接显示图17F所示的协同连接界面13。
情况三中如何切换电子设备100附加显示的能力角标,可以参考图8A至图8G中切换能力角标的实现方式,此处不再赘述。
示例性的,以图18A所示的协同连接界面13为例,图18A至图18C示出了情况三中一种能力的协同连接的相关用户界面。
如图18A所示,用户为本设备的图标301添加能力角标503后,用户可以通过滑动操作将图标302拖动至图标301的所在区域;检测到图标302接触图标301或图标301所在的预设区域1时,响应于上述滑动操作,电子设备100显示提示正在协同连接中的提示信息701,并执行与平板电脑的音频输出功能的协同连接。
如图18B所示,当确定音频输出功能协同连接成功时,电子设备100显示提示协同连接成功的提示信息702,将图标302由未协同状态切换为协同状态,并在图标302上附加显示音频输出功能的能力角标503。在一种实现方式中,如图18B所示,协同连接成功后,电子设备100停止在本设备的图标301上附加显示能力角标503;并在候选设备的环形区域显示检测到的所有未协同的候选设备。
如图18C所示,当确定音频输出功能协同连接失败时,电子设备100显示提示协同连接 失败的提示信息703,并将图标302弹回候选设备所在的环形区域。
此外,情况三中如何取消已协同能力的协同连接,可以参考情况一中的相关描述,此处不再赘述。需要说明的是,以平板电脑的摄像头为例,若情况三中取消对平板电脑的摄像头的协同连接,则取消协同连接后,平板电脑的图标302不再附加显示摄像头的能力角标。
在一些实施例中,也可以通过将本设备的图标301拖动至平板电脑的图标302的所在区域,来实现图标302附加显示的能力角标对应的能力的协同连接。
示例性的,以图19A所示的协同连接界面13为例,图19A至图19E示出了该实施例中协同连接的相关用户界面。
如图19A和图19B所示,用户可以通过滑动操作将本设备的图标301拖动至平板电脑的图标302;检测到图标301接触图标302时,响应于上述滑动操作,电子设备100显示提示正在协同连接的提示信息701,并执行与平板电脑的音频输出功能的协同连接。
如图19C所示,当确定音频输出功能协同连接成功时,电子设备100显示提示协同连接成功的提示信息702,将平板电脑的图标302由未协同状态切换为协同状态,在图标302上附加显示音频输出功能的能力角标503,并将本设备的图标301弹回圆形区域。图19D示出了本申请实施例提供的另一种图标302的已协同状态,如图19D所示,已协同状态的图标302加深显示,并随本设备的图标301一起弹回圆形区域。在一种实现方式中,如图19C和图19D所示,图标301弹回圆形区域后,停止附加显示能力角标。
如图19E所示,当确定音频输出功能协同连接失败时,电子设备100显示提示协同连接失败的提示信息703,并将本设备的图标301弹回圆形区域,图标301可以继续附加显示音频输出功能的能力角标503。
类似于图9A至图9C,情况三中,用户也可以通过拖动本设备的图标301周围显示的能力角标(例如能力角标503)至平板电脑的图标302,以实现对能力角标503对应的音频输出功能的协同连接。
示例性的,如图19F和图19G所示,用户可以通过滑动操作将能力角标503拖动至平板电脑的图标302;如图19H所示,检测到能力角标503接触图标302且用户松手时,响应于上述滑动操作,电子设备100显示图19H所示的提示信息701,并执行与平板电脑的音频输出功能的协同连接。
如图19I所示,当确定音频输出功能协同连接成功时,电子设备100显示提示协同连接成功的提示信息702,将平板电脑的图标302由未协同状态切换为已协同状态,在图标302上附加显示音频输出功能的能力角标503。
如图19J所示,当确定音频输出功能协同连接失败时,电子设备100显示提示协同连接失败的提示信息703,图标301可以附加显示音频输出功能的能力角标503。
情况四:电子设备100与候选设备200间支持多种能力的协同连接;候选设备200支持可协同的至少一种能力,电子设备100的图标可以附加显示上述至少一种能力中的一种或多种能力(例如能力1和能力2)的能力角标。
在一些实施例中,电子设备100的图标附加能力1和能力2对应的能力角标时,拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备200的图标,可以实现电子设备100对候选设备200的能力1和能力2的协同连接。
情况四下针对一种能力的协同连接可以参考前述图18A至图19J的相关描述,此处不再 赘述。
示例性的,以图20A所示的协同连接界面13为例,图20A至图20D示出了为电子设备100的图标302附加显示两种能力角标的相关用户界面。
如图20A和图20B所示,电子设备100的图标301附加显示了音频输出功能的能力角标503;图标301可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100在图标301的周围显示至少一个能力角标。在一种实现方式中,上述至少一个能力角标包括协同连接界面13中当前显示的候选设备支持的可协同的能力。相比图17B,图20B中的候选设备不支持打印功能,上述至少一个能力角标不包括打印功能的能力角标505。
在一些实施例中,如图20B所示,摄像头对应的能力角标501可以接收用户的输入操作(例如点击操作);如图20C所示,响应于上述输入操作,电子设备100将能力角标501添加为本设备的图标301附加显示的能力角标。在一种实现方式中,响应于上述输入操作,电子设备100还停止显示不支持能力角标501对应的摄像头的候选设备的图标(例如音箱的图标304),和/或将周围显示的能力角标501由未选中状态切换为选中状态。图20C所示的图标301可以接收用户的输入操作(例如点击操作);如图20D所示,响应于上述输入操作,电子设备100停止在图标301周围显示上述至少一个能力角标。在一种实现方式中,响应于针对图20B所示的能力角标503的输入操作,电子设备100可以直接显示图20D所示的协同连接界面13。
情况四中如何切换电子设备100附加的能力角标,还可以参考图12A至图12F中切换平板电脑的图标302附加的能力角标的实现方式,此处不再赘述。
示例性的,以图21A所示的协同连接界面13为例,图21A至图21D示出了情况四中两种能力的协同连接的相关用户界面。
如图21A所示,用户为本设备的图标301添加能力角标503和能力角标501后,用户可以通过滑动操作将图标302拖动至图标301的所在区域;检测到图标302接触图标301或图标301所在的预设区域1时,电子设备100显示提示正在协同连接中的提示信息711,并执行与平板电脑的音频输出功能、摄像头的协同连接。
如图21B所示,当确定音频输出功能和摄像头均协同连接成功时,电子设备100显示提示协同连接成功的提示信息712,将图标302由未协同状态切换为协同状态,并在图标302上附加显示摄像头的能力角标501和音频输出功能的能力角标503。在一种实现方式中,协同连接成功后,本设备的图标301停止附加显示音频输出功能的图标503和摄像头的图标501,并在环形区域显示检测到的所有未协同的候选设备。如图21B所示,电子设备100在环形区域再次显示音箱的图标304、投影仪的图标305、打印机的图标306。
如图21C所示,当确定摄像头协同连接成功,以及音频输出功能协同连接失败时,电子设备100显示提示信息713,将图标302由未协同状态切换为协同状态,并在图标302上附加显示摄像头的能力角标501。提示信息713用于提示与平板电脑的摄像头协同连接成功,与平板电脑的音频输出功能协同连接失败。在一种实现方式中,摄像头协同连接成功,音频输出功能协同连接失败后,本设备的图标301停止附加显示摄像头的图标501,并在环形区域显示检测到的支持音频输出功能的未协同的候选设备。如图21C所示,电子设备100在环形区域再次显示音箱的图标304。
如图21D所示,当确定音频输出功能和摄像头均协同连接失败时,电子设备100显示提示协同连接失败的提示信息714,并将图标302弹回候选设备所在的环形区域。
类似于图15A至图15D,情况四中,本设备的图标301附加显示多个能力角标时,也可以通过将本设备的图标301拖动至候选设备200的图标的所在区域,来实现上述多个能力角标对应的能力的协同连接。具体的,可以参考图19A至图19E的相关描述,此处不再赘述。
在一些实施例中,当电子设备100与候选设备200(例如平板电脑)的至少一个能力建立协同连接后,用户还可以选择该候选设备的其他能力进行协同连接。
示例性的,图22A至图23C示出了已协同的平板电脑继续进行协同连接的相关用户界面。
如图22A所示,电子设备100当前已与平板电脑的音频输出功能建立协同连接。如图22B、图22C和图22D所示,以能力角标501为例,用户可以选择能力角标501,将能力角标501添加为图标301附加显示的能力角标。具体的,可以参考图20B至图20D的相关描述,此处不再赘述。
如图22D和图23A所示,用户为本设备的图标301添加能力角标501后,用户可以通过滑动操作将本设备的图标301拖动至图标302的所在区域;检测到图标301接触图标302时,电子设备100显示提示协同连接中的提示信息721,并执行与平板电脑的摄像头的协同连接。
如图23B所示,确定协同连接成功时,电子设备100显示提示协同连接成功的提示信息722,在已协同状态的图标302上附加显示摄像头的能力角标501,将本设备的图标301弹回圆形区域1中。
如图23C所示,电子设备100确定摄像头的协同连接失败后,显示提示协同连接失败的提示信息723,将本设备的图标301弹回圆形区域中。
具体的,还可以参考图19A至图19E的相关描述,此处不再赘述。
此外,情况四中如何取消已协同能力的协同连接,可以参考情况二中的相关描述,此处不再赘述。需要说明的是,以平板电脑的摄像头为例,若情况四中取消对平板电脑的摄像头的协同连接,则取消协同连接后,平板电脑的图标302不再附加显示摄像头的能力角标。
本申请实施例中,前述情况三和情况四中,针对同一种能力,电子设备100可以同时与多个设备建立协同连接,或者,最多与一个设备建立协同连接,此处不做具体限定。
示例性的,图24A至图24E示出了电子设备100与两个设备建立协同连接的相关用户界面。
如图24A、图24B和图24C所示,电子设备100与平板电脑的音频输出功能和摄像头已建立协同连接;用户可以为本设备的图标301附加候选设备的可协同能力对应的至少一个能力角标(例如音频输出功能对应的能力角标503)。如图24C和图24D所示,用户通过滑动操作,可以拖动本设备的图标301至笔记本电脑的图标303所在区域;响应于上述滑动操作,电子设备100执行对笔记本电脑的音频输出功能的协同连接。如图24E所示,确定对笔记本电脑的摄像头的协同连接成功时,将笔记本电脑的图标303的显示状态由未协同状态转化为已协同状态,在图标303上附加显示音频输出功能的能力角标503,并将图标301弹回圆形区域。如图24F所示,确定对笔记本电脑的摄像头的协同连接失败时,将图标301弹回圆形区域。
具体的,可以参考图17A至图18C的相关描述,此处不再赘述。
情况五:用户没有为候选设备200或电子设备100选择附加的能力角标,电子设备100可以基于当前的应用场景自动选择进行协同连接的能力。
上述情况一和情况三中,电子设备100与候选设备200间仅支持一种可协同的能力,若 用户没有为候选设备200或电子设备100选择附加显示的能力角标,拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备的图标,电子设备100可以基于当前的应用场景从候选设备200的支持的可协同的能力中自动选择一种能力进行协同连接。
上述情况二和情况四中,电子设备100与候选设备200间支持至少一种可协同的能力,若用户没有为候选设备200或电子设备100选择附加显示的能力角标,拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备的图标,电子设备100可以基于当前的应用场景从候选设备200的支持的可协同的能力中自动选择至少一种能力进行协同连接。
在一些实施例中,协同连接界面13中的候选设备200支持至少一种可协同的能力,候选设备200和电子设备100的图标301均未附加显示能力角标时,用户通过滑动操作拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备的图标;响应于上述滑动操作,电子设备100基于最近前台运行的应用程序1、与候选设备200协同连接过的各能力的次数排名、与候选设备200最近协同连接的能力、候选设备200的可协同的各能力的优先级等中的一个或多个,从候选设备200的可协同的能力中自动选择至少一个能力(例如能力1)进行协同连接。
在一种实现方式中,首先,电子设备100确定最近前台运行的应用程序1所需的能力(例如能力1),从候选设备200的可协同的能力中自动选择能力1进行协同连接;当候选设备200的可协同的能力不包括应用程序1所需的能力时,电子设备100基于与候选设备200协同连接过的各能力的次数排名、与候选设备200最近协同连接的能力、候选设备200的可协同的各能力的优先级等中的一个或多个,从候选设备200的可协同的能力中自动选择至少一个能力(例如能力1)进行协同连接。在一种实现方式中,电子设备100选择与候选设备200协同连接过的各能力中次数排名靠前的至少一种能力(例如能力1)进行协同连接;其中,上述次数排名可以指最近预设时长(例如最近一周)内的各能力的协同连接次数的排名,还可以是最近的预设的总连接次数(例如最近10次)内的各能力的协同连接次数的排名。在一种实现方式中,电子设备100选择与候选设备200最近协同连接的至少一种能力进行协同连接。在一种实现方式中,电子设备100选择与候选设备200可协同的能力中优先级最高的至少一种能力进行协同连接;其中,各能力的优先级可以是电子设备100预设的,也可以是用户预设的,此处不做具体限定。
在一些实施例中,应用程序1所需的能力包括能力1,电子设备100前台运行应用程序1时,调出协同连接界面13;协同连接界面13中的候选设备(例如候选设备200)均支持能力1,候选设备200和电子设备100的图标301均未附加显示能力角标时,用户通过滑动操作拖动候选设备200的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备200的图标;响应于上述滑动操作,电子设备100从候选设备200支持的能力中自动选择应用程序1所需的能力(例如能力1)进行协同连接。
示例性的,图25A至图25D示出了基于当前的应用场景确定协同连接的能力的用户界面。
如图25A和图25B所示,以音乐APP为例,电子设备100前台运行音乐APP时,响应于用户的输入操作,显示协同连接界面13;音乐APP所需的能力包括音频输出功能,协同连接界面13中的环形区域显示的候选设备均支持音频输出功能。如图25B和图25C所示,协同连接界面13中,平板电脑的图标302和电子设备100的图标301均未附加显示能力角标, 用户通过滑动操作拖动平板电脑的图标301贴近本设备的图标301;响应于上述滑动操作,在平板电脑可协同的能力中选择音乐APP所需的能力(例如音频输出功能)进行协同连接。如图25D所示,确定与平板电脑的音频输出功能协同连接成功时,将平板电脑的图标302切换为已协同状态,并在图标302上附加显示音频输出功能的能力角标503。
本申请实施例中,前述情况五中,电子设备100也可以支持同时与多个设备建立协同连接,此处不再赘述。
下面示例性介绍本申请实施例中实现协同连接后的能力应用。
示例性的,以图26A所示的协同连接界面13为例进行说明。如图26A所示,根据已协同连接的可用设备附加显示的能力角标可知,平板电脑的音频输出功能和摄像头、笔记本电脑的音频输出功能以及打印机的打印功能,与电子设备100已建立协同连接。
示例性的,如图26B和图26C所示,用户点击音乐播放界面14中的切换控件311后,电子设备100显示选择框,该选择框包括当前已协同音频输出功能的可用设备的选项(即平板电脑的选项801和笔记本电脑的选项802),以及确定控件803和拒绝控件804。如图26D所示,用户选中至少一个可用设备的选项(例如笔记本电脑的选项801)后,检测到作用于确定控件803的输入操作(例如点击操作),响应于上述输入操作,电子设备100可以调用笔记本电脑的音频输出功能播放音乐。拒绝控件804可以接收用户的输入操作(例如点击操作),响应于上述输入操作,电子设备100停止显示上述选择框。
在一些实施例中,电子设备100可以协同连接多个设备的同一能力(例如能力1)。在一种实现方式中,针对多个已协同的可用设备的能力1,电子设备100同时仅支持调用一个可用设备的能力1。在一种实现方式中,针对多个已协同的可用设备的能力1,电子设备100支持同时调用多个可用设备的能力1。例如,用户选择图26D所示的平板电脑的选项801和笔记本电脑的选项802后,电子设备100检测到作用于确定控件803的输入操作;响应于上述输入操作,电子设备100可以同时调用平板电脑和笔记本电脑的音频输出功能播放音乐。
在一些实施例中,电子设备100需要调用可用设备的能力1时,无需显示已协同连接的可用设备的选项让用户选择,电子设备100可以自动从已协同的可用设备中选择至少一个可用设备,并调用上述至少一个可用设备的能力1。示例性的,如图26B所示,响应于针对切换控件311的输入操作,电子设备100可以自动从已协同音频输出功能的可用设备(即平板电脑的和笔记本电脑)中选择执行能力1的可用设备;例如,电子设备100自动选择音频输出功能的协同连接次数较多的可用设备,或者,最近进行音频输出功能的协同连接的可用设备。此处对电子设备100的选择策略不做具体限定。
在一些实施例中,若电子设备100仅协同连接了一个可用设备的能力1,电子设备100需要调用其他设备的能力1时,无需显示已协同连接的可用设备的选项让用户选择,电子设备100可以直接调用已协同的可用设备的能力1。
需要说明的是,图26A至图26D是本申请实施例对已协同的可用设备的能力应用的示例性说明,不应对本申请实施例构成限定。
参考前述协同连接界面13可知,本申请实施例提供的协同连接界面13采用两层环形布局设计。首先,第一层环形布局体现其他设备和本设备的关联关系,即第一层环形中显示了本机检测到的可协同的候选设备的图标,候选设备的图标的协同状态(未协同状态或已协同状态)可以指示本设备与候选设备的能力是否已建立协同连接。这样,通过第一层环形布局, 用户可直观的看到当前可与本设备进行协同连接的一个或多个候选设备,以及候选设备的协同状态,以便于用户选择待协同的候选设备。其次,第二层环形布局体现候选设备支持的可协同的能力,即显示可协同的能力对应的能力角标。这样,通过第二层环形布局,用户可直观的看到候选设备可协同的各种能力,用户通过第二层环形中展示的能力角标,可以选择和切换候选设备的图标附加显示的能力角标,进而实现协同连接的能力的选择和切换。与候选设备200的能力1建立协同连接后,已协同状态的候选设备200的图标附加显示的能力角标,还可以直观地向用户指示候选设备200的已协同的能力。
本申请实施例中,协同连接界面13中两层环形布局设计的页面风格协调统一,视觉效果好。用户选择待协同的能力、实施协同连接以及取消协同连接的界面交互,可玩性和趣味性较高,有效提高了用户的使用体验。
在一些实施例中,电子设备100支持可协同的至少一种能力,电子设备100附加显示的图标为电子设备100的上述至少一种能力中的任一种能力(例如能力1)的能力角标。用户通过滑动操作,拖动候选设备的图标贴近电子设备100的图标或者拖动电子设备100的图标贴近候选设备的图标,可以实现候选设备200对电子设备100的能力1的协同连接;协同连接成功后,候选设备200可以调用电子设备100的能力1。
示例性的,参考图17A和图17B,用户点击电子设备100的图标301,电子设备100可以在图标301周围显示电子设备100的可协同的至少一种能力的能力角标;参考图17B至图17D,用户可以为图标301选择附加显示的一个或多个能力角标。用户通过作用于滑动操作,将候选设备200(例如平板电脑的图标302)的图标拖动至图标301;响应于上述滑动操作,电子设备100执行候选设备200对电子设备100的能力1的协同连接流程;协同连接成功后,电子设备100可以将候选设备200的显示状态切换为已协同状态。
在一种实现方式中,电子设备100执行候选设备200对电子设备100的能力1的协同连接流程,可以包括:电子设备100向候选设备200发送协同连接请求5,协同连接请求用于请求候选设备1对电子设备100的能力1进行协同连接,协同连接请求5可以携带电子设备100的能力1的协同连接参数;候选设备200可以基于上述协同连接参数与电子设备100的能力1建立协同连接,并向电子设备100发送协同连接成功的协同连接响应。
在一些实施例中,若电子设备100协同连接了候选设备200的能力1,则协同连接界面中候选设备200的图标呈现为已协同状态1;当候选设备200协同连接了电子设备100的能力1,则协同连接界面中,候选设备200的图标呈现为已协同状态2;已协同状态1不同于已协同状态2。示例性的,图19D示出了平板电脑的图标302的已协同状态1,图19C示出了平板电脑的图标302的已协同状态2。
电子设备100的软件***可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android***为例,示例性说明电子设备100的软件结构。当然,在其他操作***中,只要各个功能模块实现的功能和本申请的实施例类似。
图27是本申请实施例的电子设备100的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android***分为五层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和***库,HAL(hardware abstraction layer,硬件抽 象层)层以及内核层。
应用程序层可以包括一系列应用程序包。
如图27所示,应用程序层中可以安装游戏,相机,导航,日历,图库,蓝牙,音乐,短信,Word等APP(应用,application)。
需要说明的是,电子设备100运行应用程序层中安装的应用时,可能需要调用特定的能力。例如,音乐APP播放音乐时需要调用音频输出功能,相机APP拍照时需要调用摄像头,Word APP打印word文档时调用打印功能。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图27所示,应用程序框架层可以包括窗口管理器,显示模块,内容提供器,视图***,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图***包括可视控件,例如显示文字的控件,显示图片的控件等。视图***可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在***顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
如图27所示,在一些实施例中,应用程序框架层还可以包括音频播放模块,图像采集模块。
示例性的,音频播放器可以为AudioTrack或MediaPlayer等播放器。当音频APP需要播放音频时可调用音频播放器,向音频播放器输入相应的音频数据。例如,音频APP可以向音频播放器输入原始的音频数据,由音频播放器对原始的音频数据进行解析、解封装或解码等处理后,得到一帧帧的PCM(pulse code modulation,脉冲编码调制)数据。或者,音频APP也可以直接输出PCM数据至音频播放器。音频播放器用于调用扬声器输出音频。
当相机APP需要采集时可调用图像采集模块,向图像采集模块输入采集图像的指令。图像采集模块用于调用摄像头采集图像。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓***的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
***库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子***进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
如图27所示,在Android***的应用程序框架层和内核层之间还可以包括HAL(hardware abstraction layer,硬件抽象层)。HAL负责与电子设备100的各个硬件设备进行交互,HAL一方面隐藏了各个硬件设备的实现细节,另一方面可向Android***提供调用各个硬件设备的接口。HAL中提供了与不同硬件设备对应的HAL,例如,音频(Audio)HAL、摄像头(Camera)HAL、显示(Display)HAL等。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
其中,音频播放模块可以调用音频HAL,将音频数据发送给音频HAL,由音频HAL调用内核层的音频驱动,将该音频数据发送给本设备的音频输出设备(例如扬声器),以驱动本设备的音频输出设备播放上述音频数据。图像采集模块可以调用摄像头HAL,将采集图像的指令发送给摄像头HAL,由摄像头HAL通过调用内核层的摄像头驱动,来驱动本设备的摄像头采集图像。
在一些实施例中,如图28所示,可在电子设备100的应用程序层中安装用于实现能力协同的设备虚拟化(DeviceVirtualization)APP,后续可称为DV APP。DV APP可作为***应用常驻在电子设备100中运行。或者,也可将DV APP实现的能力协同以***服务的形式常驻在电子设备100中运行。当电子设备100与候选设备200的能力1(例如音频输出功能、摄像头等)协同连接成功时,电子设备100获取候选设备200的能力1的能力参数,DV APP可按照该候选设备200的能力1的能力参数,在电子设备100中创建一个候选设备200对应的虚拟设备,该虚拟设备具备能力1;这样,电子设备100可以通过该虚拟设备调用候选设备200的能力1。
示例性的,以候选设备200为平板电脑为例,图28所示的HAL层还包括DV APP创建的平板电脑DV HAL。参见图6A至图6D,电子设备100检测到电子设备100与平板电脑的摄像头协同连接成功时,DV APP获取平板电脑的相关信息(例如可协同的能力、设备标识、设备名称、设备型号和设备类型等)和平板电脑的摄像头的能力参数,并在HAL层创建平板电脑对应的虚拟设备的调用接口(为便于描述,将该调用接口简称为平板电脑DV HAL);平板电脑DV HAL包括平板电脑对应的摄像头HAL。参见图14A至图14D,电子设备100与平板电脑的摄像头协同连接成功后,电子设备100检测到电子设备100又与平板电脑的其他能力(例如音频输出功能)协同连接成功时,DV APP获取平板电脑的音频输出功能的能力参数(例如播放时延、音频采样率等),并基于该能力参数在平板电脑DV HAL中创建平板电脑对应的音频HAL。电子设备100检测到用户调用平板电脑的摄像头的输入操作后,相机APP向图像采集模块发送指令2,指令2用于指示调用平板电脑的摄像头采集图像;图像采集模块通过调用平板电脑DV HAL中的摄像头HAL,向平板电脑发送摄像头的调用请求。
参见图29,平板电脑的应用程序层中可安装用于实现能力协同的协同APP。电子设备100与平板电脑的摄像头建立协同连接时,可以向平板电脑的协同APP获取平板电脑的摄像头的能力参数。协同连接成功后,协同APP可以接收平板电脑发送的摄像头的调用请求;响应于上述调用请求,协同APP可以向平板电脑的应用程序框架层的图像采集模块发送指令,以指示图像采集模块通过调用平板电脑的HAL层的摄像头HAL采集图像;摄像头HAL可以调用摄像头驱动,以驱动平板电脑的摄像头采集图像1;协同APP获取上述图像1,并将图像1发送给电子设备100的相机APP;相机APP可以在拍摄界面15的图像预览区显示上述图像1。
示例性的,以候选设备200为笔记本电脑YYY为例,图28所示的HAL层还包括DV APP创建的笔记本电脑DV HAL。参见图16A至图16C,电子设备100检测到电子设备100与笔记本电脑的音频输出功能协同连接成功时,DV APP获取笔记本电脑的相关信息和笔记本电脑的音频输出功能的能力参数,并基于笔记本电脑的相关信息和笔记本电脑的音频输出功能的能力参数,在HAL层创建笔记本电脑对应的虚拟设备的调用接口(为便于描述,将该调用接口简称为笔记本电脑DV HAL);笔记本电脑DV HAL包括基于上述音频输出功能的能力参数生成的音频HAL。电子设备100检测到用户调用笔记本电脑的音频输出功能的输入操作后,音乐APP向音频播放模块发送指令1和音频数据1,指令1用于指示调用笔记本电脑的音频输出功能播放音频数据1;音频播放模块通过调用笔记本电脑DV HAL中的音频HAL,向笔记本电脑发送音频输出功能的调用请求,该调用请求包括音频数据1。
参见图30,笔记本电脑的应用程序层中也可安装协同APP。电子设备100与笔记本电脑的音频输出功能建立协同连接时,可以从笔记本电脑的协同APP获取音频输出功能的能力参数。协同连接成功后,协同APP可以接收电子设备100发送的音频输出功能的调用请求;响应于上述调用请求,协同APP可以向笔记本电脑的应用程序框架层的音频播放模块发送指令,以指示音频播放模块通过调用笔记本电脑的HAL层的音频HAL播放音频数据1;摄像头HAL可以调用音频驱动,以驱动平板电脑的扬声器播放音频数据1。
示例性的,以候选设备200为打印机EEE为例,图28所示的HAL层还包括DV APP创建的打印机DV HAL。电子设备100检测到电子设备100与打印机的打印功能协同连接成功时,DV APP获取打印机的相关信息和打印功能的能力参数,并在HAL层创建打印机对应的虚拟设备的调用接口(为便于描述,将该调用接口简称为打印机DV HAL);打印机DV HAL包括基于上述打印功能的能力参数生成的打印HAL。电子设备100的应用程序框架层还可以包括打印管理模块。电子设备100检测到用户调用打印机的打印功能的输入操作后,Word APP向打印管理模块发送指令3和文档数据1,指令3用于指示调用打印机的打印功能打印文档数据1;打印管理模块通过调用打印机DV HAL中的打印HAL,向打印机发送打印功能的调用请求,该调用请求包括文档数据1。
参见图31,打印机的应用程序层中也可安装协同APP。电子设备100与打印机的打印功能建立协同连接时,可以从打印机的协同APP获取打印功能的能力参数。协同连接成功后,协同APP可以接收电子设备100发送的打印功能的调用请求;响应于上述调用请求,协同APP可以向打印机的应用程序框架层的打印管理模块发送指令,以指示打印管理模块通过调用打印机的HAL层的打印HAL打印文档数据1。
基于前述图1A至图31描述的实施例,下面介绍本申请提供的设备协同方法。
示例性的,图32是本申请实施例提供的设备协同方法的流程示意图,该方法应用于第一电子设备,该方法包括:
S101、显示第一用户界面;第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标,第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力。
其中,第一电子设备可以为前述实施例描述的电子设备100,第二电子设备可以为前述实施例描述的候选设备200(例如平板电脑);第一用户界面可以为前述实施例描述的用户界面13,第一图标可以为用户界面13中的图标301,第二图标可以为用户界面13中的图标302。
示例性的,第二电子设备为前述实施例描述的平板电脑,平板电脑的可协同的能力包括支持摄像头、音频输入功能和音频输出功能。第一能力可以为上述平板电脑的可协同的能力中的任一种。
S102、接收用于选择所述第一能力的第一输入操作。
S103、接收第二输入操作。
S104、响应于第二输入操作,与第二电子设备建立支持第一能力的协同连接。
在一些实施例中,第一用户界面还包括:第二电子设备支持的可协同的能力对应的能力角标;第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,第一输入操作作用于第一能力角标。在一种实现方式中,所述第一用户界面中,在靠近所述第二图标的周围区域显示有第二电子设备支持的可协同的能力对应的能力角标。
示例性的,参考图8B、图8E、图9A和图12B,用户界面13中图标302的周围区域显示有平板电脑的可协同的能力对应的能力角标。如图8B、图8E和图9A所示,第一能力角标可以为音频输入功能对应的能力角标502,用于选择音频输入功能的第一输入操作作用于能力角标502。
在一些实施例中,所述接收用于选择第一能力的第一输入操作之前,所述方法还包括:接收作用于第二图标的第三输入操作;响应于第三输入操作,在第一用户界面中显示第二电子设备支持的可协同的能力对应的所述能力角标。
示例性的,参考图8A至图8G以及图12A至图12F的相关描述,如图8A和图12A所示,第三输入操作可以包括作用于图标302的输入操作(例如点击操作)。可以理解,用户点击平板电脑的图标302后,电子设备100在用户界面13中显示平板电脑可协同的能力对应的能力角标。
在一些实施例中,所述方法还包括:响应于第一输入操作,在第二图标上附加显示第一能力角标。
示例性的,参考图8A至图8G的相关描述,用户选择能力角标502后,即电子设备100接收作用于能力角标502的第一输入操作后,在图标302上附加显示能力角标502。参考图12A至图12D的相关描述,用户选择能力角标501(或能力角标503)后,即电子设备100接收作用于能力角标501(或能力角标503)的第一输入操作后,在图标302上附加显示能力角标501(或能力角标503)。
在一些实施例中,响应于第三输入操作,在第一区域显示第二电子设备支持的可协同的能力对应的能力角标;所述至少两种可协同的能力还包括第二能力,接收作用于第二图标的第三输入操作时,第二图标附加显示有第二能力对应的第二能力角标;所述接收作用于第二图标的第三输入操作之后,还包括:接收作用于所述第一区域中的第二能力角标的第四输入 操作;响应于第四输入操作,停止在第二图标上附加显示第二能力角标。
示例性的,参考图12A至图12F的相关描述,如图12A所示,接收作用于图标302的第三输入操作时,图标302上附加显示能力角标502;如图12D所示,接收作用于第一区域(例如靠近图标302的周围区域)中的能力角标502的第四输入操作(例如触摸操作);如图12E所示,响应于第四输入操作,停止在图标302上附加显示能力角标502。
在一些实施例中,第二图标周围显示的能力角标中,第二图标已附加显示的能力角标呈现为选中状态,第二图标未附加显示的能力角标呈现为未选中状态;所述方法还包括:响应于第一输入操作,将第二图标周围显示的第一能力角标由未选中状态切换为选中状态;所述方法还包括:响应于第四输入操作,将第二图标周围显示的第二能力角标由选中状态切换为未选中状态。
示例性的,参考图12A至图12F的相关描述,如图12B至图12E所示,图标302已附加显示的能力角标呈现为选中状态,图标302未附加显示的能力角标呈现为未选中状态;如图12B和图12C所示,响应于作用于能力角标501的第一输入操作,将图标302周围显示的能力角标501由未选中状态切换为选中状态;如图12D和图12E所示,响应于作用于能力角标502的第四输入操作,将图标302周围显示的能力角标502由选中状态切换为未选中状态。
在一些实施例中,第一输入操作包括作用于第一能力角标的操作;第二输入操作包括:向第一图标拖动第二图标,直至第二图标接触第一图标的所在区域;或者,向第一图标拖动第二图标,直至第二图标与第一图标的距离小于或等于预设阈值;或者,向第二图标拖动第一图标,直至第一图标接触第二图标的所在区域;或者,向第二图标拖动第一图标,直至第一图标与第二图标的距离小于或等于预设阈值。
示例性的,参考图6A至图6D的相关描述,第二输入操作可以包括:向图标301拖动图标302,直至图标302接触图标301的所在区域;或者,向图标301拖动图标302,直至图标302与图标301的距离小于或等于预设阈值。示例性的,参考图10A至图10D的相关描述,第二输入操作可以包括:向图标302拖动图标301,直至图标301接触图标302的所在区域;或者,向图标302拖动图标301,直至图标302与图标301的距离小于或等于预设阈值。例如,上述预设阈值为5个像素的长度。
在一些实施例中,第二输入操作作用于第一能力角标。
在一些实施例中,第一输入操作包括作用于第一能力角标的操作;第二输入操作包括:向第一图标拖动第一能力角标,直至第一能力角标接触第一图标的所在区域;或者,向第一图标拖动第一能力角标,直至第一能力角标与第一图标的距离小于或等于预设阈值。例如第一能力角标为能力角标502。
示例性的,参考图9A至图9C的相关描述,第一输入操作和第二输入操作均作用于能力角标502。例如,第一输入操作包括作用于能力角标502的触摸操作;第二输入操作包括:向图标301拖动能力角标502,直至能力角标502接触图标301的所在区域;或者,向图标301拖动能力角标502,直至能力角标502与图标301的距离小于或等于预设阈值。例如,上述预设阈值为5个像素的长度。
在一些实施例中,所述至少两种可协同的能力还包括第二能力;与第二电子设备成功建立支持第一能力的协同连接之后,所述方法还包括:接收作用于第二图标的第五输入操作;响应于第五输入操作,显示第二电子设备支持的可协同的能力对应的能力角标,第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,以及第二能力对 应的第二能力角标;接收作用于第二能力角标的第六输入操作;响应于第六输入操作,与第二电子设备建立支持第二能力的协同连接。
示例性的,参考图14A至图14E的相关描述,如图14A所示,电子设备100与候选设备200(例如平板电脑)建立支持音频输入功能(即第一能力)的协同连接后,接收作用于图标302的第五输入操作(例如触摸操作);如图14B所示,响应于第五输入操作,显示平板电脑支持的可协同的能力对应的能力角标,例如摄像头对应的能力角标501(即第二能力对应的第二能力角标);如图14B所示,接收作用于能力角标501的第六输入操作(例如触摸操作);如图14C和图14D所示,响应于第六输入操作,与平板电脑建立支持摄像头的协同连接。
在一些实施例中,所述至少两种可协同的能力还包括第二能力;所述响应于第二输入操作,与第二电子设备建立支持第一能力的协同连接,具体包括:响应于第二输入操作,与第二电子设备建立支持第一能力和第二能力的协同连接。
示例性的,参考图13A至图13D的相关描述,平板电脑可协同的能力包括摄像头和音频输出功能(即第一能力和第二能力),响应于作用于图标302的第二输入操作(例如向图标301拖到图标302),电子设备100与平板电脑建立支持摄像头和音频输出功能的协同连接。
在一些实施例中,接收第二输入操作时,第二图标附加显示有第一能力对应的第一能力角标和第二能力对应的第二能力角标。
示例性的,参考图13A至图13D的相关描述,接收作用于图标302的第二输入操作(例如向图标301拖到图标302)时,图标302附加显示有摄像头对应的能力角标501和音频输出功能对应的能力角标503。
在一些实施例中,与第二电子设备成功建立支持第一能力和第二能力的协同连接后,所述方法还包括:接收作用于第二图标的第七输入操作;响应于第七输入操作,显示第二电子设备支持的可协同的能力对应的能力角标,第二电子设备支持的可协同的能力对应的能力角标包括第一能力对应的第一能力角标,以及第二能力对应的第二能力角标;接收作用于第一能力角标的第八输入操作;响应于第八输入操作,取消与第二电子设备的支持第一能力的协同连接。
示例性的,参考图15A至图15D的相关描述,如图15A所示,电子设备100与平板电脑建立支持摄像头和音频输入功能的协同连接后,图标302可以接收用户的第七输入操作(例如触摸操作);如图15B所示,响应于第七输入操作,在用户界面13中显示平板电脑支持的可协同的能力对应的能力角标,包括已协同的摄像头对应的能力角标501和已协同的音频输入功能对应的能力角标502;如图15B所示,接收作用于能力角标501的第八输入操作(例如触摸操作);如图15C和图15D所示,响应于第八输入操作,取消与平板电脑的支持摄像头的协同连接。
在一些实施例中,响应于第七输入操作,在第二图标周围显示的能力角标中,与第二电子设备建立的协同连接支持的能力对应的能力角标(即第一能力角标和第二能力角标)呈现为选中状态,与第二电子设备建立的协同连接不支持的能力对应的能力角标呈现为未选中状态。
示例性的,参考图15A至图15D的相关描述,如图15B所示,电子设备100与平板电脑建立支持摄像头和音频输入功能的协同连接后,已协同状态的图标302周围显示的能力角标中,已协同的摄像头对应的能力角标501和音频输入功能对应的能力角标502呈现为选中状态,未协同的音频输出功能对应的能力角标503呈现为未选中状态。
在一些实施例中,与第二电子设备成功建立支持第一能力和第二能力的协同连接后,所述方法还包括:接收作用于第二图标的第十输入操作;响应于所述第十输入操作,取消与第二电子设备的针对任意能力的协同连接。例如,第十输入操作为前述实施例描述的取消操作1。
示例性的,参考图11A至图11D的相关描述,如图11B所示,电子设备100与平板电脑建立协同连接后,接收作用于图标301的第十输入操作(例如将图标302拖离图标301的输入操作);响应于所述第十输入操作,取消与平板电脑的针对任意能力的协同连接。
在一些实施例中,第一用户界面还包括至少两种能力对应的能力角标;所述至少两种能力包括所述至少一个候选设备支持的所有可协同的能力,所述至少两种能力对应的能力角标包括第一能力对应的第一能力角标,第一输入操作作用于第一能力角标。
示例性的,参考图17B和图19F,用户界面13中图标301周围显示有检测到的所有候选设备支持的所有可协同的能力对应的能力角标,第一能力角标可以为音频输出功能对应的能力角标503,用于选择音频输出功能的第一输入操作作用于能力角标503。
在一些实施例中,所述接收用于选择第一能力的第一输入操作之前,还包括:接收作用于第一图标的第九输入操作;响应于第九输入操作,在第一用户界面中显示所述至少两种能力对应的能力角标。在一种实现方式中,所述第一用户界面中,在靠近所述第一图标的周围区域显示第二电子设备支持的可协同的能力对应的能力角标。
示例性的,参考图17A和图17B的相关描述,接收到作用于图标301的第九输入操作(例如点击操作)后,电子设备100在图标301周围显示检测到的所有候选设备支持的所有可协同的能力对应的能力角标。
在一些实施例中,所述方法还包括:响应于第一输入操作,在第一图标上附加显示第一能力角标。例如,第一能力角标为音频输出功能对应的能力角标503。
示例性的,参考图17A至图17D的相关描述,用户选择能力角标503后,即电子设备100接收作用于能力角标503的第一输入操作后,在图标301上附加显示能力角标503。
在一些实施例中,所述方法还包括:响应于第一输入操作,在第一用户界面中停止显示不可协同第一能力的候选设备的图标。
示例性的,参考图17B和图17E的相关描述,用户选择音频输出功能对应的能力角标503后,电子设备100在用户界面13中停止显示不可协同音频输出功能的候选设备的图标。
在一些实施例中,所述方法还包括:与第二电子设备建立支持第一能力的协同连接成功时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力对应的第一能力角标;与第二电子设备建立支持第一能力的协同连接失败时,第二图标保持未协同状态。
示例性的,参考图6A至图6D、图10A至图10F的相关描述,与平板电脑建立支持摄像头的协同连接成功时,图标302由未协同状态切换为已协同状态,图标302附加显示有摄像头对应的能力角标501。示例性的,参考图18A至图18B、图19A至图19D的相关描述,与平板电脑建立支持音频输出功能的协同连接成功时,图标302由未协同状态切换为已协同状态,图标302附加显示有音频输出功能对应的能力角标503。
在一些实施例中,接收第二输入操作前,第一图标显示在第一预设区域,所述至少一个候选设备的图标显示在第二预设区域;第二图标的未协同状态呈现为以第一状态显示在所述第二预设区域中;第二图标的已协同状态呈现为以第二状态吸附于第一图标,且显示在所述第一预设区域中,或者,第二图标的已协同状态呈现为以第二状态显示在所述第二预设区域 中。例如,第一状态和第二状态指不同的图标颜色。
示例性的,参考前述实施例的相关描述,如图3C所示,未执行协同连接前,图标301显示在第一预设区域(例如前述预设区域1),候选设备的图标显示在第二预设区域(例如前述预设区域2);如图3C所示,图标302的未协同状态呈现为以第一状态(例如浅色图标)显示在预设区域2中;如图6D、图10D、图18B和图19D所示,图标302的已协同状态呈现为以第二状态(例如深色图标)吸附于图标301,且显示在预设区域1中;或者,如图10F和图19C所示,图标302的已协同状态呈现为以第二状态(例如深色图标)显示在预设区域2中。本申请实施例对已协同状态、未协同状态、第一状态和第二状态均不作具体限定。
在一些实施例中,第一电子设备执行“与第二电子设备建立支持第一能力和第二能力的协同连接”的步骤后,当与第二电子设备成功建立支持第一能力和第二能力的协同连接时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力角标和第二能力角标;当与第二电子设备成功建立支持第一能力的协同连接,且该协同连接不支持第二能力时,第二图标由未协同状态切换为已协同状态,第二图标附加显示有第一能力角标,未附加显示第二能力角标。
示例性的,参考图13A至图13J的相关描述,电子设备100与平板电脑建立支持摄像头和音频输出功能的协同连接;如图13D所示,当与平板电脑成功建立支持摄像头和音频输出功能的协同连接时,图标302由未协同状态切换为已协同状态,图标302附加显示有摄像头对应的能力角标501和音频输出功能对应的能力角标503;如图13G所示,当与平板电脑成功建立支持摄像头的协同连接,且该协同连接不支持音频输出功能时,图标302由未协同状态切换为已协同状态,图标302附加显示有能力角标501,未附加显示能力角标503;如图13J所示,当与平板电脑未成功建立协同连接,图标302保持未协同状态。
本申请还提供一种设备协同方法,应用于第一电子设备,所述方法包括:显示第一用户界面,第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标;第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力;接收第十一输入操作;响应于第十一输入操作,基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,与第二电子设备建立支持第一能力的协同连接。
其中,第一电子设备可以为前述实施例描述的电子设备100,第二电子设备可以为前述实施例描述的候选设备200(例如平板电脑);第一用户界面可以为前述实施例描述的用户界面13,第一图标可以为用户界面13中的图标301,第二图标可以为用户界面13中的图标302。第一能力可以为上述平板电脑的可协同的能力中的任一种。
示例性的,参考图25A至图25D的相关描述,如图25B所示,第十一输入操作可以包括向图标301拖动图标302的输入操作。
在一些实施例中,第二电子设备的协同状态包括以下一项或多项:第一电子设备与第二电子设备协同连接过的各能力的协同连接次数,第一电子设备与第二电子设备最近协同连接的能力,第二电子设备的可协同的各能力的优先级。本申请实施例对第二电子设备的协同状态不做具体限定。
在一些实施例中,所述基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,对第二电子设备的第一能力建立协同连接,包括:当第二电子设备的可协同的能力包括所述第一应用程序所需的第一能力时,对第二电子设备的第一能力建立协同连接。
示例性的,参考图25A至图25D的相关描述,第一应用程序为音乐APP,平板电脑的可协同的能力包括音乐APP所需的音频输出能力;电子设备100与平板电脑建立支持音频输出能力的协同连接。
在一些实施例中,所述基于最近前台运行的第一应用程序和/或第二电子设备的协同状态,对第二电子设备的第一能力建立协同连接,包括:与第二电子设备协同连接过的各能力中协同连接次数最多的第一能力建立协同连接;或者,与第二电子设备最近协同连接的第一能力进行协同连接;或者,与第二电子设备的可协同的能力中优先级最高的第一能力进行协同连接。
本申请的各实施方式可以任意进行组合,以实现不同的技术效果。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
总之,以上所述仅为本发明技术方案的实施例而已,并非用于限定本发明的保护范围。凡根据本发明的揭露,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。

Claims (17)

  1. 一种设备协同方法,应用于第一电子设备,其特征在于,包括:
    显示第一用户界面;所述第一用户界面包括第一电子设备的第一图标以及检测到的至少一个候选设备的图标,所述至少一个候选设备的图标包括第二电子设备的第二图标,所述第二电子设备支持至少两种可协同的能力,所述至少两种可协同的能力包括第一能力;
    接收用于选择所述第一能力的第一输入操作;
    接收第二输入操作;
    响应于所述第二输入操作,与所述第二电子设备建立支持所述第一能力的协同连接。
  2. 根据权利要求1所述的方法,其特征在于,所述第一用户界面还包括:所述第二电子设备支持的可协同的能力对应的能力角标;所述第二电子设备支持的可协同的能力对应的能力角标包括所述第一能力对应的第一能力角标,所述第一输入操作作用于所述第一能力角标。
  3. 根据权利要求2所述的方法,其特征在于,所述接收用于选择所述第一能力的第一输入操作之前,所述方法还包括:
    接收作用于所述第二图标的第三输入操作;
    响应于所述第三输入操作,在所述第一用户界面中显示所述第二电子设备支持的可协同的能力对应的所述能力角标。
  4. 根据权利要求2所述的方法,其特征在于,所述方法还包括:
    响应于所述第一输入操作,在所述第二图标上附加显示所述第一能力角标。
  5. 根据权利要求4所述的方法,其特征在于,
    所述第一输入操作包括作用于所述第一能力角标的操作;
    所述第二输入操作包括:
    向所述第一图标拖动所述第二图标,直至所述第二图标接触所述第一图标的所在区域;或者,
    向所述第一图标拖动所述第二图标,直至所述第二图标与所述第一图标的距离小于或等于预设阈值;或者,
    向所述第二图标拖动所述第一图标,直至所述第一图标接触所述第二图标的所在区域;或者,
    向所述第二图标拖动所述第一图标,直至所述第一图标与所述第二图标的距离小于或等于所述预设阈值。
  6. 根据权利要求2所述的方法,其特征在于,所述第二输入操作作用于所述第一能力角标。
  7. 根据权利要求6所述的方法,其特征在于,
    所述第一输入操作包括作用于所述第一能力角标的操作;
    所述第二输入操作包括:向所述第一图标拖动所述第一能力角标,直至所述第一能力角标接触所述第一图标的所在区域;或者,向所述第一图标拖动所述第一能力角标,直至所述第一能力角标与所述第一图标的距离小于或等于预设阈值。
  8. 根据权利要求1至7任一项所述的方法,其特征在于,所述至少两种可协同的能力还包括第二能力;与所述第二电子设备成功建立支持所述第一能力的协同连接之后,所述方法还包括:
    接收作用于所述第二图标的第五输入操作;
    响应于所述第五输入操作,显示所述第二电子设备支持的可协同的能力对应的能力角标,所述第二电子设备支持的可协同的能力对应的能力角标包括所述第一能力对应的第一能力角标,以及所述第二能力对应的第二能力角标;
    接收作用于所述第二能力角标的第六输入操作;
    响应于所述第六输入操作,与所述第二电子设备建立支持所述第二能力的协同连接。
  9. 根据权利要求1至5任一项所述的方法,其特征在于,所述至少两种可协同的能力还包括第二能力;
    所述响应于所述第二输入操作,与所述第二电子设备建立支持所述第一能力的协同连接,具体包括:
    响应于所述第二输入操作,与所述第二电子设备建立支持所述第一能力和所述第二能力的协同连接。
  10. 根据权利要求9所述的方法,其特征在于,接收所述第二输入操作时,所述第二图标附加显示有所述第一能力对应的第一能力角标和所述第二能力对应的第二能力角标。
  11. 根据权利要求8或9所述的方法,其特征在于,与所述第二电子设备成功建立支持所述第一能力和所述第二能力的协同连接后,所述方法还包括:
    接收作用于所述第二图标的第七输入操作;
    响应于所述第七输入操作,显示所述第二电子设备支持的可协同的能力对应的能力角标,所述第二电子设备支持的可协同的能力对应的能力角标包括所述第一能力对应的第一能力角标,以及所述第二能力对应的第二能力角标;
    接收作用于所述第一能力角标的第八输入操作;
    响应于所述第八输入操作,取消与所述第二电子设备的支持所述第一能力的协同连接。
  12. 根据权利要求1所述的方法,其特征在于,所述第一用户界面还包括至少两种能力对应的能力角标;所述至少两种能力包括所述至少一个候选设备支持的所有可协同的能力,所述至少两种能力对应的能力角标包括所述第一能力对应的第一能力角标,所述第一输入操作作用于所述第一能力角标。
  13. 根据权利要求12所述的方法,其特征在于,所述接收用于选择所述第一能力的第一输入操作之前,还包括:
    接收作用于所述第一图标的第九输入操作;
    响应于所述第九输入操作,在所述第一用户界面中显示所述至少两种能力对应的能力角标。
  14. 根据权利要求12所述的方法,其特征在于,所述方法还包括:
    响应于所述第一输入操作,在所述第一图标上附加显示所述第一能力角标。
  15. 根据权利要求12至14任一项所述的方法,其特征在于,所述方法还包括:
    响应于所述第一输入操作,在所述第一用户界面中停止显示不可协同所述第一能力的候选设备的图标。
  16. 一种电子设备,其特征在于,包括存储器和处理器,所述存储器和所述处理器电偶合,所述存储器用于存储程序指令,所述处理器被配置用于调用所述存储器存储的全部或部分程序指令,以使得所述电子设备执行如权利要求1-15任一项所述的方法。
  17. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-15任一项所述的方法。
PCT/CN2022/133172 2021-11-22 2022-11-21 设备协同方法及相关装置 WO2023088459A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111385754 2021-11-22
CN202111385754.X 2021-11-22
CN202210191311.5 2022-02-28
CN202210191311.5A CN116156044A (zh) 2021-11-22 2022-02-28 设备协同方法及相关装置

Publications (1)

Publication Number Publication Date
WO2023088459A1 true WO2023088459A1 (zh) 2023-05-25

Family

ID=86337727

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/133172 WO2023088459A1 (zh) 2021-11-22 2022-11-21 设备协同方法及相关装置

Country Status (2)

Country Link
CN (1) CN116156044A (zh)
WO (1) WO2023088459A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117560792A (zh) * 2022-08-05 2024-02-13 荣耀终端有限公司 一种多设备协同方法、电子设备及相关产品

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014103307A1 (ja) * 2012-12-28 2014-07-03 パナソニック株式会社 制御方法
CN110557740A (zh) * 2019-08-02 2019-12-10 华为技术有限公司 一种电子设备控制方法及一种电子设备
CN110597473A (zh) * 2019-07-30 2019-12-20 华为技术有限公司 一种投屏方法与电子设备
CN111132101A (zh) * 2019-11-22 2020-05-08 华为技术有限公司 定位交互方法及装置
CN113190143A (zh) * 2021-04-29 2021-07-30 维沃移动通信(杭州)有限公司 界面显示方法、装置、电子设备及介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102478986B (zh) * 2010-11-30 2014-06-18 汉王科技股份有限公司 便携式电子设备及其信息共享方法
KR102412283B1 (ko) * 2016-02-17 2022-06-23 삼성전자 주식회사 전자 장치 및 전자 장치의 영상 공유 제어 방법
CN108255402A (zh) * 2018-01-12 2018-07-06 深圳市金立通信设备有限公司 查看角标通知内容的方法、终端及计算机可读存储介质
CN109660842B (zh) * 2018-11-14 2021-06-15 华为技术有限公司 一种播放多媒体数据的方法及电子设备
CN114844979A (zh) * 2019-09-19 2022-08-02 华为技术有限公司 一种设备能力调度方法及电子设备
CN112286618A (zh) * 2020-11-16 2021-01-29 Oppo广东移动通信有限公司 设备协作方法、装置、***、电子设备和存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014103307A1 (ja) * 2012-12-28 2014-07-03 パナソニック株式会社 制御方法
CN110597473A (zh) * 2019-07-30 2019-12-20 华为技术有限公司 一种投屏方法与电子设备
CN110557740A (zh) * 2019-08-02 2019-12-10 华为技术有限公司 一种电子设备控制方法及一种电子设备
CN111132101A (zh) * 2019-11-22 2020-05-08 华为技术有限公司 定位交互方法及装置
CN113190143A (zh) * 2021-04-29 2021-07-30 维沃移动通信(杭州)有限公司 界面显示方法、装置、电子设备及介质

Also Published As

Publication number Publication date
CN116156044A (zh) 2023-05-23

Similar Documents

Publication Publication Date Title
KR102470275B1 (ko) 음성 제어 방법 및 전자 장치
KR102575123B1 (ko) 애플리케이션 디스플레이 방법 및 전자 장치
WO2021129326A1 (zh) 一种屏幕显示方法及电子设备
US20220050656A1 (en) Method for displaying ui component and electronic device
US20210263564A1 (en) Display Method for Flexible Display, and Terminal
CN115629730A (zh) 显示方法及相关装置
WO2021036770A1 (zh) 一种分屏处理方法及终端设备
WO2020155014A1 (zh) 智能家居设备分享***、方法及电子设备
CN115297200A (zh) 一种具有折叠屏的设备的触控方法与折叠屏设备
WO2022068483A1 (zh) 应用启动方法、装置和电子设备
CN116360725B (zh) 显示交互***、显示方法及设备
WO2020024108A1 (zh) 一种应用图标的显示方法及终端
WO2020107463A1 (zh) 一种电子设备的控制方法及电子设备
WO2022262439A1 (zh) 网络资源的处理方法、电子设备及计算机可读存储介质
WO2024045801A1 (zh) 用于截屏的方法、电子设备、介质以及程序产品
WO2023088459A1 (zh) 设备协同方法及相关装置
WO2022001279A1 (zh) 跨设备桌面管理方法、第一电子设备及第二电子设备
CN114079691B (zh) 一种设备识别方法及相关装置
WO2024017332A1 (zh) 控制部件的方法及相关装置
WO2023142935A1 (zh) 应用组件管理方法及相关设备
WO2024002137A1 (zh) 通信方法、通信***及电子设备
WO2024022310A1 (zh) 一种设备安全处理方法及电子设备
WO2023226922A1 (zh) 卡片管理方法、电子设备及计算机可读存储介质
WO2024078412A1 (zh) 跨屏分享方法、图形界面及相关装置
WO2021013246A1 (zh) 一种无线接入点的部署方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22894988

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022894988

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022894988

Country of ref document: EP

Effective date: 20240423